Phone slows down to a crawl, but clearing apps fixes it

I'm currently running Clean Rom, but Fluent and CM do the same thing. After a bit my phone will slow WAY down. If I clear apps it speeds right back up. Rebooting fire the same thing. I have XPOSED and the Fix Lollipop installed. Is there something else I can do?