I have gone back to stock because of the lag in all the custom 5.x ROM's, update it?

I am slowly getting the OTA updates, I am at 4.4.4. now, I am hesitant to move on to the 5.* ROM's.

Are the sluggishness issues also affecting the stock roms?
Should I fully update to 5.1.1?