Skin Configuration not sticking on FireTv Stick

Ive noticed any changes I make to a skin (like confluence, removing menu items) they disappear after i exit. It isnt the biggest of deals, and some settings do stick like View settings in the Movies and TV Libraries. Is this a known problem? Im on 16.1, fresh install. I had the issue before on 16.0 as well just never bothered with it. Would like to set things and have them stay if possible.