cant remove

I'm playing on the XBOX 1 with a wireless controller. It won't let me remove anything on my walls in the main house. I've already upgraded all the way and was trying to add an attic but it won't let me because of a window. I went to remove it as usual and it will not let me move anything that's...