Since starting to play again after the new 1.6 update, I have found that the only way I can remove wall decor is by using the right joystick, hovering over the item, and selecting Y to place it back in my inventory.
I remember before that you could just stand in front of the item on the wall and...