Edit 3: Moving the cursor over the item via the right thumbstick lets you pick it up with Y. (As suggested by ConcernedApe)
I can't remove any items on walls, any wall in my home. This is most wall items, so windows, paintings, lights.
I can remove the "wall flower", "s. wall flower" and...