I have an IRL habit of losing stuff that drives me up the wall, so in the game where I have the equivalent of hammerspace, I almost always carry: watering can, scythe, hoe, axe, pickaxe, weapon, stack of food for healing, fishing pole, pan, and return scepter if I have it, farm warp totem if I don't. So I have to dump most of this if I'm going into the skull cavern - and then because my typical ring/weapon/boot combo is set up for the dangerous mines or volcano dungeon, I also need to swap out those four items, then pick up a stack of bombs and one of staircases. And then I need some triple shot espresso and whichever luck buff food I want for the day.
Basically, I've given up on going into the skull caverns. The setup is just too annoying.