I say no, but exclusively because I think sheds are of far higher priority. You often only have one house, one barn or coop etc - but you can easily have 4-8 sheds all over your farm, and it starts getting really tough to keep your layout pretty when 60% of your buildings are perfectly identical lol.
A normal looking slime hutch is my 2nd priority. I enjoy keeping them for fun, but the buildings just look so drastically different from the rest that I have no clue how to even begin making it look good.