When ridding alongisde a stone fence it is possible to go through it and cross to the other side.
Steps to reproduce
While riding the horse, move as close as possible to the fence.
Move up or down, parallel to the fence.
While holding the up or down key (W, or S in my computer), try moving...