Right-click the bundle in the town hall with the totem to make the totem sound, but it does not become a warp and the totem disappears. (I hope the translator works well.)
Did you do this on a day that had a festival in town? This is a known issue. Because you can not enter an area with a festival later that day, you also can not warp there... but it will still use the warp totem.
