It seems like a bug with the game as Leo won't attend festivals in Stardew Valley until you reach 6+ hearts with him. You just have to skip the gift giving this year or make it to 6+ hearts with Leo before Winter 25. There is not much else to be done, unfortunately.