For training to be able to capture yearly cycles the temporal encoding should reflect this. -> try cyclic embedding on a full duration
Linken question: Are we going to work with a calendar year or go for the "360 day year" Chris mentioned
Sin and cos functions over this period