How does the game decide what children look like?

I think there are only 2 appearances for the first three stages. The baby wrapped in blanket, sitting in crib, or crawling will be wearing green and will be either pink or brown. The final stage, the permanent walking toddler, has 4 appearance possibilities- girls will wear purple with hair in double buns and be either pink or brown, boys will wear blue and have spiky hair.
Pictures are in the "stages" section of the children wiki page https://stardewvalleywiki.com/Children
 
Top