Different Points of View
You can choose to make the Ecliptic “horizontal” or you can make the Equator “horizontal”. You could also replace the Sun with the Earth in this picture (going “geocentric”) and then it would be clear why the Sun shines “down” or “up” on either pole during the solstices.