There’s also the fact that, before the advent of gas and then electric lighting, you really couldn’t see shit after dark. Tallow candles allow you to see where you’re going, but they don’t give off enough light to allow you to do much real work. Thus, throughout the winter there were simply fewer hours in which to do most things.

This is also likely why “dinner” was traditionally at lunchtime, and was also the main meal of the day. This was the time of day when you would most reliably have enough light to prepare a large meal. Then, when artificial lighting became a thing, upper class types started having “dinner parties” late in the evening, and for many dinner became the evening meal. It did not spread everywhere, though, in particular the north of the UK generally still thinks of dinner as lunchtime.