What about the Victorian period made this possible? Seems strange that we have so much more wealth and efficiencies now (even just refrigeration/freezers as one example) yet seem to have gone backwards in this regard. What could be the underlying cause of this?
The few people with the wealth to be able to live this lifestyle are the ones who left enough records to read about. The commoners definitely existed, they just didn't leave records, or the ones they did leave weren't preserved, or the ones that were, common folk don't study or read about. That's all.
In another 1,000 years, think about who around you right now might have the chance to be remembered. Someone like Bezos or Musk? Those reading about our life in the year 3,022 might believe everyone in our time was a wealthy CEO funding rocketship companies if they go by the names that have stood through time.
It was only possible in the Victorian period for the wealthy elite. If you were born into a family that owned vast swaths of land or used to run slave plantations in the Caribbean you were set for life and could devote your life to less crude pursuits than the gain of capital. You would also have a ready built network of others with similar wealth and social expectations.
And not only in England - all of Europe's elite, in France, Germany, Hungary, Austria, Russia, spend their days sponsoring art and partying, basically. They were the ones paying all the famous composers, painters, etc. whose work we still marvel at today.
The rise of the United States and its capitalist system brought an end to that. The businessman rose over the noble man, both in wealth as well as image.
Not the businessman, really; the _normal_ man. If we were back in the Victorian age, it's likely that you and I would be doomed to labor every day for meager sustenance, supporting the occasional noble and their leisure.