Yes, I went up to a 5950x a while back from a 3600 for the same reason: it was the best CPU I could get without upgrading motherboard and RAM. And I hardly ever play games. Looking at the performance benchmarks it seems the X3D stuff actually slows down non-gaming workloads a bit (perhaps because it increases temperatures), so I don’t feel the need to chase after that tech.
The incentives are all wrong for this, except in FOSS. It’s never going to be a priority for Microsoft because everyone is used to the (lack of) speed of Windows etc., and “now a bit faster!” isn’t a great marketing line. And it’s not in the interests of hardware companies that need to keep shifting new boxes if the software doesn’t keep bogging each generation down eventually. So we end up stuck with proprietary bloatware everywhere.