Look... This is basically all correct except that it's a tedious point by now. The web started out as an idealistic place where money and profit were not a concern. At some point they had to change because servers cost money and the web had lots of potential to make a lot of money. Which attracted people who want to make money and the idealists either left or took the money. The former are the ones responsible for why the web is bad. Think Instagram in 2011 vs now.
UX came into the picture by idealists with good intentions and when the money people started realizing they can make a shekel or two, they did. Thing is, us UX people need to put food on the table. We have bosses that tell us to do things who have bosses that tell them to do things. If you've been a UX designer for a while, chances are you you can design something cohesive and good. But there's always going to be some prick that says do it this way so we can squeeze 2% more profit or whatever. And if you don't they'll find a designer that will. The modern web is the result of a lot of bad decisions like SEO, advertising and content creators giving away free content.
The way to look at bad design is not to scold and blame the designer or dev team. You should ask, what compromises did these teams have to make to end up with this garbage?
Bad designers and developers do exist but it's more likely that the end result is compromises made by what stakeholders demanded (time or features), technology or something/anything...
Profit is always going to conflict with design. Profit is going to conflict with most things. Even hospitals have to make money. It's like the old line about politics: It's the art of the possible, the attainable, the next best. Politics isnt about getting everything you want, you must be pragmatic and realistic about what is achievable with competing interests.
So take what you can get, make the best possible experience you can with the demands, tools and time offered to you. And realize that's what the rest of us are doing as well.
