It’s interesting because not knowing exactly how powerful something is feels more realistic. I think the uncertainty has it’s place as a narrative device. One way to mitigate the problem you’re describing would be more liberal use of passive checks, like if the party is facing down a troll, a nature check might reveal it’s a powerful ancient beast. For your 17th level fighter example, a good insight check (or passive insight) would let the DM say ‘dont mess with this guy’ without it breaking immersion too much.
By this logic, no businesses should rely on the internet, roads, electricity, running water, GPS, or phones. It is short sighted building stuff on top of brand new untested tech, but everything was untested at one point. No one wants to get left behind in case it turns out to be the next internet where early adoption was crucial for your entire business to survive. It shouldn’t be necessary for like, Costco to have to spin up their own LLM and become an AI company just to try out a better virtual support chat system, you know? But ya, they should be more diligent and get an SLA in place before widespread adoption of new tech for sure.