Google translate isn’t the key or the answer either, it’s constantly slightly wrong, but it’s still useful because you can combine it with your own partial understanding to get the right translation.
It feels like you’re either missing or ignoring my point entirely here, I’m not saying use Google translate for the legal document, I’m giving examples of how imperfect tools can still help you get to where you need to go. You’re saying it’s completely useless because sometimes it’s going to be wrong, I’m just saying that’s an un-nuanced take. Yes if they’re signing a contract, absolutely get a lawyer if you don’t understand what you’re signing, but occasionally you just need to look up a law or accept a eula, and it would be nice to be able to have some help reading it, even if it’s from an imperfect tool.
Totally fair disagreement to have there. I’m extremely critical of llms for many of the same reasons as you, plus environmental and economical concerns. Having said that however for summarization, simplification, and rephrasing they don’t tend to hallucinate. Exactly as you say, they don’t know anything, but they’re instructed to always answer, so when something that doesn’t match their training data comes along they hallucinate. For this kind of task though a specialized llm is actually a pretty good fit. As long as such a tool is used responsibly and carefully I don’t see why it couldn’t exist and be moderately helpful.