A German regional court has ruled that Google is directly liable for the content of its AI search overviews. According to the court, previous limited liability protections for search engine operators don't apply to AI overviews. In this case, Google's AI had falsely linked two publishers to fraud and made claims that didn't appear in any of the linked sources. The ruling could set a precedent for AI-generated content liability worldwide.
You just need to be able to reduce the risk. They all operate like this. You can’t have complete certainty, even pre-LLMs. If the answers are wrong in only 0.001% cases and gravely wrong in 0.00001% cases it may be worth the risk. You gotta be able to sue for damages after all.