Old Sci-Fi AI used to be an entity which have a hard facts database and was able to instantly search it.

I think that's the right direction for modern AI to move. ChatGPT uses Google searches often. So replace Google with curated knowledge database, train LLM to consult this database for every fact and hallucinations will be gone.