Wikidata and ChatGPT integration failure

Integration of knowledge graphs with large language models (e.g., Wikidata and ChatGPT) is an interesting topic that might help gain better grounding in reality and less confabulation/hallucination often seen with large language models alone.

I have implemented a ChatGPT called Wikibåt and which is configured via “actions” and OpenAPI configuration to query the Wikidata API. My initial impression of this system was quite good, see my blog post Multihub question answering with ChatGPT and Wikidata from November 2023.

But now I have run into a simple example where it fails. I entered “Can you give a list of supervised students of Lars Kai Hansen?” and Wikibåt identifies and looks up the correct Wikidata entity fine, but then fails to use the entity data correctly, listing two wrong students as supervised by Lars Kai Hansen even though such information is ready available as “first order data” in the entity requiring no multihub processing.

(The reason why there is a link to Scholia is due to the prompt, i.e., the “Instructions” field in the configuration)