Adapting to Non-Stationary Environments: Multi-Armed Bandit Enhanced Retrieval-Augmented Generation on Knowledge Graphs

This research paper describes a new system for improving how computer programs answer questions using large language models and knowledge graphs. Knowledge graphs are like giant webs of facts, and large language models are computer programs trained on tons of text data to understand and generate human-like text. The researchers found that just using one way to find information in the knowledge graph wasn't always the best, so they built a system that acts like a "smart librarian." This librarian uses feedback from users to learn which ways of finding information work best for different types of questions. This makes the system better at understanding complex questions, finding the right answers quickly, and adapting to changes in how people ask questions or how the knowledge graph is organized. The researchers tested their system and found that it outperformed other systems, especially when dealing with changes, like updates to the knowledge graph. This new system could make computer programs much better at answering questions in a variety of real-world situations, such as for personal assistants or customer support chatbots.

https://arxiv.org/pdf/2412.07618