Skip to content

RAG

Periodic Remote LLM Sources and LBS RAG

This week, as a follow-up to Remote LLM RAG this post, I have been working on additional RAG (Retrieval Augmented Generation) functionality for the rXg's built in LLM solution. This includes 2 components:

  1. LBS (Location Based Services): The rXg is now able to inform the user about what is near them.
  2. Periodic Sync of Remote LLM Sources: The rXg can now re-download remote LLM Sources, akin to redownloading config templates or content filter lists.

Remote LLM RAG

Recently my boss gave me an interesting challenge: Make our LLM (Large Language Model) system smarter by giving it access to remote data feeds.

LLMs are very good at knowing about events that are in their training data. But they are not able to know about new information.

RAG (Retrieval Augmented Generation) is a technique of finding contextually relevant data, based on the users' query and including it in the context sent to the LLM, so that the LLM can forumulate an up-to-date response, or a response that is informed by data beyond its training data.

Flight Gate Example

Continue reading for a concise explaination of how to accomplish this magic...