Periodic Remote LLM Sources and LBS RAG

This week, as a follow-up to Remote LLM RAG this post, I have been working on additional RAG (Retrieval Augmented Generation) functionality for the rXg's built in LLM solution. This includes 2 components:

1. LBS (Location Based Services): The rXg is now able to inform the user about what is near them.
2. Periodic Sync of Remote LLM Sources: The rXg can now re-download remote LLM Sources, akin to redownloading config templates or content filter lists.

LBS

Floorplan and POIs

In order to begin using LBS RAG, you will want to setup at least one floor for your deployment. I recommend following the guide here. In order to get the right calibration for your floor plan, and following the guide here, in order to setup your POIs (Points of interest).

LLM

LBS

Next, you will want to trun on "Use Connected AP" In your LLM Option. The AP Nearness Threshold is the radius around the AP that will be considered near enough to be included in the answer.

In order for the rXg to know what is near the user, an operator will need to configure it with many POIs.

Now, when the user asks what is near, the LLM will know! Make sure you properly calibrate your floorplan and setup Points of Interest (POIs) for best results.

You can see that the rXg included context about what is near to the LLM.

Periodic Remote Sources

Periodic sources can be anything (text-based, for now) that is reachable by the rXg. For example, if you a PDF of important information that the LLM should know about, simply create a periodic remote data source for it and the rXg will download and ingest it into its RAG system.

Step 1: Create a remote llm data source. You can simply put the whole URL in here. The combination of the base url in here and the path in the LLM Source is intended to give the operator maximum flexibility, but for a single fixed asset you can just put the whole URL in for base URL.

Step 2: Create an llm source which daily, weekly or monthly, or manual refresh selected. Associate it with the LLM Options that you want to have access to this information.

Step 3: If you are impatient, go ahead and click the refresh button to download it right away.

Step 4: Now you can see that it has downloaded the source, and you can download that source here if you wish.

Now it knows who to complain to about trash!

The frequency "manual" is also available. Manual frequency LLM Sources will periodically refresh at all.