Remote LLM RAG
Recently my boss gave me an interesting challenge: Make our LLM (Large Language Model) system smarter by giving it access to remote data feeds.
LLMs are very good at knowing about events that are in their training data. But they are not able to know about new information.
RAG (Retrieval Augmented Generation) is a technique of finding contextually relevant data, based on the users' query and including it in the context sent to the LLM, so that the LLM can forumulate an up-to-date response, or a response that is informed by data beyond its training data.
Continue reading for a concise explaination of how to accomplish this magic...