DEFINITION
Retrieval-Augmented Generation (RAG) is an AI architecture using information retrieval methods to provide answers to questions based on external data. When a query is put into the system, information will be extracted from documents, databases or knowledge bases that will be provided to the language model. This can provide factual answers and can also make use of current or organization-specific data without the need to retrain the model. The benefit of RAG will depend on the quality of the information that has been retrieved, the reliability of the source and how the model is used.
Why RAG is useful
- Provides factual answers by providing relevant source information.
- Can provide up to date information.
- Allows access to internal documents to be used within AI applications.
- Can provide source references if the system is set to keep track of it.
- Less retraining required as the knowledge sources can be updated.
Applications of RAG
- Create AI assistants to help with internal documentation.
- Answer queries about contracts, policies and product manuals.
- Support customer service with up to date product information.
- Search through procurement, supplier and business reports.
- Create knowledge assistants for technical and operations teams.
See it running on your own hardware
Vanik Edge OS runs AI models, agents and apps inside your building, so your data stays there.
