📄️ Gaia nodes with long-term knowledge
The LLM app requires both long-term and short-term memories. Long-term memory includes factual knowledge, historical facts, background stories etc. They are best added to the context as complete chapters instead of small chunks of text to maintain the internal consistency of the knowledge.
📄️ Knowledge base from a plain text file
In this section, we will discuss how to create a vector collection snapshot from a plain text file. The
📄️ Knowledge base from a markdown file
In this section, we will discuss how to create a vector collection snapshot from a markdown file. The
📄️ Knowledge base from source / summary pairs
In this section, we will discuss how to create a vector collection snapshot for optimal retrieval of
📄️ Knowledge base from a PDF file
In this section, we will discuss how to create a vector collection snapshot from a PDF file. First, we will parse the unstructured PDF file to a structured markdown file. Then, we will follow the steps from Knowledge base from a markdown file to create embedding for your PDF files.
📄️ Knowledge base from a URL
In this section, we will discuss how to create a vector collection snapshot from a Web URL. First, we will parse the URL to a structured markdown file. Then, we will follow the steps from Knowledge base from a markdown file to create embedding for your URL.
📄️ Build a knowledge base using Gaia web tool
GaiaNet has developed a tool for making vector collection snapshot files, so everyone can easily create their own knowledge base.