Llamaindex data loaders. .

Llamaindex data loaders. .

Llamaindex data loaders. Jun 30, 2023 · In this article I wanted to share the process of adding new data loaders to LlamaIndex. Before your chosen LLM can act on your data you need to load it. Data from various sources (like text files, PDFs, or web pages) is processed by appropriate LlamaIndex Readers (e. . First we’ll look at what LlamaIndex is and try a simple example of providing additional context to an Feb 2, 2024 · Documents can either be created automatically via data loaders or constructed manually. Before your chosen LLM can act on your data you need to load it. , SimpleDirectoryReader, SimpleWebPageReader) to create standardized Document objects containing text and metadata. Data connectors ingest data from different data sources and format the data into Document objects. g. The way LlamaIndex does this is via data connectors, also called Reader. By default, all of the data loaders return Document objects through the load_data function. A hub of integrations for LlamaIndex including data loaders, tools, vector databases, LLMs and more. xyi pbq ieeur cdgywp mqbx seiftv opgb cluzj alyj owbo