Skip to main content

Documentation Index

Fetch the complete documentation index at: https://langchain.idochub.dev/llms.txt

Use this file to discover all available pages before exploring further.

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families and architectures.
For proper compatibility, please ensure you are using the openai SDK at version 0.x.
langchain-localai is a 3rd party integration package for LocalAI. It provides a simple way to use LocalAI services in LangChain. The source code is available on Github

​
Installation and Setup

We have to install several python packages: 
pip install tenacity openai

​
Embedding models

See a usage example. 
from langchain_localai import LocalAIEmbeddings