> ## Documentation Index
> Fetch the complete documentation index at: https://langchain.idochub.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# LocalAI

> [LocalAI](https://localai.io/) is the free, Open Source OpenAI alternative.
> `LocalAI` act as a drop-in replacement REST API that’s compatible with OpenAI API
> specifications for local inferencing. It allows you to run LLMs, generate images,
> audio (and not only) locally or on-prem with consumer grade hardware,
> supporting multiple model families and architectures.

<Warning>
  **For proper compatibility, please ensure you are using the `openai` SDK at version **0.x**.**
</Warning>

<Info>
  `langchain-localai` is a 3rd party integration package for LocalAI. It provides a simple way to use LocalAI services in LangChain.
  The source code is available on [Github](https://github.com/mkhludnev/langchain-localai)
</Info>

## Installation and Setup

We have to install several python packages:

<CodeGroup>
  ```bash pip theme={null}
  pip install tenacity openai
  ```

  ```bash uv theme={null}
  uv add tenacity openai
  ```
</CodeGroup>

## Embedding models

See a [usage example](/oss/python/integrations/text_embedding/localai).

```python theme={null}
from langchain_localai import LocalAIEmbeddings
```