Skip to main content
Abso is an open-source LLM proxy that automatically routes requests between fast and slow models based on prompt complexity. It uses various heuristics to chose the proper model. It’s very fast and has low latency.

​
Installation and setup

pip install langchain-abso

​
Chat Model

See usage details here