Skip to main content
Abso is an open-source LLM proxy that automatically routes requests between fast and slow models based on prompt complexity. It uses various heuristics to chose the proper model. It’s very fast and has low latency.

​
Installation and setup

​
Chat Model

See usage details here