🚅 LiteLLM

LiteLLM handles loadbalancing, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format. The Predibase / LiteLLM integration provides customers with not only the base open source LLMs, but also with the highly efficient fine-tuned adapters that beat GPT-4 in performance.