I Underestimated LiteLLM

By David Holder on

Our first post in my self-hosted AI series is about LiteLLM (https://www.litellm.ai/). LiteLLM is an open source AI gateway. It enables you to aggregate multiple AI vendors and expose them in a single OpenAI API compatible endpoint. All of your clients can plugin to that single…

AI Lock-In Is Coming. Here's What I'm Doing About It.

By David Holder on

I’ve been increasingly concerned about the economics of SaaS AI providers (e.g. OpenAI & Anthropic) especially when combined with the dependency they foster. It seems to me that we are headed towards a future of AI lock-in and rising costs. Anthropic shifted their enterprise plan over to…