Kaeso：開源 AI Gateway 計劃與首版方向

A long time has passed since I last worked on a personal project which I worked on solely by myself, and whenever I did, I learned an enormous amount by doing so. Today I will be presenting my plans for Kaeso, an open source AI Gateway which will initially aim to compete with LiteLLM and then move on by adapting new features. My goal is to build a foundation for the future, and by building Kaeso this is the perfect way. I personally love and believe in open source because without it, I would definitely not be where I am right now.

From my understanding and knowledge of market needs, I believe that this idea is not a good one and will probably fail, at least as a startup it would. This project in its current state is a solved problem and the initial user base will be very small as LiteLLM is significantly further developed.

Kaeso in its first version will be split into four core components which will shape its fundamental structure:

As Apple's early Marketing Philosophy said, people DO judge a book by its cover. So the first big difference will be the UX/UI for the people using Kaeso. In my view, the current LiteLLM User Interface has considerable room for a cleaner and more cohesive experience. Kaeso will aim to create a good environment for all kinds of users.

Of course, announcing this as the only change is vague. In most cases nobody cares about the UI and it's the functionality which matters, but as I'm currently just trying to establish a baseline, this is the first and best visible best practice I can create.

Lastly, I want to mention that the Kaeso Roadmap will be fully led by me and that will probably remain the case at its core.