from first glance, it looks similar to LiteLLM[0]. Are there any key differences?
Also, in light of this weekend's madness, are you reconsidering using the OpenAI API as the canonical interface? Do you think there could be changes in the future?
LiteLLM is a great project. The key differences (from what I can tell) are that:
a) This is hosted
b) Supports caching and load balancing
c) Can manage multiple providers behind a single API key
d) Implemented in Typescript (vs. Python)
On the other hand, LiteLLM is a more mature project and supports significantly more model providers than we currently do!
Also, in light of this weekend's madness, are you reconsidering using the OpenAI API as the canonical interface? Do you think there could be changes in the future?
[0] https://github.com/BerriAI/litellm