OpenAI Python API Compatibility

An increasing number of open-sourced generative AI large language models (LLM) are being hosted behind an OpenAI API-compatible endpoint or have tools that offer an OpenAI API. The Python library for accessing OpenAI is just a REST client, and the library provides a way to specify the URL and an API key, as well as the model being offered by the provider. Here are a few examples of how the OpenAI library is used with other open-source models. ...

May 9, 2024 · 3 min · Michael OShea