Quite unexpectedly today, I found out that GitHub is currently offering free inference with quite a few models, including some of OpenAI's models. The UI can be found here: https://github.com/marketplace/models They also support an API. You can generate an API key from that link. --- I wonder what is going on here. - Why is this free? - Why are open models and OpenAI models both free? - Even ignoring the price, why would I use this over any of the myriad other services that offer inference? GitHub is owned by Microsoft, which has a special deal with Open AI. None of that explains why this is free, but it's not completely unusual to see OpenAI models offered for free, alongside a bunch of open source models. Anthropic models and Google models are notably absent. ![[CleanShot 2025-01-25 at [email protected]]]