GitHub has introduced GitHub Models, a new feature that provides developers with complimentary access to various AI models. The initiative aims to integrate sophisticated AI capabilities into the practical workflows of over 100 million developers in the GitHub community.
Navigating AI Models on GitHub
Developers can access AI models by visiting the GitHub Marketplace, then selecting the “Models” category from the sidebar. Detailed information on each model can be found by clicking on its respective name. Available models include OpenAI’s GPT-4o and GPT-4o mini, Microsoft’s Phi 3, Meta’s Llama 3.1, and Mistral Large 2. GitHub plans to expand the model selection as new language and vision models are introduced.
At the core of GitHub Models is a free playground that allows developers to experiment with different AI models. Now in a limited public beta, this playground lets users tweak model parameters and submit prompts to see responses. Developers can join a waitlist to gain access to this feature through GitHub’s platform.
Moving to Production
GitHub Models offers a straightforward path from testing to production. Developers can transition from using a GitHub personal access token to an Azure subscription and credentials. GitHub assures users that no prompts or outputs from GitHub Models are shared with model providers or used to enhance AI models, safeguarding user privacy and data integrity.
Beyond the playground, GitHub Models offers free API access, also limited to public beta. This enables developers to embed AI models into their applications. Instructions and example code for using the models are available on the GitHub Marketplace. Developers can choose their programming language and SDK, configure their environment, and make requests to the models with the provided example code.
Both playground and API access are subject to rate limits, which vary depending on the model type and the user’s subscription tier. Specific limits, such as requests per minute and tokens per request, are detailed for different tiers: Free, Copilot Individual, Copilot Business, and Copilot Enterprise.
Last Updated on November 7, 2024 3:25 pm CET
