From the course: Enterprise AI Development with GitHub Models and Azure
Join today to access over 24,900 courses taught by industry experts.
Different AI interaction modals
From the course: Enterprise AI Development with GitHub Models and Azure
Different AI interaction modals
- [Instructor] Generative AI, in general, is rather costly to operate, both in monetary value, as in resources used. A large amount of graphical processing power, and therefore energy consumption, is needed to compute the results of your prompts. So, GitHub has to implement rate limits on this free service to keep cost on their side manageable. This also protects this free service against misuse or even using this in production-style settings. That is not what this service is for. Of course, rate limits are a way to make sure every user has room to play with GitHub models and make it available for you when you want to play around with it, up to a certain extent. When a service has a rate limit, it means that GitHub actively monitors how many times you have used this service. For example, during the last minute. If you go over that rate limit, an error is returned that tells you to wait until the rate limit is reset. Most GitHub services have a rate limit on an amount of calls per…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.