Release 0.40.2

Released 2021-04-05.

• Fixed token counting for long prompts
• Faster model list caching
• Added per-model rate limits

Release 24471 · Release 24472 · Release 91600

Back to the changelog