Release 0.21.0

Released 2023-10-12.

• Fixed token counting for long prompts
• Reduced idle memory use
• Added per-model rate limits

Release 84241 · Release 84242 · Release 82622

Back to the changelog