Release 0.31.8

Released 2022-05-18.

• Improved TLS handshake handling
• Added per-model rate limits
• Fixed token counting for long prompts

Release 39369 · Release 39370 · Release 25384

Back to the changelog