Release 0.16.2

Released 2024-05-31.

• Added support for custom upstream timeouts
• Added per-model rate limits
• Fixed token counting for long prompts

Release 99183 · Release 99184 · Release 28458

Back to the changelog