Release 0.34.5

Released 2022-01-06.

• Fixed token counting for long prompts
• Added support for custom upstream timeouts
• Added per-model rate limits

Release 93402 · Release 93403 · Release 36673

Back to the changelog