Release 0.40.6

Released 2021-03-20.

• Fixed token counting for long prompts
• Added support for custom upstream timeouts
• Added per-model rate limits

Release 90475 · Release 90476 · Release 47701

Back to the changelog