Release 0.31.1

Released 2022-06-15.

• Fixed token counting for long prompts
• Improved streaming reliability
• Added support for custom upstream timeouts

Release 60362 · Release 60363 · Release 922

Back to the changelog