Release 0.40.0

Released 2021-04-13.

• Reduced idle memory use
• Fixed token counting for long prompts
• Added support for custom upstream timeouts

Release 18469 · Release 18470 · Release 68364

Back to the changelog