Release 0.16.9

Released 2024-05-03.

• Added support for custom upstream timeouts
• Fixed token counting for long prompts
• Reduced idle memory use

Release 24190 · Release 24191 · Release 69925

Back to the changelog