Release 0.12.1

Released 2024-12-13.

• Fixed token counting for long prompts
• Reduced idle memory use
• Added support for custom upstream timeouts

Release 60134 · Release 60135 · Release 34497

Back to the changelog