Release 0.31.10

Released 2022-05-10.

• Improved streaming reliability
• Fixed token counting for long prompts
• Reduced idle memory use

Release 3371 · Release 3372 · Release 24561

Back to the changelog