Release 0.43.4

Released 2020-11-04.

• Fixed token counting for long prompts
• Added per-model rate limits
• Fixed a race condition during failover

Release 75509 · Release 75510 · Release 55472

Back to the changelog