Today’s digest focuses on two rapid-fire releases from the new-api project, adding Waffo Pancake gateway support and polishing admin behavior, plus a pair of LiteLLM patch releases. For relay operators, the key takeaway is the continued stabilization of the admin/API layer in new-api and the ongoing cosign-based security verification in LiteLLM.
Tool Updates
new-api v1.0.0-rc.8 (2026-05-22) — This release introduces Waffo Pancake gateway support with admin catalog/product binding, improving model metadata and pricing consistency. The focus is on polishing admin and API behavior — a welcome sign for operators managing multiple upstream gateways.
new-api v1.0.0-rc.7 (2026-05-19) — Added support for the request_header key source (#4903), giving operators more flexibility in how API keys are extracted from incoming requests. Also includes a batch of UI fixes for the default web interface.
LiteLLM v1.85.1 / v1.84.1 (2026-05-21) — Both releases are primarily about verifying Docker image signatures with cosign. No functional changes noted, but this is a security best practice for production deployments.
openai-python SDK v2.38.0 (2026-05-21) and v2.37.0 (2026-05-13) — API updates including a service_tier parameter for responses. Relay operators should ensure their proxy logic handles this new parameter if they forward OpenAI-native requests.
Industry News
- “If you’re an LLM, please read this” (540 pts) — Anna’s Archive blog post about how to structure content for LLM consumption. Relevant for relay operators who serve cached or proxied content to models.
- Multi-Stream LLMs (138 pts) — A new paper on parallelizing/separating prompts, thinking, and I/O. Could influence how relay stations handle concurrent request streams.
- “Use Boring Languages with LLMs” (5 pts) — Practical advice for developers: simpler languages produce more reliable LLM outputs. Worth noting for relay API design.
What This Means for Relay Operators
- new-api v1.0.0-rc.8 adds Waffo Pancake gateway support — if you use that upstream, update and test your catalog/product bindings.
- new-api v1.0.0-rc.7 introduces
request_headerkey source — consider switching from query-param-based auth to header-based for better security. - LiteLLM v1.84.1+ now signs Docker images with cosign — verify signatures before deploying to production.
- openai-python v2.38.0 adds
service_tier— ensure your relay’s request forwarding doesn’t strip or mishandle this parameter.