
Integrating external agents with ElevenLabs Agents' voice orchestration
Patterns for integrating ElevenLabs voice orchestration with complex and stateful agents
Open source sits at the foundation of modern engineering. Every product we build at ElevenLabs depends on tools, libraries, and infrastructure created and maintained by people who often work without recognition or predictable support. Their work accelerates ours, and it expands what is possible for anyone building with audio and voice systems.
Today, we are launching the ElevenLabs OSS Engineers Fund, a program that directs sustained support to the open-source projects our engineers rely on most. Over the next six months, we are contributing $22,000 to projects and maintainers nominated by our engineering team. Each engineer identifies projects they depend on, explains why they matter, and we allocate a portion of the fund based on those recommendations.
We will continue this program on a six-month cycle, with a new set of projects selected in May 2026.
The pace of our work is only possible because of the open-source ecosystem around us. It provides the compilers, runtimes, frameworks, editors, testing systems, and model tooling that form the backbone of our stack. Much of this infrastructure is maintained with limited resources. Supporting it directly is not only the right thing to do, it is also a practical investment in the stability and resilience of the systems we build on. The Engineers Fund is one way for us to contribute recurring and predictable funds to people who build software the world relies on.
Every six months, we ask engineers across the company to nominate the projects they depend on and describe how those tools support their work. We then assign funding across the nominated projects. This approach keeps the fund close to our actual workflows and ensures support flows to the projects that meaningfully improve our engineering, research, and product development.
This cycle includes a wide range of projects across audio, web infrastructure, testing, rendering, developer tooling, and core language ecosystems. A full list of supported projects and contribution amounts is included at the end of this post.
Total funding for the next six months: $22,000.
As we continue our frontier research on audio models, and our product surface area grows, our reliance on open-source work will continue to expand. The Engineers Fund is our commitment to providing stable, recurring support to the projects that make our work possible. We expect the next six-month cycle to include many of the same projects but also some new projects selected through the same engineer-driven process.
If you maintain an open-source project in audio, machine learning, distributed systems, or developer tooling, and our engineers rely on your work, there is a strong chance your project will appear in a future cycle.
We are hiring across engineering, research, and product.
Apply to work at ElevenLabs
If you are a developer building with voice, agents, or audio systems, our API is built for you.
Sign up for ElevenLabs
Mediabunny
We use mediabunny at the core of Studio’s new video-rendering pipeline, enabling fast and reliable frontend media processing for upcoming features.
ProseMirror
ProseMirror powers our text editing surfaces across Studio and internal tools, providing a stable and extensible editing foundation.
GraphiteEditor
GraphiteEditor advances open-source 2D image and video tooling and helps accelerate the ecosystem we build on.
FFmpeg
FFmpeg is essential to our audio and media pipelines, powering playback and transformations across our systems.
FastAPI
FastAPI underpins a large part of our backend services and remains a high-impact, high-usage framework throughout the codebase.
Lingui
Lingui drives our localization workflows and appears extensively across our frontend applications.
PostCSS
PostCSSは現代のウェブツールの基盤であり、私たちが広く使用しているものです。エンジニアたちはその重要性に対してサポートが不足していると考えています。
Python Software Foundation
PSFは、私たちのバックエンドと研究スタックの多くを支えるPythonエコシステムを維持しています。
Unsloth
Unsloth provides optimized kernels and fixes for open-source model releases, improving the performance and usability of models we rely on.
Hiroshi Ogawa
Hiroshi contributes essential work to vite and vitest, improving build tooling we rely on daily.
Daishi Kato
Daishi maintains state-management libraries that enable predictable, scalable state across our frontend applications.
Joshua Goldberg
Joshua maintains typescript-eslint, the core linting tooling that ensures code quality across our TypeScript projects.
TanStack Query
msgspec provides high-performance message serialization that improves the speed and reliability of our systems.
Chakra UI
TanStack Query handles data-fetching patterns across our frontend, streamlining how we manage backend queries.
pytest
Chakra UI accelerates our product development with a flexible and accessible component library.
pre-commit/action
pytest is central to our testing workflows and enables fast, reliable validation of Python services.
Starlette
pre-commit/action automates key code-quality checks, reducing engineering overhead.
urllib3
Starlette underlies FastAPI’s internals and remains a critical part of our Python service stack.
pixijs
urllib3 is a core HTTP client used across the Python ecosystem and is largely maintained by a single contributor.
Feedparser
pixijs powers the rendering canvas in Studio, enabling performant visual work.
Tailwindcss
feedparser is essential for parsing RSS feeds inside ElevenReader.
Neovim
tailwindcss is used across our frontend, providing a consistent, flexible styling system that is difficult to monetize.
mobx
neovim is a daily driver editor for many engineers and a key part of our development workflow.
mobx
mobx supports complex UI state across our applications with a simple and effective reactive model.

Patterns for integrating ElevenLabs voice orchestration with complex and stateful agents

Exploring how AI audio can support the creative process
Powered by ElevenLabs エージェント