Flyte 2 is dynamic, self-healing AI orchestration. It is available today in open source for local execution, and for production preview hosted on Union.ai.
What is Flyte 2 and why is it the standard for AI orchestration?
Flyte 2 is fully dynamic, self-healing AI orchestration. As an agent harness and execution runtime, it uses infrastructure-as-context to fix failures autonomously as workflows run.
Workflow authors are feeling the pain of maintaining brittle pipelines and juggling fragmented devtools – most of which are designed for data pipelines, not AI. With the growing complexity of agents and AI, workflows need to be extremely durable, scalable, and adaptable at runtime. Since we first announced the Flyte 2 beta last year, our open source community has come alive with excitement and feedback.
And now, we’re thrilled to announce that Flyte 2 is available locally in open source. We’re also making Flyte 2 for distributed execution available as part of our production preview, hosted on Union.ai.
Early feedback from the Flyte 2 beta
Let’s start with a massive thank you to all the contributors and beta users who have helped shape the future of open source AI orchestration. Since launching the beta, we’ve seen…
- 60 new releases
- 508 merged PRs
- 35 unique contributors
Those efforts have helped us get to this major milestone, and we’re incredibly grateful to everyone who contributed.
Our most recent feedback shows how powerful Flyte 2 truly is:
How Flyte 2 improves the way you orchestrate AI
Pure Python authoring
Flyte 2 lets you author workflows in actual Python without learning a new DSL. You can write, test, and version your workflows locally in pure Python. Migrating existing scripts is simple, and there's no need to rewrite logic just to fit a framework.
<div class="manual-figcaption">TUI with simplified DevEx (tasks simply call tasks)</div>
Self-healing workflows
Most “durable execution” providers can’t handle infrastructure-caused failures. That means out of memory errors, container pre-emption, etc. can’t be automatically addressed.
Flyte 2 is an agent harness, so pipelines that fail can recover and continue where they left off. It uses infrastructure-as-context to handle both logic and infrastructure failures autonomously. The workflows and agents on Flyte 2 are self-healing. With built-in caching, retries, and support for custom error handling, Flyte ensures that failures are isolated and never bring down your entire workflow.
Intuitive Debugging
For anything beyond automation, Flyte 2 makes debugging fast and intuitive. You can observe execution state, logs, and failures at every step, catch errors as they happen, and even rerun workflows interactively in a live debugger.
Dynamic, on-the-fly orchestration
Flyte 2 delivers fully dynamic workflows that adapt in real time. From branching logic and loops to dynamic resource allocation, your AI systems and agents can make decisions on the fly at runtime.
*You still have the option of static DAGs, too.
Optimized, scalable workflows
Flyte 2 handles large task fanout and parallelism with ease, scaling with you as you grow your AI systems. Use native multi-container pipelines. Auto-scaling (including scale-to-zero) means you only pay for the compute infra you need.
Rapid iteration
Flyte 2 automatically versions your executions, supports multi-tenancy in dev/stage/prod environments, and provisions infrastructure only when needed, keeping costs and complexity low.
What can Flyte 2 do locally today?
The Flyte 2 SDK is available today locally for one machine. Running Flyte 2 locally offers a bunch of cool features that illustrate why Flyte’s architecture is changing the game for AI orchestration.
What Flyte 2 can do locally
- Durable agent workflows — test and run AI orchestration locally without a cluster
- Terminal UI — launch, inspect, and manage workflows straight from your laptop
- Async I/O — non-blocking, concurrent task execution out of the box
- Local caching — reuse prior results to speed up iteration and reruns
- Local serving — serve apps that call workflows and execute agentic logic locally
- Observability — real-time reports and execution state at every step
<div class="button-group is-center"><a class="button" target="_blank" href="https://flyte2intro.apps.demo.hosted.unionai.cloud/">Demo Flyte 2 in browser</a></div>
Flyte 2 for production
Releasing Flyte 2 locally is a major stepping stone in building open infrastructure for AI development. Our next milestone is releasing a powerful Flyte 2 backend for distributed execution. This backend will enable scalable, fault-tolerant workflow runs, bringing autoscaling, resource awareness, and resilient state management to production environments.
In the meantime, we’re giving teams the chance to access Flyte 2 for production as part of our production preview, hosted on Union.ai, the enterprise Flyte platform.
Get started
<div class="button-group is-center"><a class="button" target="_blank" href="https://www.union.ai/docs/v2/flyte/user-guide/running-locally/">Try Flyte 2</a></div>
Try Flyte 2 for distributed execution as part of our production preview, hosted on Union.ai
Available today for local execution.
Other helpful links
- Try our in-browser demo and see Flyte 2 in action
- Check out our Github page
- Join our Slack community
