Netflix has developed a microservices orchestrator called Conductor and is now offering it via open source.
Inspired by the company’s need to run business processes for streaming titles worldwide, Conductor was built as a cloud-based orchestration engine. It manages workflows, can pause and restart processes, and uses a JSON DSL-based blueprint to define execution flow. It also features a user interface to visualize process flows and can scale to millions of concurrently running process flows.
Conductor has been in use at Netflix for almost a year. “To date, it has helped orchestrate more than 2.6 million process flows ranging from simple linear workflows to very complex dynamic workflows that run over multiple days,” Netflix said in a bulletin. The company is open-sourcing the technology in order to learn from others with similar needs and enhance the software.