# Transcoder Campaign: Open Orchestrator

**URL:** https://forum.livepeer.org/t/transcoder-campaign-open-orchestrator/1856
**Category:** Transcoders
**Created:** [July 12, 2022, 2:21am UTC](https://forum.livepeer.org/t/transcoder-campaign-open-orchestrator/1856 "2022-07-12T02:21:37Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![0xcadams](https://yyz2.discourse-cdn.com/flex030/user_avatar/forum.livepeer.org/0xcadams/32/1020_2.png) [@0xcadams](https://forum.livepeer.org/u/0xcadams)
#### Post date: [July 12, 2022, 2:21am UTC](https://forum.livepeer.org/t/transcoder-campaign-open-orchestrator/1856/1 "2022-07-12T02:21:37Z")

</div>

Hey all,

This is `open-orchestrator.eth` - we’ve just launched our official campaign! Excited to officially join the community.

We run a globally distributed orchestrator which is [completely open source](https://github.com/0xcadams/livepeer-open-orchestrator) - we built our stack on Kubernetes (a popular solution for managing complex software architectures) and open sourced the entire codebase for the community.

Our orchestrator will be managed using “OIPs” - whenever a protocol-level change is being considered (e.g. reward/fee cuts), or significant change to the off-chain orchestrator parameters (e.g. price per pixel, max face value for tickets, etc), an Orchestrator Improvement Proposal (OIP) must be submitted by the maintainer(s) or by a delegator. This will consist of a PR similar to [OIP-1](https://github.com/0xcadams/livepeer-open-orchestrator/pull/10) which outlines the proposed changes and the reasoning for the change. The community will be given seven (7) days to leave comments on the PR before it is merged and executed. If you are a delegator, please turn notifications on for PRs, so you can participate in these discussions. We want complete transparency with our delegators to make sure we maintain the ideals of this great ecosystem.

I also work at Livepeer on the protocol design and web3 initiatives in the company. This is a personal project (not sponsored by Livepeer) built so that it can give back to the community by giving an open source example of one way a globally performant orchestrator can be set up. You’ll see me in the Discord channels as `0xcadams`.

Feel free to reach out to me on Discord, I’m always available to help set up new orchestrators, especially using Helm/Kubernetes!

Cheers!

---

<div class="post-metadata">

### Author: ![chrishobcroft](https://yyz2.discourse-cdn.com/flex030/user_avatar/forum.livepeer.org/chrishobcroft/32/1340_2.png) [@chrishobcroft](https://forum.livepeer.org/u/chrishobcroft)
#### Post date: [July 13, 2022, 6:51pm UTC](https://forum.livepeer.org/t/transcoder-campaign-open-orchestrator/1856/2 "2022-07-13T18:51:11Z")

</div>

Welcome to the Public Network, Chase!

---

<div class="post-metadata">

### Author: ![0xcadams](https://yyz2.discourse-cdn.com/flex030/user_avatar/forum.livepeer.org/0xcadams/32/1020_2.png) [@0xcadams](https://forum.livepeer.org/u/0xcadams)
#### Post date: [November 18, 2022, 3:09pm UTC](https://forum.livepeer.org/t/transcoder-campaign-open-orchestrator/1856/3 "2022-11-18T15:09:20Z")

</div>

An update for delegators:

The open orchestrator experienced a temporary outage from Nov 16th at 21:50:30 UTC to the following morning at 9:15:00 UTC. During this time, the [Arbitrum nginx proxy](https://github.com/0xcadams/livepeer-open-orchestrator/blob/main/charts/arbitrum/templates/nginx-proxy-config.yml) got into an unrecoverable state on all clusters, despite the upstream [Arbitrum failover nginx](https://github.com/0xcadams/livepeer-open-orchestrator/blob/main/charts/arbitrum/templates/nginx-failover-config.yml) continuing to respond appropriately. This was likely due to a temporary outage in the community Arbitrum node (as has been seen in the past), which triggers the nginx pod to cache/continue to return a bad response code.

There has been a bug filed in the repo and it will be fixed ASAP. Please subscribe to the Github issue for updates.

> <https://github.com/0xcadams/livepeer-open-orchestrator/issues/16>
>
> The open orchestrator experienced an outage on Nov 16th at 21:50:30 UTC to 9:15:…00 UTC. During this time, the \[Arbitrum nginx proxy\](https://github.com/0xcadams/livepeer-open-orchestrator/blob/main/charts/arbitrum/templates/nginx-proxy-config.yml) got into an unrecoverable state on all clusters, despite the upstream \[Arbitrum failover nginx\](https://github.com/0xcadams/livepeer-open-orchestrator/blob/main/charts/arbitrum/templates/nginx-failover-config.yml) continuing to respond appropriately. This was likely due to a temporary outage in the community Arbitrum node (as has been seen in the past).
> 
> Action Items:
> \- \[\] Add monitoring alerts for nginx errors
> \- \[\] Configure the nginx proxy to be resistant to these failures perform a health check

---

<div class="post-metadata">

### Author: ![0xcadams](https://yyz2.discourse-cdn.com/flex030/user_avatar/forum.livepeer.org/0xcadams/32/1020_2.png) [@0xcadams](https://forum.livepeer.org/u/0xcadams)
#### Post date: [December 15, 2022, 6:47pm UTC](https://forum.livepeer.org/t/transcoder-campaign-open-orchestrator/1856/4 "2022-12-15T18:47:36Z")

</div>

An update for delegators:

We will be winding down our Frankfurt region for the foreseeable future to cut down on costs. The Virginia region consistently receives more traffic and has good enough networking to provide a comparable service without the expense of the Frankfurt region (near $400-500/mo currently). Once it becomes more economical to operate again, we will spin the Frankfurt region back up.

---

<div class="post-metadata">

### Author: ![0xcadams](https://yyz2.discourse-cdn.com/flex030/user_avatar/forum.livepeer.org/0xcadams/32/1020_2.png) [@0xcadams](https://forum.livepeer.org/u/0xcadams)
#### Post date: [February 6, 2023, 2:20pm UTC](https://forum.livepeer.org/t/transcoder-campaign-open-orchestrator/1856/5 "2023-02-06T14:20:06Z")

</div>

An update for delegators:

We regret to inform the community that Open Orchestrator will be shutting down due to financial conditions and unsustainable infrastructure costs. This was a difficult decision to make and we are deeply sorry for the inconvenience it may cause.

We have been a part of the Orchestrator community for nearly eight months and we have enjoyed every moment. We understand that this news may come as a surprise to our delegators, and we want to thank you for your loyalty and support.

Since our service will no longer be available, we recommend that you find an alternative orchestrator(s) to meet your needs. We apologize for any disruption this announcement may cause and we wish you the best of luck in finding a suitable replacement.

The source code will remain available indefinitely for anyone looking to spin up a cluster with Kubernetes. We will be spinning down operations on Feb 13, 2023.

Thank you for your understanding.

---

<div class="post-metadata">

### Author: ![Authority\_Null](https://yyz2.discourse-cdn.com/flex030/user_avatar/forum.livepeer.org/authority_null/32/1364_2.png) [@Authority\_Null](https://forum.livepeer.org/u/Authority_Null)
#### Post date: [February 7, 2023, 4:27am UTC](https://forum.livepeer.org/t/transcoder-campaign-open-orchestrator/1856/6 "2023-02-07T04:27:11Z")

</div>

Sorry to see your O go Chase ☹ Thanks for sharing your Kubernetes setup.
