Protocol Paused For Bug Fix Upgrade - 3/31/2021 11:45am ET (Update: Protocol Resumed)

Hi everyone. This announcement is to let you know that a bug has been identified in the Livepeer protocol smart contracts, and we will be conducting a fix. This is a bug that remains unexploited at this time, though if exploited it would put user value at risk. After some analysis, and due to the mandate to protect user value, we have decided to pause the protocol out of an excess of caution so that we can prepare a fix, test it, and get it deployed, without putting any user’s protocol role or tokens at risk. While Livepeer is still in the beta stage, this sort of issue is fully expected, and we have built these upgrade and bug fix mechanisms for exactly this purpose. It is important for us to mitigate risks for our early protocol participants as much as possible.

Note that this issue is related to the recent protocol pause and accompanying bug fix on 3/28/2021. During the post-impact analysis and post-mortem process, it was discovered that the previous fix partly addressed the accounting issue, but additional cases were discovered that also need to be addressed and could lead to opportunities for exploits.

The estimated duration of the protocol pause is unknown at this time . It is hoped to avoid missing a single protocol round, however it is possible that the pause may extend longer if necessary, or resumed quicker if possible.

During the paused period, the protocol will be inactive and protocol parameters will stay the same. This means any interaction with the protocol will be ineffective. For delegators, your token will stay bonded but will receive no rewards because there will be no round progression. For transcoders, your nodes will not be able to initialize round or call reward, and there will be no token reward minted. However, non-participating tokens can still be transferred as usual. Broadcasters are urged to continue using Rinkeby to test and develop. The Livepeer team is working hard to fix the bug, and we will be in constant communication with updates. Expect a full post-mortem with details of the issue and remedy after the fix has been deployed and verified. If you notice any issues, please report to the discord channel at http://discord.gg/q6XrfwN , and check here for updates.

3 Likes

Good luck y’all, ping me if I can help with anything.

2 Likes

If any of you are missing sleep, try to drink plenty of water, sip a little often to keep hydrated. And don’t forget to eat. Love you all hope things are OK.

Update at 4:18am ET, 4/1/2021 : The fix has been deployed and the protocol is unpaused.

Thanks to everyone who worked on this bug fix. We will follow up with a post mortem on the issue in a few days. This fix was a follow up fix to the recent bug fix on 3/18/2021. No user funds were compromised as a result of this bug to the best of the team’s knowledge.

Thank you for being patient during the pause.

2 Likes

The post-mortem for this bug has been published.