Increase File Limit as a Transcoder


#1

If you are running a transcoder on a linux box, sometimes you’ll see a “too many files open” error. When this happens, the transcoder can stop doing work.

This is because the Livepeer transcoder runs an internal IPFS node. Since IPFS requires a larger file limit, you have to change your default file limit. For Ubuntu users, you can do this by:

  1. Change /etc/security/limits.conf by adding * hard nofile 4096 and * soft nofile 40960
  2. After that, change /etc/pam.d/common-session by adding session required pam_limits.so
  3. Restart the machine, and verify via ulimit -a to make sure the soft/hard limits have changed.