feat: clustered ffmpeg transcoding #1653
Draft
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Clustered FFmpeg transcoding for video uploads
Proof-of-concept with Node and Express acting as a master server that queue transcoding jobs to be picked up by its defined workers.
It enables transcoding for video uploads streamlining compatibility across devices.
Screenshots
n/a
Additional Context
Transcoding requires some time and it can add a noticeable overhead on video uploads. The result video is a slimmed, color corrected mp4 file.
note: this is not a well-tested feature and nowhere near ready for production, I halted development on this to explore other solutions
note 2: this transcodes every video file to mp4, could also allow only video/quicktime mime type to act as a last-resort option
Checklist
Are your changes backwards compatible? Please answer below:
Doesn't interfere with video playback, it's a new step while uploading that only happens when the file is a video.
On a scale of 1-10 how well and how have you QA'd this change and any features it might affect? Please answer below:
5.
Tried with 4 workers and 8 simultaneous uploads, enqueueing correctly the jobs until workers were available.
An 18 MB 720p mov file was correctly transcoded to 13 MB 720p mp4 file.
For frontend changes: Tested on mobile, light and dark mode? Please answer below: n/a
Did you introduce any new environment variables? If so, call them out explicitly here: