Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error encoding large videos #548

Open
gbrn opened this issue Jan 11, 2025 · 9 comments
Open

Error encoding large videos #548

gbrn opened this issue Jan 11, 2025 · 9 comments

Comments

@gbrn
Copy link

gbrn commented Jan 11, 2025

@DanielnetoDotCom Danny, I'm having trouble encoding large videos using AVideo-Encoder.
Since my videos are movies, some of them can be over 5GB in file size.
But occasionally this problem can happen, and I'm facing it now... a movie that's 5 hours and 33 minutes long.
I think this must be a restriction applied to the code.

I tried the public Encoder and the restriction is greater, it is not accepting large files, I think larger than 4GB.
I also tried my private Encoder, it accepts large files, but it cannot finish the encoder correctly.
My private encoder is 65% free and apparently it is not a problem of space on the server:
image

After the encoder it enters the state: Broken or Missing Files.
image
image

I have done several tests and I cannot resolve this issue. What is the correct way to resolve this issue?

@DanielnetoDotCom
Copy link
Member

@gbrn
Copy link
Author

gbrn commented Jan 14, 2025

@DanielnetoDotCom

Check if this is not your case
https://github.com/WWBN/AVideo/wiki/How-to-find-errors-on-AVideo-Platform#video-resolution-considerations

The problem that occurs is not the one mentioned in the URL, as the resolution of the video I am testing is 1280x720 pixels, within the standard.

image

image

The difference in the test video is that it is 5 hours and 33 minutes long and the file is 4.90GB in size.

@DanielnetoDotCom
Copy link
Member

@gbrn
Copy link
Author

gbrn commented Jan 14, 2025

Danny, I'm doing a lot of tests.
I just uploaded the 5 hour and 33 minute file. But in low resolution 640px. With only 700MB.
I uploaded it to the public encoder for a test.
I bring the results.

image

@gbrn
Copy link
Author

gbrn commented Jan 14, 2025

@DanielnetoDotCom Danny, the file with 750MB, 5 hours and 33 minutes, was successfully completed.
So the problem is not in the resolution or the duration of the video. It is in the size in Gigabytes of the video file.
Could you help me diagnose this limitation of the video file size?

image

image

@gbrn
Copy link
Author

gbrn commented Jan 15, 2025

@DanielnetoDotCom Danny, I did another test, with a larger file. This one is now 4.90GB. The total HLS encoding was 11.95GB.
But apparently the file was not transferred to the storage, through YPTStorage. Here it shows that it is still in LOCAL. (I couldn't tell if this has to do with the transfer time, since the servers are in different locations).

image

image

@DanielnetoDotCom
Copy link
Member

Hold on

  1. 640p on public encoder will work, public encoder will handle resolutions from 480p
  2. the 11.95GB file transfered fine to your server and it is playable?
  3. the YPT storage compress the file to transfer it. you will probably need more ram then the filesize (11.95GB), but you may find some clues in the log file

@gbrn
Copy link
Author

gbrn commented Jan 16, 2025

  1. the 11.95GB file transfered fine to your server and it is playable?

No, the file does not play in the player.

  1. the YPT storage compress the file to transfer it. you will probably need more ram then the filesize (11.95GB), but you may find some clues in the log file

Yes, the system can do the compression and apparently does the transfer.
My encoder server has 23.4GB of RAM.
image

As soon as I have more time I will run new tests.

@DanielnetoDotCom
Copy link
Member

For me the best way to test is doing this

#548 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants