Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DockerTimeout on AWS Batch #75

Closed
sivkovic opened this issue Mar 26, 2019 · 3 comments
Closed

DockerTimeout on AWS Batch #75

sivkovic opened this issue Mar 26, 2019 · 3 comments
Assignees
Labels
bug Something isn't working
Milestone

Comments

@sivkovic
Copy link
Collaborator

This issue happening sometimes because volume IO utilization is close to 100% while downloading and uploading files.
Error on AWS Batch:
DockerTimeoutError: Could not transition to created; timed out after waiting 4m0s
In this case whole nextflow job will fail.
Other manifestation of the same issue:
CannotInspectContainerError: Could not transition to inspecting; timed out after waiting 30s
In this case only some jobs are seen as failed on AWS Batch although they are successful.

Link to nextflow issue.

@sivkovic sivkovic added the bug Something isn't working label Mar 26, 2019
@sivkovic
Copy link
Collaborator Author

sivkovic commented Apr 2, 2019

Fix for nextflow timeout on AWS Batch sivkovic/nextflow#1. Waiting for NF folks to review.

@evanbiederstedt
Copy link
Contributor

Fix for nextflow timeout on AWS Batch sivkovic/nextflow#1. Waiting for NF folks to review.

@sivkovic would it make sense to do a PR directly to Nextflow?

@sivkovic sivkovic added this to the 0.9.0 milestone Apr 30, 2019
@sivkovic
Copy link
Collaborator Author

Merged. Works with nextflow version 19.05.0-SNAPSHOT build 5075

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants