Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EU AWS S3 bucket #215

Open
StrandedKitty opened this issue Feb 29, 2024 · 2 comments
Open

EU AWS S3 bucket #215

StrandedKitty opened this issue Feb 29, 2024 · 2 comments

Comments

@StrandedKitty
Copy link

We've encountered a problem with slow response times when fetching tiles from the US-based public bucket elevation-tiles-prod (https://registry.opendata.aws/terrain-tiles/) using HTTP. It often takes ~100ms to fetch a single tile. We think that the main problem is that this bucket is hosted in the United States while a lot of our users are from the EU.

There's a mention of a EU-based mirror bucket (elevation-tiles-prod-eu) but it doesn't work. It's not possible to access it neither using HTTP nor S3.

Is it possible by any chance for us to access the dataset and mirror it ourselves? We've tried mirroring this public bucket by moving tiles 1-by-1, but unfortunately there's so many small files that it's not feasible to do it like this.

@iandees
Copy link
Member

iandees commented Feb 29, 2024

At this time we only offer the single bucket in the one region. You're welcome to copy the data over to another bucket in another region if needed. As you found, there are lots of files, but if you parallelize the process it should be possible to copy them over in a few days. AWS also offers tools to migrate data between S3 buckets that you could look into. The bucket is public, so you should already have the access you need to perform the mirror.

@StrandedKitty
Copy link
Author

@iandees Thanks for the quick response! What's the total size of the bucket?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants