Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EPSS CSV retrieval is being strained by a go client #1

Open
jayjacobs opened this issue Nov 18, 2024 · 0 comments
Open

EPSS CSV retrieval is being strained by a go client #1

jayjacobs opened this issue Nov 18, 2024 · 0 comments

Comments

@jayjacobs
Copy link

I am not sure if your package is causing this or not, but the API serving up the CSV for EPSS is being hit repeatedly by a client with the user agent of "Go-http-client/2.0" with some IP addresses requesting the CSV thousands of times per day. Could you implement some type of local caching that will only retrieve the CSV once per day?

The URL "https://epss.cyentia.com/epss_scores-current.csv.gz" should always return a 302 redirect to a URL that contains a date in the filename. If you could check that against a local cache and not retrieve the full CSV repeatedly that would help our API costs and hopefully prevent us from having to implement a rate limit or registration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant