Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Scraping Student Clubs should scrape links #467

Open
CommanderStorm opened this issue Nov 13, 2024 · 0 comments
Open

[Bug] Scraping Student Clubs should scrape links #467

CommanderStorm opened this issue Nov 13, 2024 · 0 comments
Labels
bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed

Comments

@CommanderStorm
Copy link
Member

Currently scraping student clubs is a bit buggy in the english mode:

  • images are not consistently downloaded
  • urls are not consistently downloaded

The scraper is located here and should contain a testcase.
https://github.com/TUM-Dev/Campus-Backend/tree/main/server/backend/cron/student_club_parsers

I somewhat expect the scraper and not the upstream code to be at fault, but if adding a testcase for an english page works (keep the testcase), the issue is here https://github.com/TUM-Dev/Campus-Backend/blob/main/server/backend/cron/student_clubs.go

@CommanderStorm CommanderStorm added bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed labels Nov 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant