feat: New component - Media scraper
Can be called with command line flag '-p Scraper'. To use, the config file requires the following minimal entry (with URL for South Asia): "Scraper" : { "ProcessPreJob" : "do_nothing_return_true", "ProcessInJob" : "process_in_job_media_scraper", "ProcessEWSPlotting" : "do_nothing", "seasonStartString" : "20220101", "URL" : "https://arrcc-viewer.onrender.com/assets/sample_data/data.zip" },
Showing
- coordinator/ProcessorComponents.py 13 additions, 1 deletioncoordinator/ProcessorComponents.py
- coordinator/ProcessorScraper.py 423 additions, 0 deletionscoordinator/ProcessorScraper.py
- coordinator/ProcessorUtils.py 1 addition, 0 deletionscoordinator/ProcessorUtils.py
- run_GatherScrapedMediaReports.sh 0 additions, 10 deletionsrun_GatherScrapedMediaReports.sh
Loading
Please register or sign in to comment