FAQ | This is a LIVE service | Changelog

Skip to content
Snippets Groups Projects
  1. Mar 14, 2023
  2. Jan 27, 2023
  3. Jan 24, 2023
    • J.W. Smith's avatar
      feat: Clearup functionality · bce461a1
      J.W. Smith authored
      Optional config argument to delete mid-process files at the end of a
      successful job. There is an associated command-line flag '--clearup'.
      
      The reason for this feature is to provide a way to slim down data
      volumes of production runs. A lot of processing files are generated
      and production runs may only need to retain configuration, logs and
      outputs. Also, the inputs might be archived separately, so they
      wouldn't need to be retained in prod runs.
      
      Currently, files are moved to a hard-coded 'recycling bin' directory,
      and there is a minimal set of files set for clearup: only the deposition
      and environment tar files.
      
      This change requires some standard structure to outputs of
      processor_in_job functions, which would be more robust if
      a class structure is implemented.
      
      TODO: Implement a test for file clearup.
      bce461a1
    • J.W. Smith's avatar
      feat: Clearup functionality · c6610b10
      J.W. Smith authored
      chore: Tidy imports
      c6610b10
  4. Dec 08, 2022
  5. Nov 15, 2022
  6. Nov 08, 2022
  7. Oct 20, 2022
  8. Oct 03, 2022
  9. Sep 14, 2022
  10. Aug 31, 2022
    • J.W. Smith's avatar
      chore: Remove redundant imports · 2ad9e748
      J.W. Smith authored
      2ad9e748
    • J.W. Smith's avatar
      feat: Source switch and split ProcessorComponents · cf4caf3f
      J.W. Smith authored
      1) There is now a python alternative to the R-based wheat-source-
      generation, called source_gen. The functionality to call source_gen
      has been added (see ProcessorSurveys.pyL939 and L1032-1040), but not
      yet switched on while we await testing of
      output at the Met Office.
      
      2) ProcessorComponents was huge (2100 lines!) and the structure was
      not apparent. Each component's supporting functions are now in a
      separate directory. There is also a ProcessorServer.py relating to
      file down/up-loads. ProcessorComponents is now essentially a directory
       to import all the functions. This might inspire a more systematic
       (object-oriented?) structure for each component within coordinator
       in the future.
      cf4caf3f
  11. Aug 24, 2022
  12. Aug 19, 2022
  13. Aug 18, 2022
  14. Aug 16, 2022
  15. Jun 30, 2022
  16. Jun 29, 2022
    • J.W. Smith's avatar
      feat: Email config is moved out of this project. · a14f5c2e
      J.W. Smith authored
      The email config is required to set up the logging before any other
      tasks are done in order to maximise coverage. It is expected that the
      location of the required config file is defined in run_Processor.sh,
      or exported to local environment before calling Processor.py.
      a14f5c2e
    • J.W. Smith's avatar
      feat: ssh will not prompt user · a37b74ad
      J.W. Smith authored
      The ssh commands now do not check new server identities. This prevents a
      user prompt on first-time use, which otherwise inhibits Amazon Web
      Server instances.
      a37b74ad
  17. Mar 22, 2022
  18. Feb 28, 2022
  19. Feb 25, 2022
  20. Jan 25, 2022
  21. Sep 27, 2021
  22. Jun 24, 2021
  23. Jun 16, 2021
  24. May 17, 2021
  25. May 04, 2021
    • J.W. Smith's avatar
      feat: Run EpiModel from configs · 6891a694
      J.W. Smith authored
      This configuration works with EWS-EpiModel git commit 631e3520. This can handle multiple diseases but only one region. Output directories are <job-directory>/<region>/<disease>/<output>
      6891a694
  26. Apr 05, 2021
  27. Mar 16, 2021
  28. Mar 09, 2021
  29. Jan 21, 2021
    • J.W. Smith's avatar
      chore: Point to operational workspace · 12f8d94b
      J.W. Smith authored
      This should only apply to the operational copy of the EWS-Coordinator. If you want to run a separate copy for any reason, make these changes to point to your separate workspace. The git ignored files still need pointing to, but they don't need to be duplicated. Your local version of these changes can be stashed while pushing and pulling to/from the master branch.
      12f8d94b
    • J.W. Smith's avatar
      feat: Add optional second path for results upload · 6736f40a
      J.W. Smith authored
      In operational version, this is needed for survey results. The way this is implemented, it can be configured for any other component too.
      6736f40a
  30. Jan 05, 2021
  31. Dec 21, 2020
Loading