FAQ | This is a LIVE service | Changelog

Skip to content
Snippets Groups Projects
  1. Jan 12, 2023
  2. Dec 16, 2022
  3. Nov 15, 2022
  4. Nov 09, 2022
  5. Nov 08, 2022
  6. Nov 07, 2022
    • J.W. Smith's avatar
      0c7be7f4
    • J.W. Smith's avatar
      fix: Check tar file completeness before download · 9f19cef1
      J.W. Smith authored
      Before this commit, the process_pre_job_server_download() function would
      check if the necessary tar file exists on the remote server. But, because it is
       written there by sftp, and sftp doesn't generate any lock file or temp files, in-progress sftp writes look like they are available and the job continues. With this change, the job will only process if the tar file is completely written.
      9f19cef1
  7. Oct 20, 2022
  8. Oct 03, 2022
  9. Aug 31, 2022
    • J.W. Smith's avatar
      feat: Source switch and split ProcessorComponents · cf4caf3f
      J.W. Smith authored
      1) There is now a python alternative to the R-based wheat-source-
      generation, called source_gen. The functionality to call source_gen
      has been added (see ProcessorSurveys.pyL939 and L1032-1040), but not
      yet switched on while we await testing of
      output at the Met Office.
      
      2) ProcessorComponents was huge (2100 lines!) and the structure was
      not apparent. Each component's supporting functions are now in a
      separate directory. There is also a ProcessorServer.py relating to
      file down/up-loads. ProcessorComponents is now essentially a directory
       to import all the functions. This might inspire a more systematic
       (object-oriented?) structure for each component within coordinator
       in the future.
      cf4caf3f
Loading