This is done with a set of <date_valid_from>: <host_file.tif> pairs in
the run configuration under ['Epidemiology']['Host']['HostRasters'].
This is an optional argument. The 'HostRaster' argument in the
configuration is still needed, but is renamed as 'TargetRaster' to
avoid confusion.

Cocnurrent changes were made in epi model.

This may one day be replaced by some 'host preprocessing' type
of EWS component.

Aspects to improve:

*  Currently, the dynamic host map has to be handled both in
ews-epidmiology for run time, and here for post-run in order
to convert units. It might be neater to do once in one place only
 by moving the unit conversion functionality into the epi model.

 * Implement testing for handling of dynamic host data.

See EpiModel.EpiPrep.updater.update_input() docstring for comments.

This should substantially speed up production epi runs, particularly
towards the end of the season.

This commit also unifies deposition and env suit preparation code.

Not for immediate production, awaiting verification from Yoseph.

Credentials to access the new survey form are available on episerver at
/storage/app/EWS_prod/regions/EastAfrica/resources/coordinator/configs/
Cred-ODK-EIAR_newODK.json

changing the landpoint files to use a new column "included", to filter for countries, rather than using the lat lon values to decide what to filter

Adding the functionality to group surveys and run source gen on each groups. Grouping is only run if it is defined in the config (otherwise it use all available surveys), and it is based on the 'Origin' column of the surveys. All unique 'Origin' will create its own group alongside the ones defined in the config. Groups can be ignored by defining 'GroupsToIgnore' in the config (this has no effect on 'Origin' types).

Handle missing redundant columns and continue to set a common column
order at the same time.

This is useful for the new ODK form until the wheat rust toolbox is setup.

adding a list of wildcards used when searching for nc file - useful if reporting that none are found

changing the optional SPATIAL_POINTS_FILE config parameter to SPATIAL_POINTS_FILE_TEMPLATE and allowing ${} value subsiitution in the paremeter value
removing some points from the ethiopia post processing landpoint file, to allow checking that the filtering for post-processing is working

It is possible to specify which spatial points file to use in the main config json. The default file will be used if not specified. This will allow us to perfrom historic runs with the old grid and specify manually.
The country-level points filtering used by the postprocessing steps (beofre plotting) now round down the acuracy when filtering points. This allows the country filtering to work with both the new and the old grid, as the differece is lost in the rounding

So that coordinator tests work with ews-epidemiology commit d344567 .

An error once happened where it seems the request content was lost
before it could be used. This may mitigate the risk of it happening
again.

This is an initial step to have multiple source file setup.
This step is NOT utilising the grouped files yet.

Survey processor to handle WheatRustToolbox download and formating.

New function to allow conversion of a series according to a provided dictionary. (Needed for WRT formating.)

- Always create ExportCSV folder if it is not exist to allow merging.
- Correcting messages to not have ODK as the default download.
- Add ProcessorSurveysWRT import.

moving log file output to before the assert statement, so we can more easily see which file is missing [if a file is missing]

making gitignore ignore the contents of the log dir rather than the dir itself. Think it may be why the integration tests are failing

This allows the ODK export functionality to append latest changes
to a single database path, instead of downloading the full database
history which can stretch over many years. This saves a lot of time
for the daily survey job.

The WRSIS survey processor can already limit the download size to
the current season(s) with a start-date parameter.

The Kobotoolbox survey processor doesn't have a solution for
avoiding the daily download of extensive historical data. This needs
investigating further at some point.

This will be helpful in cases when a given day's source calculation
fails as it allows the NAME spore dispersion model to run with the
previous day's calculation, provided there are no new surveys on
the latest day (which will only be known about once there is a
successful download again).

This reverts commit d84d1b1e.