making gitignore ignore the contents of the log dir rather than the dir itself. Think it may be why the integration tests are failing

making gitignore ignore the contents of the log dir rather than the dir itself. Think it may be why the integration tests are failing

This reverts commit 8c32ad24

This allows the ODK export functionality to append latest changes
to a single database path, instead of downloading the full database
history which can stretch over many years. This saves a lot of time
for the daily survey job.

The WRSIS survey processor can already limit the download size to
the current season(s) with a start-date parameter.

The Kobotoolbox survey processor doesn't have a solution for
avoiding the daily download of extensive historical data. This needs
investigating further at some point.

This will be helpful in cases when a given day's source calculation
fails as it allows the NAME spore dispersion model to run with the
previous day's calculation, provided there are no new surveys on
the latest day (which will only be known about once there is a
successful download again).

This reverts commit d84d1b1e.

some additional comments and code-tidying

making survey tests use the same structure as others, with separated test suits for full and partial tests