FAQ | This is a LIVE service | Changelog

Skip to content
Snippets Groups Projects
  1. Jun 08, 2021
  2. May 12, 2021
    • Dr Catherine Pitt's avatar
      Fix a bug in the move-machine script · 75db08dc
      Dr Catherine Pitt authored
      The generation of the command to unexport NFS filesystems could generate
      an invalid command. Leading spaces were not being stripped, and in cases
      where there is more than one backup target for a machine we need to
      unexport every target. Because we also had 'set -e' in operation at this
      point, the script would fail there and never clean up the moved ZFS. I
      don't mind if we fail to unexport; if that's subsequently a problem for
      removing the ZFS then the script will fail at that point.
      
      This change makes the script generate better exportfs -u commands and
      not exit if they fail.
  3. Apr 30, 2021
    • Dr Catherine Pitt's avatar
      Make database connections short-lived · e40c1a55
      Dr Catherine Pitt authored
      The code used to open a database connection for each thread and leave
      them open for as long as the scheduler ran. This worked reasonably well
      until we moved to PostgreSQL 13 on Focal, although the scheduler would
      fail if the database was restarted because there was no logic to
      reconnect after a connection dropped.
      
      On Focal/PG13 the connection for the 'cron' thread steadily consumes
      memory until it has exhausted everything in the machine. This appears to
      be a Postgres change rather than a Perl DBI change: the problem can be
      reproduced by sitting in psql and running 'select * from backup_queue'
      repeatedly. Once or twice a minute an instance of this query will cause
      the connection to consume another MB of RAM which is not released until
      the database connection is closed. The cron thread runs that query every
      two seconds. My guess is it's something peculiar about the view that
      query selects from - the time interval thing is interesting.
      This needs more investigation.
      
      But in the meantime I'd like to have backup servers that don't endlessly
      gobble RAM, so this change makes the threads connect to the database
      only when they need to, and closes the connection afterwards. This
      should also make things work better over database restarts but that's
      not been carefully tested.
  4. Dec 11, 2020
  5. Oct 06, 2020
  6. Apr 07, 2020
  7. Dec 18, 2019
  8. Jul 30, 2019
  9. Jul 23, 2019
  10. Apr 23, 2019
  11. Oct 18, 2018
  12. May 22, 2017
  13. Mar 28, 2017
  14. Feb 14, 2017
  15. Jan 12, 2017
  16. Dec 08, 2016
  17. Sep 07, 2016
  18. Apr 12, 2016
  19. Apr 05, 2016
    • Dr Catherine Pitt's avatar
      Logging enhancements and prepare-nondebian tweak · bd5e7e8d
      Dr Catherine Pitt authored
      Split logs for tasks with same target machine but different target filesystems into
      different logfiles for easier debugging.
      
      prepare-nondebian script creates a fake excludes file for the machine now if
      one doesn't exist, because I keep forgetting to do it myself for Redhat
      machines and then the zfs-rsync script fails.
      bd5e7e8d
  20. Jan 15, 2016
  21. Jan 14, 2016
  22. Dec 15, 2015
  23. Sep 18, 2015
  24. Jul 02, 2015
Loading