add dynamic ingest of lecturer preferences

Add ingest of lecturer preferences from the preferences webapp. Periodically the preferences web application is polled for lecturer preferences and the state of opt-ins are updated.

In future, we can use filtering on the preferences list to only query preferences which have changed since the last time we fetched them but, for the moment, keep the simple approach until we hit scaling problems.