Skip to contents

Downloads raw structured legacy data from cloud storage services and pre-process into a binary format that is easier to deal with in R.

Usage

preprocess_legacy_landings(log_threshold = logger::DEBUG)

Arguments

log_threshold

The (standard Apache logj4) log level used as a threshold for the logging infrastructure. See logger::log_levels for more details

Value

no outputs. This funcrion is used for it's side effects

Details

This function downloads the landings data from a given version (specified in the config file conf.yml. The parameters needed are:

surveys:
  landings_1:
   api:
   survey_id:
   token:
   file_prefix:
 version:
  preprocess:

storage:
  storage_name:
    key:
    options:
      project:
      bucket:
      service_account_key:

Progress through the function is tracked using the package logger.