Pre-process Pelagic Data System trips — preprocess_pds

Downloads raw structured data from cloud storage services and pre-process into a binary format that is easier to deal with in R.

Usage

preprocess_pds_trips(log_threshold = logger::DEBUG)

Arguments

log_threshold: The (standard Apache logj4) log level used as a threshold for the logging infrastructure. See logger::log_levels for more details

Value

no outputs. This function is used for it's side effects

Details

This function downloads the landings data from a given version (specified in the config file conf.yml. The parameters needed are:

pds:
  trips:
    token:
    secret:
    file_prefix:
  version:
    preprocess:
storage:
  storage_name:
    key:
    options:
      project:
      bucket:
      service_account_key:

Progress through the function is tracked using the package logger.