Pre-process Zanzibar WCS Surveys

Downloads and preprocesses raw structured WCS survey data from cloud storage into a binary format. The process includes nesting multiple columns related to species information into single columns within a dataframe, which helps reduce its width and organize data efficiently for analysis.

Usage

preprocess_wcs_surveys(log_threshold = logger::DEBUG)

Arguments

log_threshold

Log level used as the threshold for logging (see logger::log_levels).

Value

None; the function is used for its side effects.

Details

Configurations are read from conf.yml with the following necessary parameters:

surveys:
  wcs_surveys:
    asset_id:
    username:
    password:
    file_prefix:
  version:
    preprocess:
storage:
  storage_name:
    key:
    options:
      project:
      bucket:
      service_account_key:

The function uses logging to track progress.

See also

pt_nest_trip, pt_nest_catch, pt_nest_length, pt_nest_market, pt_nest_attachments