Skip to contents

Preprocess Landings Data

preprocess_landings.Rd

This function preprocesses raw landings data from a MongoDB collection. It performs various data cleaning and transformation operations, including column renaming, data pivoting, and standardization of catch names.

Usage

preprocess_landings(log_threshold = logger::DEBUG)

Arguments

log_threshold

Logging threshold level (default: logger::DEBUG)

Value

A tibble containing the preprocessed landings data

Details

The function performs the following main operations:

  1. Pulls raw data from the MongoDB collection

  2. Renames columns and selects relevant fields

  3. Generates unique survey IDs

  4. Cleans and standardizes text fields

  5. Pivots catch data from wide to long format

  6. Standardizes catch names and separates size information

  7. Converts data types and handles cases with no catch data

  8. Uploads the processed data to the preprocessed MongoDB collection.

Examples

if (FALSE) { # \dontrun{
preprocessed_data <- preprocess_landings()
} # }