Preprocess ADNAP Landings Data
preprocess_landings_adnap.RdThis function preprocesses raw ADNAP survey data from Google Cloud Storage. It performs data cleaning, transformation, catch weight calculations using length-weight relationships, and uploads processed data back to GCS.
Usage
preprocess_landings_adnap(log_threshold = logger::DEBUG)Details
The function performs the following main operations:
Downloads ASFIS species data and Airtable form assets from GCS
Downloads raw survey data from GCS as Parquet file
Processes general trip information using
preprocess_general_adnap()Processes catch data using
preprocess_catch()which handles survey version detectionCalculates catch weights via
calculate_catch_adnap()using length-weight coefficientsJoins trip and catch data
Maps survey codes to standardized names using Airtable assets
Uploads preprocessed data as versioned Parquet file to GCS