Package index • peskas.kenya.data.pipeline

Workflow

These are arguably the most important functions in the package. Each of these functions executes a step in the data pipeline.

export_summaries(): Export Summarized Fishery Data for Dashboard Integration

ingest_landings(): Download and Process WCS Surveys from Kobotoolbox

merge_landings(): Merge Legacy and Ongoing Landings Data

preprocess_landings(): Preprocess Landings Data

preprocess_legacy_landings(): Preprocess Legacy Landings Data

validate_landings(): Validate Fisheries Data

Cloud Storage

Functions that interact with cloud storage providers.

get_metadata(): Get metadata tables

mdb_collection_pull(): Retrieve Data from MongoDB

mdb_collection_push(): Upload Data to MongoDB and Overwrite Existing Content

Ingestion

Functions dedicated to the ingestion module

get_kobo_data(): Retrieve Data from Kobotoolbox API

ingest_landings(): Download and Process WCS Surveys from Kobotoolbox

Preprocessing

Functions dedicated to the preprocessing module

clean_catch_names(): Clean Catch Names

preprocess_landings(): Preprocess Landings Data

preprocess_legacy_landings(): Preprocess Legacy Landings Data

Validation

Functions dedicated to the validation module

alert_outlier(): Generate an alert vector based on the univOutl::LocScaleB() function

get_catch_bounds(): Get Catch Bounds

validate_catch(): Validate Catch Data

validate_dates(): Validate Landing Dates

validate_landings(): Validate Fisheries Data

validate_nboats(): Validate Number of Boats

validate_nfishers(): Validate Number of Fishers

Export

Functions dedicated dissemination of processed and analysed fisheries data

export_summaries(): Export Summarized Fishery Data for Dashboard Integration

Helper functions

Functions dedicated to data processing.

add_version(): Add timestamp and sha string to a file name

read_config(): Read configuration file