Skip to contents

Ingest Pelagic Data Systems (PDS) Trip Data

Source: R/ingestion-pds.R
ingest_pds_trips.Rd

This function handles the automated ingestion of GPS boat trip data from Pelagic Data Systems (PDS). It performs the following operations:

  1. Retrieves device metadata from configured cloud storage

  2. Downloads all trip data from PDS API (2018-01-01 to present)

  3. Selects the trips belonging to the country's fleet

  4. Converts the data to parquet format

  5. Uploads the processed file to configured cloud storage

Usage

ingest_pds_trips(log_threshold = logger::DEBUG, package = "coasts")

Arguments

log_threshold

The logging threshold to use. Default is logger::DEBUG.

package

Name of the package whose inst/conf.yml to read. Defaults to "coasts". Pass your own package name when calling from a downstream package with a compatible configuration.

Value

None (invisible).

Selecting the country's trips

Set by pds.customers / pds.exclude_customers and pds.select_by, and applied by select_country_trips(), which explains the three rules.

See also

get_trips(), cloud_object_name(), download_cloud_file(), upload_cloud_file(), resolve_storage_opts()