Download and Process Lurio Surveys from Kobotoolbox
ingest_landings_lurio.RdThis function retrieves Lurio survey data from Kobotoolbox, processes it,
and uploads the raw data to Google Cloud Storage as Parquet files. It uses the
get_kobo_data function to retrieve survey submissions via the Kobotoolbox API.
Details
The function performs the following steps:
Reads configuration settings from config.yml
Downloads survey data from Kobotoolbox using
get_kobo_dataChecks for uniqueness of submissions
Flattens nested JSON data to tabular format
Uploads raw data as versioned Parquet file to Google Cloud Storage