Upload Data as Parquet File to Cloud Storage — upload_parquet_to

Writes a data frame to a versioned Parquet file and uploads it to cloud storage.

Usage

upload_parquet_to_cloud(
  data,
  prefix,
  provider,
  options,
  compression = "lz4",
  compression_level = 12,
  bucket_name = NULL
)

Arguments

data: A data frame containing the data to be uploaded.
prefix: A character string specifying the file prefix path.
provider: A character string specifying the cloud storage provider key.
options: A named list of cloud storage provider options.
compression: A character string specifying compression type. Default is "lz4".
compression_level: An integer specifying compression level. Default is 12.
bucket_name: Optional character string specifying the GCS bucket name. If provided, overrides the bucket in `options`. If NULL (default), uses the bucket defined in `options`.

Value

Invisible NULL (called for side effects).

Examples

if (FALSE) { # \dontrun{
upload_parquet_to_cloud(
  data = survey_data,
  prefix = "raw-data/survey-data",
  provider = conf$storage$google$key,
  options = conf$storage$google$options
)
} # }