Upload File to Cloud Storage, Retrying on Failure

upload_cloud_file() wrapped in with_storage_retry(). Uploads are the most failure-prone step in the pipelines — large objects, hour-long service-account token windows, and peers that reset connections mid-stream.

Usage

insistent_upload_cloud_file(
  file,
  provider,
  options,
  name = file,
  max_times = 10,
  pause_cap = 300
)

Arguments

file

A character vector of file paths to upload.

provider

A character string specifying the cloud storage provider.

options

A named list of cloud storage provider options.

name

A character vector of names to assign files in cloud storage. Defaults to local filenames.

max_times

Maximum number of attempts. Default 10.

pause_cap

Longest pause between attempts, in seconds. Default 300.

Value

A list of upload metadata, as upload_cloud_file().

See also

upload_cloud_file(), with_storage_retry()