Sync Files to datom Repository — datom

Processes new/changed files from a manifest produced by datom_sync_manifest(). Imports each file via rio::import(), converts to a data frame, and calls datom_write() to store as parquet in S3 with git metadata. Updates the local .datom/manifest.json after each successful write.

Usage

datom_sync(conn, manifest, continue_on_error = TRUE)

Arguments

conn: A datom_conn object from datom_get_conn().
manifest: Data frame from datom_sync_manifest(), with columns name, file, format, file_sha, status.
continue_on_error: If TRUE (default), continues processing remaining tables when one fails. If FALSE, stops on first error.

Value

The manifest data frame augmented with result and error columns. result is "success", "skipped", or "error".