Active Integration Pipeline/ID: pip_ledger_sync_v4

Stripe Billing to BigQuery Warehouse

Ingest verified global customer billing history, handle raw micro-unit conversion, and aggregate historical ledger balances for financial auditing queries in BigQuery.

REAL-TIME SYNC MAP

SOURCE

Stripe Ledger

stripe_raw.charges

Auth StatusCONNECTED

TRANSFORM

SQL Ledger Engine

micro_usd_dedup.sql

CompilationSUCCESSFUL

DESTINATION

Google BigQuery

nexus_analytics.ledger

Sink Speed10,000 rps

Pipeline Health Metrics

Execution Reliability99.98%

Target Rate Limits (Quota)64% of BigQuery limit

Storage Deduplication Ratio1.8x reduction

Active Configuration Summary

Primary Key:transaction_id

Deduplication:idempotent (latest_timestamp)

Time Partitioning:DAY (on field sync_timestamp)

Backfill window:30 days (automatic recovery)

Incremental Sync Active

This pipeline only fetches modified charges from the Stripe API since the last execution window. This limits bandwidth usage and guarantees ultra-low processing overhead.

Pipeline Controls

Manage execution frequency & automation state.

Last manual sync: 2h agoUser: alex@nexus.io

Automatic Sync Schedule

Query Stripe updates every 15m

Synchronization Frequency

Next scheduled execution: 10:15:00 UTC (in 5 minutes)

Sync Ingestion Telemetry

Data Ingestion Rate:24.2 MB / sec

Daily Volume:1.82 GB

Average Processing Latency:14.2 seconds

Source API Latency (Stripe):104 ms

Destination Sink Wait:22 ms

Diagnostic reporting stateVERBOSE