LIVE ⚠ 3
■ idle

sales_analytics_daily

Sync sales orders, customers, and products from PostgreSQL to Snowflake for BI dashboards.

💾
Extract
PostgreSQL
►
⚙
Transform
filter cancelled
►
⚙
Transform
normalize currency
►
⚙
Transform
join customers
►
⚙
Transform
aggregate daily
►
☁
Load
Snowflake
SCHEDULE
Daily at 02:00 UTC
LAST RUN
12m ago success
SUCCESS RATE
99.1%
ROWS / 30 DAYS
2.4M
AVG DURATION
14s
▶ running

user_events_stream

Real-time streaming of user behaviour events from Kafka into BigQuery for product analytics.

▨
Extract
Kafka
►
⚙
Transform
parse json
►
⚙
Transform
enrich geo
►
⚙
Transform
deduplicate by id
►
⚙
Transform
cast timestamps
►
☁
Load
BigQuery
SCHEDULE
Continuous Stream
LAST RUN
now running
SUCCESS RATE
88.2%
ROWS / 30 DAYS
88.2M
AVG DURATION
<1s
■ idle

inventory_sync

Pull product inventory from REST API every 2 hours and upsert into operational MySQL database.

📡
Extract
REST API
►
⚙
Transform
map fields
►
⚙
Transform
filter inactive
►
⚙
Transform
validate sku
►
💾
Load
MySQL
SCHEDULE
Every 2 hours
LAST RUN
1h ago success
SUCCESS RATE
97.8%
ROWS / 30 DAYS
117K
AVG DURATION
7s
☓ error

marketing_attribution

Joins ad spend data from multiple sources, applies attribution model, loads to Redshift.

◫
Extract
Segment
►
⚙
Transform
merge channels
►
⚙
Transform
apply attribution model
►
⚙
Transform
aggregate by campaign
►
☁
Load
Redshift
SCHEDULE
Daily at 06:00 UTC
LAST RUN
2h ago failure
SUCCESS RATE
72.5%
ROWS / 30 DAYS
0
AVG DURATION
28s
■ idle

product_catalog_export

Nightly export of full product catalog from MongoDB to S3 in Parquet format.

💾
Extract
MongoDB
►
⚙
Transform
flatten nested
►
⚙
Transform
convert to parquet
►
⚙
Transform
partition by category
►
📁
Load
Amazon S3
SCHEDULE
Daily at 01:30 UTC
LAST RUN
3h ago success
SUCCESS RATE
100.0%
ROWS / 30 DAYS
430K
AVG DURATION
22s
■ idle

finance_ledger_sync

Sync accounting ledger from MySQL to BigQuery for finance reporting. PII anonymised in transit.

💾
Extract
MySQL
►
⚙
Transform
anonymize pii
►
⚙
Transform
cast amounts
►
⚙
Transform
validate balances
►
☁
Load
BigQuery
SCHEDULE
Every 12 hours
LAST RUN
4h ago success
SUCCESS RATE
100.0%
ROWS / 30 DAYS
104K
AVG DURATION
9s
■ idle

crm_contacts_delta

Incremental sync of CRM contact changes from Salesforce into internal PostgreSQL replica.

◫
Extract
Salesforce
►
⚙
Transform
delta detect
►
⚙
Transform
map sf fields
►
⚙
Transform
upsert by contact id
►
💾
Load
PostgreSQL
SCHEDULE
Every 15 minutes
LAST RUN
5h ago partial
SUCCESS RATE
95.3%
ROWS / 30 DAYS
271K
AVG DURATION
19s
▮▮ paused ▮ disabled

log_archive

Archive CloudWatch application logs to S3 Glacier for long-term retention and compliance.

☁
Extract
CloudWatch
►
⚙
Transform
compress gzip
►
⚙
Transform
partition by date
►
📁
Load
S3 Glacier
SCHEDULE
Weekly Sunday 03:00 UTC
LAST RUN
6h ago success
SUCCESS RATE
100.0%
ROWS / 30 DAYS
12.4M
AVG DURATION
47s