Ingestion

Cron schedule, run telemetry, and failure diagnostics for the ingestion scripts.

Cron schedule
Hermes cronjob
SourceCronWhen
sendpilot0 */6 * * *Every 6 hours at :00
zernio30 */6 * * *Every 6 hours at :30
weekly-digest0 9 * * MONMondays at 09:00 EST
Manual run
From loudmusic-supabase repo
# Activate venv
cd /home/derrick/loudmusic-supabase
source .venv-marketing/bin/activate

# Full backfill (last 90 days)
python -m scripts.marketing.ingest_sendpilot --backfill
python -m scripts.marketing.ingest_zernio

# Incremental (default; pulls since max(last_activity_at) - 1h)
python -m scripts.marketing.ingest_sendpilot
python -m scripts.marketing.ingest_zernio

# Smoke test (limit to 10 conversations)
python -m scripts.marketing.ingest_sendpilot \
  --limit-conversations 10 --since 2026-06-01
Ingestion runs
12 most recent
SourceStatusRecordsDurationStartedError
sendpilotsuccess1842.0s6/25/2026, 11:57:25 PM
zerniosuccess188.0s6/25/2026, 10:57:25 PM
sendpilotsuccess1942.0s6/25/2026, 7:57:25 PM
zerniosuccess208.0s6/25/2026, 6:57:25 PM
sendpilotsuccess2042.0s6/25/2026, 3:57:25 PM
zerniosuccess228.0s6/25/2026, 2:57:25 PM
sendpiloterror042.0s6/25/2026, 11:57:25 AMConnection timeout to api.sendpilot.com (60s)
zerniosuccess248.0s6/25/2026, 10:57:25 AM
sendpilotsuccess2142.0s6/25/2026, 7:57:25 AM
zerniosuccess268.0s6/25/2026, 6:57:25 AM
sendpilotsuccess2242.0s6/25/2026, 3:57:25 AM
zerniosuccess288.0s6/25/2026, 2:57:25 AM