Skip to content

Data Stores

Fresh

Source: BIBLE.md (Pulse metrics, Data stores 21 dirs 106 files), bible/setup.md (Data directories)

21 directories, 106 files (as of 2026-05-16).

Persistence model

Not a real database. JSON files on disk with field-level AES-256-GCM encryption for sensitive fields (passwords, proxy credentials, cookies, fingerprints).

Directory layout

data/
  ghost-engine/
    accounts/                # DAM cards (JSON per account)
    armies/                  # Army group definitions
    backlink-targets/        # Target sites for backlinks
    backlinks/               # Backlink submission records
    brand-bombs/             # Brand bomb campaign data
    campaigns/               # CTR campaign configs
    cascade-log/             # Cascade execution logs
    citation-profiles/       # NAP citation data
    citation-submissions/    # Citation submission records
    fingerprints/            # Generated browser fingerprints
    google-ctr/              # Google CTR round results
    local-seo-audits/        # Local SEO audit reports
    ranks/                   # Rank tracking snapshots
    results/                 # Search result captures
    review-campaigns/        # Review campaign data
    schedules/               # Scheduled job configs
    sessions/                # Browser session data
    social-campaigns/        # Social posting campaigns
    warmup-plans/            # Account warmup schedules
    workflows/               # Multi-step workflow definitions
    yt-comment-campaigns/    # YouTube comment campaigns
    jobs/                    # Persistent job queue
    backups/                 # Backup archives
    geogrid-scans/           # Geogrid scan results
  mini-engine-v2/
    profiles/                # Chrome profile directories (per account)
    fingerprints/            # Fingerprint snapshot files
  mini-engine/
    cookies/                 # Encrypted cookie jars
  proxy-pool.json            # 100 session proxies for fallback
  proxy-marriages.json       # Permanent 1:1 account-to-proxy bindings

Store modules (core)

StorePurpose
account-storeDAM cards, encrypted
fingerprint-storePer-account fingerprints, encrypted
campaign-storeCampaign state
result-storeCTR results (append-only)
rank-storeRank snapshots, 90-day retention
cookie-managerEncrypted cookies

Plus plugin-specific stores (24 more): links, brand-bombs, geogrid-scans, jobs, backups, etc.

Encryption

FieldAlgo
Account passwordAES-256-GCM
Proxy credentialsAES-256-GCM
CookiesAES-256-GCM
Fingerprint configsAES-256-GCM

Key derivation: machine-derived by default, override with MINI_ENGINE_KEY.

Backup and restore

bash
# Create a backup
curl -X POST http://localhost:4700/backup/create \
  -H "Content-Type: application/json" \
  -d '{ "label": "pre-upgrade-2026-05-20" }'

# Restore
curl -X POST http://localhost:4700/backup/restore \
  -H "Content-Type: application/json" \
  -d '{ "backupId": "backup-abc123", "overwrite": false }'

File size estimates

StoreTypical size per item
Account (DAM card)~3-5 KB
Fingerprint snapshot~1-2 KB
Cookie jar~10-50 KB
CTR result~500 B
Rank snapshot~200 B
Campaign config~2 KB

50 accounts plus 90 days of activity: typical disk usage ~50-100 MB.