An AI co-pilot for small business operations. Automates invoice processing, payout calculations, and repetitive back-office tasks.
Small business employees often spend hours manually reading invoices, checking vendor payouts, and answering repetitive questions. Helm acts as an AI operations assistant that reads invoices with computer vision, flags billing mistakes, and performs routine financial checks at a fraction of a cent per document.
Helm orchestrates four back-office workflows (accounts-payable invoice OCR, creator payout reconciliation, Tier-1 customer service responses, and cross-company KPI Q&A) with measured cost and accuracy per task.
Live dashboard: helm-bridge.vercel.app (rendering the 200-invoice measurement against Gemini 3.1 Flash Lite).
99.0% parse rate, 91.9% field accuracy, 84.1% line-item exact match at $0.000298 per invoice. The system detected 93% of billing errors and anomalies. Compared to a human employee taking 6 minutes per invoice at $25/hour, this pipeline saves ~18.7 labor hours per 200 invoices, cutting processing time by 15.4x for only $0.06 in total AI cost. Reproduced by
pnpm measure:invoice-ocr --seed 1 --extractor gemini.
Trial 02: Partner Payout Calculations (50 creators across 863 orders, Gemini 3.1 Flash Lite reasoning)
6.0% exact-match rate, 54.1% field accuracy, with up to $285 discrepancy on $14,184 in total payouts. This highlights a critical lesson: AI models read visual documents well, but struggle with complex multi-step math. The same AI model that scored 91.9% on visual invoice reading dropped to 54% when calculating multi-tier commissions, refunds, and shipping deductions across 17 orders per person. The architectural solution is to let AI extract the data, but use reliable code to do the final arithmetic. Reproduced by
pnpm measure:payout-reconciler --seed 1 --extractor gemini.
The dashboard at helm-bridge.vercel.app displays both trials side by side for comparison.
Helm is a practical portfolio project showing what an AI automation engineer would build inside a growing small or mid-sized business. Many expanding companies struggle with manual back-office tasks like reading invoices, checking vendor payments, answering routine support emails, and looking up business metrics. Helm creates an automated layer between employees and business databases to handle routine tasks and flag tricky issues for human review.
The focus is on practical workflow automation rather than theoretical research. The core engineering contribution is connecting specialized business tools, visual invoice readers, rules checks, and executive search into a cohesive, measured system.
sequenceDiagram
autonumber
participant U as User
participant D as Dashboard (React + Chart.js)
participant API as API (Node + Express)
participant L as Gemini 3.1 Flash Lite
participant MCP as MCP servers
participant DB as libsql (SQLite + vector)
rect rgb(245, 245, 255)
Note over U,DB: AP Invoice OCR
U->>D: Drop invoice PDFs
D->>API: POST /api/ap/ingest
API->>API: render PDF β PNG
API->>L: vision call (extract structured fields)
L-->>API: invoice JSON
API->>API: Zod schema + math reconciliation
API->>DB: insert ap_invoices, flag anomalies
API-->>D: live activity log
end
rect rgb(245, 255, 245)
Note over U,DB: Creator Payout Reconciler
U->>D: Upload orders CSV + policy.md
D->>API: POST /api/payouts/run
API->>L: policy + creator rows
L-->>API: payout breakdown
API->>API: deterministic re-compute, flag diffs
API-->>D: payouts.csv + discrepancies.md
end
rect rgb(255, 250, 240)
Note over U,DB: Tier-1 CS Responder
U->>D: Inbound message arrives
D->>API: POST /api/cs/draft
API->>DB: vector_distance_cos retrieve KB passages
API->>L: message + KB β reply + confidence
L-->>API: structured response
API-->>D: auto-send / review / escalate
end
rect rgb(255, 240, 250)
Note over U,DB: Cross-Company KPI Q&A
U->>D: Ask a question
D->>API: POST /api/kpi/ask
API->>L: question + MCP tool catalog
loop one or more
L->>MCP: tool call (ERP / CRM / AP / channel)
MCP->>DB: query rows
DB-->>MCP: rows
MCP-->>L: tool result
end
L-->>API: answer with grounded citations
API-->>D: grounded answer, click to source row
end
Each panel of the dashboard maps to one sub-feature, and each sub-feature ships with a measurement. The full contract (workflow, schema, and exact measurement protocol) lives in docs/scope.md.
| Sub-feature | Stack | Measurement |
|---|---|---|
| Invoice OCR | Gemini 3.1 Flash Lite vision, Zod, libsql | Line-item accuracy on 200-invoice holdout, USD/invoice, latency |
| Creator Payout Reconciler | Gemini + programmatic calculator | Exact-match rate vs. hand-computed ground truth on 50-creator fixture |
| Customer Support Responder | libsql vector retrieval, Gemini structured output, confidence gating | Auto-response rate, precision, and escalation accuracy |
| Cross-Company Metrics Q&A | Gemini tool-use, four custom MCP servers | Citation accuracy and tool-routing precision on a 10-question battery |
Helm/
βββ front/ React 19 + Vite + Chart.js + Tailwind: the dashboard
βββ back/ Node 22 + Express 5: API surface, agent orchestration
βββ mcp/ Four MCP servers: one per data source (erp, crm, ap, channel)
β βββ erp/
β βββ crm/
β βββ ap/
β βββ channel/
βββ data/
β βββ generators/ Seed-driven synthetic-data generators
β βββ render-png/ Playwright-driven HTML to PNG renderer for invoices
β βββ fixtures/ Versioned generated fixtures with labels
β βββ measurements/ Reproducibility scripts for every README number
βββ e2e/ Playwright: QA suite + demo-recording suite
βββ docs/ scope.md, architecture.md
βββ assets/ Banner SVGs, logo, demo recordings
βββ .github/workflows/ CI + deploy
Detailed architectural notes on model routing, tool protocols, and prompt structure live in docs/architecture.md.
Many small and mid-sized companies face the same operational challenge: real revenue and customer volume, but no in-house AI automation team. They spend countless hours on invoice processing, creator-payout calculations, customer-service triage, and looking up numbers across disconnected spreadsheets and tools. Helm demonstrates a practical solution to these bottlenecks, backed by measurable accuracy and cost data on every workflow.
pnpm install
pnpm exec playwright install chromium # first run only
cp .env.example .env # add GEMINI_API_KEY (free at aistudio.google.com); LIBSQL_URL defaults to file:./data/helm.db
pnpm data:generate --seed 1 # generators
pnpm data:render-png --seed 1 # HTML to PNG (~17s)
pnpm measure:invoice-ocr --seed 1 # full pipeline against the mock extractor
pnpm measure:invoice-ocr --seed 1 --extractor gemini # against real Gemini 3.1 Flash Lite vision (~14 min, free)See CONTRIBUTING.md for the complete development guide.
The dashboard visualizes tests across increasing depth levels. Each video is recorded by the Playwright demo suite (pnpm test:demo) and stored in docs/demos/.
Dashboard Tour (β30s)
A tour through the dashboard: the Invoice OCR panel with its 99.0% parse rate, followed by the Creator Payout Reconciler showing the payout discrepancies flagged for human review.
The master video (docs/demos/helm-tour.mp4) is embedded above as a GIF.
| Phase | Status |
|---|---|
| Scaffold | β |
| Synthetic-data generators (seed=1 committed) | β |
| Sub-feature 1: Invoice OCR | β 200 invoices, 99.0% parse, 91.9% field accuracy, $0.000298/invoice |
| Sub-feature 2: Creator Payout Reconciler | β 50 creators, 6.0% exact-match (highlights LLM math limits), $0.000237/creator |
| Sub-feature 3: Customer Support Responder | β Vector retrieval + confidence gating, 94.2% precision, 0.85 auto-send threshold |
| Sub-feature 4: Cross-Company Metrics Q&A | β Multi-tool orchestration (ERP/CRM/AP/Channel), 96.0% citation accuracy |
| Banner SVGs + favicon + social card | β |
| Dashboard SPA (AP panel rendering live measurement) | β |
| Demo videos | β
docs/demos/helm-tour.gif |
| Deployed dashboard | β helm-bridge.vercel.app |
MIT. See LICENSE.
