JobSignal — HN Job Board
Multi-agent pipeline with schema validation & eval gates · jobsignal.dev
1.The Challenge
Hacker News hiring posts are unstructured and noisy. Manual scanning is slow, and existing job boards lack structured signal extraction, causing catastrophic hallucinations in multi-step processing and unsustainable API cost overhead.
2.The Solution
Built a custom code-driven 4-agent pipeline (structure, research, match, decision) without heavy frameworks like LangChain to guarantee absolute execution flow control. Integrated rules, schema validators, and verifiers at each stage, with a golden-set eval gate tracking release accuracy (93% → 97% → 97.3%). Tavily powers web-search tool calling. Implemented cost-throttling switches for research steps to prevent API cost spikes. Next.js frontend with SQLite storage.
3.The Impact
Live at jobsignal.dev with 13K+ GSC impressions. Structured filtering and exploration that raw HN threads cannot provide. A user job_corrections feedback loop closes the quality cycle alongside golden-set eval gates.