Empirical Comparison of General-Purpose AI vs Domain-Tuned Plan Intelligence
This benchmark compares a state-of-the-art general-purpose LLM against Foreman AI when applied to real-world construction plan sets. Results reveal a consistent performance gap favoring domain-tuned intelligence.
Technical benchmark report — 136-Page Aspen Estate Plan Intelligence
A controlled evaluation on a complex, multi-wing 136-page architectural plan set across tiny-text evidence, geometry & spatial reasoning, and builder-risk coordination. Efficiency-adjusted result: Foreman AI 109.75 / 115, Perplexity Computer 105.75 / 115.
Nearly one million pages of real construction plans for AI training and evaluation
This publication introduces a dataset of 7,550 construction plan sets totaling 954,892 pages—the first large-scale, vector-native corpus enabling meaningful model training and benchmarking on professional construction documents.