How It WorksProof
Book a Free Workshop
Deep Case Study

BMARK 2019-B14: The AI Provenance Test

We asked five leading AI models a straightforward question about a real CMBS deal. Every one failed — wrong numbers, stale data, or fabricated answers. The real figures were sitting in SEC filings the whole time. Here's what we found.
The Question

What is the current balance and DSCR for BMARK 2019-B14?

What the LLMs Said

Five models. One question. Zero correct answers.

All responses captured February 20, 2026. LLM answers change over time.
ChatGPT response to BMARK 2019-B14 question — part 1
1
2
ChatGPT response to BMARK 2019-B14 question — part 2
3
ChatGPT response to BMARK 2019-B14 question — part 3
4
1
"I cannot find a current (2025–2026) pool-level unpaid principal balance"Admits defeat in the first sentence. This number is in the latest ABS-EE filing.
2
"~$807 M ... ~2.18x (UW NCF DSCR)"Real numbers — from 2019 origination. Six years stale.
3
"Not publicly available in free sources"Both figures are in the ABS-EE filing. Public data, published monthly.
4
"access a paid CMBS data provider (e.g., Trepp)"ChatGPT's final answer: pay someone else.
STALE
ChatGPT 5.2
ChatGPT returns real numbers — but they're from 2019 origination documents. The $807M balance and 2.18x DSCR are six years out of date. It then admits it can't find current performance data and tells you to pay Trepp.
The Grounding Problem

Every model failed for the same reason.

Not because they're bad at language — because they had no verified source to draw from.The numbers exist in public SEC filings, updated monthly. But without systematic ingestion, extraction, and lineage tracking, AI tools have nothing to ground their answers in. They guess, hallucinate, or punt.We publish these numbers on DealCharts.org. Every one traces back to its source filing.
BMARK 2019-B14 deal metrics on DealCharts.org — Current Trust Amount, DSCR, loans, and properties with full provenance
BMARK 2019-B14 on DealCharts.org — every metric traced to its source filing.View live page
Current Trust Amount$1,157,461,196
ABS-EE filing, Jan 2026
WA DSCR (NCF)1.88x
ABS-EE filing, Jan 2026
Number of Loans48
ABS-EE filing, Jan 2026
Number of Properties171
ABS-EE filing, Jan 2026
Could you fix this with RAG — feed the filing straight into an LLM? You'd get better numbers. But you'd still have no record of which filing was used, which field was extracted, or whether the same question yesterday would have produced the same answer. The hardest problem isn't getting AI to produce a correct number — it's proving that it did.We use AI extensively — for extraction, classification, and anomaly detection. But every number that reaches the catalog passes through deterministic tools that tag it with its source filing, extraction method, and timestamp. That's the difference.
The Ambiguity Problem

Which balance? Which DSCR?

When someone asks for "the current balance" or "the DSCR," there are multiple valid answers. The SEC defines two distinct balance fields — Scheduled and Actual — that differ by whether they reflect amortization terms or legal obligation. The gap is real money. An LLM that doesn't know the difference will give you a number without telling you which one it picked — or worse, mix them up.
Current Balance
Scheduled
Default
$1,157,461,196reportPeriodEndScheduledLoanBalanceAmountThe scheduled or stated principal balance, determined by considering scheduled and unscheduled principal payments received during the collection period.
Actual
$1,159,223,847reportPeriodEndActualBalanceAmountThe outstanding actual balance representing the legal remaining outstanding principal balance related to the borrower's mortgage note.
WA DSCR
NCF-based
WA by Balance1.88x
Default
WA by Count2.01x
 
NOI-based
WA by Balance2.06x
 
WA by Count2.19x
 
CMD+RVL labels every metric precisely and traces it to the specific SEC field it was derived from. The highlighted path is our default — but all variants are available.
LLM Scorecard

Five LLMs. Five questions. One deal.

We asked each model the same five questions about BMARK 2019-B14. Only CMD+RVL's catalog had all five answers — each traced to its source filing. These scores will improve over time — but a correct answer you can't verify is still a compliance gap.Tested February 20, 2026
QuestionChatGPTClaudeGeminiGrokPerplexityCMD+RVL
Current trust balance?
STALE
FAIL
HALLUCINATED
STALE
FAIL
PASS
WA DSCR (NCF)?
STALE
FAIL
HALLUCINATED
STALE
FAIL
PASS
Number of current loans?
STALE
FAIL
HALLUCINATED
FAIL
FAIL
PASS
Largest loan by balance?
FAIL
FAIL
HALLUCINATED
FAIL
FAIL
PASS
Most recent filing date?
FAIL
FAIL
HALLUCINATED
STALE
FAIL
PASS
Pass
Stale
Fail
Hallucinated
Now Multiply
1,185
Active Deals
CMBS and Auto ABS deals monitored with full provenance — every number traced to its SEC filing.
7,385
Charts Published
Live charts across DealCharts.org, each with a complete data lineage trail.
Daily
Update Frequency
New filings ingested, extracted, cataloged, and published — every single day.

These models will get stronger.

The stale answers will become current. The hallucinations will get rarer. But even when the answers are perfect, you'll still need to verify them — and so will your regulators.The scariest failure mode isn't a wrong answer — it's a correct answer with no lineage. That's the one your compliance team can't distinguish from a hallucination.The practice of capturing lineage doesn't become less important as AI improves. It becomes the thing that makes AI auditable.The only question is whether you can build it without too much work, and carry it forward as the technology changes.

Now imagine this on your data.

Your firm is using AI on your data right now. When a regulator, auditor, or board member asks where the answer came from — what do you show them?SCHEDULE A FREE ASSESSMENTFree. No commitment. We connect to your systems and show you what's there.

PRODUCTS

OutcomesData ProductsSignals

EVIDENCE

All Evidence

PRODUCTS

OutcomesData ProductsSignals

EVIDENCE

All Evidence

RESOURCES

How It WorksCalendarDiscoveryWays to WorkFoundationsGlossaryBlog

DEVELOPERS

Tools & Open SourceMachine Data

COMPANY

AboutPartnersContactLogin

CONNECT

GitHubX (Twitter)LinkedIn

MARKETPLACES

AWS MarketplaceSnowflake MarketplaceDatabricks MarketplaceKaggleWhop
© 2026 CMD+RVL. All rights reserved.
Decisions that hold up under scrutiny. Built on open standards.
PrivacyTermsSub-ProcessorsSecurity