Report generated: 2026-10-22T07:59:06.487Z. Named assertions on public research calls and generated English PDF fixtures. Failing checks remain visible. No general benchmark ranking, customer success rate or scanned-document accuracy claim.
Dated task assertions
Only the assertion below was checked. Local PDF tests use generated English documents. These results do not measure customer success, OCR accuracy or future availability. Tests older than 30 days do not count as a recent pass in task planning.
Passed · microsoft-lifecycle-v1
Official Microsoft documentation URL and lifecycle topic returned.
2026-10-22T03:50:08.281Z · public_read_only_task · 3091 ms (single check)
One public query on one date. No private data, paid credentials, answer-quality evaluation or reliability percentage.svc_official_microsoft_learn connection plan
Passed · cloudflare-cpu-v1
Official Cloudflare documentation URL and CPU topic returned.
2026-10-22T03:50:21.486Z · public_read_only_task · 13196 ms (single check)
One public query on one date. No private data, paid credentials, answer-quality evaluation or reliability percentage.svc_official_cloudflare_docs connection plan
Passed · sdk-repository-structure-v1
A non-empty repository documentation outline returned; not a code correctness test.
2026-10-22T03:50:23.696Z · public_read_only_task · 2207 ms (single check)
One public query on one date. No private data, paid credentials, answer-quality evaluation or reliability percentage.svc_official_deepwiki connection plan
Passed · mcp-primary-source-v1
Search returned a modelcontextprotocol.io source URL for the MCP tools specification.
2026-10-22T03:50:27.818Z · public_read_only_task · 4121 ms (single check)
One public query on one date. No private data, paid credentials, answer-quality evaluation or reliability percentage.svc_official_exa connection plan
Passed · pdf-text-english-v1
Extracted exact row text from a selectable-text PDF. English fixture only.
2026-10-22T03:50:28.293Z · generated_public_test_document
Generated fixture only; not a customer document.svc_evident_pdf_local connection plan
Passed · pdf-fixed-columns-v1
All 9 cells equal expected text in a simple 3-column fixture with caller-supplied boundaries.
2026-10-22T03:50:28.300Z · generated_public_test_document
Generated fixture only; not a customer document.svc_evident_pdf_local connection plan
Passed · no-text-rejection-v1
A page without a text layer is marked OCR_REQUIRED, never a successful extraction. This is a rejection test, not OCR capability.
2026-10-22T03:50:28.308Z · generated_public_test_document
Generated fixture only; not a customer document.svc_evident_pdf_local connection plan
Passed · mixed-pages-v1
Preserved extracted text and flagged the second page without a text layer.
2026-10-22T03:50:28.316Z · generated_public_test_document
Generated fixture only; not a customer document.svc_evident_pdf_local connection plan
Passed · bad-columns-v1
Rejected reversed column boundaries.
2026-10-22T03:50:28.316Z · generated_public_test_document
Generated fixture only; not a customer document.svc_evident_pdf_local connection plan
Passed · crossref-public-metadata-v1
The public query returns a work with a DOI, title and HTTPS source URL.
2026-10-22T07:59:05.419Z · public_read_only_task · 1109 ms (single check)
One query checks metadata fields only. No full-text extraction, source quality, general relevance or reliability claim.svc_official_crossref connection plan
Passed · arxiv-atom-metadata-v1
The public query returns an Atom entry with a title and arXiv identifier.
2026-10-22T07:59:06.486Z · public_read_only_task · 1066 ms (single check)
One query checks metadata fields only. No full-text extraction, source quality, general relevance or reliability claim.svc_official_arxiv connection plan
JSON test report