What Claude finds when someone asks for a roofer in Columbus, Ohio
Claude API with web search, 3 runs, 2026-11-03 21:47–21:52 UTC. A snapshot, not a ranking.
We asked Claude the same question three times on November 3, 2026, through the Claude API with web search turned on. It searched all three times, used the same search words each time, and got back the same 8 domains each time. This page lists which sites were in the search results, which were named in the answer, and what we could measure on those pages.
- Question, verbatim: "Who is a good roofing company in Columbus, Ohio?"
- Model and settings: claude-sonnet-5-5 through the Claude API, effort low, web search tool
web_search_20260209limited to 1 search per answer, dynamic filtering on (the default), max_tokens 4000, no system prompt. - Run times (UTC, 2026-11-03): 21:47:33, 21:49:16, 21:51:05.
- Search Claude ran, all 3 runs: "best roofing companies Columbus Ohio reviews"
Which websites did Claude's search return for roofers in Columbus?
The same 8 domains in all 3 runs. Two were named in Claude's answer every time: a Yahoo roundup and Angi's roofer list. The other six were list or directory pages that Claude did not name. No roofing company's own service page was in the results.
| Domain | Page title, as the search returned it | In the search results (runs of 3) | Named in the answer (of those runs) |
|---|---|---|---|
| local.yahoo.com | Best roofers in Columbus, Ohio | 3 | 3 |
| angi.com | 10 Best Roofers in Columbus, OH - Nov 2026 (Verified Reviews) | 3 | 3 |
| 614exteriors.com | Top 10 Roofing Companies in Columbus, Ohio | 3 | 0 |
| entrepreneursofcolumbus.com | 10 Top-Rated Roofers in Columbus, OH | 3 | 0 |
| theroofingbrief.com | Best Roofers in Columbus, OH (2026) | 3 | 0 |
| serviceagent.ai | Repair Roofing in Columbus, Ohio: 15 Top Pros (2027) | 3 | 0 |
| trustanalytica.org | Top Roofing Contractors in Columbus (Oct 2026 Rankings) | 3 | 0 |
| homeadvisor.com | Roofing Install or Repair (two pages: Lewis Center, OH and Sunbury, OH) | 3 | 0 |
"Named in the answer" means the site's or business's name appears in Claude's answer text. The API returned no citation data in these runs, so neither column measures citations.
In all 3 answers, Claude also named eight roofers and credited them to those two pages: Newman Roofing, Ace Roofing, Highmark Renovations and Acme Roofing and Siding to the Yahoo roundup, and Topline, Blackstar, KFX and Prime Service Ohio to Angi. We list them as a record of what the answer said. They are not our recommendations.
What do the listed pages have in common?
They are lists of roofers, not roofers' own pages. 7 of the 9 result titles say "best" or "top", 7 name Columbus, Ohio or OH, and 4 carry a year or month. The two that do neither are HomeAdvisor pages titled "Roofing Install or Repair", for Lewis Center and Sunbury.
One page came from a business site: 614exteriors.com's blog post "Top 10 Roofing Companies in Columbus, Ohio", a list of roofing companies. It was in the search results in all 3 runs and was not named in any answer.
What could we measure on those pages?
5 of the 9 URLs served us the page. All 5 had JSON-LD structured data, and 4 had at least one heading phrased as a question. The other 4 answered our server with HTTP 403 or 429 and are not measured. We fetched each URL from our server on 2026-11-03 between 21:53 and 21:56 UTC, with a Chrome user agent, and read the HTML as served before JavaScript ran.
| Domain | What our server got | JSON-LD types | Question H2/H3 | robots.txt: Claude-SearchBot | robots.txt: ClaudeBot |
|---|---|---|---|---|---|
| local.yahoo.com | page (200) | ItemList, NewsArticle, Organization, Review | 10 | allowed | disallows / |
| angi.com | HTTP 403; not measured | not measured | not measured | allowed | allowed |
| 614exteriors.com | page (200) | Person | 3 | allowed | allowed |
| entrepreneursofcolumbus.com | HTTP 429; not measured | not measured | not measured | allowed | allowed |
| theroofingbrief.com | page (200) | AggregateRating, Article, Dataset, FAQPage, ItemList, Organization | 14 | allowed | allowed |
| serviceagent.ai | page (200) | Article, CollectionPage, Dataset, FAQPage, ItemList, LocalBusiness, Organization | 1 | allowed | allowed |
| trustanalytica.org | page (200) | AggregateRating, FAQPage, ItemList, LocalBusiness, Review | 0 | allowed | allowed |
| homeadvisor.com (2 URLs) | HTTP 403; not measured | not measured | not measured | allowed | allowed |
Of the 5 pages we could read, 4 carried ItemList, 3 FAQPage and 2 LocalBusiness. robots.txt allowed Claude-SearchBot on all 9 URLs.
local.yahoo.com's robots.txt disallows / for ClaudeBot. Its group for Claude-SearchBot disallows some paths, but none that match the roundup's URL. Anthropic says a ClaudeBot restriction signals that a site's future materials should be excluded from its model training data. The Yahoo roundup was in the search results, and named in the answer, in all 3 runs.
Did Claude search the web every time?
For this question, yes: Claude searched in 3 of 3 runs. That does not hold for every question. Anthropic's web search documentation says "Claude determines when to search based on the prompt." When we asked the HVAC version of this question the same way, Claude searched in 0 of 3 runs and answered from general knowledge.
Across all 10 buyer questions in this study, Claude searched in 10 of 30 runs. The questions it did not search are on the hub page.
How do I get my roofing company recommended by AI?
No one can promise it, and this study did not test what causes a mention. What it shows is narrower. On November 3, Claude named eight Columbus roofers, and it credited every one to a Yahoo roundup or Angi's list, not to a roofer's own website.
So two things are worth checking for your own business: what the list pages that come up for your city say about you, and whether Claude's search crawler is allowed to read your site. The second one you can check yourself.
Can Claude's search crawler read your roofing website?
Your robots.txt tells it whether it may: open yourdomain.com/robots.txt and look for a group naming Claude-SearchBot. If that group says Disallow: /, Claude's search crawler is told not to fetch your pages. If no group names Claude-SearchBot, the User-agent: * group applies to it instead, so check that one too.
Anthropic says Claude-SearchBot "navigates the web to improve search result quality" and that disabling it "may reduce your site's visibility and accuracy in user search results." A rule for ClaudeBot is a different choice: it is about training data, as on the Yahoo page above.
The free Corpus Plan audit runs this check for you. Its AI-crawler rules separate answer crawlers (OAI-SearchBot, PerplexityBot, Claude-SearchBot, Applebot) from training crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot and others). It also checks whether your question headings are answered in a first sentence of 40 words or fewer. The checks never ask a model.
Free preview with no account · free account for the full report · up to 20 pages per audit.
Run the free audit on your site · How the audit works
What this does and does not show
- One question, one city, one model, one day: three runs between 21:47 and 21:52 UTC on 2026-11-03. Ask again and the results may change.
- "In the search results" means the URLs the search returned. Anthropic's documentation says that with dynamic filtering, Claude's code filters the search results before they reach its context window. In all 3 runs, the code tried to print 6 results, hit an error, and then printed the first 3,000 characters of the results. That text held only the first 2 results, the Yahoo roundup and Angi's list, the two sites named in every answer. The record does not show Claude reading the other 7 pages in the table.
- The API returned no citation data, so nothing here measures citations.
- This is the Claude API. We did not test the Claude.ai app.
- We measured a state, not a cause. Nothing here shows that a list page, a JSON-LD type or a robots.txt rule makes a site more likely to be found.
- 4 of the 9 URLs answered our server with HTTP 403 or 429 and are not measured.
- It is not a ranking of roofers or of websites.
Same study, other trades: web designers · landscapers · plumbers · all 10 questions
Related: What ChatGPT and Google cite: three measured studies · Does my website show up in ChatGPT?