If you want Claude to be able to reach and reference your content, allow ClaudeBot in robots.txt and make sure no WAF rule blocks it. Blocking it keeps your pages out of Anthropic's crawl.
As with other AI crawlers, the most common reason ClaudeBot cannot reach a site is an unintended bot-management rule, not a deliberate robots.txt block.