Quick Tip: When AI Agents Get Blocked by AWS Managed Rules

lakil00
Quick Tip: When AI Agents Get Blocked by AWS Managed Rules TL;DR: OpenAI agent traffic was being blocked by AWS WAF’s Anonymous IP List rule (HostingProviderIPList). The source IP belonged to an Azure range included in the HostingProviderIPList. Bot Control was correctly identifying the same traffic as a verified bot, so the fix was to switch HostingProviderIPList to Count and add a custom rule …

Why My Blog Won't Serve HTML to Bots

lakil00
Why My Blog Won’t Serve HTML to Bots TL;DR: Serving Markdown instead of HTML to verified bots gives you two things: your content gets cited accurately in AI answers, and Data Transfer Out costs drop by 94 %. AWS WAF Bot Control identifies the bots, and CloudFront Functions rewrites the URL. Key Terms: Bot Control Targeted = AWS WAF’s bot detection level combining IP reputation, TLS fingerprinting, …