Blog
Mauricio Rodriguez
-
How to Check the Backlinks of Any Website for Free (6 Methods)
Six free ways to see the backlinks of your own site or a competitor’s: Google Search Console, Bing Webmaster Tools, the free versions of the big SEO tools…
-
Training Bots vs Search Bots: What Blocking Each One Really Does
GPTBot and OAI-SearchBot, ClaudeBot and Claude-SearchBot: AI companies run separate crawlers for training and search. Here is what happens when you block each one.
-
What Is llms.txt? Guide, Format and Examples
llms.txt is a Markdown file that gives AI assistants a curated map of your website. Learn the format, see real examples and decide whether you need one.
-
Should You Block AI Bots? A robots.txt Guide for Every Type of Website
Blocking AI crawlers can protect your content or cost you visibility in ChatGPT, Claude and Perplexity. Here is how to decide, with ready-to-use robots.txt rules.
-
The Complete List of AI Crawlers and User Agents (2026)
Every major AI crawler in one place: who runs it, what it does, its robots.txt token and whether blocking it affects your visibility in AI answers.