Skip to content

Site check and bot log

Can AI crawlers access your website?

Check technical accessibility and inspect recorded bot visits alongside your visibility measurements. Give your web team a specific issue to investigate.

The technical check

AMI checks robots.txt, potential access restrictions, speed and structure for known AI crawlers. A bot log shows the visits that the configured measurement can record.

Access is one part of visibility

An accessible page is not guaranteed to be indexed, cited or recommended. Your website and external publications play different roles. Use the check to find technical obstacles without treating a successful crawl as a ranking result.

Work with your developer

Review the findings per website and share concrete checks with your web team. Decide whether a crawler restriction is intentional before changing it. The AMI site check itself does not edit your website.

Explore the other AMI features

Illustrative example

An illustrative check finds that robots.txt has blocked two AI crawlers since 3 October. Your developer checks the affected rules and confirms whether the restriction should remain.

Which plan includes it?

Available in Groei, Pro and Bureau.

Compare AMI plans

Questions and answers

How often is the check run?

A daily snapshot is available. A manual recheck can be requested at ten-minute intervals.

Will AMI change robots.txt automatically?

No. The findings are advice for your team or developer. Changes need the appropriate access and agreement.

See what AI says about your brand.

Start with the free brand check. Review the saved answers and their sources before choosing your next step.

Free AI brand check