GEO Technical SEO Audit

GEO Technical SEO Audit

tags: [geo, technical-seo, core-web-vitals, ssr, crawlability, security, performance]

Category: development Source: zubair-trabzada/geo-seo-claude

GEO Technical SEO Audit

What Is This?

The GEO Technical SEO Audit skill provides a comprehensive framework for assessing and scoring the technical SEO health of a website, with a special focus on GEO-specific requirements. Unlike typical SEO audits, this skill is designed to address the unique needs of modern search and AI citation, ensuring that both traditional and AI-driven crawlers can effectively access, crawl, and index your site. The audit covers eight critical categories, including crawlability, indexability, security, performance, server-side rendering (SSR), and AI crawler access. This is essential for websites that require robust search visibility across both human and AI platforms.

Key features include:

  • Evaluation of robots.txt and sitemap.xml for proper crawler instructions
  • Analysis of HTTP headers and page structure for crawlability and indexability
  • Security checks such as HTTPS enforcement and headers
  • Core Web Vitals and overall performance assessment
  • Strict verification of SSR to ensure AI crawlers can access content
  • Explicit checks for AI crawler access in robots.txt

The skill is implemented using a combination of command-line tools (curl, grep, bash) and web fetch utilities, providing a repeatable, scriptable process for technical SEO auditing.

Why Use It?

A technically sound site is the foundation of all search visibility. If your website is not accessible, indexable, or performant, no amount of content optimization or backlink building will compensate. The rise of AI search engines and citation-based retrieval makes technical SEO more important than ever. Many sites inadvertently block AI crawlers in robots.txt or rely on client-side rendering that search bots cannot parse. This skill ensures your site is not only ready for Google and Bing, but also for AI-driven crawlers that rely on raw HTML and HTTP headers.

Reasons to use this skill:

  • Prevent accidental de-indexing by misconfigured robots.txt
  • Maximize visibility in both traditional and AI search engines
  • Ensure compliance with GEO requirements for international sites
  • Detect and resolve performance issues affecting crawl budget and rankings
  • Secure your site against common vulnerabilities that affect SEO

How to Use It

Follow these steps to run a GEO Technical SEO Audit:

  1. Collect URLs: Identify the homepage and 2-3 key inner pages that represent your site’s structure.
  2. Fetch Raw Data: Use curl or WebFetch to download each page and its HTTP headers. For example:
    curl -I https://example.com
curl https://example.com > homepage.html
  3. Run Category Checks: For each URL, assess the following categories:
    • Crawlability (robots.txt, sitemap.xml, HTTP status codes)
    • Indexability (meta robots, canonical tags, noindex directives)
    • Security (HTTPS, security headers)
    • Performance (Core Web Vitals, server response times)
    • Server-Side Rendering (presence of full content in HTML, no reliance on JavaScript for main content)
    • AI Crawler Access (robots.txt rules for GPTBot, CCBot, etc.)
    • Other site-specific technical factors as outlined in the audit rubric
  4. Score Categories: Use the provided rubric to assign points for each check (e.g., 15 points for Crawlability).
  5. Generate Report: Compile your findings into GEO-TECHNICAL-AUDIT.md. Summarize scores, highlight critical issues, and provide actionable recommendations.

Example: Checking robots.txt validity

curl https://example.com/robots.txt
## Look for missing 'User-agent', overly broad 'Disallow', and presence of 'Sitemap:' line

Example: Verifying SSR

curl https://example.com | grep -i "<main"
## The <main> content should be present in raw HTML, not injected by JavaScript

When to Use It

  • Before launching a new site: Ensure technical readiness for search and AI crawlers from day one.
  • After major site updates: Re-audit to catch new technical issues introduced by redesigns, migrations, or platform changes.
  • During ongoing SEO campaigns: Regularly monitor technical health to maintain and improve search rankings.
  • For international or GEO-targeted sites: Verify proper handling of multi-regional configurations and crawler access in different markets.
  • When troubleshooting ranking drops: Technical audits often reveal root causes missed by content-focused reviews.

Important Notes

  • SSR Is Mandatory for AI Search: AI crawlers do not execute JavaScript. Ensure all primary content is available in the server-rendered HTML.
  • AI Crawler Access: Explicitly check robots.txt for rules affecting AI crawlers such as GPTBot, CCBot, and PerplexityBot. Do not assume default rules permit access.
  • Security Best Practices: Enforce HTTPS sitewide and use recommended security headers to avoid SEO penalties and protect users.
  • Performance Matters: Poor Core Web Vitals or slow server response can reduce crawl frequency and hurt rankings.
  • Consistency Across Pages: Audit multiple key pages, not just the homepage, to ensure comprehensive coverage.
  • Scriptability: This skill is designed for command-line automation and can be integrated into CI/CD pipelines.

By following the GEO Technical SEO Audit process, you can systematically identify and resolve technical issues that would otherwise block your site from search visibility and AI citation. This is a foundational skill for any modern web developer, SEO specialist, or site owner concerned with search performance.