techcrunch.com

Ranked #6 of 300 on the Leaderboard. Analyzed .

Index Quotient

85.82

See it on the LeaderboardAnalyze again
97.82
Technical
77.88
Content
77.24
Answers
85.53
AI
90.64
Authority

Technical Health

97.82

Whether search engines can fetch, trust, and quickly load the site.

Strengths

  • CrawlabilityStrong

    Crawlers are welcome here: a sitemap points the way, links work, and pages are allowed into the index.

  • SpeedStrong

    Pages load quickly, and the server answers fast.

  • URL and canonical hygieneStrong

    URLs are clean and consistent, each page has one address, and missing pages say so.

Opportunities

Nothing stands out to work on here.

Content Quality

77.88

Whether pages say clearly what they are about, in a form machines can read.

Strengths

  • Depth and readabilityStrong

    Pages say enough to be useful, in plain language, and stay on the topic their titles promise.

  • HeadingsStrong

    Each page has one main heading, with subheadings in a sensible order beneath it.

  • FreshnessStrong

    Something here was published or updated recently, and the site says when.

Opportunities

  • Titles and descriptionsPartial

    Titles are mostly in place; descriptions and link previews are patchier, and each page wants ones of its own.

  • Images and linksPartial

    Pages link to one another, though some images lack a description and some link text says "read more" rather than where it leads.

Answer Readiness

77.24

Whether content is shaped and marked up so an engine can lift a direct answer.

Strengths

  • Structured dataStrong

    Pages carry structured data of the kinds engines use, filled in properly, and the site says its own name in it.

  • Navigation aidsStrong

    Interior pages show where they sit in the site, and say so in a way engines can read.

Opportunities

  • Question-and-answer shapePartial

    Some headings are questions with an answer beneath them; more of them, each followed by a short direct answer, is what an answer engine lifts.

  • Scannable formattingPartial

    Pages are partly scannable; opening with a short summary, and putting facts in lists and tables, makes them easier to lift from.

AI Visibility

85.53

Whether AI systems can reach, read, and confidently identify the site.

Strengths

  • IdentityStrong

    It is clear who is behind this site, on its pages, in its markup, and in the public record.

  • Readable without JavaScriptStrong

    The content is in the page itself, marked out from the navigation, and written in prose a machine can lift.

  • Authorship and sourcingStrong

    Articles carry an author and a date, and the content points to its sources.

Opportunities

  • AI accessPartial

    AI systems are partly allowed in: some crawlers are blocked, or pages limit how much of them may be quoted.

Authority

90.64

Whether the wider web vouches for the site.

Strengths

  • BacklinksStrong

    Plenty of other sites link here, including ones that matter.

  • TrafficStrong

    The site has a large audience.

  • Domain historyStrong

    The domain has a long history, and history counts.

Opportunities

Nothing here to work on. The points left are the ones only the web's largest sites earn.

Nearby on the Leaderboard

  1. #5wikihow.com85.83
  2. #6techcrunch.com85.82
  3. #7duke.edu85.58

Scores reflect what IndexBot could read from techcrunch.com's available pages on .

IndexBot

IndexBot is the crawler behind SEO Leaderboard. It visits a website only when someone submits that domain, reads it the way a search engine would, and leaves.

What it does

  • Fetches the homepage, robots.txt, the sitemap, and up to 24 more pages, at most four at a time.
  • Reads raw HTML only. It runs no JavaScript and loads no images, fonts, or scripts.
  • Visits a domain at most once every 24 hours, however many people submit it.
  • Stores what it measured, never full copies of pages.

How it identifies itself

Mozilla/5.0 (compatible; IndexBot/1.0; +https://seoleaderboard.com/bot)

How to let it in

Bot protection often turns IndexBot away before it reads anything, and the domain then cannot be scored. If you run the site, allow the User-Agent IndexBot. In Cloudflare that is a WAF skip rule; most other tools have the same idea under a different name.

(http.user_agent contains "IndexBot")

IndexBot has no fixed IP range to allow instead, so the User-Agent is the only thing to match on. It never tries to disguise itself as a browser, and the limits above are the whole of what it asks for.

How to keep it out

IndexBot obeys robots.txt. Add this and it will not read your site, and your domain cannot be scored.

User-agent: IndexBot
Disallow: /

Questions

Write to bot@seoleaderboard.com.