{"id":20874,"date":"2022-07-12T09:25:07","date_gmt":"2022-07-12T08:25:07","guid":{"rendered":"https:\/\/www.improvemysearchranking.com\/?p=20874"},"modified":"2022-07-12T09:25:07","modified_gmt":"2022-07-12T08:25:07","slug":"google-updates-indexation-policy-limits-crawler-to-15-mb-html-content","status":"publish","type":"post","link":"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/","title":{"rendered":"Google Updates Indexation Policy; Limits Crawler To 15 MB HTML Content"},"content":{"rendered":"

In a surprising development, Google has updated its Googebot\u2019s help document and announced that the Googlebot would crawl only the first 15 MB of a web page. It means that anything on the web page beyond that 15 MB cut-off point will not be crawled, indexed, or included in search engine rankings calculations.<\/p>\n

Here is what Google\u2019s updated help document states:<\/p>\n

\u201cAny resources referenced in the HTML such as images, videos, CSS, and JavaScript are fetched separately. After the first 15 MB of the file, Googlebot stops crawling and only considers the first 15 MB of the file for indexing. The file size limit is applied on the uncompressed data.\u201d<\/em><\/p>\n

Google\u2019s John Mueller briefly elaborated on this change and confirmed that this change would only apply to the HTML file itself.<\/p>\n

\u201cIt\u2019s specific to the HTML file itself like it\u2019s written. Embedded resources\/content pulled in with IMG tags is not a part of the HTML file,\u201d<\/em> clarified John Mueller on Twitter.<\/p>\n

What is the potential impact of this change?<\/h2>\n

Theoretically, this change should not affect a large majority of websites. That is because the best SEO practices recommend keeping HTML pages to 100 KB or less. If a website has been following the recommended SEO practices, and the HTML file size is around that 100 KB mark, it should be completely fine and unaffected by this change.<\/p>\n

However, not all websites follow the recommended practices to a T. If you potentially have some important content on a web page beyond the 15 MB cut-off point, it will likely be affected.<\/p>\n

Besides, it may sound theoretically worrisome, but 15 MB is a reasonably big size limit. So most websites should be fine.<\/p>\n

Google PageSpeed Insights<\/h2>\n

\"Google-Pagespeed-insighta\"<\/p>\n

The easiest way to identify if this is going to be an issue for you or not is to use a free tool like Google PageSpeed Insights<\/a> and check the HTML size of your web pages.<\/p>\n

What SEOs and webmasters could do<\/h2>\n

\"SEO-Webmasters\"<\/p>\n

There isn\u2019t much to do except follow the best SEO practices that keep the page size as small as possible.<\/p>\n

If you run into the aforementioned issue, there are two steps you can take:<\/p>\n

    \n
  1. First, make sure that all the important content that you want Google to crawl and index is included near the top of the web page.<\/li>\n
  2. Second, do not encode images and videos directly into the HTML. That\u2019s because, as John Mueller clarified, embedded content that is pulled in with IMG tags wouldn\u2019t be a part of the HTML file and, therefore, won\u2019t be counted when calculating the 15 MB HTML file.<\/li>\n<\/ol>\n

    If you have any questions about this update or how you ensure your website is in proper shape for the best possible SEO results, feel free to contact us.<\/p>\n","protected":false},"excerpt":{"rendered":"

    In a surprising development, Google has updated its Googebot\u2019s help document and announced that the Googlebot would crawl only the first 15 MB of a web page. It means that anything on the web page beyond that 15 MB cut-off point will not be crawled, indexed, or included in search engine rankings calculations. Here is […]<\/p>\n","protected":false},"author":13,"featured_media":20878,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_oct_exclude_from_cache":false,"inline_featured_image":false},"categories":[33,36],"tags":[],"yoast_head":"\nGoogle Updates Indexation Policy; Limits Crawler Content | IMSR<\/title>\n<meta name=\"description\" content=\"Google has updated its Googebot\u2019s help document and announced that the Googlebot would crawl only the first 15 MB of a web page.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Google Updates Indexation Policy; Limits Crawler Content | IMSR\" \/>\n<meta property=\"og:description\" content=\"Google has updated its Googebot\u2019s help document and announced that the Googlebot would crawl only the first 15 MB of a web page.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/\" \/>\n<meta property=\"og:site_name\" content=\"Improve My Search Ranking\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ImproveMySearchRanking\" \/>\n<meta property=\"article:published_time\" content=\"2022-07-12T08:25:07+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.improvemysearchranking.com\/wp-content\/uploads\/2022\/07\/Googleupdates-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1707\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Tesharn\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ImproveMySearch\" \/>\n<meta name=\"twitter:site\" content=\"@ImproveMySearch\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tesharn\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/\",\"url\":\"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/\",\"name\":\"Google Updates Indexation Policy; Limits Crawler Content | IMSR\",\"isPartOf\":{\"@id\":\"https:\/\/www.improvemysearchranking.com\/#website\"},\"datePublished\":\"2022-07-12T08:25:07+00:00\",\"dateModified\":\"2022-07-12T08:25:07+00:00\",\"author\":{\"@id\":\"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/17b149c7d4d8df22952ffc8e105dba4b\"},\"description\":\"Google has updated its Googebot\u2019s help document and announced that the Googlebot would crawl only the first 15 MB of a web page.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.improvemysearchranking.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Google Updates Indexation Policy; Limits Crawler To 15 MB HTML Content\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.improvemysearchranking.com\/#website\",\"url\":\"https:\/\/www.improvemysearchranking.com\/\",\"name\":\"Improve My Search Ranking\",\"description\":\"Improve My Search Ranking\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.improvemysearchranking.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/17b149c7d4d8df22952ffc8e105dba4b\",\"name\":\"Tesharn\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/dd6bab971be0ef968c140ee1d7e9317b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/dd6bab971be0ef968c140ee1d7e9317b?s=96&d=mm&r=g\",\"caption\":\"Tesharn\"},\"url\":\"https:\/\/www.improvemysearchranking.com\/author\/tesharn\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Google Updates Indexation Policy; Limits Crawler Content | IMSR","description":"Google has updated its Googebot\u2019s help document and announced that the Googlebot would crawl only the first 15 MB of a web page.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/","og_locale":"en_GB","og_type":"article","og_title":"Google Updates Indexation Policy; Limits Crawler Content | IMSR","og_description":"Google has updated its Googebot\u2019s help document and announced that the Googlebot would crawl only the first 15 MB of a web page.","og_url":"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/","og_site_name":"Improve My Search Ranking","article_publisher":"https:\/\/www.facebook.com\/ImproveMySearchRanking","article_published_time":"2022-07-12T08:25:07+00:00","og_image":[{"width":2560,"height":1707,"url":"https:\/\/www.improvemysearchranking.com\/wp-content\/uploads\/2022\/07\/Googleupdates-scaled.jpg","type":"image\/jpeg"}],"author":"Tesharn","twitter_card":"summary_large_image","twitter_creator":"@ImproveMySearch","twitter_site":"@ImproveMySearch","twitter_misc":{"Written by":"Tesharn","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/","url":"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/","name":"Google Updates Indexation Policy; Limits Crawler Content | IMSR","isPartOf":{"@id":"https:\/\/www.improvemysearchranking.com\/#website"},"datePublished":"2022-07-12T08:25:07+00:00","dateModified":"2022-07-12T08:25:07+00:00","author":{"@id":"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/17b149c7d4d8df22952ffc8e105dba4b"},"description":"Google has updated its Googebot\u2019s help document and announced that the Googlebot would crawl only the first 15 MB of a web page.","breadcrumb":{"@id":"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.improvemysearchranking.com\/google-updates-indexation-policy-limits-crawler-to-15-mb-html-content\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.improvemysearchranking.com\/"},{"@type":"ListItem","position":2,"name":"Google Updates Indexation Policy; Limits Crawler To 15 MB HTML Content"}]},{"@type":"WebSite","@id":"https:\/\/www.improvemysearchranking.com\/#website","url":"https:\/\/www.improvemysearchranking.com\/","name":"Improve My Search Ranking","description":"Improve My Search Ranking","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.improvemysearchranking.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/17b149c7d4d8df22952ffc8e105dba4b","name":"Tesharn","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.improvemysearchranking.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/dd6bab971be0ef968c140ee1d7e9317b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/dd6bab971be0ef968c140ee1d7e9317b?s=96&d=mm&r=g","caption":"Tesharn"},"url":"https:\/\/www.improvemysearchranking.com\/author\/tesharn\/"}]}},"_links":{"self":[{"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/posts\/20874"}],"collection":[{"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/comments?post=20874"}],"version-history":[{"count":3,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/posts\/20874\/revisions"}],"predecessor-version":[{"id":20890,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/posts\/20874\/revisions\/20890"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/media\/20878"}],"wp:attachment":[{"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/media?parent=20874"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/categories?post=20874"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.improvemysearchranking.com\/wp-json\/wp\/v2\/tags?post=20874"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}