Cloudflare Supports IndexNow via One-click Integration

IndexNow is an initiative by Microsoft and Yandex to push content to search engines that launched in October 2021. Cloudflare announced that they have partnered with Microsoft Bing and Yandex to support IndexNow, ranking over 60,000 websites. Microsoft and Yandex announced a new initiative named IndexNow, a protocol that any search engine can participate in […]

Topics

  • IndexNow is an initiative by Microsoft and Yandex to push content to search engines that launched in October 2021.

    Cloudflare announced that they have partnered with Microsoft Bing and Yandex to support IndexNow, ranking over 60,000 websites.

    Microsoft and Yandex announced a new initiative named IndexNow, a protocol that any search engine can participate in to enable site owners to have their pages and content instantly indexed by the search engine. Currently, Microsoft Bing and Yandex are the two search engines fully participating in the initiative but others are welcome to adopt this open protocol.

    Also Read: Are You Using Push Notifications? Almost Everyone Is.

    IndexNow allows “websites to easily notify search engines whenever their website content is created, updated, or deleted,” Microsoft wrote on its blog. The goal is to make for a “more efficient Internet,” the company said, by reducing the dependency on search engine spiders having to go out into the web and crawl each URL they find.

    According to a Microsoft blog, here is how the new integration will work. To power experiences that rely on indexing content from across the web, search engines operate networks of bots that crawl the Internet to identify the content most relevant to a user query. But because content on the web is always changing, and there is no central clearinghouse for when these changes happen on websites, search engine crawlers have a Sisyphean task. They must continuously wander the Internet, trying to find out how frequently they should check a given site for updates to its content.

    Companies that run search engines have worked hard to make the process as efficient as possible, pushing the state-of-the-art for crawl cadence and infrastructure efficiency. But there remains one clear area of waste: excessive crawl.

    Topics

    More Like This