Apple has finally confirmed that they have a web crawler, Applebot which is chiefly used for Siri and Spotlight Suggestions.
Applebot is the in-house web crawler of Apple that is used to help services like Siri and Spotlight on iOS and OS X platforms. Apple has also posted a help document, confirming about its web crawler, Applebot, “Applebot is the web crawler for Apple, used by products including Siri and Spotlight Suggestions. It respects customary robots.txt rules and robots Meta tags. It originates in the 17.0.0.0 net block.
User-agent strings will contain “Applebot” together with additional agent information. For example:
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1)
If robots instructions don’t mention Applebot but do mention Googlebot, the Apple robot will follow Googlebot instructions.”
A web crawler is an internet bot which is used by search engines that automatically scans and browse the webpages for indexing of information. You can exclude Applebot from searching your site by updating the robots.txt file on your site. AppleBot works similarly to Google’s Googlebot, and Apple instructed developers that it will follow Googlebot instructions if no AppleBot specific instructions are found.
Website managers can contact Apple’s network operations center if they have query or concerns about the crawler, Applebot.
Related Posts...
Social Media UpdatesWhat's Hot
Jan 30th, 2024
There are so many e-commerce platforms these days that it can be rather hard for an uninitiated business owner to make the right decision. However, any experienced business owner will […]
Read more
Nov 16th, 2023
A spearheading revolutionary move in artificial intelligence, OpenAI has propelled its widely acclaimed ChatGPT into a new era of real-time internet browsing. Breaking free from the shackles of a time-bound […]
Read more
Aug 11th, 2023
Celebrate this Independence Day with a touch of technological empowerment! As a tribute to the spirit of freedom, Singsys is thrilled to offer an exclusive 15% discount on all our […]
Read more