Apple is Using 'Applebot' to Crawl the Web for Siri and Spotlight
Posted May 6, 2015 at 2:40pm by
Shalom Levytam
Apple has revealed that it is using 'Applebot' to crawl the web for Siri and Spotlight Suggestions in a newly modified support document.
Applebot respects customary robots.txt rules and robots meta tags and originates in the 17.0.0.0 net block.
It's user-agent strings will contain “Applebot” together with additional agent information.
For example:
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1)
If robots instructions don't mention Applebot but do mention Googlebot, the Apple robot will follow Googlebot instructions.
If you have questions or concerns about the Applebot you can find contact information at the link below.
Read More [via AppleInsider]
Applebot respects customary robots.txt rules and robots meta tags and originates in the 17.0.0.0 net block.
It's user-agent strings will contain “Applebot” together with additional agent information.
For example:
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1)
If robots instructions don't mention Applebot but do mention Googlebot, the Apple robot will follow Googlebot instructions.
If you have questions or concerns about the Applebot you can find contact information at the link below.
Read More [via AppleInsider]
![Apple Releases watchOS 11.6.2 for Apple Watch [Download]](/images/news/99853/99853/99853-160.jpg "Apple Releases watchOS 11.6.2 for Apple Watch [Download]")
![Apple May Keep Current Designs for iPhone 17e and Entry-Level iPad [Report]](/images/news/99850/99850/99850-160.jpg "Apple May Keep Current Designs for iPhone 17e and Entry-Level iPad [Report]")
![iFixit Teardown Reveals AirTag 2 Speaker Can Still Be Disabled [Video]](/images/news/99849/99849/99849-160.jpg "iFixit Teardown Reveals AirTag 2 Speaker Can Still Be Disabled [Video]")
![iPad Air (M3) Drops to Lowest Price of the Year at $489.99 [Deal]](/images/news/99843/99843/99843-160.jpg "iPad Air (M3) Drops to Lowest Price of the Year at $489.99 [Deal]")
![Beats Powerbeats Pro 2 Drop to $199.95 [Deal]](/images/news/99815/99815/99815-160.jpg "Beats Powerbeats Pro 2 Drop to $199.95 [Deal]")
![Apple Watch Series 11 Drops Back to All-Time Low of $299 [Deal]](/images/news/99283/99283/99283-160.jpg "Apple Watch Series 11 Drops Back to All-Time Low of $299 [Deal]")
![Apple AirPods 4 With Active Noise Cancellation Drop to $119 [Deal]](/images/news/99794/99794/99794-160.jpg "Apple AirPods 4 With Active Noise Cancellation Drop to $119 [Deal]")
![AirPods Pro 3 Return to All-Time Low Price of $199 [Deal]](/images/news/99752/99752/99752-160.jpg "AirPods Pro 3 Return to All-Time Low Price of $199 [Deal]")
