
Apple is Using 'Applebot' to Crawl the Web for Siri and Spotlight
Posted May 6, 2015 at 2:40pm by
Shalom Levytam
Apple has revealed that it is using 'Applebot' to crawl the web for Siri and Spotlight Suggestions in a newly modified support document.
Applebot respects customary robots.txt rules and robots meta tags and originates in the 17.0.0.0 net block.
It's user-agent strings will contain “Applebot” together with additional agent information.
For example:
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1)
If robots instructions don't mention Applebot but do mention Googlebot, the Apple robot will follow Googlebot instructions.
If you have questions or concerns about the Applebot you can find contact information at the link below.
Read More [via AppleInsider]

Applebot respects customary robots.txt rules and robots meta tags and originates in the 17.0.0.0 net block.
It's user-agent strings will contain “Applebot” together with additional agent information.
For example:
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1)
If robots instructions don't mention Applebot but do mention Googlebot, the Apple robot will follow Googlebot instructions.
If you have questions or concerns about the Applebot you can find contact information at the link below.
Read More [via AppleInsider]

![OpenAI Launches GPT-6.2 Astra and Sol With Better Performance, Lower Costs [Video] OpenAI Launches GPT-6.2 Astra and Sol With Better Performance, Lower Costs [Video]](/images/news/103626/103626/103626-160.jpg)

![iFixit Finds Apple HomeView Unnecessarily Difficult to Repair [Video] iFixit Finds Apple HomeView Unnecessarily Difficult to Repair [Video]](/images/news/103617/103617/103617-160.jpg)


![How To Back Up Your iPhone to an External Drive on Mac [Video] How To Back Up Your iPhone to an External Drive on Mac [Video]](/images/tutorials/72786/72786/72786-160.jpg)
![How To Sideload Apps Onto Your iPhone Using Xcode [Video] How To Sideload Apps Onto Your iPhone Using Xcode [Video]](/images/tutorials/52314/52314/52314-160.jpg)
![How To Find Your IP Address on iPhone [Video] How To Find Your IP Address on iPhone [Video]](/images/tutorials/496/496/496-160.jpg)


![MacBook Neo Drops to $649.99 ($49 Off) [Deal] MacBook Neo Drops to $649.99 ($49 Off) [Deal]](/images/news/103599/103599/103599-160.jpg)
![15-Inch M5 MacBook Air Drops to $1,249.99 ($249 Off) [Deal] 15-Inch M5 MacBook Air Drops to $1,249.99 ($249 Off) [Deal]](/images/news/103563/103563/103563-160.jpg)
![Apple Watch Series 12 Drops to New All-Time Low of $329 ($70 Off) [Deal] Apple Watch Series 12 Drops to New All-Time Low of $329 ($70 Off) [Deal]](/images/news/103548/103548/103548-160.jpg)
![AirPods Pro 3 Drop Back to $179.99 ($69 Off) [Deal] AirPods Pro 3 Drop Back to $179.99 ($69 Off) [Deal]](/images/news/103545/103545/103545-160.jpg)
