Consumers set up a blockbuster holiday season at the Box Office
A crawler, also known as a spider or a bot, is the software Comscore uses to visit and access the content of webpages.
The Comscore crawler:
Here are answers to the most common questions. If you need to know more, please contact us.
Mozilla/5.0 (compatible; proximic; +https://www.comscore.com/Web-Crawler)
User-agent: proximic Disallow:
www.forum.com/showthread.php?t=123
www.forum.com/showthread.php?
User-agent: proximic Disallow: /path/
User-agent: proximicCrawl-Delay: 2