What is PressEngineBot?

PressEngine's innovative robots scan and digest video game and entertainment coverage from outlets across the web.

PressEngineBot is the generic name of two types of crawler: an automatic crawler that regularly scans our outlet database for new coverage, and discovers new outlets for coverage, and a manual crawler that will index coverage on request from a PressEngine user.

How does PressEngineBot visit websites?

PressEngineBot reads outlet websites looking for new coverage and content and matches this data with campaigns sent from PressEngine users. As the robot is not a crawler in the traditional sense (it doesn't follow every internal link or any external links), it does not follow robots.txt files.

A PressEngine user may also request to add coverage manually, where they provide a URL for PressEngineBot to read and match data on demand.

What does PressEngineBot collect?

When scanning for new content the bot will look at:

The URL of the page
The title of the page
A summary of the content
Any links from that page to other pages on your website (but only to a maximum of three levels deep)

What the PressEngineBot does not look at

The bot will not scan or collect any information about:

Images or videos on your web pages
Links that go away from your website
Any part of your website that would not normally contain coverage (admin pages, author listing, forums, comments etc.)

The bot will never copy any of your content for republishing.

Verifying PressEngineBot

You can identify PressEngineBot in your access logs with the following user agent(s):

PressEngineBot (+http://pressengine.net/crawl-policy)

The requests made by PressEngineBot may come from the follow IP address(es):

20.0.177.61
20.77.142.177
20.117.101.135
51.105.37.162
51.132.208.31
51.140.46.202
51.140.84.145
51.140.177.236

We continuously update this list as our IP addresses change.

Blocking PressEngineBot from visiting your site

For a user of PressEngine, preventing PressEngineBot from visiting your site may result in lowered coverage ratings. You may be less likely to have review key requests accepted by publishers.

For video game and entertainment outlets, PressEngineBot allows publishers to see the coverage of their upcoming and released titles, and who is promoting them. We believe supporting publishers is important to a healthy and collaborative industry.