Known Bots Site Config (Internal)

Information on Known Bots

Details

The site configuration setting 'put known robots in listen mode’ should be DISABLED for new sites. Disabling this setting will allow the browser to return the same recommendations for a bot as for a user, but it will not impact the models or reporting. This is now the default setting.

Definition

The current list of known bots:

// Google
"Googlebot",
"Mediapartners-Google",
"AdsBot-Google",
// Bing
"bingbot",
"msnbot",
"BingPreview",
// Yahoo!
"YahooSeeker",
"Yahoo! Slurp",
// Baidu (Asian bot)
"Baiduspider",
// Yandex (Russion bot)
"Yandex",
"dwbot"