We've moved.
Visit our new home for news and updates from AdSense
Inside AdSense
Google's official blog for news, tips and information on AdSense.
I, Robots.txt
otrdiena, februāris 07, 2006
Often when troubleshooting targeting inquiries, we find that publishers have unknowingly blocked the
Googlebots
from crawling sections of their site, resulting in PSAs or mistargeted ads. With the newest release of
Google Sitemaps
, you can get a report that shows you Googlebot's view of your
robots.txt file
.
In addition to general status updates such as the last time Googlebot downloaded your robots.txt file, this new report allows you to test specific URLs to see if your robots.txt file is blocking them from the MediaPartners Googlebot, the Google content crawler. Plus, you can test changes to your robots.txt file against other Google crawlers (e.g., search or image) or the Robots Standard. This way you can experiment with changes to see how they would impact the crawl of your site, as well as make sure there are no errors in the file, before making changes to the file on your site.
Learn more
about this recent release on the Google Sitemaps Blog.
Still not sure if Sitemaps can really help you? Check out the newest Sitemaps
success story
showcasing fellow AdSense publisher ApartmentRatings.com.
Posted by Shaluinn Fullove - Sitemaps Product Marketing
Iezīmes
#GlobalSpotlight
2
#SuccessStack
9
Active View
9
Ad formats
22
Ad layout
6
Ad Placement
2
AdSense
5
AdSense Anniversary
15
AdSense features
231
adsense guide
14
AdSense In Your City
22
AdSense Interface
61
AdSense Team
31
AdSense101
13
AMP
3
AskAdSense
4
Audience Engagement
4
Beginner's
1
Best Practice
22
Beta
1
Case studies
99
Certified Partners
4
Content strategy
23
DoubleClick
17
download
3
Earnings/Reports
70
eBook
3
Education
4
engagement
1
Facts and Fiction
11
FAQs
1
Feedback
10
Google Analytics
7
Google's Certified Publishing Partner
3
googlenew
13
Guest Blogger
4
Help
2
How to avoid policy violations
1
India
1
infographic
3
International
118
YouTube
3
Learn with Google for Publishers
17
Matched content
6
micro-moments
5
Mobile
67
Mobile optimization
3
Multi-Screen
32
Native
1
native ads
4
Newbie
32
Optimal ad placement
1
Optimization
165
Other
245
Other Google products
106
Page-Level
1
PageSpeed
10
Payments
62
Pakistan
1
Passion into profit
8
Policy
2
Pop-Unders
1
Pop-Ups
1
Product update
11
Program Policies
79
Programmatic
1
Social
19
Support
10
Tips
37
Urdu
1
User Generated Content
1
Video
41
Viewability
13
Webinars
15
Archive
2019
okt.
sept.
aug.
jūl.
maijs
febr.
janv.
2018
dec.
nov.
okt.
aug.
jūn.
maijs
apr.
marts
febr.
janv.
2017
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2016
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2015
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2014
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2013
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2012
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2011
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2010
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2009
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2008
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2007
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2006
dec.
nov.
okt.
sept.
aug.
jūl.
jūn.
maijs
apr.
marts
febr.
janv.
2005
dec.
nov.
okt.
sept.
aug.
Feed
Subscribe to receive posts via email:
Visit this group
Follow @adsense
Useful links
Get started with AdSense
Sign in to your account
AdSense Help Center
AdSense Help Forum
Related Google products
AdMob: Monetize your app
DoubleClick for Publishers Small Business
Google AdWords
Google Analytics
Give us feedback in our
Product Forums
.