We've moved.
Visit our new home for news and updates from AdSense
Inside AdSense
Google's official blog for news, tips and information on AdSense.
Run, don't crawl, to the new Site Diagnostics page
Friday, July 21, 2006
If you've ever wondered whether our crawler is able to reach all of your pages, you should try out the new Site Diagnostics tool. To determine the meaning of your site and show relevant ads, our crawlers need to be able to access your pages. Site Diagnostics enables you to see some of the errors our crawler finds while it's crawling. You can find the
Site Diagnostics
page listed under the
Reports
tab of your account.
If our crawler is having trouble reaching any of your pages, you'll see those URLs listed in the
Blocked URLs
section of the Site Diagnostics table. At the moment, we're displaying two types of errors:
URL not found – this means our crawler wasn't able to reach your pages, most likely because your server was temporarily down
Robots.txt file – this indicates that your robots.txt file was blocking our crawler from visiting
For help resolving either of these issues, just head over to the
the AdSense Help Center
. You can also access more general
information about our crawler
.
If you don't see any errors listed on your Site Diagnostics page but still want to improve the relevance of your Google ads, visit the following entries:
Why are my ads not relevant?
Why am I getting PSAs?
Posted by Nikhil Achwal - AdSense Publisher Support
Labels
#GlobalSpotlight
2
#SuccessStack
9
Active View
9
Ad formats
22
Ad layout
6
Ad Placement
2
AdSense
5
AdSense Anniversary
15
AdSense features
231
adsense guide
14
AdSense In Your City
22
AdSense Interface
61
AdSense Team
31
AdSense101
13
AMP
3
AskAdSense
4
Audience Engagement
4
Beginner's
1
Best Practice
22
Beta
1
Case studies
99
Certified Partners
4
Content strategy
23
DoubleClick
17
download
3
Earnings/Reports
70
eBook
3
Education
4
engagement
1
Facts and Fiction
11
FAQs
1
Feedback
10
Google Analytics
7
Google's Certified Publishing Partner
3
googlenew
13
Guest Blogger
4
Help
2
How to avoid policy violations
1
India
1
infographic
3
International
118
Learn with Google for Publishers
17
Matched content
6
micro-moments
5
Mobile
67
Mobile optimization
3
Multi-Screen
32
Native
1
native ads
4
Newbie
32
Optimal ad placement
1
Optimization
165
Other
245
Other Google products
106
Page-Level
1
PageSpeed
10
Pakistan
1
Passion into profit
8
Payments
62
Policy
2
Pop-Unders
1
Pop-Ups
1
Product update
11
Program Policies
79
Programmatic
1
Social
19
Support
10
Tips
37
Urdu
1
User Generated Content
1
Video
41
Viewability
13
Webinars
15
YouTube
3
Archive
2019
Oct
Sep
Aug
Jul
May
Feb
Jan
2018
Dec
Nov
Oct
Aug
Jun
May
Apr
Mar
Feb
Jan
2017
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2016
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2015
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2014
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2013
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2012
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2011
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2010
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2009
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2008
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2007
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2006
Dec
Nov
Oct
Sep
Aug
Jul
Jun
May
Apr
Mar
Feb
Jan
2005
Dec
Nov
Oct
Sep
Aug
Feed
Subscribe to receive posts via email:
Visit this group
Follow @adsense
Useful links
Get started with AdSense
Sign in to your account
AdSense Help Center
AdSense Help Forum
Related Google products
AdMob: Monetize your app
DoubleClick for Publishers Small Business
Google AdWords
Google Analytics
Give us feedback in our
Product Forums
.
