Utilisation de fichier robots.txt et autres méthodes de blocage des url
Ces conseils font parties du guide SEO pour apprendre a référencer un site Web, Le fichier robots est utilisé pour demander aux moteurs de recherche de ne pas explorer certains pages. Toutefois ce fichier n’empêche pas l’indexation dans Google.
Pour empêcher l’affichage de contenu dans les résultats de recherche, il faut utiliser d’autres méthodes notamment avec l’attribut rel= »noIndex ».
– Utilisez un fichier robots.text pour empêcher l’exploration de certaines pages de votre site
– Utilisez un fichier .htaccess pour protéger par mot de passe vos répertoires
– Utilisez l’outil Google pour les webmasters pour supprimer du contenu ayant déjà fait l’objet d’une exploration
Notes : Google recommande de contrôler l’information que les robots doivent explorer ou pas !
1. Évitez d’autoriser l’exploration de pages ressemblant à une page des résultats de recherche
2. Évitez d ’autoriser l’exploration d’un grand nombre de pages générées automatiquement
3. Évitez d ’autoriser l’exploration de pages contenant le même contenu ou du contenu très similaire.
l’attribut rel= »Nofollow »
Cette valeur sert à combattre le spam. En l’utilisant, vous indiquez à Google de ne pas suivre le lien ou de ne pas transmettre la popularité de votre page aux autres pages vers lesquelles des liens renvoient.
– Utilisez-là sur les commentaires publics de votre site
– Utilisez-là pour interdire de suivre les liens ajoutés par les utilisateurs.
– Utilisez-là pour éviter de transmettre votre réputation aux sites.
– Utilisez-là pour ne pas garantir un contenu
– Utilisez-là pour les liens payants
– Utilisez-là sur les liens du type « inscrivez-vous ici » ou « se connecter »
Il est précisé par Google que la balise meta <meta name= »robots » content= »nofollow » />
indique de ne pas suivre les liens sortants. Il est dit également que « Google ne transfère pas le classement PageRank ni le texte d’ancrage à travers ces liens. »
Notes : Google conseille de ne pas se focaliser sur les priorités d’exploration via les liens non suivis. Ce que l’on appelle le pagerank sculpting.
87 réflexions sur “Bloquer l'Indexation de pages : Fichier robots.txt – Guide SEO”
Hey there! I’m at work surfing around your blog from my new iphone 3gs!
Just wanted to say I love reading your blog and look forward
to all your posts! Keep up the excellent
Greetings I am so grateful I found your blog page, I really
found you by accident, while I was browsing on Bing for something else, Anyhow I am here now and would just like to say
kudos for a fantastic post and a all round exciting blog
(I also love the theme/design), I don’t have time to look over it all at the minute
but I have bookmarked it and also added your RSS feeds, so when I have time I will be back to read
much more, Please do keep up the superb job.
Every weekend i used to visit this website, for
the reason that i want enjoyment, for the reason that this this website conations really
fastidious funny data too.
Howdy just wanted to give you a quick heads up. The text in your post seem to be running off the screen in Opera.
I’m not sure if this is a format issue or something to do with
internet browser compatibility but I figured I’d post to let you know.
The design and style look great though! Hope you get the issue resolved soon. Many thanks
I’m not sure why but this weblog is loading incredibly slow for me.
Is anyone else having this problem or is it a problem on my end?
I’ll check back later on and see if the problem still exists.
Nice blog here! Also your web site loads up very fast!
What web host are you using? Can I get your affiliate
link to your host? I wish my web site loaded up as fast as yours lol
After I initially commented I appear to have clicked on the -Notify me when new comments are added- checkbox and now each
time a comment is added I recieve four emails with the exact
same comment. There has to be an easy method you are able to remove me from that service?
An impressive share! I have just forwarded this onto a co-worker who
has been conducting a little research on this. And he in fact bought me lunch because
I found it for him… lol. So allow me to reword this….
Thanks for the meal!! But yeah, thanx for spending some time to discuss this topic here on your website.
Good day! This post couldn’t be written any better!
Reading through this post reminds me of my previous room mate!
He always kept chatting about this. I will forward this write-up to him.
Fairly certain he will have a good read.
Many thanks for sharing!
I was able to find good info from your articles.
Hi there all, here every one is sharing such knowledge,
therefore it’s pleasant to read this webpage, and I used to pay a quick visit this
Admiring the time and energy you put into your blog and detailed
information you provide. It’s nice to come across a blog every once in a while that isn’t the same old
rehashed information. Fantastic read! I’ve bookmarked your site and I’m
adding your RSS feeds to my Google account.
Hey There. I found your blog using msn. This is a really well
written article. I will make sure to bookmark it and come back to read more of your useful info.
Thanks for the post. I’ll definitely comeback.
What’s up, all the time i used to check blog posts here in the early hours in the morning,
for the reason that i enjoy to find out more and more.
It’s actually a great and helpful piece of info. I’m
happy that you shared this useful information with us.
Please keep us informed like this. Thank you for sharing.
I must thank you for the efforts you have put in writing this site.
I really hope to check out the same high-grade blog posts by
you in the future as well. In fact, your creative writing abilities has
encouraged me to get my very own blog now 😉
Pretty nice post. I just stumbled upon your blog and wanted to say
that I have really enjoyed browsing your blog posts.
After all I will be subscribing to your feed and I
hope you write again soon!
You made some decent points there. I looked on the net to
find out more about the issue and found most individuals will go along with your views on this web
If you would like to get a great deal from this piece of writing then you have to apply
such techniques to your won blog.
Good day! Do you use Twitter? I’d like to follow you if that would be ok.
I’m definitely enjoying your blog and look forward to new updates.
Pretty section of content. I just stumbled upon your weblog and in accession capital to assert that I get actually
enjoyed account your blog posts. Anyway I’ll be subscribing to your augment and even I achievement
you access consistently rapidly.
Thanks for ones marvelous posting! I quite enjoyed reading it, you
could be a great author. I will make certain to bookmark your
blog and definitely will come back at some point.
I want to encourage continue your great job, have
a nice day!
Good day! I know this is kinda off topic but
I was wondering if you knew where I could
find a captcha plugin for my comment form? I’m using the same blog platform as yours and I’m
having trouble finding one? Thanks a lot!
What’s Going down i’m new to this, I stumbled upon this I have discovered It absolutely useful and it has aided me out loads.
I hope to give a contribution & help other users like its
aided me. Great job.
of course like your web site however you need to check the spelling on quite a few of your posts.
A number of them are rife with spelling problems and
I to find it very troublesome to inform the reality on the other hand I
will certainly come again again.
This paragraph will assist the internet viewers for building up
new web site or even a weblog from start to end.
Hi, this weekend is good designed for me, as this point in time i
am reading this great educational paragraph here at my home.
WOW just what I was searching for. Came here by searching for Hrvatski Telekom telefonski imenik | Telefonski i poslovni imenik
It’s going to be end of mine day, except before end
I am reading this wonderful post to improve my experience.
Excellent beat ! I wish to apprentice at the same time as you amend your web
site, how could i subscribe for a blog site? The account helped me a applicable deal.
I had been a little bit acquainted of this your broadcast offered brilliant transparent concept
I’m now not certain the place you are getting your info, but great topic.
I needs to spend a while studying much more or working out
more. Thank you for magnificent info I was on the lookout for this
info for my mission.
What i don’t realize is actually how you’re not actually a lot
more smartly-appreciated than you might be right now.
You’re so intelligent. You realize thus considerably on the subject of this subject, made me individually imagine it
from a lot of numerous angles. Its like men and women don’t
seem to be interested except it is something to accomplish with Woman gaga!
Your individual stuffs excellent. At all times handle it up!
Hi to all, how is all, I think every one is getting more from this web page, and
your views are nice for new viewers.
I visited several web sites however the audio feature for
audio songs current at this website is truly excellent.
Amazing things here. I’m very happy to see
your article. Thank you a lot and I’m having a look forward to contact
you. Will you kindly drop me a e-mail?
naturally like your website but you need to take a look at the spelling on several of your posts.
Many of them are rife with spelling issues and I to find it very bothersome to inform the
reality then again I’ll certainly come again again.
Thanks for one’s marvelous posting! I really enjoyed reading it, you could be a great author.
I will make certain to bookmark your blog and will eventually
come back later on. I want to encourage yourself to continue your
great job, have a nice day!
Excellent web site you’ve got here.. It’s difficult to find high quality writing like yours
nowadays. I seriously appreciate individuals like you!
Have you ever considered creating an e-book or guest authoring
on other websites? I have a blog centered on the
same ideas you discuss and would really like to have you share some stories/information. I know
my audience would value your work. If you’re even remotely
interested, feel free to send me an e mail.
I’m not positive the place you are getting your info, however good
topic. I must spend a while studying much more or figuring out more.
Thanks for wonderful information I was on the lookout for this info for my
I know this web site offers quality dependent articles or reviews and extra
data, is there any other website which gives these kinds of data in quality?
hey there and thank you for your info – I’ve certainly
picked up anything new from right here. I did however expertise a few technical
issues using this web site, since I experienced to reload the site a lot of
times previous to I could get it to load properly. I had been wondering if your hosting is OK?
Not that I am complaining, but slow loading instances times will
very frequently affect your placement in google and could damage your high-quality score
if advertising and marketing with Adwords. Anyway I’m adding this RSS to my email and
could look out for a lot more of your respective exciting content.
Make sure you update this again very soon.
Heya! I realize this is somewhat off-topic however I needed to ask.
Does running a well-established blog like yours take a lot of work?
I am brand new to running a blog but I do write
in my diary everyday. I’d like to start a blog so I can easily share my own experience and thoughts online.
Please let me know if you have any kind of ideas or tips for brand
new aspiring bloggers. Thankyou!
Thanks for sharing your thoughts on 電話番号検索・情報 | 定番サイトJAPAN.
Hi mates, how is all, and what you want to say about this post, in my view its truly remarkable in favor of me.
Wonderful blog! I found it while searching on Yahoo News.
Do you have any tips on how to get listed in Yahoo News?
I’ve been trying for a while but I never seem to get there!
Fabulous, what a website it is! This web site provides helpful facts to us, keep it up.
This is a topic that’s near to my heart… Many thanks!
Exactly where are your contact details though?
You made some really good points there.
I looked on the net for more info about the issue and found
most people will go along with your views on this site.
When some one searches for his required thing, therefore he/she desires to
be available that in detail, thus that thing is maintained over here.
Awesome blog! Do you have any hints for aspiring writers?
I’m hoping to start my own website soon but I’m a little lost
on everything. Would you advise starting with a free platform like WordPress or
go for a paid option? There are so many options out there that I’m totally confused
.. Any suggestions? Cheers!
Excellent post. I was checking continuously this blog and I am impressed!
Extremely useful info specially the last part 🙂 I care for such information a
lot. I was looking for this certain information for a very long
time. Thank you and best of luck.
I just like the helpful information you provide in your articles.
I will bookmark your blog and test again here regularly.
I’m somewhat certain I’ll be told many new stuff
proper here! Good luck for the next!
Hey There. I found your weblog the use of msn. This is a very smartly written article.
I’ll make sure to bookmark it and return to read extra of
your useful information. Thanks for the post. I’ll definitely comeback.
Way cool! Some extremely valid points! I appreciate you writing this write-up
and also the rest of the site is also very good.
Spot on with this write-up, I truly think this amazing site
needs far more attention. I’ll probably be returning to see more,
thanks for the info!
Sweet blog! I found it while surfing around on Yahoo News.
Do you have any tips on how to get listed in Yahoo News?
I’ve been trying for a while but I never seem to get there!
I pay a visit everyday a few websites and information sites to read articles, however this weblog
gives feature based posts.
Thanks very interesting blog!
Hi there! Do you know if they make any plugins to safeguard against hackers?
I’m kinda paranoid about losing everything I’ve worked hard on. Any tips?
Hey! Do you use Twitter? I’d like to follow you
if that would be ok. I’m definitely enjoying your blog and look
forward to new posts.
Heya i am for the first time here. I came across this board and I find It truly useful & it helped me out much.
I hope to give something back and aid others like you aided me.
Do you have a spam problem on this site; I also am a blogger,
and I was wondering your situation; many of us have created some nice procedures and we are looking to trade strategies with other
folks, please shoot me an e-mail if interested.
Have you ever considered writing an ebook or guest authoring on other sites?
I have a blog based on the same information you
discuss and would love to have you share some stories/information. I know my subscribers
would appreciate your work. If you are even remotely interested, feel free to send me an email.
Hi, I do think this is a great blog. I stumbledupon it 😉 I may
come back once again since I book-marked it.
Money and freedom is the greatest way to change, may you be rich and continue to
Hello there! Do you use Twitter? I’d like to follow you if that would be ok.
I’m absolutely enjoying your blog and look forward to new updates.
Highly descriptive post, I enjoyed that bit. Will there be a part 2?
Incredible points. Great arguments. Keep up the great effort.
An interesting discussion is worth comment. I believe that you should
publish more about this subject, it might not be a
taboo subject but generally folks don’t discuss such topics.
To the next! Cheers!!
Hey There. I found your blog using msn. This is a really well written article.
I’ll be sure to bookmark it and come back to read more of your useful information. Thanks
for the post. I’ll definitely return.
hello!,I love your writing very much! share we communicate more approximately your
post on AOL? I require an expert in this space to solve my
problem. May be that is you! Having a look ahead to see you.
Hmm is anyone else having problems with the images on this blog loading?
I’m trying to determine if its a problem on my end or if it’s the blog.
Any suggestions would be greatly appreciated.
I know this website provides quality based articles or reviews and additional material,
is there any other website which offers these data in quality?
Heya i am for the first time here. I found this board and I find It truly useful
& it helped me out much. I hope to give something
back and aid others like you aided me.
What a material of un-ambiguity and preserveness of valuable knowledge on the topic
of unexpected emotions.
I think that everything wrote made a lot of sense. However,
think about this, suppose you composed a catchier post title?
I ain’t saying your content is not solid., but what if you added a
post title that makes people desire more? I mean Bloquer
l'Indexation de pages : Fichier robots.txt – Guide SEO is
kinda boring. You might peek at Yahoo’s home page and note how they write article titles to
grab viewers to open the links. You might try adding a video or
a picture or two to get people interested about
what you’ve got to say. In my opinion, it would make your blog a little livelier.
Why users still make use of to read news papers when in this technological world all is presented on web?
I am sure this piece of writing has touched all the internet visitors, its really
really pleasant article on building up new website.
Hi, i read your blog from time to time and i own a similar one and
i was just curious if you get a lot of spam comments? If so how do you stop it,
any plugin or anything you can advise? I get so much lately it’s driving me crazy so any assistance
is very much appreciated.
It’s going to be finish of mine day, however before end
I am reading this great piece of writing to increase my know-how.
Howdy would you mind letting me know which web host you’re working with?
I’ve loaded your blog in 3 completely different browsers and
I must say this blog loads a lot faster then most. Can you
recommend a good internet hosting provider at a fair price?
Kudos, I appreciate it!
At this time I am ready to do my breakfast, after having my breakfast coming again to read further news.
Excellent site. Plenty of useful info here. I’m sending it to some friends ans also sharing in delicious.
And naturally, thank you in your effort!
Wonderful post however , I was wanting to know if you could write
a litte more on this topic? I’d be very grateful if you could elaborate a little bit
Les commentaires sont fermés.