Bloquer l'Indexation de pages : Fichier robots.txt – Guide SEO

Utilisation de fichier robots.txt et autres méthodes de blocage des url

Ces conseils font parties du guide SEO pour apprendre a référencer un site Web, Le fichier robots est utilisé pour demander aux moteurs de recherche de ne pas explorer certains pages. Toutefois ce fichier n’empêche pas l’indexation dans Google.

Pour empêcher l’affichage de contenu dans les résultats de recherche, il faut utiliser d’autres méthodes notamment avec l’attribut rel= »noIndex ».

– Utilisez un fichier robots.text pour empêcher l’exploration de certaines pages de votre site
– Utilisez un fichier .htaccess pour protéger par mot de passe vos répertoires
– Utilisez l’outil Google pour les webmasters pour supprimer du contenu ayant déjà fait l’objet d’une exploration

Notes : Google recommande de contrôler l’information que les robots doivent explorer ou pas !

1. Évitez d’autoriser l’exploration de pages ressemblant à une page des résultats de recherche
2. Évitez d ’autoriser l’exploration d’un grand nombre de pages générées automatiquement
3. Évitez d ’autoriser l’exploration de pages contenant le même contenu ou du contenu très similaire.

l’attribut rel= »Nofollow »

Cette valeur sert à combattre le spam. En l’utilisant, vous indiquez à Google de ne pas suivre le lien ou de ne pas transmettre la popularité de votre page aux autres pages vers lesquelles des liens renvoient.

– Utilisez-là sur les commentaires publics de votre site
–  Utilisez-là pour interdire de suivre les liens ajoutés par les utilisateurs.
– Utilisez-là pour éviter de transmettre votre réputation aux sites.
– Utilisez-là pour ne pas garantir un contenu
– Utilisez-là pour les liens payants
–  Utilisez-là sur les liens du type « inscrivez-vous ici » ou « se connecter »

Il est précisé par Google que la balise meta <meta name= »robots » content= »nofollow » />
indique de ne pas suivre les liens sortants. Il est dit également que «  Google ne transfère pas le classement PageRank ni le texte d’ancrage à travers ces liens. »

Notes : Google conseille de ne pas se focaliser sur les priorités d’exploration via les liens non suivis. Ce que l’on appelle le pagerank sculpting.

87 réflexions sur “Bloquer l'Indexation de pages : Fichier robots.txt – Guide SEO”

  1. Hey there! I’m at work surfing around your blog from my new iphone 3gs!
    Just wanted to say I love reading your blog and look forward
    to all your posts! Keep up the excellent

  2. Greetings I am so grateful I found your blog page, I really
    found you by accident, while I was browsing on Bing for something else, Anyhow I am here now and would just like to say
    kudos for a fantastic post and a all round exciting blog
    (I also love the theme/design), I don’t have time to look over it all at the minute
    but I have bookmarked it and also added your RSS feeds, so when I have time I will be back to read
    much more, Please do keep up the superb job.

  3. Howdy just wanted to give you a quick heads up. The text in your post seem to be running off the screen in Opera.
    I’m not sure if this is a format issue or something to do with
    internet browser compatibility but I figured I’d post to let you know.
    The design and style look great though! Hope you get the issue resolved soon. Many thanks

  4. I’m not sure why but this weblog is loading incredibly slow for me.
    Is anyone else having this problem or is it a problem on my end?
    I’ll check back later on and see if the problem still exists.

  5. After I initially commented I appear to have clicked on the -Notify me when new comments are added- checkbox and now each
    time a comment is added I recieve four emails with the exact
    same comment. There has to be an easy method you are able to remove me from that service?

  6. An impressive share! I have just forwarded this onto a co-worker who
    has been conducting a little research on this. And he in fact bought me lunch because
    I found it for him… lol. So allow me to reword this….

    Thanks for the meal!! But yeah, thanx for spending some time to discuss this topic here on your website.

  7. Pretty nice post. I just stumbled upon your blog and wanted to say
    that I have really enjoyed browsing your blog posts.
    After all I will be subscribing to your feed and I
    hope you write again soon!

  8. You made some decent points there. I looked on the net to
    find out more about the issue and found most individuals will go along with your views on this web

  9. Pretty section of content. I just stumbled upon your weblog and in accession capital to assert that I get actually
    enjoyed account your blog posts. Anyway I’ll be subscribing to your augment and even I achievement
    you access consistently rapidly.

  10. Thanks for ones marvelous posting! I quite enjoyed reading it, you
    could be a great author. I will make certain to bookmark your
    blog and definitely will come back at some point.
    I want to encourage continue your great job, have
    a nice day!

  11. Excellent beat ! I wish to apprentice at the same time as you amend your web
    site, how could i subscribe for a blog site? The account helped me a applicable deal.
    I had been a little bit acquainted of this your broadcast offered brilliant transparent concept

  12. I’m now not certain the place you are getting your info, but great topic.
    I needs to spend a while studying much more or working out
    more. Thank you for magnificent info I was on the lookout for this
    info for my mission.

  13. What i don’t realize is actually how you’re not actually a lot
    more smartly-appreciated than you might be right now.
    You’re so intelligent. You realize thus considerably on the subject of this subject, made me individually imagine it
    from a lot of numerous angles. Its like men and women don’t
    seem to be interested except it is something to accomplish with Woman gaga!
    Your individual stuffs excellent. At all times handle it up!

  14. Have you ever considered creating an e-book or guest authoring
    on other websites? I have a blog centered on the
    same ideas you discuss and would really like to have you share some stories/information. I know
    my audience would value your work. If you’re even remotely
    interested, feel free to send me an e mail.

  15. hey there and thank you for your info – I’ve certainly
    picked up anything new from right here. I did however expertise a few technical
    issues using this web site, since I experienced to reload the site a lot of
    times previous to I could get it to load properly. I had been wondering if your hosting is OK?
    Not that I am complaining, but slow loading instances times will
    very frequently affect your placement in google and could damage your high-quality score
    if advertising and marketing with Adwords. Anyway I’m adding this RSS to my email and
    could look out for a lot more of your respective exciting content.

    Make sure you update this again very soon.

  16. Heya! I realize this is somewhat off-topic however I needed to ask.

    Does running a well-established blog like yours take a lot of work?
    I am brand new to running a blog but I do write
    in my diary everyday. I’d like to start a blog so I can easily share my own experience and thoughts online.
    Please let me know if you have any kind of ideas or tips for brand
    new aspiring bloggers. Thankyou!

  17. Wonderful blog! I found it while searching on Yahoo News.
    Do you have any tips on how to get listed in Yahoo News?
    I’ve been trying for a while but I never seem to get there!


  18. Awesome blog! Do you have any hints for aspiring writers?
    I’m hoping to start my own website soon but I’m a little lost
    on everything. Would you advise starting with a free platform like WordPress or
    go for a paid option? There are so many options out there that I’m totally confused
    .. Any suggestions? Cheers!

  19. Hey There. I found your weblog the use of msn. This is a very smartly written article.
    I’ll make sure to bookmark it and return to read extra of
    your useful information. Thanks for the post. I’ll definitely comeback.

  20. An interesting discussion is worth comment. I believe that you should
    publish more about this subject, it might not be a
    taboo subject but generally folks don’t discuss such topics.
    To the next! Cheers!!

  21. Hey There. I found your blog using msn. This is a really well written article.
    I’ll be sure to bookmark it and come back to read more of your useful information. Thanks
    for the post. I’ll definitely return.

  22. Hmm is anyone else having problems with the images on this blog loading?
    I’m trying to determine if its a problem on my end or if it’s the blog.
    Any suggestions would be greatly appreciated.

  23. I think that everything wrote made a lot of sense. However,
    think about this, suppose you composed a catchier post title?
    I ain’t saying your content is not solid., but what if you added a
    post title that makes people desire more? I mean Bloquer
    l'Indexation de pages : Fichier robots.txt – Guide SEO is
    kinda boring. You might peek at Yahoo’s home page and note how they write article titles to
    grab viewers to open the links. You might try adding a video or
    a picture or two to get people interested about
    what you’ve got to say. In my opinion, it would make your blog a little livelier.

  24. Hi, i read your blog from time to time and i own a similar one and
    i was just curious if you get a lot of spam comments? If so how do you stop it,
    any plugin or anything you can advise? I get so much lately it’s driving me crazy so any assistance
    is very much appreciated.

  25. Howdy would you mind letting me know which web host you’re working with?
    I’ve loaded your blog in 3 completely different browsers and
    I must say this blog loads a lot faster then most. Can you
    recommend a good internet hosting provider at a fair price?
    Kudos, I appreciate it!

  26. Wonderful post however , I was wanting to know if you could write
    a litte more on this topic? I’d be very grateful if you could elaborate a little bit
    more. Cheers!

Les commentaires sont fermés.