• Visitors can check out the Forum FAQ by clicking this link. You have to register before you can post: click the REGISTER link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. View our Forum Privacy Policy.
  • Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!

Hide web page from search bots

Collapse
X
  •  
  • Filter
  • Time
  • Show
Clear All
new posts

    Hide web page from search bots

    I have a website, but there's one page in particular that I don't want to appear on search engine indexes. I know this used to be achievable using meta tags or something about 10 years ago, but I'd imagine the search bots have probably got wise to it by now. So can it still be done?


    The reason is this: the page in question is my company's contacts page. One of the office addresses is a particularly sought-after bit of city-centre real estate and I want to show it on the website. But it's on a lease that (if you read it in a very literal, boorish way) doesn't appreciate commercial use. I don't want the landlord to be able to Google for "123 Swanky Street SW1" and get the hump when he finds it.

    ta,
    tl

    #2
    It may be old - but it still works - try a robots.txt file in the root of your web site.

    http://www.robotstxt.org/wc/robots.html
    www.stormtrack.co.uk - My Stormchasing website.

    Comment


      #3
      mustard, I shall give that a try!


      tl

      Comment


        #4
        it's noindex

        try :

        <meta name="robots" content="noindex,follow">

        http://www.robotstxt.org/wc/meta-user.html

        HTH

        Edit!!

        should say

        <meta name="robots" content="noindex,nofollow">

        If you don't want to pass on Google pagerank (which I'm guessing you don't)
        So this edit won't make any difference
        Last edited by Jog On; 9 May 2007, 23:49.
        "Is someone you don't like allowed to say something you don't like? If that is the case then we have free speech."- Elon Musk

        Comment


          #5
          you guys are the best!

          I have done both those. (unfortunately too late: I'm right there on google page 1! Hope google's got a short memory.)

          Hope I've got robots.txt right.

          If the site is www.thunderlizard.com and the page to conceal is www.thunderlizard.com/findme.html,
          I've got www.thunderlizard.com/robots.txt
          and it contains:

          User-agent: *
          Disallow: /findme



          edit: wow I didn't know there actually was a www.thunderlizard.com! it looks cool but it's not mine sadly!
          Last edited by thunderlizard; 10 May 2007, 21:59.

          Comment


            #6
            I think ( which is not a factor at all ) that simply removing all href references to the page should hide it from the bots. That s how they work. Of course you need to make sure that the web server is not returning the list of the html files in a dir on a general request ( one that is not absoolute with the page url )
            Last edited by 2uk; 10 May 2007, 23:17.

            Comment


              #7
              but that would make my page impossible to get to wouldn't it?

              Comment


                #8
                Originally posted by thunderlizard
                but that would make my page impossible to get to wouldn't it?

                kinda. Unless they know the exact url.

                Comment


                  #9
                  Originally posted by thunderlizard
                  but that would make my page impossible to get to wouldn't it?

                  You could use Javascript to call the page.. i.e. use 'document.location.href='yourpage.htm'. You could use images as links then, or even anchor tabs without the 'href' part.

                  Comment

                  Working...
                  X