Results 1 to 8 of 8

Thread: location of robot.txt file?

  1. #1
    User
    Join Date
    10-07-11.
    Posts
    59

    Default location of robot.txt file?

    Hi, where can I modify the robot.txt? I need to tell bots to stop searching for some paths to my old website.

    Thanks

  2. #2
    User
    Join Date
    01-20-11.
    Location
    Germany
    Posts
    77

    Default Re: location of robot.txt file?

    Hello,

    the robots.txt is in your document root. Please edit it using any editor of your choice.

    But the better solution is to redirect the old URLs to new ones using redirect rules in the .htaccess file. Otherwise all old deep link to your website will be broken and it's better for your search engine ranking.

    Jan
    Free support only here in the forum.
    Please report bugs for my extensions using http://www.contao-forge.org. Thanks!
    Requests for Contao support and development please send mail to jan@theofel.de

  3. #3
    User
    Join Date
    10-07-11.
    Posts
    59

    Default Re: location of robot.txt file?

    Thanks for the advice, I'll give that a go :D

  4. #4
    User
    Join Date
    10-07-11.
    Posts
    59

    Default Re: location of robot.txt file?

    forgive me if I'm just being stupid but...
    I created a new htaccess file in notepad. I uploaded it to AutoBackupDB and tried to rename it '.htaccess' but contao keeps automatically adding the .txt suffix.
    None of my redirects are working and I wondered if it was because of the .txt on the file.

    What am i doing wrong?
    :?

  5. #5
    Experienced user
    Join Date
    06-20-09.
    Posts
    1,311

    Default Re: location of robot.txt file?

    I uploaded it to AutoBackupDB
    ???
    FTP it to your root directory (where robots.txt is) as .htaccess.default - using Filezilla or WSFTP etc
    Rename it on the server via FTP to .htaccess

    None of my redirects are working and I wondered if it was because of the .txt on the file
    Yes that will prevent it from working

  6. #6
    User
    Join Date
    10-07-11.
    Posts
    59

    Default Re: location of robot.txt file?

    Thanks Ramjet
    That shows why I'm in the newbie forum! :lol:

  7. #7
    User
    Join Date
    01-20-11.
    Location
    Germany
    Posts
    77

    Default Re: location of robot.txt file?

    Hello,

    please be careful: Contao brings it's own .htaccess file. You have to extend it and should not replace it, because rewriting the URLs for Contao won't work any longer.

    Jan
    Free support only here in the forum.
    Please report bugs for my extensions using http://www.contao-forge.org. Thanks!
    Requests for Contao support and development please send mail to jan@theofel.de

  8. #8
    User
    Join Date
    10-07-11.
    Posts
    59

    Default Re: location of robot.txt file?

    Thanks for the tip, I did that and it seems to be working like a dream :D

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •