location of robot.txt file?

**corrie** · 10/07/2011, 15:38

Hi, where can I modify the robot.txt? I need to tell bots to stop searching for some paths to my old website.

Thanks

**jan.theofel** · 10/09/2011, 16:48

Hello,

the robots.txt is in your document root. Please edit it using any editor of your choice.

But the better solution is to redirect the old URLs to new ones using redirect rules in the .htaccess file. Otherwise all old deep link to your website will be broken and it's better for your search engine ranking.

Jan

**corrie** · 10/10/2011, 10:50

Thanks for the advice, I'll give that a go :D

**corrie** · 10/10/2011, 13:54

forgive me if I'm just being stupid but...
I created a new htaccess file in notepad. I uploaded it to AutoBackupDB and tried to rename it '.htaccess' but contao keeps automatically adding the .txt suffix.
None of my redirects are working and I wondered if it was because of the .txt on the file.

What am i doing wrong?
:?

**ramjet** · 10/10/2011, 14:05

I uploaded it to AutoBackupDB

???
FTP it to your root directory (where robots.txt is) as .htaccess.default - using Filezilla or WSFTP etc
Rename it on the server via FTP to .htaccess

None of my redirects are working and I wondered if it was because of the .txt on the file

Yes that will prevent it from working

**corrie** · 10/10/2011, 14:43

Thanks Ramjet
That shows why I'm in the newbie forum! :lol:

**jan.theofel** · 10/12/2011, 12:18

Hello,

please be careful: Contao brings it's own .htaccess file. You have to extend it and should not replace it, because rewriting the URLs for Contao won't work any longer.

Jan