404 error for robots

[Isgaard]

Hi!
I have some troubles with search and other bots...

In server access log i see

95.108.129.207 - - [30/Nov/2010:15:13:44 +0300] "GET / HTTP/1.1" 404 26 "-" "Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)"

and in Contao log

No root page found (host "ogolego.ru", languages "")
PageRoot generate()
95.108.129.207
Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)

Looks like Contao didn't know what do with requests like GET / from user-agents without defined language like

213.141.154.168 - - [30/Nov/2010:15:11:00 +0300] "GET / HTTP/1.1" 200 25798 "-" "Opera/9.80 (Windows NT 6.1; U; ru) Presto/2.6.30 Version/10.63"

So, i can't understand what is what, how to fix that, and need help from community

Thank's,
Paul

[xchs]

Hi Isgaard,

the problem relates not only to search engines and bots, even if I load the page in question I get an "No pages found" error message.

You have to set up in the back end module "Site structure" a page of type "Website root". In the section "DNS settings" check the field "Language" and of course you have to enable also the checkbox "Language fallback" for this website root.

Google (and many other crawlers/bots) speaks English!