Blocking the Facebook bot?

What is the best way to block the Facebook bot when it doesn't recognise robots.txt

It appears to be an aggressive bot and has been hitting our server resources a lot recently.
I've added their IP subnets to the 'Banned IP addresses' in the ACP for now but not sure if this is the best way to go about it.

If Mark Z'berg wants to use our content he can pay for it lol

Читать далее...
 
Активность
Пока что здесь никого нет
Назад
Верх Низ