Page 1 of 1

Blocking Googlebot hitting my server

Posted: Sat Apr 04, 2015 6:55 pm
by howardm
Hi,

I have a server that provides access to radiology teaching files. It is not a conventional web site.

I've noticed— from the server logs— that Googlebots have been hitting the server and clicking on links to downloadable Zip files.

This is silly!

Can I use Murus to block this by setting up a Custom Group and specifying the following address range for blocking ?

....

66.0.0.0/8

.....

I'd appreciate any general comments as well.

Cheers,


Howard

Re: Blocking Googlebot hitting my server

Posted: Tue Apr 07, 2015 12:37 pm
by hany
Yes, create a custom group, put 66/8 in its addresses list, then assign the group to the Black List.
In case you run Murus Lite you don't have a black list, so just assign this group WEB service's blocked groups

Re: Blocking Googlebot hitting my server

Posted: Wed Apr 08, 2015 7:47 pm
by howardm
Hi,

Thanks for your response. I am using Murus Lite.

I've attached two images that indicate what I did:

* created a Custom Service, BLOCKGOOBOT, specifying port 3333, which is the port involved.

* created a new Group, googlebot, specifying an IP range: 66.0.0.0/8 (I presume this is the proper way to specify the proper I.P. range)

* assigned the Group to the Blocked Groups of the Custom Service.

Did I do all this correctly ?

Thanks!


Howard

Re: Blocking Googlebot hitting my server

Posted: Thu Apr 09, 2015 6:57 pm
by hany
Everything looks correct :)
Yes, 66.0.0.0/8 is correct. However you can shorten network addresses if you want, so 66.0.0.0/8 becomes 66/8, and 192.168.0.0/16 becomes 192.168/16.

Re: Blocking Googlebot hitting my server

Posted: Fri Apr 10, 2015 1:05 am
by howardm
Thanks!

I have the following question:

If I choose a certain preset for instituting the firewall (Page 13 of the User Manual), will this incoming rule I just configured be added to that ruleset ?

Cheers.


Howard