|
Posted by Stan Hilliard on June 13, 2007, 9:31 am
If you were Registered and logged in, you could reply and use other advanced thread options
>On Tue, 05 Jun 2007 20:34:58 GMT, Fuzzy Logic
>
>>
>>> I am looking for a newsgroup or forum that discusses best practices in
>>> using methods to influence how web crawlers record a website.
>>>
>>> Information will be appreciated,
>>> Stan Hilliard
>>>
>>
>>http://www.robotstxt.org/wc/faq.html
>
>Thanks. I have placed a robots.txt on my website. But I notice from my
>log files that many web crawlers do not even check it. Can some web
>crawlers be malicious?
>
>Is there a free tool that can analyze a web site to determine its
>vulnerabilities?
>
>Stan Hilliard
My web site is on a remote windows 2000 server running IIS & MS
Frontpage. It is hosted by an internet service provider. I am mostly
interested in whether permissions are properly set, what
vulnerabilities it has, and occurrences or clues of malicious
intrusion.
Stan Hilliard
| 
XML site map