Hello all, I am looking forward to write a bot of my own that will
crawl the web and index pages just like other search engines do. But I
have no idea where and how to begin. Can anyone give me any input in
the matter?
...
Go to the complete details ...