Author: zoseph | Posted on: 2/23/2010 9:18:55 PM | Views : 485

Hi,
I am working on a project that uses data scraping technique to retrieve some url links. I encounter this problem when i pass in the url of a [previous page button] link frm the html code and pass it in to httpWebRequest, the httpWebResponse that i get back is different form the actually content.
i have been try to sovle this problem for days and no result, as anyone encounter similar problem and manage to sovle it?
below is my sample code :
[previous page button] url: http://localhost/cgi-bin/spydus.exe/SET/OPAC/BIBENQ/12806897/491904?NREC=10&NAVDIR=-1    
note: i have change the domain name to a dummy address which is localhost
public void http_Get_Request() { //establish request HttpWebRequest httpRequest = (HttpWebRequest)WebRequest.Create(url); //retrive request info headers HttpWebResponse httpResponse = (HttpWebResponse)ht ...

Go to the complete details ...