|
|
|
Web Fetching/Grabbing help
posted on 12/7/2003Hi,
I am working on a script which is basically doing what I need, however it needs some tweaking after a found a slight problem with the source.
I am pulling from a web site for some content (don't worry I have permission however they can't change there end for me).
The page contains a number of dynamic entries, all in the same format as this:
AREA
blah blah text here
However when they are generated to HTML page at source they are not done in any logical order (ie: not newest first), therefore I need to go through a whole page and find every new instance of the above format and store the results into a mySQL DB.
At the moment all I am getting is the first instance naturally :?
Therefore I need a script that searches a set URL for Incidents and then cross checks this with all the Incident ID currently held on record to see if they are in my local DB. If it's a new ID then pull out the content (as the format above) and INSERT new record.
As anyone got any code I could look at that basically does something like this, or know of a script I can review?
Many many thanks
Martin
We are no longer accepting applications for this project.