Web Spider For Aggregate Site

We need to commission a web spider built in php/mysql.

It will initially designed to spider a certain list of sites and extract information such as name, description, location, and date information and also save images attached to that item.

It is not an ebay spider but it is similar in concept.

Each site/item combination should also be keyed so future runs on the same sites will not result in duplicate items.

It should be flexible so we can expand it to other sites with different html layouts in future.

Leave a Reply

Your email address will not be published. Required fields are marked *