Site Crawler Needed
I need someone to write a php curl app that makes use of proxy servers to crawl a big hentai site and copy images from the site. The images should then be imported into my site. My site makes use of PHP and a MySQL db. You can write a simple script to import the images. The site that I want to crawl is http://bit.ly/PgZiO
The script should do the following:
1) Run as a cron job once daily
2) For the 10 categories on the site it should download and export to my site the days new images.
3) The images should be named according to the title of the image uploaded.
4) If a duplicate image exists the image should get an underscore character and a numeric digit along with the original title. This number must be incremented each time a duplicate is found.