Hi Im looking for someone that can program a simple Python webcrawler (preferably using Scrapy) to index a webshop (one domain), including the function of saving the crawled data into a (wordpress) Mysql database. The data (per cell) will be requested from this database through php programming.
Details:
– URL to crawl: http://www.lightinthebox.com/see-all.html
– Extract all categories (level A) -> all the products in the categories (level B) and the product details (level C),
– Fetch …
