Dear Scriptlance community
Our firm is looking for a person or firm to help us design a crawler/scraper (or series of crawlers) for a large amount of real estate websites over time. These sites may be in the form of regular real estate websites or local mls’s which aggregate listings from multiple sites.
You are bidding on putting together a (or adapting your existing) crawler to help us crawl and scrape 10 sites – to start with.
We will give you the list of websites; we need description, prices, pictures, and other fields – details on format will follow. Your deliverable will be the technology itself, which will have to be demonstrated to work before we purchase it.
Programming languages or methods are not important – you just need to make sure you don’t get banned from the sites or burn any proxies while you’re at it, as we will have to repeatedly scrape these sites every 2-5 days. Must run from server.
Please ONLY BID if you believe you will be able to provide us with steady work over time — we are looking for an ongoing relationship, not a one time solution.
Happy Bidding!
