Web Scraping

Job Description

I am looking for the below data to be mined/scraped for Payday Loan and Cash Advance Companies in the United States. I need them sorted by State and City. I am looking for as many per city as possible and I want as many cities as possible. All information needs to be organized in a CSV file.

Name of Company
Address- City, State, ZipCode
Website Address
Phone Number
Email
any other information that looks available across all of the companys being scraped

An Example of a site that has a payday lender directory would be the following:
http://www.mypaydaycashadvanceloans.com/payday-loans/texas

Notice the lender directory for the state further down on the page…then at the very bottom it breaks down into the major cities in that state and when you click on them they also have a lender directory for that local city. I am looking for something very similar to that site example, but I want to be able to hyperlink to the companies websites so I need their web addresses.

THE SITE ABOVE IS JUST A EXAMPLE OF A SITE!
We would like multiple sites scraped to give us the largest number of results possible.

The information should be provided to us a a csv file with DUPLICATES REMOVED

Another example would be google local results for keywords…example
payday loans chicago

http://local.google.com/maps?f=q&source=s_q&hl=en&geocode=&q=payday+loans+chicago&vps=1&jsv=259e&sll=37.0625,-95.677068&sspn=28.39116,79.013672&ie=UTF8&sa=N&start=10

If the information for all states could be scraped that would be ideal

Leave a Reply

Your email address will not be published. Required fields are marked *