I need a crawler that can go through a college directory and do two things:
1. Get all the names of Faculty/Staff, title, their department, and their email address.
2. Get all the names of Students, title, and email address.
The site that I want the names asks people to log in using their college email address and password. We need to get around that. I need the files in excel format AND a format ready to be put into a MySQL database.
I need this down within 48-72 hours.
