Data Mining Web Scraping Project

NOTICE: READ the full specification and visit each site link listed. YOUR BID IS TO BE THE FINAL TOTAL PAID Project: Create CSV files including all attorney leads in sites listed below. - Data to be formatted with the following columns: 1. lawyer.first_name - (REQUIRED) 2. lawyer.last_name - (REQUIRED) 3. [login to view URL] - (REQUIRED) 4. [login to view URL] - (If available from site) 5. lawyer.firm_name - (If available from site) 6. [login to view URL] - (If available from site) 7. [login to view URL] - (If available from site) 8. [login to view URL] - (If available from site) 9. [login to view URL] - (If available from site) 10. lawyer.type_of_law - (If available from site) - No duplicates accepted. - Finished data to be separated and delivered in multiple CSV files with each having no more than 10k leads. - Estimated total number of leads: 900k (1,269,350 lawyer leads minus 300k duplicates or name/email cant be found) Site #1: (1.2 million leads) For each state you must click the state's abbreviation at the top of the page. We need all of the leads from all 50 states on the site. [login to view URL] ---------- Site #2: (18,478 leads) lists law types under "SECTIONS". Need to screen out "Ms.", "Mrs.", "Miss." and "Mr." before some first names. You must wait for it to resolve as it will display all leads on the site. [login to view URL] ---------- Site #3: (158 leads) Type of law= Bankruptcy [login to view URL]:2014-bk-10979-13109 ---------- Site #4: (40 leads) Go to each type of law link to get the lawyer info. Attorneys listed by type so all at each link are the same type:, those are the type of law "Administrative Law, Appellate, Bankruptcy,..." [login to view URL] ---------- Site #5: (312 leads) Type of law = after "Area of Practice". [login to view URL] ---------- Site #6: (236 leads) Type of law = last line above "View". If you click "View" it is listed after "Area of Work" [login to view URL] ---------- Site #7: (270 leads) Type of law = under "Specialization" [login to view URL] ---------- Site #8: (36 leads) Type of law = after the email. [login to view URL] ---------- Site #9: (46,323 leads) No type of law. You need to download vcard for email. https://www.zeekbeek.com/SBM/Search-Results#mtype=good&region=MI ---------- Site #10: Same as Sites 12 and 13 (1000+ Records Found) Must click lawyer name, pass access check, then info with email and type of law as "Area(s) of Practice: Insurance" [login to view URL] ---------- Site #11: (495 results found) Must click "View Profile" then Type of law is listed after "Practice Areas". Must click "Contact " for email. [login to view URL] ---------- Site #12: Same as Sites 10 and 13 (1000+ Records Found) Must click lawyer name, pass access check, then info with email and type of law as "Area(s) of Practice: Insurance" [login to view URL] ---------- Site #13: Same as Sites 10 and 12 (1000+ Records Found) Must click lawyer name, pass access check, then info with email and type of law as "Area(s) of Practice: Insurance" [login to view URL]