ASRS Doctor Directory Web Scrape

Starting URL: [login to view URL] We’d like to collect some information on doctors listed on the website above in two CSV files. Visit the URL above. You will reach a directory with 2,947 records at 50 per page. For each record, you can click on the name to reach a profile page. We want to collect the following information, when available, in a CSV file with one row for each doctor or healthcare professional: id (unique numeric ID associated with each profile, found in the profile URL as [login to view URL]{id}/ ) email (if available) name suffix (Jr., etc.) title (MD, DO, etc.) phone (do NOT include mobile) fax (if present) addr1 addr2 city state zip country (include United States records only) This file should be named scrape_ASRS_{date} The first row should contain column names exactly as listed above. Multiple addresses or phone numbers may be contained on each page. Just choosing the first one is fine. See example file [login to view URL] Each doctor may also have one or more “Hospital Appointment” listed on the right side of their profile. We’d like to collect a CSV file with one row for each hospital appointment in the following format: id (incrementing numeric id assigned by your script) scrape_ASRS_{date}_id (the id for this doctor corresponding to the id in your script ) affiliation (name of Hospital Appointment) This file should be named scrape_ASRS_{date}_specialty The first row should contain column names exactly as listed above. See example file [login to view URL]