Convert List Of Websites To XML

I want a program to traverse a list of links on a webpage, visit the websites (follow the links) and grab the title, and description (and other information) from the website, and write it to an xml file. ## Deliverables I want a program to traverse a list of links on a webpage, visit the websites (follow the links) and grab the title, and description (and other information) from the website, and write it to an xml file. It's using yahoo's siteexplorer (free). To see an example, go to http:/[login to view URL] and enter a domain When it has finished searching, click link under Inbound links, and you will be taken to yahoo. The program would have to go through all the links on this page (and go to the next page, etc) visiting each link in turn, grabbing the information from the page, and adding it to the xml. The program should simulate human use by pausing for a random period of time between get requests and not just try and execute as quickly as possible. The user should be able to specify the numbers of seconds to pause (a range) between each request and the program would pause for a random number within this range on each request. The program should be able to resume from a given point.