Good day!, How have you been?
I would like to work with you on this project, and it's quite an interesting one.
30 minutes windows, is quite substantial to download all those data on a fair internet connection.
Currently the "Barcelona" link has 181 page on it, and using the speed optimized method of making XMLHttpRequest, it's possible all the data would come in, in less than 5 minutes.
XMLHttpRequest is quite fast compared to the common, screen-scrapping approach, that is more popular, because, it's easier to understand and more simple to code.
The outline of my work goes thus:
1. I will work on the XMLHttpRequest module, that will return the source code of all the pages available, then
2. I will work on the module that will retrieve, the the needed data, from each page's source-code, and then
3. I work on the module that will present the data in the spreadsheet and also an interface in the spreadsheet where the link can be substituted
I can get all of these done, in less than 24 hours, 'cause I am currently, free of any project.
Once you message me, I will start working on it immediately.
Thank you.