Automate web data collection based on existing scripts

On the basis of existing elements of code written in Python for similar purposes, _adaptation of a script_ should be made that automates the collection of user profiles from 6 web sources. The current elements of code available concern in particular the collection of data from an API, and the direct collection of data from html pages, conversion to XML and extraction of the relevant information. On the basis of this, a consistent code will be written that can run to i) query the API, and, when not possible, gather data from html pages, ii) do so in a manner limiting to the maximum the load on the corresponding servers iii) apply to the 6 sources. The six sources concerned have similar, simple API structures, and the pages provided also have a simple data structures that allow for fairly straightforward conversion from html to xml. ## Deliverables Rent A Coder requirements notice: As originally posted, this bid request does not have complete details. Should a dispute arise and this project go into arbitration "as is", the contract's vagueness might cause it to be interpreted against you, even though you were acting in good-faith. So for your protection, if you are interested in this project, please work-out and document the requirements onsite. Complete and fully-functional script ready to run ## Platform Any standard environment