Hello Freelancers!
Everyday I'm manually going through a number of websites/forums dedicated to job announcements in a niche industry. I'm looking for a way to pull the respective information from all those sites together into a centralized interface/website to simplify things. I want to be able to check just one site, to get all the information I need from those source websites/forums.
Maybe the individual entries could be listed,by date and time as links to the original posts.
All of this should update automatically on a daily basis.
There should also be an error/success log, which confirms if pulling the information was successful and let's me know, if it fails - for instance, in the case of a change in layout/structure in one of the source websites.
I have a Linux server, where this should run. Additional help and support for installing is required.
At the moment we are talking about 5 websites that need to be checked daily, but I can see this to be extended in future, so that should be kept in mind. If this project is finished successfully, I may re-approach you in the future.
Dear Employee!
I've done jobs like this (actually I am creating one at the moment too).
I have a good, own-developed system, which uses anonymous proxies to hide itself if needed.
But I think if you want to search on the site only once a day this function is useless.
Please see my message for further details!
Regards:
Gergely
Hi. I am very keen to complete this project for you. I have developed similar systems before during my work with large companies in London over the last few years. Please see my profile for more info. Thanks - Jack
Hi JacOdn
I have done several scraper projects before, so I can get this project up and running for your pretty fast.
I'll build you a website, which stores the scraped content in a database, updated on a daily basis.