Hi,
As your project lacks detail, I have made a proposal based on scraping up to one thousand pages with a common format from a single site once, and returning the data as mySQL commands, or directly inserting the data in the database.
If you would like to get a better estimate, please give me more details regarding:
- the site or sites to scrape
- which pages you want to scrape (including how many different page types and the number of each)
- what data you want to capture
- the format you want the results in
Let me know as well if you need just one-time scraping of if you require regular scraping of the data (with or without change detection), and in the latter case, if you need the scraper to run on your own servers or if I can run them on mine and just send you the data. Of course, on-going scraping will incur a subscription fee, and there will be additional costs if the format of the site(s) to be scraped changes.
If you want to run the scraper on your own server, let me know which technologies I can use (I usually develop using perl, but I can be flexible on this).
I have scraped dozens of sites using many different data formats (HTML, XML, JSON...) and technologies for inclusion in many of my own sites, so I have quite some experience doing so.
Let me know if you have any further questions.
Jacques.