Bot for Crawling a Flash website and Scraping data to XML file

Zamknięty Opublikowano Sep 9, 2014 Płatność przy odbiorze
Zamknięty Płatność przy odbiorze

Please just bid if you read what I'm writing and you really think you can do it, don't waist your time and my time bidding without even reading. I'm ok to give a chance to someone that is starting. Please be as professional with me as you want that I will be with you, because I'm going to be professional with you. Please don't bid in the maximum value and just afgterwards read, because I will ward project also watching the final price. Ok, having that clear, let's start.

If your bid is choosen, before starting the work for you to clearly know what is expected to do, we will have everything specified in the requirements documents that both of us have to accept. I will write a draft of the requirements and you can adjust, but both of us have to agrree before the project is awarded.

The main objective is clear, crawl a part of a website mainly build in flash, scrap and collect specific data and store in a XML file.

I need that to be done recuservely, so you will need to create a bot. The objective is to read the website and constantly keep updating the XML. Entries that are older than 90 minutes (1 and 1/2 hour) should be deleted.

Just for having a general idea, another program (not from this project) will read the XML and use the data for some purpose.

I will create a XML and XSD for you to use, I'm open to listen your ideas and if you propose some other structure that can store all the data in a easy to index way and if I accept it, that can also be changed.

As data from the website is constanly changing is expected that the all process to take just a few seconds to crawl , scrape and store the data, otherwise data will not be up-to-date.

The time between each access of the bot to the website should be randomize between two values.

The start of the crawl is one fixed webpage mainly build in flash, each access is supossed to crawl just the dynamic links situated in a column of that flash webpage, all crawled webpages are also mainly done in flash and all pages have a very similar structure.

Each acces is expected to crawl between 10 to at most 250 pages. Each page can have from none to 500 registries to store in the XML.

One access (for istance right now where the movement is not too high) should crawl 22 pages and scrape around 100 registers per page.

More specific information like the webpage, the data required will be given to the bidders.

Adobe Flash Pozyskiwanie danych z Internetu XML

Numer ID Projektu: #6431362

O projekcie

12 ofert Zdalny projekt Aktywny Oct 16, 2014

12 freelancerów złożyło ofertę za €139 w tym projekcie

mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

€250 EUR w ciągu 5 dni
(104 Oceny)
6.6
uumairkhalid

Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience. Więcej

€111 EUR w ciągu 3 dni
(101 Oceny)
6.4
mhmhz

Hi Let me check the flash to analyze it. Thanks

€263 EUR w ciągu 3 dni
(34 Oceny)
6.4
uumarkhalid31

hi, i am expert in web scraping and interested in this project, let me do this work with perfection, accuracy and according to your requirements, plz contact with me so we can discuss further about the project and plz Więcej

€100 EUR w ciągu 3 dni
(76 Oceny)
6.0
freelance4hire80

hi, please provide the site URL to study first............................................................................................

€100 EUR w ciągu 3 dni
(10 Oceny)
4.6
sby

hi i have made many bots before you can see my review what site you need to scrape please contact me soon ready to work

€94 EUR w ciągu 3 dni
(3 Oceny)
2.9
sheka87

Hi, Flash websites is really hard to scrape, but maybe they communicate with server with JSON or xml. Please send me link and I will try. Thanks.

€80 EUR w ciągu 3 dni
(1 Ocena)
1.9
mmuthamilselvan

I am recently working on a chrome extension to collect xml from a flash website and send it to another service. I have successfully reached a point where i can extract particular xml response from a required webserv Więcej

€250 EUR w ciągu 10 dni
(1 Ocena)
1.8
sumitnautiyal13

We specialize in Digital Consulting, Digital Marketing, IT Outsourcing, e-commerce Development and Maintenance, Software development and career Development. We build web solutions, which evolve with the changing needs Więcej

€68 EUR w ciągu 3 dni
(0 Oceny)
0.0