Find Jobs
Hire Freelancers

Website scraper

$750-1500 USD

W trakcie realizacji
Opublikowano 11 miesięcy temu

$750-1500 USD

Płatne przy odbiorze
The task is to identify a total of 350 products pre-selected by the client on the websites of nine Internet data sources (Hungarian-language online stores of retail chains), some of which are offered by several retailers and some of which are sold by only one retailer. The parameters of the identified products have to be provided in a structured format to the background database manager. The data updates should be synchronised with the update time of the relevant data source, in terms of price and availability of the product, probably on a daily basis, in order to ensure that the offers are as accurate as possible. The data should be updated on a daily basis over a two-week testing period to ensure accuracy (apart from products that become unavailable during the day due to stock depletion.) Based on the product URLs, the following product data should be provided to the backend database: - Product name - Product description - Product image - Product packaging (unit and quantity) - Product price In the case of a promotional price, the start and end of the promotion If available, also the non-special price - Other product attributes (ingredients, vegan not vegan, etc.) - Product unique identifier (if any) The implementation should not give the impression of a "bot" to avoid possible flagging, e.g.: properly configured "real life" web client (user-agent, etc.), proxy configuration from list (if you want to run the scraper from multiple IP addresses). It would be an advantage to develop a solution that can efficiently handle product data for the entire portfolio of the given sources in the future, if the test is successful (up to 60-70E products per source). The sponsor considers a timeframe of 2 weeks as sufficient to complete the task. The 2-week update period will start thereafter at a date agreed with the client. The programming language and framework are optional. Proposed budget 800-1200 USD. Bids should be submitted by 05.07.2023! The contracting authority will contact the bidders of interest and is expected to finalise the agreement in the form of further Q&As.
Identyfikator projektu: 36813036

Informację o projekcie

97 ofert
Zdalny projekt
Aktywny 10 miesięcy temu

Szukasz sposobu na zarobienie pieniędzy?

Korzyści ze składania ofert na Freelancer.com

Ustal budżet i ramy czasowe
Otrzymuj wynagrodzenie za swoją pracę
Przedstaw swoją propozycję
Rejestracja i składanie ofert jest bezpłatne
Przyznano:
Awatar Użytkownika
$0 USD w 14 dni
5,0 (95 opinii)
6,8
6,8
97 freelancerzy składają oferty o średniej wysokości $1 089 USD dla tej pracy
Awatar Użytkownika
hello, How are you? Thanks for sharing information yes i am ready to Scrap website data as per given your data . lets do chat? Thanks Shweta
$1 125 USD w 7 dni
4,9 (309 opinii)
9,2
9,2
Awatar Użytkownika
Hello Good afternoon , I hope you are doing great. Just finished reading the brief details of your job . I see you have been looking for a freelancer who has experience with Data Entry, PHP, MySQL, Software Architecture and Web Scraping. Upon the first look I feel confident about getting it done because of having experience doing similar jobs My Experience? I have 9 years of experience working with those technologies. Its been 8 years since I have been working on freelancer.com, Please review my profile. Check: Skills, Portfolio, Customer Feedbacks. Why Choose Me? 1. I have done more than 250 major projects only on freelancer.com. 2. I have not received a single bad feedback since last 5-6 years. 3. You will find 5 star feedback on last 100+ major projects which shows my clients are happy with my work. Portfolio: https://www.freelancer.com/u/AwaisChaudhry Timings: 9am - 9pm Eastern US Time I would like you to start the chat so we could discuss it in detail and we will continue from there. Thanks! Awais
$1 500 USD w 16 dni
4,9 (123 opinii)
8,6
8,6
Awatar Użytkownika
I have reviewed the project requirements and I am confident in my ability to successfully complete this task. Based on my expertise, I propose developing a web scraping solution using Python and the Beautiful Soup library to extract the required product data from the specified Hungarian-language online stores. This solution will be implemented in a "real life" web client configuration to avoid flagging and will include proxy configuration from a list to enable scraping from multiple IP addresses. The extracted data will be structured and provided to the backend database manager. The data updates will be synchronized with the update time of the relevant data source, ensuring accurate and up-to-date product information on a daily basis. A two-week testing period will be conducted to ensure accuracy, with daily updates except for products that become unavailable due to stock depletion. The following product data will be included in the structured format provided to the backend database: - Product name - Product description - Product image - Product packaging (unit and quantity) - Product price, including promotional prices and non-special prices - Other product attributes (ingredients, vegan/non-vegan, etc.) - Product unique identifier (if available) The proposed solution is scalable and can efficiently handle product data for the entire portfolio of the specified data sources in the future, allowing for up to 60-70E product...
$1 350 USD w 10 dni
5,0 (307 opinii)
8,7
8,7
Awatar Użytkownika
Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 900 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion. Thank you Sandeep
$1 200 USD w 10 dni
4,9 (514 opinii)
8,5
8,5
Awatar Użytkownika
Hello, Hope you are doing great, i am expert in web scraping , I can easily scrape all the target data from the website using Python or any other script so you don't have to spend any time or effort doing it manually. Plus, I provide quality results quickly and efficiently within your budget. Lets connect through chat for further detailed discussion, i can start the work right after the discussion., thank you Gaurav D.
$1 125 USD w 7 dni
4,9 (292 opinii)
8,1
8,1
Awatar Użytkownika
Hello! I am George, a web crawler expert with experience in custom web scraping solutions. As an example, I can cite our previous project which involved scraping in a similar field: product data from 17 different internet resources was provided to a background database manager in a structured format. I feel confident that my team and I can complete the task comfortably in the given two-week timeframe and deliver the product data you need. In addition, I am sure that our solution can handle the entire product portfolio in the future if the test is successful. We can use any programming language and framework that is fit best for the job. I have the following questions about the task: 1. Does the client follow any specific names, unique identifiers or product descriptions that must be requested? 2. Are there any particular sources or websites from which the product data should not be taken? 3. Are any security measures in place to protect the data we are using? 4. Is it necessary to register in the websites prior to scraping the product data? 5. Is there a particular structure and format that the data should be provided in? I am looking forward to further discussions and thank you for such interesting project proposal!
$1 500 USD w 3 dni
5,0 (114 opinii)
8,0
8,0
Awatar Użytkownika
Hello there, I am experienced in web scraping and to build script or a windows desktop application by using python. I am also experienced in large data scraping from the given website, by pass IP, Captcha, and anti bot or cloud flair protection. Please message me to discuss more regarding this project. Best Regards
$750 USD w 7 dni
4,9 (370 opinii)
8,1
8,1
Awatar Użytkownika
Hey, ----keen eye for detail and outstanding observational abilities----Let’s get started to achieve your goals on this specific task.I am talented solution oriented Web scarpper/Full stack developer. Please ping me to get started and provide you great results. Thanks
$1 200 USD w 7 dni
4,9 (108 opinii)
7,9
7,9
Awatar Użytkownika
Hi, I am a experienced web scraping, and wordpress web developer am verified by freelancer.com you can visit my profile to verify it. https://www.freelancer.com/u/rehmatclick I have read your project details that's pretty simple for me am sure I can do this but I have some questions to ask so please message me for other details thanks Am Muhammad Ghaffar professional freelancer before 8 years. You can check the profile link below for previous feedbacks and portfolio. https://www.freelancer.com/u/rehmatclick Regards, Muhammad Ghaffar.
$800 USD w 3 dni
4,9 (288 opinii)
7,6
7,6
Awatar Użytkownika
Hello, my name is Hossein and I am a qualified freelancer. I have extensive experience in data entry, software architecture, web scraping and mobile software development. I understand that you are looking for a website scraper and need data updates to be made daily over a two-week testing period to ensure accuracy (apart from products that become unavailable during the day due to stock depletion). My skillset allows me to complete this project efficiently. Please feel free to contact me if you would like any further information or if you would like me to submit a bid for this project. Thank you for considering me for this position!
$1 125,01 USD w 7 dni
5,0 (59 opinii)
7,0
7,0
Awatar Użytkownika
Hello I have read your project details that's pretty simple for me am sure I can do this but I have some questions to ask so Please send me a message so that we can discuss more. Thank you Azad
$1 200 USD w 15 dni
4,9 (168 opinii)
7,3
7,3
Awatar Użytkownika
Dear Sir, Are you looking for a reliable and efficient solution to identify and provide 350 pre-selected products from nine Hungarian-language online stores of retail chains? I am confident that I can deliver a successful solution that meets your project requirements. My experience in data entry, MySQL, PHP, software architecture, and web scraping makes me the right fit for this project. My proposed steps to complete the project are as follows: 1. Identify the 350 pre-selected products from the nine Hungarian-language online stores of retail chains. 2. Provide the parameters of the identified products in a structured format to the background database manager. 3. Ensure the data updates are synchronised with the update time of the relevant data source. 4. Develop a solution that can efficiently handle product data for the entire portfolio of the given sources in the future. 5. Configure a “real life” web client (user-agent, etc.) and proxy configuration from list (if you want to run the scraper from multiple IP addresses). I am offering a free demonstration of the solution even before the project is awarded. I look forward to hearing from you and discussing the project further. Thank you for your time and consideration. Sincerely, Smith
$1 125 USD w 7 dni
4,9 (54 opinii)
7,0
7,0
Awatar Użytkownika
Hello, My name is Sandeep and I am part of the team at ESOLUTIONS SS. We understand that you are looking for a website scraper and we believe our skillset makes us the perfect fit for this project. Our team has extensive data entry, web scraping, data processing and other services that will be invaluable when it comes to working on your website scraper project. We also offer 24/7 availability so that you can always reach us if necessary. With our extensive experience in data entry, web scraping and data processing we are confident that we can provide the required 350 products pre-selected by you on the websites of nine Internet data sources in an accurate manner within the timeframe of 2 weeks.
$750 USD w 1 dzień
4,9 (246 opinii)
7,0
7,0
Awatar Użytkownika
Hello there, Hope you are doing well. As you are looking for a website scrapper to identify a total of 350 products pre-selected by the client on the websites of nine Internet data sources (Hungarian-language online stores of retail chains), some of which are offered by several retailers and some of which are sold by only one retailer. We have the skill set you need to make this project. Given our substantial 8 years of experience with the website and Application development and data scraping, If you have any questions and/or suggestions, feel free to reach out. Looking forward to a fruitful collaboration. Thanks & Regards Gopal
$800 USD w 8 dni
4,5 (127 opinii)
7,7
7,7
Awatar Użytkownika
Hello, I have over 9 years of experience in extracting data and I have a long history of successfully completed projects and positive feedback. I am a full-time freelancer and do Web Scraping, Web Crawler, Data Scraping, Web Automation, Django, Data Mining, Custom bot development, Building Business Lists, Email list generating, Lead Generation, Data Extraction, Data entry and many more. I am creating automated data extraction systems for more than six years now. I have already scraped millions of records out of dozens of websites. I can scrape any kind of websites like - E-Commerce - Business Directories - Listing site - any public website My Technical skills are as follows - Languages: Python, PHP, JAVA, MySQL, HTML - Libraries: Selenium, Scrapy, Requests, Regex, BeautifulSoup4, Multiprocessing, Pandas - OS: Windows, Ubuntu Linux 16.04 - Browsers: Chromedriver, Firefox driver You can expect fast and accurate results. Try to describe your needs as much as possible (exact site URL + the fields you need). Thank you
$1 000 USD w 12 dni
5,0 (13 opinii)
6,5
6,5
Awatar Użytkownika
Dear Client, We are delighted to have the opportunity to present our proposal for the Website Scraper project. With over 20 years of experience in the IT industry, our company, N&T Negocios y Tecnologias s.r.l., has a proven track record in developing web, mobile, blockchain, and AI projects. Based on the project description provided, we have identified several solutions to meet your requirements effectively. Our proposed architecture and technology include the use of a web scraping tool that will systematically extract the desired product data from the specified Hungarian-language online stores. This tool will be configured to mimic a genuine web client, preventing any potential flagging issues. Additionally, the tool will support proxy configuration to enable scraper operation from multiple IP addresses. To ensure accuracy, the data updates will be synchronized with the update time of the relevant data sources, focusing on price and product availability. Daily updates will be carried out during a two-week testing period, allowing us to verify and maintain data accuracy. The extracted data, including product name, description, image, packaging details, price, attributes, and unique identifier, will be then structured and stored in a backend database. In anticipation of future scalability, we aim to develop a solution that can efficiently handle the entire product portfolio of the given sources, with a capacity of up to 60-70K products per source. We estimate a timeframe of two weeks to complete the project, followed by a two-week update period as agreed upon with your team. The programming language and framework for the implementation are flexible and can be tailored to your preferences. In terms of budget, our proposed range is $800-1200 USD, subject to final agreement upon further discussions and Q&As. We believe this budget is appropriate considering the complexity and scope of the project. We kindly request all interested parties to submit their bids by 05.07.2023. We assure you that the contracting authority will reach out to selected bidders for further discussions and to finalize the agreement. Thank you for considering our proposal. We look forward to your positive response. Best regards, N&T Negocios y Tecnologias s.r.l.
$1 500 USD w 30 dni
4,9 (8 opinii)
6,6
6,6
Awatar Użytkownika
Hello, my name is Furqan and I am writing to you regarding your project for Website Scraper. I understand that you are looking for someone who can identify 350 products on the websites of nine Internet data sources that are offered by several retailers and sold by only one. I believe I am the perfect fit for this project as I have extensive experience in data entry, MySQL, PHP, web scraping and more. Additionally, I have experience in developing systems using CodeIgniter, Cakephp and Dotnetnuke as well as platforms such as Odoo and Magento. This gives me the knowledge necessary to effectively complete the task at hand within the timeframe agreed upon between us. I would be more than happy to discuss this project further with you if given the opportunity. Please feel free to reach out if you have any additional questions or would like to discuss further.
$1 125 USD w 7 dni
4,9 (21 opinii)
6,2
6,2
Awatar Użytkownika
Hi, Greetings for the day! My name is Apurva and have experience of more than 6 years in writing robust Python utility Scripts for Scraping, Automation, and Importing. so I can help you to identify a total of 350 products pre-selected by the client on the websites of nine Internet data sources. I can write custom code to crawl and extract different sorts of data and provide the Best Web Scraping and Data Extraction Services. I can efficiently scrape data from websites, aggregate them, and report for business operations. I can automate the task while performing the following steps- - Access data behind user authentication by solving captcha in some cases. - Pull together transaction records by navigating to various characters, numeric fields, calendars. - Iterate to complete transactions for a time period. - Prepare the data from each website to a set schema ready for BI ingestion. My expertise lies in- • Scraping websites with bare-bones structures and complex to parse • Regular expression( regex) to extract data • Selenium scripts to automate activities on the web • Bot development • ETL Rest I assure you about the quality work and delivery of the project on time. Response Awaiting! Regards
$1 000 USD w 12 dni
4,9 (26 opinii)
6,2
6,2
Awatar Użytkownika
Hello Employer, I can build up a project to handle searches of the selected products from different retail sources along with IP & User Agent rotations to avoid being flagged as a Bot. I am interested to know theoratical design and the complete requirements. I am available for meetings to discuss the project. From the description, I clearly understood that you need a web crawler to identify selected products from integrated Nine data sources ( all in hungarian ). So the workload according to me, is to develop 9 scrapers to pull data of selected products received by the client and handed over to Database manager once scraping is complete. Good news is that I have a team of web scrapers that can make these 9 scrapers. Otherwise, it will take longer to develop 9 scrapers, a integrated system and fully functioning db in 14 days. You can leave me a message and I can all the queries that you might have regarding my team, my work and deliverables of the project. I will work on this project for 1000 USD and it will delivered on promised deadline. Thank you, Mubashir A.
$1 000 USD w 14 dni
5,0 (31 opinii)
6,1
6,1
Awatar Użytkownika
Hello Gábor J., We would like to grab this opportunity and will work till you get 100% satisfied with our work. We are an expert team which have many years of experience on PHP Please come over chat and discuss your requirement in a detailed way. Thank You
$1 100 USD w 7 dni
5,0 (12 opinii)
5,7
5,7

O kliencie

Flaga HUNGARY
Budapest, Hungary
5,0
1
Zweryfikowana metoda płatności
Członek od sty 19, 2023

Weryfikacja Klienta

Dziękujemy! Przesłaliśmy Ci e-mailem link do odebrania darmowego bonusu.
Coś poszło nie tak podczas wysyłania wiadomości e-mail. Proszę spróbować ponownie.
Zarejestrowani Użytkownicy Całkowita Liczba Opublikowanych Projektów
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Wczytywanie podglądu
Udzielono pozwolenia na Geolokalizację.
Twoja sesja logowania wygasła i zostałeś wylogowany. Proszę, zalogować się ponownie.