Scraper for multiple e-commerce websites

We're looking for someone who can build a scraper that will scrape the products/clothing items from several e-commerce websites to create a single database. We'd like these products displayed on a website where visitors can browse and filters the items based on sizes, colors, types of clothing, and more. The visitor does not need the ability to purchase from our website; instead, we will offer an affiliate link to the 3rd party website where the visitor can buy it.

Our website will only focus on 1 style of clothing (petite) so we will provide the direct URLs to this category for each ecommerce website. The initial sites will be:

-[login to view URL]

-[login to view URL]

-[login to view URL]

-[login to view URL]

-[login to view URL]

*Alternatively, if any of the sites provide an API, you can use it instead.

We will start by scraping these 5 e-commerce sites. The chosen developer will be paid to add additional websites at a later time.

*Phase 1:*

Build the scraper. Perhaps something like [login to view URL]

1. Scrape all data provided by the e-commerce website; some examples of required data (if provided):

*Product name


*URL to product


*Sale price

*In-stock/out of stock



*Category (shirt, pants, shorts etc.)


2. Configure the scraper to be executed daily.

3. When the details of a product changes (such as the price or "in stock" status), update our database accordingly.

3. "Flag" any items in our database that are no longer available (i.e., item does not exist on the website anymore but still exists in our database)

*Phase 2:*

Create an admin panel that displays all products scraped.

1. Allow admins to add any missing data for the product.

2. Allow admins to assign custom keywords/tags to each item (pattern, solid, striped).

3. Create a button that allows us to "Add Product to Website", which allows the product to be visible on the website (alternatively, they should be able to toggle to "Remove from Website").

4. Allow #2 to be completed in mass (check boxes that we can add/remove multiple products at once).

5. Add an option for each product to "delete". Deleting will remove the product from the admin list/prevent it from showing again in the future.

6. Basic filtering in the admin to sort the products.

7. A filter/page that lists all items that no longer exist (see Phase 1, #3).

8. A section to manage "affiliate links" for each e-commerce website.

For example, when we display a product link to "[login to view URL]", we need to automatically append parameters to the [login to view URL] URL, ex:

[login to view URL]

will become:

[login to view URL]

*We need this page in the admin to allow us to define the parameters that must be added to each 3rd party ecommerce domain we're going to link to

*Phase 3:*

Create a public facing website with a basic fashion e-commerce theme

1. We'll need your help choosing a CMS that will be the best fitting for this type of website (Wordpress with WooCommerce?)

2. The website will need to contain filtering options for filtering the products. For example:

[login to view URL]

Filtering options include:

*Price range



*Category (shirt, pants, shorts etc.)


3. An option to "Sort results by".

*Most popular

*Price high to low

*Price low to high



[login to view URL]

4. Display 12 products by default, load more products as the user scrolls down

5. Each product will need its own "view product" page that provides all the information we have stored as well as a link to the 3rd party e-commerce website to purchase the item

6. A global search box/search results page

7. Track number of clicks on the "purchase item" button for each product. We will need this to track the "most popular" items (needed for #3)

Umiejętności: MySQL, PHP, Python, Pozyskiwanie danych z Internetu, WordPress

Zobacz więcej: e commerce websites, e-commerce websites, website development and design and e commerce websites, e commerce websites in uae, all india e commerce websites name and email, amazon international e commerce websites, art e commerce websites, buy e commerce websites, c2b e commerce websites list, cheap e commerce websites in dubai, china e commerce websites, drupal e-commerce websites, e commerce websites alibaba, e commerce websites description, e commerce websites developer noida, e commerce websites developers in india, e commerce websites developers in kolkata, e commerce websites development, e commerce websites development application, e commerce websites development india

O pracodawcy:
( 0 ocen ) United States

Numer ID Projektu: #17576692

56 freelancerów złożyło ofertę na kwotę $578 do tego projektu


Dear AlessandraJones1. I have experienced with woocommerce. I check [login to view URL], [login to view URL], [login to view URL] Więcej

$574 USD w ciągu 16 dni
(1053 Oceny)

Hello, This is Vaishali from "Hire WordPress Experts" and I am here to help you with Scraper for multiple e-commerce websites . We have gone through the information provided by you. and I can assure you that we are Więcej

$250 USD w ciągu 5 dni
(387 Oceny)

Hi, I have extensive experience of working on similar scraping projects, I can help to develop a crawler to scrape products data from the websites you mentioned and create a single database. Please let me know when you Więcej

$250 USD w ciągu 10 dni
(292 Oceny)

Hi,Alessandra! I’m experienced Python developer, and web-scraping is one of my main fields of knowledge, so I’m 100% confident that I can scrap websites you need and organize the product database. Please contact me Więcej

$500 USD w ciągu 5 dni
(73 Oceny)

Hi I can work only on the 1st phase (scraping) I bid with 90 USD per site. I will provide scrapers that can run in "windows VPS" and export to the database. later your site can connect to this database. Więcej

$450 USD w ciągu 2 dni
(168 Oceny)

Greetings! We are a team of experienced professionals and would like to complete your work with quality work. Have a look at our profile and our reviews. We are capable of setting up a website with sleek and sizz Więcej

$750 USD w ciągu 10 dni
(433 Oceny)

Dear Sir/Ma'am, I can scrape for multiple e-commerce websites. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir

$750 USD w ciągu 10 dni
(190 Oceny)

I have read your project details. I have to ask a few questions. Can you please message me via chat so we can discuss all the details to elicit all the requirements and hence start the development? I will showcase al Więcej

$555 USD w ciągu 10 dni
(34 Oceny)

Hi I am expert in web scraping and data mining and i have done several scraping jobs similar to this one. Please check my profile as thats the best thing i can present you as a proof of my skills. After checking pleas Więcej

$500 USD w ciągu 4 dni
(232 Oceny)

Dear AlessandraJones1 I have gone through your project Scraper for multiple e-commerce websites Can we do quick chat right now so that we can discuss the project briefly? I do have similar experience doing somethi Więcej

$525 USD w ciągu 12 dni
(47 Oceny)

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within Więcej

$555 USD w ciągu 5 dni
(95 Oceny)

Hi. I am very interested in your project, because I have much experience in such projects. I have good skills with the program language including C/C++, C#, java, php,, python, VB.NET. So I have expert and s Więcej

$555 USD w ciągu 10 dni
(116 Oceny)

Hi there, I can scrape these websites as I have more than 7 years of experience in this field. I have checked the website and i assure you that i can scrape them for the details you want. Looking forward to hearing ba Więcej

$555 USD w ciągu 3 dni
(158 Oceny)

Hello, Hope you are doing well. I can help with you in your project Scraper for multiple e-commerce websites. I can assure you the quality job. I have good experience in MySQL, PHP, Python, Web Scraping, WordP Więcej

$750 USD w ciągu 12 dni
(73 Oceny)

Hi there, I would like to let you know that I have successfully built more than 150 multiple website based on WordPress for our clients. I have ample experience in not only WordPress but in Magento,Shopify,Wix,Square Więcej

$411 USD w ciągu 8 dni
(140 Oceny)

Hello Sir, As a self-motivated, solutions-oriented and passionate individual, I have been actively involved in implementing WordPress security and have considerable knowledge of PHP and MySQL Injection. With over 8 Więcej

$666 USD w ciągu 10 dni
(173 Oceny)

My name is Nelson. How are you? I read your description carefully and fully understood what you need. I'm the best, highly skilled and talented Mobile app developer who can give you great help. As a senior and profess Więcej

$555 USD w ciągu 10 dni
(5 Oceny)

Hi Sir, I’m a Python Programmer. I have created many Bots to scrape the websites like Amazon(UK, USA, AU, de),Alibaba(suppliers data), Linkedin, Facebook, Trulia(real estate, homes), [login to view URL], Amazon(using API), A Więcej

$360 USD w ciągu 4 dni
(151 Oceny)

Hi there, My queries:- 1. Which payment gateway you want to integrate? 2. Do you also want to add any shipping charges? Please clear me these points. I am ready to start working today. I've 7 year experienc Więcej

$555 USD w ciągu 10 dni
(114 Oceny)

⭐⭐⭐⭐⭐ Hello ⭐⭐⭐⭐⭐ I'm a senior developer and Scraping expert. Web scraping is my skill, and I can do your task perfectly in a short time. I can scrape by PHP or Python. I can save data to .csv or .xml file. I will Więcej

$300 USD w ciągu 10 dni
(37 Oceny)