I need to set up some of the web Crawlers, which:
- to use some existing crawler freeware solution
- search on google eshops according definition (keywords like: toys ... also with negative KW like: adult), so the task of crowler will be scrape URL of such eshop from google - national version or on some national price comparative websites, or google store ect.
- generaly task of crawller will be to find all eshops according of field of research in the country - just eshops and just in narow defined field by positive and negative keywords
- no new SW needed, i just need to set up some existing freeware solution to make this job for me - i should be able to change the settings as needed
- crawller activity should be regulated - not to be banned
I have the crawler premade but i cant give it to the product budget of 30 eur if you want demo i can provide you i have my reasonable bid price for this project.