Bug in Python Scraper (Paying for Fix)

€8-30 EUR

Zamknięte

Opublikowano

około 8 lat temu

€8-30 EUR

Płatne przy odbiorze

I am currently experiencing a bug in a twitter search scraper. The application gets the json results for a specified keyword. After about a week of scraping data the last output is `{'min_position': 'TWEET-694117347599130624-694117353320116224-BD1UO2FFu9QAAAAAAAAETAAAAAcAAAASAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA', 'items_html': '\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n', 'has_more_items': False, 'focused_refresh_interval': 30000, 'new_latent_count': 0}`. I don't know whether the error is timeout related or whether Twitter simply blocks access. I hope someone got an idea. Code is provided in attachment. Will pay maximum of 30 Euros. Please do not come up with you could use the Twitter API. I need old tweets!

JSON

Python

Web Scraping

Identyfikator projektu: 9618025

Informację o projekcie

7 ofert

Zdalny projekt

Aktywny 8 lat temu

Szukasz sposobu na zarobienie pieniędzy?

Adres e-mail

Korzyści ze składania ofert na Freelancer.com

Ustal budżet i ramy czasowe

Otrzymuj wynagrodzenie za swoją pracę

Przedstaw swoją propozycję

Rejestracja i składanie ofert jest bezpłatne

7 freelancerzy składają oferty o średniej wysokości €25 EUR dla tej pracy

@Marie1234

A proposal has not yet been provided

€28 EUR w 1 dzień

4,9

(88 opinii)

6,6

@TonyPFS

Your crawler running to fast and simple static period. So twitter can detect you as bot. Also your code is little bit dirty :) Twitter blocked your account or ip for acting like bot. If you need any help to improve it just text me i don't want any price i can help you free. I build 2 social media analyzer and also too many twitter bots. I can help you. Bests.

€12 EUR w 1 dzień

0,0

(0 opinii)

0,0

@almiasnikov

Hello! I was able to make it work. The problem was in your static min_id and max_id. And what you attached is not bug in Twitter, but rather normal behaviour. You need to handle min_id and max_id properly ( try resetting both to zeros to see results, for example ). Lets talk about that!

€23 EUR w 1 dzień

0,0

(0 opinii)

0,0

@pphowakande

Hello, I have 4 years of experience in Big Data Projects and I have worked on Big Data technologies like Golang ,Python ,PHP,Mongodb , SQL,mapreduce framework ,NodeJs ,ANgular Js ,Redis ,RabbitMQ ,docker ,Linux. I have worked on writiing programs to get mentions from alll social media platforms like facebook ,twitter , youtube ,etc. I can handle this issue very well.

€23 EUR w 1 dzień