Send 1000k+ HTTP requests a second
£10-20 GBP
Płatność przy odbiorze
We would essentially require a solution to make > 1000 HTTP requests in parallel a second.
Our proxy provider allows us to use residential proxies with an incredibly low latency.
Thus, speed is not a bottleneck in the given use-case nor should it be whatsoever.
In terms of a programming language, we would prefer Golang or Python to be used.
However, If you have anything else in mind then we're open to ideas!
The plan would be to have a solution which makes > 1000 HTTP requests in parallel a second while connected to a specified HTTP proxy (Oxylabs). It is an absolute requirement that we meet these specifications and have the resources to do so.
We have already looked into this topic but failed with little success due to host connection limitations or improper techniques used while attempting the given task. Thus, we have attempted to reach out to the world of Freelancer.
The endpoint (i.e. [login to view URL]) in mind is not to change although the payload (data) sent shall change with each request.
All required additional information shall be given upon request.
If you think that you could assist us from a long-time perspective then please do let us know as there is an opportunity to make a fixed amount of $1000-2000 every week. See this as more-so a test of knowledge then anything.
We have an example version of what we need done but it sadly has a bottleneck (hence why we posted here).
P.S. This is an urgent listing so please get back to us if you think you can do the job!
Numer ID Projektu: #17984443
O projekcie
11 freelancerów złożyło ofertę za £71 w tym projekcie
Hi, I have a knowledge using python with AWS lambda to do parallel requests. Per default, you can reach at maximum 5k requests at the same time using AWS lambda.
Using Tensorflow Deep Learning library this can be achieved. Pure python multi threading or multiprocessing is limited. Take my bid in account for this challenge. Kind Regards, Dom
Hi, I've worked quite a bit with writing server code for highly parallel and concurrent servers with multiple protocols. I've worked with servers that bypass the host OS network stack, as well as from within the ho Więcej
Hello, I wrote a similar script to the one you are describing and it can be realized in a few lines of code using Python. However I do have a few questions about your project. What version of python do you want the Więcej
Hello, I think for this job we can use the language Golang to be faster than python. We can just start some goroutine to achieve all the requests that you want or use a lib for stress tests which I think can help us as Więcej
