Introducing NinjaPear Learn more

NinjaPear Logo NinjaPear
faq

How to maximize throughput on Proxycurl?

More often or not, Proxycurl is not the bottleneck for your application.

On a regular account, every account has a rate limit of 300 requests every minute. So, in theory, you can make 432,000 API requests per day, which amounts to $4320 per day at a minimum. This brings me to the point that most customers are bottlenecked by budget and not the API itself.

That said, should budget not be a problem for you, you can take the following steps to maximize throughput on Proxycurl API.

  1. Make API requests in parallel. It would help if you increased the concurrency until you are maxing out the rate limit.

For each thread that is making the API request:

  • Handle 503 errors by retrying immediately up to 3 times.
  • Handle 500 errors by retrying up to 2 times later. (Could be an intermittent database issue).
  • Handle 429 with exponential backoff.
Steven Goh | CEO
World's laziest CEO. Before starting the highly-successful Proxycurl and Sapiengraph, Steven founded 5 other startups: Gom VPN, Kloudsec, SilvrBullet, NuMoney, and SharedHere.

Featured Articles

Here's what we've been up to recently.

I dismissed someone, and it was not because of COVID19

The cadence of delivery. Last month, I dismissed the employment of a software developer who oversold himself during the interview phase. He turned out to be on the lowest rung of the software engineers in my company. Not being good enough is not a reason to be dismissed. But not

sharedhere

I got blocked from posting on Facebook

I tried sharing some news on Facebook today, and I got blocked from posting in other groups. I had figured that I needed a better growth engine instead of over-sharing on Facebook, so I spent the morning planning the new growth engine. Growth Hacking I term what I do in