Proxycurl Blog | Read our stories on data, scraping, APIs (Page 7)

Welcome to the Proxycurl blog, your new hub for all things relating to B2B data. Especially data enrichment and scraping! You can find our product and company updates here too.

Tutorial: How to crawl millions of LinkedIn private profiles

Tutorial: How to crawl millions of LinkedIn private profiles

LinkedIn sued Mantheos, a real-time LinkedIn Scraping API service, on 1st February 2022 for fraudulently scraping millions of profiles. In a way, Mantheos is a competitor of ours, and I have always been curious about how they can scrape private LinkedIn profiles at scale. Finally, I understood how they do

Tutorial: How to crawl millions of LinkedIn private profiles

LinkedIn is suing Mantheos - What you should know

LinkedIn is suing Mantheos - What you should know

As the chief customer support officer of Proxycurl, I have been receiving emails seeking clarifications on our service reliability from customers who swing between our service and Mantheos'. I quote one email: One of our other vendors informed us there have been significant changes to the LinkedIn data structure.

LinkedIn is suing Mantheos - What you should know

Happy Lunar New Year! We added 1.5M Irish profiles into LinkDB

Happy Lunar New Year! We added 1.5M Irish profiles into LinkDB

I am happy to share that we just added 1.5M Irish profiles to LinkDB. With this update, Ireland is now an officially supported region in Proxycurl's suite of services. Now, you can: * List Irish employees with our Employee Listing API Endpoint * Purchase a snapshot of 1.5M

Happy Lunar New Year! We added 1.5M Irish profiles into LinkDB

Happy 2022! We added 6.3M Australians to LinkDB

Happy 2022! We added 6.3M Australians to LinkDB

I am happy to share that we just added 6.3M Australian profiles to LinkDB. With this update, Australia is now an officially supported region in Proxycurl's suite of services. Now, you can: * List Australian employees with our Employee Listing API Endpoint * Purchase a snapshot of 6.3M

Happy 2022! We added 6.3M Australians to LinkDB

ways to maximize throughput on Proxycurl

How to maximize throughput on Proxycurl?

More often or not, Proxycurl is not the bottleneck for your application. On a regular account, every account has a rate limit of 300 requests every minute. So, in theory, you can make 432,000 API requests per day, which amounts to $4320 per day at a minimum. This brings

ways to maximize throughput on Proxycurl

15+M UK profiles added to LinkDB

15+M UK profiles added to LinkDB

I am happy to share that we just added 15+M UK profiles to LinkDB. With this update, United Kingdom is now an officially supported region in Proxycurl's suite of services. Now, you can: * List UK employees with our Employee Listing API Endpoint [https://nubela.co/proxycurl/docs#

15+M UK profiles added to LinkDB

Does Proxycurl scrape a LinkedIn profile for posts?

Yes, we do for people profiles, with caveats. The articles and activities values in our Person Profile Endpoint describe a profile's post activities. However, given that we scrape public LinkedIn profiles, our API can only scrape what is present on the public profile: the most recent (ten) posts.

How to get a list of former employees of Buzzfeed (or any other companies)

How to get a list of former employees of Buzzfeed (or any other companies)

There are only three ways to get a list of employees of any company. The goal of this article is to guide you to a fool-proof method to build a list of employees working in any company in a spreadsheet without much menial effort. To get a list of employees

How to get a list of former employees of Buzzfeed (or any other companies)

Enrich companies with funding, categories, emails, exits/acquisitions data

Enrich companies with funding, categories, emails, exits/acquisitions data

Hello! We are constantly adding data sources other than LinkedIn into Proxycurl API, such as the data powering our Contact API. Happy to share that we're adding 40 new data points to the Company Profile Endpoint, which includes but is not limited to: * Funding data -- how much

Enrich companies with funding, categories, emails, exits/acquisitions data

Our service stability depends on LinkedIn's policies

How stable is Proxycurl for scraping LinkedIn?

The short answer is -- as stable as LinkedIn lets us be. It is a constant cat-and-mouse game with LinkedIn. Given that we scrape public LinkedIn profiles only. There are quite a few moving parts that we have no control over, such as: * If LinkedIn removes a particular data field

Our service stability depends on LinkedIn's policies

Introducing the Role Lookup API endpoint for quickly finding specific LinkedIn profiles by company and role.

Introducing Role Lookup API endpoint

Proxycurl's Lookup Search endpoint takes in a company_name and the role you want to reach out to, and bam. It returns you the LinkedIn profile URL of the person of interest.

Introducing the Role Lookup API endpoint for quickly finding specific LinkedIn profiles by company and role.

Why use Proxycurl if you are already using LinkedHelper, Zoominfo, and LinkedIn Sales Navigator?

Why use Proxycurl if you are already using LinkedHelper, Zoominfo, and LinkedIn Sales Navigator?

In one of my sales outreach, I spoke to a customer who challenged me: > We use LinkedHelper and I'm an expert. So I'm not sure what your service would add. Right off the bat, the user is very sales-savvy but not technically savvy because he

Why use Proxycurl if you are already using LinkedHelper, Zoominfo, and LinkedIn Sales Navigator?

Contact Number Lookup API is now live!

Contact Number Lookup API is now live!

Today, it's personal phone numbers. So we are live with a new API endpoint today -- Personal Contact Number Lookup API endpoint.

Contact Number Lookup API is now live!

Introducing Personal Email Lookup API

Introducing Personal Email Lookup API

I'm happy to share that we have a new Personal Email Lookup API endpoint, which is live right now in production.

Introducing Personal Email Lookup API

Advanced search of companies on LinkedIn - based on industries, funding, products, apps and more

The Ultimate Guide To Advanced LinkedIn Company Search

I will take you through the various techniques to make a LinkedIn Company Search. These techniques range from straightforward to advanced, depending on what your needs are.

Advanced search of companies on LinkedIn - based on industries, funding, products, apps and more

How to change your login email address in Proxycurl?

How to change your login email address in Proxycurl?

The customer support staff at Proxycurl can help you change your email address. However, it is not a direct change. What we can do is to transfer credits from one account to another. We are not able to help you move over 1. the credit cards added to the original

How to change your login email address in Proxycurl?

870k Israeli profiles added to LinkDB

870k Israeli profiles added to LinkDB

I am happy to share that we just added 8.7+ Israeli profiles to LinkDB. With this, Israel is now an officially supported region in Proxycurl's suite of services.

870k Israeli profiles added to LinkDB

Can Proxycurl scrape LinkedIn profile connections?

No, Proxycurl is not able to fetch connections of users for two reasons..

8.7M Canadian profiles added to LinkDB

8.7M Canadian profiles added to LinkDB

I am happy to share that we just added 8.7+ Canadian profiles to LinkDB. With this, Canada is now an officially supported region in Proxycurl's suite of services. Now, you can: * List Canadian employees with our Employee Listing API Endpoint * Query Canadian profiles in LinkDB * Purchase a

8.7M Canadian profiles added to LinkDB

Proxycurl Vs. People Data Labs

Proxycurl Vs. People Data Labs

US employers struggle to find workers to keep up with the economy’s recovery from the pandemic-caused recession. Although the job market is picking up all over the US, the unemployment rate still fell from 5.8% to 6.1% in May. Employers can close the labor gap is to

Proxycurl Vs. People Data Labs

API updated to return 503 for backend scraping failures instead of 429.

We updated the status code for "scrape failed" event from 429 to 503

We updated the API today with a new 503 error status code. Context -- there are two reasons why you will get an error with the status code of 429. And it has been confusing for users because users assume they made a mistake. The first reason is that your

API updated to return 503 for backend scraping failures instead of 429.

Reasons why first name and last name are wrong sometimes.

Why do the `first_name` and `last_name` return incorrectly sometimes in the Person Profile API Endpoint?

There are two reasons why it happens in our Person Profile API Endpoint [https://nubela.co/proxycurl/linkedin]: 1. The interpretation of first and last names might vary between people. For example, my name is "Steven Goh." Some people might consider "Steven" the first name, and

Reasons why first name and last name are wrong sometimes.

5 Sure Hacks To Find Anyone's Personal & Work Emails

5 Sure Hacks To Find Anyone's Personal & Work Emails

In this article, I will exhaustively list down all possible methods you can use to lookup email addresses, personal or work, for anyone on the internet.

5 Sure Hacks To Find Anyone's Personal & Work Emails

Proxycurl now provides an API Endpoint to search for LinkedIn profiles based on specific criterias

Does Proxycurl have an API Endpoint to search Linkedin profiles?

Yes we do! You can use the Company Search Endpoint & Person Search Endpoint.

Proxycurl now provides an API Endpoint to search for LinkedIn profiles based on specific criterias

What causes a slow API

Why is the API so slow?

Proxycurl scrapes public Linkedin profiles in real-time and on-demand. Web scraping takes time, and on average. Every API Request dispatches a real-time job to scrape a profile. Because each API request is a job to scrape a profile live, it takes about 5-6 seconds to complete and the API to

What causes a slow API

Subscribe to our newsletter

Get the latest news from Proxycurl