Introducing NinjaPear Learn more

NinjaPear Logo NinjaPear
proxycurl

Why is the API returning S3 links for profile pictures scraped from Professional Social Network profiles?

When we scrape a public Professional Social Network profile for example with our Person Profile API, we are served with a temporary CDN URL by Professional Social Network which usually begins with https://media-exp... Some of our customers store the temporary CDN URL which expires in an unpredictable manner. To prevent this, we have taken to temporarily cache the images so that the links to the pictures persist in a predictable fashion. To be precise, 30 minutes.

This is by design so developers can handle images by downloading them instead of relying on unreliable CDN URLs.

The recommended approach to these temporal links is to download the image via the URL returned from our API as soon as we return the response and host the image on your end.

Steven Goh | CEO
World's laziest CEO. Before starting the highly-successful Proxycurl and Sapiengraph, Steven founded 5 other startups: Gom VPN, Kloudsec, SilvrBullet, NuMoney, and SharedHere.

Featured Articles

Here's what we've been up to recently.

I dismissed someone, and it was not because of COVID19

The cadence of delivery. Last month, I dismissed the employment of a software developer who oversold himself during the interview phase. He turned out to be on the lowest rung of the software engineers in my company. Not being good enough is not a reason to be dismissed. But not

sharedhere

I got blocked from posting on Facebook

I tried sharing some news on Facebook today, and I got blocked from posting in other groups. I had figured that I needed a better growth engine instead of over-sharing on Facebook, so I spent the morning planning the new growth engine. Growth Hacking I term what I do in