Top News

This proxy provider I tested is the best for web scraping – and it’s not IPRoyal or MarsProxies

Oxylabs reports just a million machines in its proxy pool, IPRoyal reports dashboard

Screenshot by David Gewirtz/ZDNET

They also offer a testing platform, called the API playground. It’s here that you can paste in code segments and see how they perform. Note that the company offers pre-written code blocks for CURL, Python, PHP, C#, Go, Java, Node.js, and JSON. That’s a plus, because many API vendors don’t do this. I always feel more comfortable when I can see code examples in the programming environment I’m using.

Screenshot by David Gewirtz/ZDNET

Notice how challenging the raw returned data is. But then I did the same operation using OxyCopilot. I started by giving it a URL to scrape.

Screenshot by David Gewirtz/ZDNET

The result is this interesting form. Note that it did pull the pricing data correctly. It presented the data to me as a JSON block. But the interesting bit is the Parsing Instructions tab at the far right.

seems like a good choice. And, judging from my limited testing, it’s also a good choice from a programming and algorithmic point of view.

As for whether it’s cost-effective, that depends entirely on your use case. Only you and your team can decide that.

Also: How Cisco plans to stop rogue AI agent attacks inside your network

Finally, when it comes to documentation and training materials, Oxylabs is first-rate. I was very impressed with the overall content on their site and on YouTube. It brought me up to speed very quickly.

What about you? Have you used proxy or web scraping services like Oxylabs in your work or research? What challenges have you faced with data collection at scale, and how did you navigate ethical or technical roadblocks? Have you tried integrating AI tools like OxyCopilot to streamline your scraping workflows? Let us know in the comments below.

Access news anywhere with our mobile app:
Send this to a friend