Proxies for web scraping
What changes with one
Many addresses where you had one
Rotating residential gives each new connection a different home IP, so the per-IP counter on the other end never climbs far.
Your own IP stays clean
The target sees our exit address. If something gets blocked, it is that address, and your home connection keeps working.
A cheap lane for sites that do not care
Plenty of sites never check whether you come from a hosting range. For those, one rented datacenter IP does the job for a fixed price per term.
When it will not help
A proxy does nothing for a scraper that fires fifty parallel requests at one site, sends a Python user agent, or throws cookies away. Fix those first. A new IP buys a badly behaved crawler a few more minutes.
What to run it on
Residential
Sites that bother blocking scrapers usually block by range and by rate. Rotation handles both, and you pay only for the bytes you move.
from $1.75/GB
Datacenter
If a quick test shows the site lets datacenter through, a rented IP for the month is the cheaper way to fetch the same pages.
from $1.50/IP/mo
What it would cost
Worked out from today’s price list with the assumptions shown. Your pages will weigh something else, so measure fifty of them and redo the sum.
A one-off crawl of product pages from a single shop
Requests10,000
Weight each~120 KB
Traffic≈ 1.2 GB
Top-up that covers it2 GB
Rate at that size$5.20/GB
Cost$10.40
Assumes HTML only, with images, scripts and fonts not fetched; request and response headers counted. We meter request bytes plus response bytes. The rate is set by the size of one top-up and applies to all of it, and the balance does not expire.
What is off limits
- Credential stuffing: trying leaked usernames and passwords against a login form
- Crawling a small site hard enough to slow it down for its real visitors
- Reselling access to your proxies without a written agreement with us
- Scraping behind a login you legitimately hold, or high-volume crawling of a small site, are grey areas. Ask in Discord before you start.
From our acceptable use policy. We close accounts that break it, and refund the unused balance when we do.
Web scraping questions
Is web scraping legal?
Collecting publicly available data is lawful in many places, but it depends on where you are, what you collect and the site's terms. Our acceptable use policy allows scraping public data at a considerate rate.
Personal data and copyrighted content carry their own rules, and a proxy does not change them.
Residential or datacenter for my first scraper?
Try datacenter first. If the target returns 403s through datacenter and 200s through residential, the site blocks hosting ranges and you need residential. The residential vs datacenter guide has a script that tells you in about five minutes.
How many GB will my scraper use?
Fetch fifty representative pages, read the byte counts in your usage log, and multiply out. We bill request bytes plus response bytes, headers included, so the log will read a little higher than the size of the HTML you saved.
Do I need a new IP for every request?
For one-off page fetches, rotation per request is the default and usually what you want. Paginating a search or holding a cart needs one address for a while; residential supports sticky sessions for that.
Can I pick which country the IP is in?
Residential has no country selector here. The pool covers 180+ countries and you get whichever one the rotation hands you. ISP and datacenter IPs are bought in the country you choose at checkout.
Other use cases
Price monitoring
Watch a few hundred product pages for price drops and restocks without getting your IP benched.
Read →SERP tracking
Check where your side project ranks for a few hundred keywords without meeting a CAPTCHA wall.
Read →AI training data
Collect a text corpus for a fine-tune, a RAG demo or a thesis, and only pay residential rates where you have to.
Read →
Stuck on web scraping?
Post the target and the error in Discord. Somebody has usually hit the same wall and will tell you whether a proxy is even the fix.
Join the Discord4,200+monkeys in the Discord
Help from humans
Post your error, get an answer. Usually in minutes, usually from someone who has hit the same wall.
A status bot that tells on us
Pool health, incidents and maintenance posted automatically. Including the bad days.
Deals and free traffic
Bonus GB drops, early access to new pools, and the occasional giveaway for a good bug report.