what's the best way to scale scraping-heavy services like this without getting blocked?
nDmitry 4 hours ago [-]
It depends on how their owners protect them. Switching IPs via proxies and changing user agents are well-known and relatively simple methods—essentially pretending to be different clients. However, nowadays, services like Cloudflare often render these techniques obsolete, forcing you to mimic human behavior instead. I don’t have expertise in that area.