Unlike other scraping utilities that charge for the set up external proxies feature, Octoparse allows both free and premium users to add custom proxies for IP rotation. Getting your IP address blocked is one of the problems you may face when scraping websites. So a proxy or proxy server is an essential part of web scraping and it is widely used for anonymous web scraping.Ĭlick "Setting" above the workflow once you've finished configuration. Manual set up proxies in Octoparse is particularly useful if you would like to access the website with external proxies (or from a specific country) or you prefer to use your own proxies instead of using our auto IP rotation features of cloud extraction. There are some websites that might be very sensitive to web scraping and take some serious anti-scraping measures like IP’s blocking to stop any possible scraping activities.
The latest version for this tutorial is available here.
0 kommentar(er)
