Colly (Go) 代理配置
The scraping framework for Go. 按下面的配置把它指向 Eveses 住宅池 — 地区写在用户名里,所以换国家不需要动其他任何设置。
proxy.eveses.com:12321 · SOCKS5 在 32325 · 199 个国家 · $7.35/GB 起
Colly ships `proxy.RoundRobinProxySwitcher`, which rotates a fixed LIST of proxy URLs. With a rotating pool you want the opposite: one URL, and the pool rotates behind it. Feeding the switcher one URL is correct and the round-robin is simply unused.
配置
package main
import (
"github.com/gocolly/colly/v2"
"github.com/gocolly/colly/v2/proxy"
)
func main() {
c := colly.NewCollector(colly.Async(true))
// One URL: the pool rotates behind it, so the switcher has nothing to do.
rp, err := proxy.RoundRobinProxySwitcher(
"http://eveses_user_country-us:[email protected]:12321",
)
if err != nil { panic(err) }
c.SetProxyFunc(rp)
c.OnHTML("title", func(e *colly.HTMLElement) { println(e.Text) })
c.Visit("https://target-site.com")
c.Wait()
}Colly (Go) 相关说明
Set Limit() with a Parallelism cap; Colly's async mode will otherwise open as many connections as it has URLs.
Give each parallel worker its own session token if the target ties state to an IP.
换国家而不动 Colly (Go)
eveses_user_country-deeveses_user_country-de_session-ab12cd34_lifetime-30m地区和会话都写在用户名里,而不是主机或端口。换国家时本页所有配置保持原样 — 你只改一个字符串。可定位 199 个国家,其中大多数还支持城市与州/省令牌。