Categorygithub.com/boblab/colly/v3extensions
package
3.0.0
Repository: https://github.com/boblab/colly.git
Documentation: pkg.go.dev
Overview
Versions
2
Dependencies
3
Dependents
0
Files
208 SLOC

# Functions

RandomMobileUserAgent generates a random MOBILE browser user-agent on every requests.
RandomUserAgent generates a random DESKTOP browser user-agent on every requests.
Referer sets valid Referer HTTP header to requests.
URLLengthFilter filters out requests with URLs longer than URLLengthLimit.