Categorygithub.com/linkec/collyextensions
package
1.2.0
Repository: https://github.com/linkec/colly.git
Documentation: pkg.go.dev
Overview
Versions
1
Dependencies
3
Dependents
0
Files
72 SLOC

# Functions

RandomUserAgent generates a random browser user agent on every request.
Referer sets valid Referer HTTP header to requests.
URLLengthFilter filters out requests with URLs longer than URLLengthLimit.