Categorygithub.com/axeven/colly/v2extensions
package
2.2.0
Repository: https://github.com/axeven/colly.git
Documentation: pkg.go.dev
Overview
Versions
1
Dependencies
4
Dependents
0
Files
507 SLOC

# Functions

RandomMobileUserAgent generates a random MOBILE browser user-agent on every requests.
RandomUserAgent generates a random DESKTOP browser user-agent on every requests.
Referer sets valid Referer HTTP header to requests.
URLLengthFilter filters out requests with URLs longer than URLLengthLimit.