Categorygithub.com/golangltd/pholcusappdownloadersurfer
package
1.3.0
Repository: https://github.com/golangltd/pholcus.git
Documentation: pkg.go.dev
Overview
Versions
2
Dependencies
26
Dependents
0
Files
924 SLOC

# Packages

Package agent generates user agents strings for well known browsers and for custom browsers.
No description provided by the author

# Functions

采用surf内核下载时，可以尝试自动转码为utf8 采用phantomjs内核时，无需转码（已是utf8）.
读取完整响应流正文.
销毁Phantomjs的js临时文件.
No description provided by the author
The GetWDPath gets the work directory path.
The IsDirExists judges path is directory or not.
The IsFileExists judges path is file or not.
New 创建一个Surf下载器.
No description provided by the author
No description provided by the author
返回编码后的url.URL指针、及解析错误.
遍历目录，可指定后缀.

# Constants

默认下载超时.
默认请求服务器超时.
默认请求方法.
默认重新下载前停顿时长.
默认最大下载次数.
PhomtomJs下载器标识符.
Surf下载器标识符.

# Structs

Body
封装Response.Body.
No description provided by the author
No description provided by the author
DnsCache DNS cache.
No description provided by the author
No description provided by the author
No description provided by the author
Surf is the default Download implementation.

# Interfaces

No description provided by the author
Downloader represents an core of HTTP web browser for crawler.