Categorygithub.com/tossmilestone/crawlgo
repository
1.0.0
Repository: https://github.com/tossmilestone/crawlgo.git
Documentation: pkg.go.dev
Overview
Dependencies
0
Dependents
0

# Packages

No description provided by the author
No description provided by the author

# README

crawlgo

A crawler written in golang

Prerequisite

  • Linux OS
  • phantomjs: phantomjs binary must be in the PATH env

Install

go get github.com/tossmilestone/crawlgo

Usage

crawlgo --site {site_url} --workers {workers} --download-selector {download_selector} --save-dir {save_dir}