Categorygithub.com/devsolux/go-clonepkgcrawler
package
2.0.0+incompatible
Repository: https://github.com/devsolux/go-clone.git
Documentation: pkg.go.dev
Overview
Versions
2
Dependencies
11
Dependents
2
Files
193 SLOC

# Functions

Collector searches for css, js, and images within a given link TODO improve for better performance.
Crawl asks the necessary crawlers for collecting links for building the web page.
Extractor visits a link determines if its a page or sublink downloads the contents to a correct directory in project folder TODO add functionality for determining if page or sublink.
HTMLExtractor ...