Categorygithub.com/maniakalen/crawler
modulepackage
0.0.5
Repository: https://github.com/maniakalen/crawler.git
Documentation: pkg.go.dev
Overview
Versions
1
Dependencies
12
Dependents
0
Files
221 SLOC

# README

Crawler

This module is used for crawling the web page given and return Page object for each status that has configured channel for it.

You can configure new channels using the Channels map like

	chans := crawler.Channels{
		404: make(chan crawler.Page),
		200: make(chan crawler.Page),
	}

# Packages

No description provided by the author
No description provided by the author

# Functions

New is the crawler inicialization method.

# Structs

Crawler is the main package object used to initialize the crawl.
Page
Page is a struct that carries the scanned url, response and response body string.

# Type aliases

Channels is a Page channels map where the index is the response code so we can define different behavior for the different resp codes.