Categorygithub.com/jamesjarvis/web-graphpkglinkstorage
package
0.1.0
Repository: https://github.com/jamesjarvis/web-graph.git
Documentation: pkg.go.dev
Overview
Versions
1
Dependencies
11
Dependents
3
Files
664 SLOC

# Functions

NewLinkBatcher is a helpfer function for constructing a LinkBatcher object.
NewPageBatcher is a helpfer function for constructing a PageBatcher object.
NewStorage is a wrapper for easily creating a storage object.
ReplaceSQL replaces the instance occurrence of any string pattern with an increasing $n based sequence.

# Structs

Link is a link object.
LinkBatcher is a simple batching system for recording links to the db.
Page
Page is a page object.
PageBatcher is a simple batching system for recording links to the db.
Storage implements a PostgreSQL storage backend for colly.