package
0.0.0-20240823114315-c41cfec78b8b
Repository: https://github.com/dennis-tra/nebula-crawler.git
Documentation: pkg.go.dev

# Functions

DefaultEngineConfig returns a default engine configuration that can and should be adjusted for different networks.
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
NewEngine initializes a new engine.
No description provided by the author
No description provided by the author

# Structs

CrawlHandler is the default implementation for a [Handler] that can be used as the basis for crawl operations.
No description provided by the author
CrawlResult captures data that is gathered from crawling a single peer.
CrawlWriter handles the insert/upsert/update operations for a particular crawl result.
No description provided by the author
No description provided by the author
No description provided by the author
DialResult captures data that is gathered from pinging a single peer.
DialWriter handles the insert/upsert/update operations for a particular crawl result.
Engine is the integral data structure for orchestrating the communication with peers and writing the processing results to disk.
The EngineConfig object configures the core Nebula [Engine] below.
A Pool manages a set of Workers.
PriorityQueue is can take unique items and pops them according to their priority.
Result is a generic result object.
RoutingTable captures the routing table information and crawl error of a particular peer.
WriteResult must be returned by write workers.

# Interfaces

A Driver is a data structure that provides the necessary implementations and tasks for the engine to operate.
Handler defines the interface that the engine will call every time it has received a result from any of its workers.
PeerInfo is the interface that any peer information struct must conform to.
A Worker processes tasks of type T and returns results of type R or an error.
WorkResult must be implemented by the result that a Worker which processes peers returns.