# Functions
Download returns parsed data after downloading the specified url.
LongestCommonPrefix returns the common path elements between two paths.
New returns a new crawler instance.
ReduceURL returns relative version of url from base.
# Constants
CSSUri url from url().
HTMLTagA url from <a href=""></a>.
HTMLTagForm url from <form action="" />.
HTMLTagImg url from <img src="" />.
HTMLTagLinkStylesheet url from <link rel="stylesheet" href="" />.
HTMLTagScript url from <script src="" />.
HTTP3xxLocation url from HTTP response code 3xx.
# Structs
Downloaded represents processed data after downloading.
Input represents a download request ready to be processed.
Link represents an extracted link from download result.
QueueItem represents a download request in the queue.
# Interfaces
Crawler represents an object that can process download requests.