GetSimplifiedHostname returns the URL's hostname without 'www.' prefix.

GetSimplifiedHostnameWithoutTLD returns the URL's hostname without 'www.' prefix and removes the top level domain suffix (.com, etc.).

NewFactory creates a new thread-safe resource factory.

InvalidHTTPRespStatusCodeError is used as Error.Code when the traversed URL returns a non-200 status code.

TraversedLink tracks a single URL that was curated or discovered in Content.

URLStructureInvalidError is used as Error.Code when the URL cannot be parsed.

CleanLinkQueryParamsPolicy indicates whether a specific URL parameter should be "cleaned" (removed).

Factory is a lifecycle manager for URL-based resources.

FollowRedirectsInHTMLContentPolicy indicates whether we want to perform any destination actions.

IgnoreLinkPolicy indicates whether a given URL should be ignored or harvested.

Link is the public interface for a "smart URL" which knows its destination.