New creates a new instance of Scraper with the provided options.

async: The boolean value indicating if the scraper should run asynchronously.

WithBlacklist creates an Options function that appends the url endpoints to be excluded from the scraping, to the current list Default value: []string{ "login", "signup", "signin", "register", "logout", "download", "redirect", }, blacklist: slice of strings with url endpoints to be excluded from the scraping.

WithDelay creates an Options function that sets the delay of a Scraper.

WithMaxDepth sets the maximum depth for the Scraper.

WithNewBlacklist creates an Options function that replaces the list of url endpoints to be excluded from the scraping, with a new list.

WithParallelsNum sets the number of maximum allowed concurrent requests of the matching domains Default value: 2 parallels: the number of parallels to set.