CrawlFiles returns a list of file names found from the seed URL, filtered by file name regex.

CrawlFolders returns a list of folder names found from each seed URL, filtered by folder name regex.

CrawlFoldersPath returns a list of folder names found from each seed URL, filtered by folder name regex.