Categorygithub.com/recoilme/snippet
modulepackage
0.0.0-20240405080720-3945f9905433
Repository: https://github.com/recoilme/snippet.git
Documentation: pkg.go.dev
Overview
Versions
1
Dependencies
8
Dependents
0
Files
162 SLOC

# README

Simple library for scrapping title/descriptions

Supported:

  • timeout
  • converting to utf8
  • custom headers
  • meta tags

Usage

	snippet, err := snippet("http://vc.ru", 0, nil)
	fmt.Println("Title:", snippet.Title, "\nDescription:", snippet.Description)

    // use https://github.com/pokatovski/text-cleaner if clean needed

Author

t.me/recoilme

# Functions

getLinkReader return NopCloser from url params are timeout in seconds and headers dont foget to close reader.
Snippet return snippet from url params: timeout (in seconds) and custom http headers.
SnippetFromReader return snippet from io.Reader.