Categorygithub.com/bcampbell/scrapeomatcmdwpjsontool
package
0.0.0-20220820232205-23e64141c89e
Repository: https://github.com/bcampbell/scrapeomat.git
Documentation: pkg.go.dev
Overview
Versions
1
Dependencies
18
Dependents
0
Files
885 SLOC

# README

wpjsontool

Tool to grab articles from wordpress sites, outputing JSON suitable for loading by loadtool.

# Functions

HTMLToText converts html into text, with an attempt to make it look nice by plonking line breaks between block elements.
HTTPGetWithCache performs a GET, using files in cacheDir to cache requests.
NodeToText renders HTML as text, using linebreaks for block elements.
No description provided by the author
No description provided by the author
Tidy up extracted content into something that'll produce reasonable html when rendered.

# Structs

Article
Our output data format.
No description provided by the author
Client holds everything we need to perform WP api queries.
No description provided by the author
No description provided by the author
Post
Post data returned from wp/posts endpoint.
.