pkg.gl

Categorygithub.com/QuisVenator/compi-tptokenizer

package

0.0.0-20240624194523-3dffa2c90e51

Repository: https://github.com/quisvenator/compi-tp.git

Documentation: pkg.go.dev

# Functions

NewDictionary

No description provided by the author

NewDictionaryFromFile

No description provided by the author

NewDictionaryFromJSONFile

No description provided by the author

NewDictionaryFromYAMLFile

No description provided by the author

NewTokenizer

No description provided by the author

SplitWords

No description provided by the author

# Constants

ADJECTIVE

No description provided by the author

ADVERB

No description provided by the author

CONJUNCTION

No description provided by the author

DETERMINER

No description provided by the author

EOF

No description provided by the author

ERROR_LX

No description provided by the author

INTERJECTION

No description provided by the author

JSON

Enum of permissible dictionary file formats.

NOUN

No description provided by the author

PREPOSITION

No description provided by the author

PRONOUN

No description provided by the author

UNKNOWN

Enum of permissible dictionary file formats.

VERB

No description provided by the author

YAML

Enum of permissible dictionary file formats.

# Variables

AvailableCategories

No description provided by the author

# Structs

ClassifiedWord

No description provided by the author

DictEntry

We use a struct to represent a dictionary entry instead of a string of only category This is to allow for future expansion of the dictionary entry.

Runinfo

No description provided by the author

Tokenizer

No description provided by the author

# Type aliases

Dictionary

No description provided by the author

Wordcategory

No description provided by the author