package
5.0.0-rc+incompatible
Repository: https://github.com/pingcap/tidb-lightning.git
Documentation: pkg.go.dev
# Functions
No description provided by the author
No description provided by the author
IndexAnyByte returns the byte index of the first occurrence in s of any of the byte points in chars.
MakePooledReader constructs a new PooledReader.
No description provided by the author
NewChunkParser creates a new parser which can read chunks out of a file.
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
NewStringReader constructs a new StringReader.
No description provided by the author
ReadChunks parses the entire file and splits it into continuous chunks of size >= minSize.
a special func to fetch parquet file row count fast.
SplitLargeFile splits a large csv file into multiple regions, the size of each regions is specified by `config.MaxRegionSize`.
# Constants
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
# Variables
No description provided by the author
# Structs
Chunk represents a portion of the data file.
ChunkParser is a parser of the data files (the file containing only INSERT statements).
CSVParser is basically a copy of encoding/csv, but special-cased for MySQL-like input.
No description provided by the author
No description provided by the author
Mydumper File Loader
*/.
No description provided by the author
No description provided by the author
PooledReader is a throttled reader wrapper, where Read() calls have an upper limit of concurrency imposed by the given worker pool.
`RegexRouter` is a `FileRouter` implement that apply specific regex pattern to filepath.
No description provided by the author
Row is the content of a row.
No description provided by the author
StringReader is a wrapper around *strings.Reader with an additional Close() method.
No description provided by the author
# Interfaces
// RouteRule is a rule to route file path to target schema/table.
No description provided by the author
ReadSeekCloser = Reader + Seeker + Closer.