package
9.0.0-alpha+incompatible
Repository: https://github.com/pingcap/tidb.git
Documentation: pkg.go.dev
# Functions
BytesMax returns the largest of byte slice a and b.
BytesMin returns the smallest of byte slice a and b.
CleanUpFiles delete all data and stat files under one subDir.
GetAllFileNames returns data file paths and stat file paths.
GetMaxOverlapping returns the maximum overlapping weight treating given `points` as endpoints of intervals.
GetMaxOverlappingTotal assume the most overlapping case from given stats and returns the overlapping level.
MergeOverlappingFiles reads from given files whose key range may overlap and writes to new sorted, nonoverlapping files.
MergeOverlappingFilesV2 reads from given files whose key range may overlap and writes to new sorted, nonoverlapping files.
MockExternalEngine generates an external engine with the given keys and values.
MockExternalEngineWithWriter generates an external engine with the given writer, keys and values.
NewEngineWriter creates a new EngineWriter.
NewExternalEngine creates an (external) engine.
NewKeyValueStore creates a new KeyValueStore.
NewMergeKVIter creates a new MergeKVIter.
NewMergePropIter creates a new MergePropIter.
NewRangeSplitter creates a new RangeSplitter to process the stat files of `multiFileStat` stored in `externalStorage`.
NewSortedKVMeta creates a SortedKVMeta from a WriterSummary.
NewWriterBuilder creates a WriterBuilder.
# Constants
DefaultBlockSize is the default block size for writer.
DefaultMemSizeLimit is the default memory size limit for writer.
ExclusiveEnd represents "..., Endpoint.Key)".
InclusiveEnd represents "..., Endpoint.Key]".
InclusiveStart represents "[Endpoint.Key, ...".
# Variables
ConcurrentReaderBufferSizePerConc is the buffer size for concurrent reader per concurrency.
MaxMergingFilesPerThread is the maximum number of files that can be merged by a single thread.
MergeSortFileCountStep is the step of file count when we split the sorted kv files.
MergeSortOverlapThreshold is the threshold of overlap between sorted kv files.
MinUploadPartSize is the minimum size of each part when uploading files to external storage, which is 5MiB for both S3 and GCS.
# Structs
Endpoint represents an endpoint of an interval which can be used by GetMaxOverlapping.
Engine stored sorted key/value pairs in an external storage.
EngineWriter implements backend.EngineWriter interface.
KeyValueStore stores key-value pairs and maintains the range properties.
MemoryIngestData is the in-memory implementation of IngestData.
MergeKVIter is an iterator that merges multiple sorted KV pairs from different files.
MergePropIter is an iterator that merges multiple range properties from different files.
MultipleFilesStat is the statistic information of multiple files (currently every 500 files).
OneFileWriter is used to write data into external storage with only one file for data and stat.
RangeSplitter is used to split key ranges of an external engine.
SortedKVMeta is the meta of sorted kv.
Writer is used to write data into external storage.
WriterBuilder builds a new Writer.
WriterSummary is the summary of a writer.
# Type aliases
EndpointTp is the type of Endpoint.Key.
OnCloseFunc is the callback function when a writer is closed.