package
6.0.2
Repository: https://github.com/apache/arrow.git
Documentation: pkg.go.dev

# Functions

LevelEncodingMaxBufferSize estimates the max number of bytes needed to encode data with the specified encoding given the max level and number of buffered values provided.
NewBinaryDictionary returns a memotable interface for use with strings, byte slices, parquet.ByteArray and parquet.FixedLengthByteArray only.
No description provided by the author
NewBufferWriter constructs a buffer with initially reserved/allocated memory.
NewBufferWriterFromBuffer wraps the provided buffer to allow it to fulfill these interfaces.
NewDecoder constructs a decoder for a given type and encoding.
NewDictConverter creates a dict converter of the appropriate type, using the passed in decoder as the decoder to decode the dictionary index.
NewDictDecoder is like NewDecoder but for dictionary encodings, panics if type is bool.
NewEncoder will return the appropriately typed encoder for the requested physical type and encoding.
NewFloat32Dictionary returns a memotable interface for use with Float32 values only.
No description provided by the author
NewFloat64Dictionary returns a memotable interface for use with Float64 values only.
No description provided by the author
NewInt32Dictionary returns a memotable interface for use with Int32 values only.
No description provided by the author
NewInt64Dictionary returns a memotable interface for use with Int64 values only.
No description provided by the author
No description provided by the author
NewPooledBufferWriter returns a new buffer with 'initial' bytes reserved and pre-allocated to guarantee that writing that many more bytes will not require another allocation.

# Variables

No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author

# Structs

BufferWriter is a utility class for building and writing to a memory.Buffer with a given allocator that fulfills the interfaces io.Write, io.WriteAt and io.Seeker, while providing the ability to pre-allocate memory.
ByteArrayDictConverter is a helper for dictionary handling which is used for converting run length encoded indexes into the actual values that are stored in the dictionary index page.
DeltaBitPackInt32Decoder decodes Int32 values which are packed using the Delta BitPacking algorithm.
DeltaBitPackInt32Encoder is an encoder for the delta bitpacking encoding for int32 data.
DeltaBitPackInt64Decoder decodes a delta bit packed int64 column of data.
DeltaBitPackInt32Encoder is an encoder for the delta bitpacking encoding for int32 data.
DeltaByteArrayDecoder is a decoder for a column of data encoded using incremental or prefix encoding.
DeltaByteArrayEncoder is an encoder for writing bytearrays which are delta encoded this is also known as incremental encoding or front compression.
DeltaLengthByteArrayDecoder is a decoder for handling data produced by the corresponding encoder which expects delta packed lengths followed by the bytes of data.
DeltaLengthByteArrayEncoder encodes data using by taking all of the byte array lengths and encoding them in front using delta encoding, followed by all of the binary data concatenated back to back.
DictByteArrayDecoder is a decoder for decoding dictionary encoded data for parquet.ByteArray columns.
DictByteArrayEncoder is an encoder for parquet.ByteArray data using dictionary encoding.
DictFixedLenByteArrayDecoder is a decoder for decoding dictionary encoded data for parquet.FixedLenByteArray columns.
DictFixedLenByteArrayEncoder is an encoder for parquet.FixedLenByteArray data using dictionary encoding.
DictFloat32Decoder is a decoder for decoding dictionary encoded data for float32 columns.
DictFloat32Encoder is an encoder for float32 data using dictionary encoding.
DictFloat64Decoder is a decoder for decoding dictionary encoded data for float64 columns.
DictFloat64Encoder is an encoder for float64 data using dictionary encoding.
DictInt32Decoder is a decoder for decoding dictionary encoded data for int32 columns.
DictInt32Encoder is an encoder for int32 data using dictionary encoding.
DictInt64Decoder is a decoder for decoding dictionary encoded data for int64 columns.
DictInt64Encoder is an encoder for int64 data using dictionary encoding.
FixedLenByteArrayDictConverter is a helper for dictionary handling which is used for converting run length encoded indexes into the actual values that are stored in the dictionary index page.
Float32DictConverter is a helper for dictionary handling which is used for converting run length encoded indexes into the actual values that are stored in the dictionary index page.
Float64DictConverter is a helper for dictionary handling which is used for converting run length encoded indexes into the actual values that are stored in the dictionary index page.
Int32DictConverter is a helper for dictionary handling which is used for converting run length encoded indexes into the actual values that are stored in the dictionary index page.
Int64DictConverter is a helper for dictionary handling which is used for converting run length encoded indexes into the actual values that are stored in the dictionary index page.
LevelDecoder handles the decoding of repetition and definition levels from a parquet file supporting bit packed and run length encoded values.
LevelEncoder is for handling the encoding of Definition and Repetition levels to parquet files.
PlainBooleanDecoder is for the Plain Encoding type, there is no dictionary decoding for bools.
PlainBooleanEncoder encodes bools as a bitmap as per the Plain Encoding.
PlainByteArrayDecoder decodes a data chunk for bytearrays according to the plain encoding.
PlainByteArrayEncoder encodes byte arrays according to the spec for Plain encoding by encoding the length as a int32 followed by the bytes of the value.
PlainFixedLenByteArrayDecoder is a plain encoding decoder for Fixed Length Byte Arrays.
PlainFixedLenByteArrayEncoder writes the raw bytes of the byte array always writing typeLength bytes for each value.
PlainFloat32Decoder is a decoder specifically for decoding Plain Encoding data of float32 type.
PlainFloat32Encoder is an encoder for float32 values using Plain Encoding which in general is just storing the values as raw bytes of the appropriate size.
PlainFloat64Decoder is a decoder specifically for decoding Plain Encoding data of float64 type.
PlainFloat64Encoder is an encoder for float64 values using Plain Encoding which in general is just storing the values as raw bytes of the appropriate size.
PlainInt32Decoder is a decoder specifically for decoding Plain Encoding data of int32 type.
PlainInt32Encoder is an encoder for int32 values using Plain Encoding which in general is just storing the values as raw bytes of the appropriate size.
PlainInt64Decoder is a decoder specifically for decoding Plain Encoding data of int64 type.
PlainInt64Encoder is an encoder for int64 values using Plain Encoding which in general is just storing the values as raw bytes of the appropriate size.
PlainInt96Decoder is a decoder specifically for decoding Plain Encoding data of parquet.Int96 type.
PlainInt96Encoder is an encoder for parquet.Int96 values using Plain Encoding which in general is just storing the values as raw bytes of the appropriate size.
PooledBufferWriter uses buffers from the buffer pool to back it while implementing io.Writer and io.WriterAt interfaces.

# Interfaces

BinaryMemoTable is an extension of the MemoTable interface adding extra methods for handling byte arrays/strings/fixed length byte arrays.
BooleanDecoder is the interface for all encoding types that implement decoding bool values.
BooleanEncoder is the interface for all encoding types that implement encoding bool values.
Buffer is an interface used as a general interface for handling buffers regardless of the underlying implementation.
ByteArrayDecoder is the interface for all encoding types that implement decoding parquet.ByteArray values.
ByteArrayEncoder is the interface for all encoding types that implement encoding parquet.ByteArray values.
DecoderTraits provides an interface for more easily interacting with types to generate decoders for specific types.
DictDecoder is a special TypedDecoder which implements dictionary decoding.
DictEncoder is a special kind of TypedEncoder which implements Dictionary encoding.
EncoderTraits is an interface for the different types to make it more convenient to construct encoders for specific types.
FixedLenByteArrayDecoder is the interface for all encoding types that implement decoding parquet.FixedLenByteArray values.
FixedLenByteArrayEncoder is the interface for all encoding types that implement encoding parquet.FixedLenByteArray values.
Float32Decoder is the interface for all encoding types that implement decoding float32 values.
Float32Encoder is the interface for all encoding types that implement encoding float32 values.
Float64Decoder is the interface for all encoding types that implement decoding float64 values.
Float64Encoder is the interface for all encoding types that implement encoding float64 values.
Int32Decoder is the interface for all encoding types that implement decoding int32 values.
Int32Encoder is the interface for all encoding types that implement encoding int32 values.
Int64Decoder is the interface for all encoding types that implement decoding int64 values.
Int64Encoder is the interface for all encoding types that implement encoding int64 values.
Int96Decoder is the interface for all encoding types that implement decoding parquet.Int96 values.
Int96Encoder is the interface for all encoding types that implement encoding parquet.Int96 values.
MemoTable interface that can be used to swap out implementations of the hash table used for handling dictionary encoding.
TypedDecoder is the general interface for all decoder types which can then be type asserted to a specific Type Decoder.
TypedEncoder is the general interface for all encoding types which can then be type asserted to a specific Type Encoder.