package
17.0.0
Repository: https://github.com/apache/arrow.git
Documentation: pkg.go.dev

# Functions

DefLevelsToBitmap creates a validitybitmap out of the passed in definition levels and info object.
DefRepLevelsToBitmap constructs a full validitybitmap out of the definition and repetition levels properly handling nested lists and parents.
DefRepLevelsToListInfo takes in the definition and repetition levels in order to populate the validity bitmap and properly handle nested lists and update the offsets for them.
NewBooleanColumnChunkWriter constructs a new column writer using the given metadata chunk builder provided Pager, and desired encoding and properties.
NewByteArrayColumnChunkWriter constructs a new column writer using the given metadata chunk builder provided Pager, and desired encoding and properties.
NewColumnChunkWriter constructs a column writer of the appropriate type by using the metadata builder and writer properties to determine the correct type of column writer to construct and whether or not to use dictionary encoding.
NewColumnReader returns a column reader for the provided column initialized with the given pagereader that will provide the pages of data for this column.
NewDataPageV1 returns a V1 data page with the given buffer as its data and the specified encoding information Will utilize objects that have been released back into the data page pool and re-use them if available as opposed to creating new objects.
NewDataPageV1WithStats is the same as NewDataPageV1, but also allows adding the stat info into the created page.
NewDataPageV2 constructs a new V2 data page with the provided information and a buffer of the raw data.
NewDataPageV2WithStats is the same as NewDataPageV2 but allows providing the encoded stats with the page.
NewDictionaryPage constructs a new dictionary page with the provided data buffer and number of values.
NewFixedLenByteArrayColumnChunkWriter constructs a new column writer using the given metadata chunk builder provided Pager, and desired encoding and properties.
NewFloat32ColumnChunkWriter constructs a new column writer using the given metadata chunk builder provided Pager, and desired encoding and properties.
NewFloat64ColumnChunkWriter constructs a new column writer using the given metadata chunk builder provided Pager, and desired encoding and properties.
NewInt32ColumnChunkWriter constructs a new column writer using the given metadata chunk builder provided Pager, and desired encoding and properties.
NewInt64ColumnChunkWriter constructs a new column writer using the given metadata chunk builder provided Pager, and desired encoding and properties.
NewInt96ColumnChunkWriter constructs a new column writer using the given metadata chunk builder provided Pager, and desired encoding and properties.
NewPageReader returns a page reader for the data which can be read from the provided reader and compression.
NewPageWriter returns a page writer using either the buffered or serialized implementations.
NewParquetReader returns a FileReader instance that reads a parquet file which can be read from r.
NewParquetWriter returns a Writer that writes to the provided WriteSeeker with the given schema.
OpenParquetFile will return a Reader for the given parquet file on the local file system.
WithMetadata allows providing a specific FileMetaData object rather than reading the file metadata from the file itself.
WithReadProps specifies a specific reader properties instance to use, rather than using the default ReaderProperties.

# Structs

BooleanColumnChunkReader is the Typed Column chunk reader instance for reading Boolean column data.
BooleanColumnChunkWriter is the typed interface for writing columns to a parquet file for Boolean columns.
ByteArrayColumnChunkReader is the Typed Column chunk reader instance for reading ByteArray column data.
ByteArrayColumnChunkWriter is the typed interface for writing columns to a parquet file for ByteArray columns.
CryptoContext is a context for keeping track of the current methods for decrypting.
DataPageV1 represents a DataPage version 1 from the parquet.thrift file.
DataPageV2 is the representation of the V2 data page from the parquet.thrift spec.
DictionaryPage represents the a page of data that uses dictionary encoding.
FixedLenByteArrayColumnChunkReader is the Typed Column chunk reader instance for reading FixedLenByteArray column data.
FixedLenByteArrayColumnChunkWriter is the typed interface for writing columns to a parquet file for FixedLenByteArray columns.
Float32ColumnChunkReader is the Typed Column chunk reader instance for reading Float32 column data.
Float32ColumnChunkWriter is the typed interface for writing columns to a parquet file for Float32 columns.
Float64ColumnChunkReader is the Typed Column chunk reader instance for reading Float64 column data.
Float64ColumnChunkWriter is the typed interface for writing columns to a parquet file for Float64 columns.
Int32ColumnChunkReader is the Typed Column chunk reader instance for reading Int32 column data.
Int32ColumnChunkWriter is the typed interface for writing columns to a parquet file for Int32 columns.
Int64ColumnChunkReader is the Typed Column chunk reader instance for reading Int64 column data.
Int64ColumnChunkWriter is the typed interface for writing columns to a parquet file for Int64 columns.
Int96ColumnChunkReader is the Typed Column chunk reader instance for reading Int96 column data.
Int96ColumnChunkWriter is the typed interface for writing columns to a parquet file for Int96 columns.
Reader is the main interface for reading a parquet file.
RowGroupReader is the primary interface for reading a single row group.
Input/Output structure for reconstructed validity bitmaps.
Writer is the primary interface for writing a parquet file.

# Interfaces

BinaryRecordReader provides an extra GetBuilderChunks function above and beyond the plain RecordReader to allow for efficiently building chunked arrays.
BufferedRowGroupWriter allows writing to multiple columns simultaneously, data will not be flushed to the underlying writer until closing the RowGroupWriter.
ColumnChunkReader is the basic interface for all column readers.
ColumnChunkWriter is the base interface for all columnwriters.
DataPage is the base interface for both DataPageV1 and DataPageV2 of the parquet spec.
Page is an interface for handling DataPages or Dictionary Pages.
PageReader is the interface used by the columnreader in order to read and handle DataPages and loop through them.
PageWriter is the interface for both serialized and buffered page writers.
RecordReader is an interface for reading entire records/rows at a time from a parquet file for both flat and nested columns.
RowGroupWriter is the base interface for writing rowgroups, the actual writer will be either the SerialRowGroupWriter or the BufferedRowGroupWriter.
SerialRowGroupWriter expects each column to be written one after the other, data is flushed every time NextColumn is called and will panic if there is an unequal number of rows written per column.

# Type aliases