package
0.3.7
Repository: https://github.com/aliyun/aliyun-odps-go-sdk.git
Documentation: pkg.go.dev

# Packages

No description provided by the author

# Functions

NewFileReader opens an Arrow file using the provided reader r.
NewFileWriter opens an Arrow file using the provided writer w.
NewMessage creates a new message from the metadata and body buffers.
NewMessageReader returns a reader that reads messages from an input stream.
NewReader returns a reader that reads records from an input stream.
NewReaderFromMessageReader allows constructing a new reader object with the provided MessageReader allowing injection of reading messages other than by simple streaming bytes such as Arrow Flight which receives a protobuf message.
NewRecordBatchReader returns a reader that reads records from an input stream.
No description provided by the author
NewWriter returns a writer that writes records to the provided output stream.
NewWriterWithPayloadWriter constructs a writer with the provided payload writer instead of the default stream payload writer.
WithAllocator specifies the Arrow memory allocator used while building records.
WithCompressConcurrency specifies a number of goroutines to spin up for concurrent compression of the body buffers when writing compress IPC records.
WithFooterOffset specifies the Arrow footer position in bytes.
WithLZ4 tells the writer to use LZ4 Frame compression on the data buffers before writing.
WithSchema specifies the Arrow schema to be used for reading or writing.
WithZstd tells the writer to use ZSTD compression on the data buffers before writing.

# Constants

No description provided by the author
constants for the extension type metadata keys for the type name and any extension metadata to be passed to deserialize.
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
version for Arrow-0.1.0.
version for Arrow-0.2.0.
version for Arrow-0.3.0 to 0.7.1.
version for >= Arrow-0.8.0.
version for >= Arrow-1.0.0, backward compatible with v4.

# Variables

Magic string identifying an Apache Arrow file.

# Structs

FileReader is an Arrow file reader.
FileWriter is an Arrow file writer.
Message is an IPC message, including metadata and body.
Payload is the underlying message object which is passed to the payload writer for actually writing out ipc messages.
Reader reads records from an io.Reader.
No description provided by the author
No description provided by the author
Writer is an Arrow stream writer.

# Interfaces

No description provided by the author
PayloadWriter is an interface for injecting a different payloadwriter allowing more reusability with the Writer object with other scenarios, such as with Flight data.
No description provided by the author

# Type aliases

MessageType represents the type of Message in an Arrow format.
MetadataVersion represents the Arrow metadata version.
Option is a functional option to configure opening or creating Arrow files and streams.