Generates code for the statement, if any and a physical plan.

If plan node statistics are available, generates a logical plan and also the statistics.

Generates parsed logical plan, analyzed logical plan, optimized logical plan and physical plan.

Generates a physical plan outline and also node details.

Generates only physical plan.

RangeFrame treats rows in a partition as groups of peers.

RowFrame treats rows in a partition individually.

Interrupt all running executions within the session with the provided session_id.

Interrupt the running execution within the session with the provided operation_id.

Interrupt all running executions within the session with the provided operation_tag.

Enum value maps for Aggregate_GroupType.

Enum value maps for Aggregate_GroupType.

Enum value maps for AnalyzePlanRequest_Explain_ExplainMode.

Enum value maps for AnalyzePlanRequest_Explain_ExplainMode.

Enum value maps for Expression_SortOrder_NullOrdering.

Enum value maps for Expression_SortOrder_NullOrdering.

Enum value maps for Expression_SortOrder_SortDirection.

Enum value maps for Expression_SortOrder_SortDirection.

Enum value maps for Expression_Window_WindowFrame_FrameType.

Enum value maps for Expression_Window_WindowFrame_FrameType.

Enum value maps for InterruptRequest_InterruptType.

Enum value maps for InterruptRequest_InterruptType.

Enum value maps for Join_JoinType.

Enum value maps for Join_JoinType.

Enum value maps for Parse_ParseFormat.

Enum value maps for Parse_ParseFormat.

Enum value maps for SetOperation_SetOpType.

Enum value maps for SetOperation_SetOpType.

SparkConnectService_ServiceDesc is the grpc.ServiceDesc for SparkConnectService service.

Enum value maps for WriteOperation_SaveMode.

Enum value maps for WriteOperation_SaveMode.

Enum value maps for WriteOperation_SaveTable_TableSaveMethod.

Enum value maps for WriteOperation_SaveTable_TableSaveMethod.

Enum value maps for WriteOperationV2_Mode.

Enum value maps for WriteOperationV2_Mode.

Request to transfer client-local artifacts.

A chunk of an Artifact.

A number of `SingleChunkArtifact` batched into a single RPC.

Signals the beginning/start of a chunked artifact.

An artifact that is contained in a single `ArtifactChunk`.

Response to adding an artifact.

Metadata of an artifact.

Relation of type [[Aggregate]].

Request to perform plan analyze, optionally to explain the plan.

Explains the input plan based on a configurable mode.

Returns `true` when the logical query plans are equal and therefore return same results.

Response to performing analysis of the query.

Request to get current statuses of artifacts at the server side.

Response to checking artifact statuses.

A local relation that has been cached already.

Represents a remote relation that has been cached on server.

See `spark.catalog.cacheTable`.

Catalog messages are marked as unstable.

See `spark.catalog.clearCache`.

Collect arbitrary (named) metrics from a dataset.

A [[Command]] is an operation that is executed by the server that does not directly consume or produce a relational result.

Request to update or fetch the configurations.

Response to the config request.

A command that can create DataFrame global temp view or local temp view.

See `spark.catalog.createExternalTable`.

See `spark.catalog.createTable`.

See `spark.catalog.currentCatalog`.

See `spark.catalog.currentDatabase`.

See `spark.catalog.databaseExists`.

This message describes the logical [[DataType]] of something.

Start compound types.

Relation of type [[Deduplicate]] which have duplicate rows removed, could consider either only the subset of columns or all the columns.

Drop specified columns.

See `spark.catalog.dropGlobalTempView`.

See `spark.catalog.dropTempView`.

A request to be executed by the service.

The response of a query, can be one or more for each request.

Batch results of metrics.

A SQL command returns an opaque Relation that can be directly used as input for the next call.

Expression used to refer to fields, functions and similar.

Expression as string.

SortOrder is used to specify the data ordering, it is normally used in Sort and Window.

An unresolved attribute that is not explicitly bound to a specific column, but the column is resolved during analysis by name.

Extracts a value or values from an Expression.

An unresolved function is not explicitly bound to one explicit function, but the function is resolved during analysis following Sparks name resolution rules.

Represents all of the input attributes to a given relational operator, for example in "SELECT `(id)?+.+` FROM ...".

UnresolvedStar is used to expand all the fields of a relation or struct.

Add, replace or drop a field of `StructType` expression by name.

Expression for the OVER clause or WINDOW clause.

The window frame.

Relation that applies a boolean expression `condition` on each row of `input` to produce the output result.

See `spark.catalog.functionExists`.

See `spark.catalog.getDatabase`.

See `spark.catalog.getFunction`.

Command to get the output of 'SparkContext.resources'.

Response for command 'GetResourcesCommand'.

See `spark.catalog.getTable`.

Specify a hint over a relation.

Compose the string representing rows for output.

See `spark.catalog.isCached`.

Relation of type [[Join]].

The key-value pair for the config request and response.

Relation of type [[Limit]] that is used to `limit` rows from the input relation.

See `spark.catalog.listCatalogs`.

See `spark.catalog.listColumns`.

See `spark.catalog.listDatabases`.

See `spark.catalog.listFunctions`.

See `spark.catalog.listTables`.

A relation that does not need to be qualified by name.

Drop rows containing null values.

Replaces null values.

Replaces old values with the corresponding values.

Relation of type [[Offset]] that is used to read rows staring from the `offset` on the input relation.

A [[Plan]] is the structure that carries the runtime information for the execution from the client to the server.

Projection of a bag of expressions for a given input relation.

Relation of type [[Range]] that generates a sequence of integers.

Relation that reads from a file / table or other data source.

See `spark.catalog.recoverPartitions`.

See `spark.catalog.refreshByPath`.

See `spark.catalog.refreshTable`.

The main [[Relation]] type.

Common metadata of all relations.

Release and close operation completely.

Release all responses from the operation response stream up to and including the response with the given by response_id.

Relation repartition.

ResourceInformation to hold information about a type of Resource.

Relation of type [[Sample]] that samples a fraction of the dataset.

See `spark.catalog.setCurrentCatalog`.

See `spark.catalog.setCurrentDatabase`.

Relation of type [[SetOperation]].

Compose the string representing rows for output.

Relation of type [[Sort]].

Relation that uses a SQL query to generate the output.

A SQL Command is used to trigger the eager evaluation of SQL commands in Spark.

Calculates the approximate quantiles of numerical columns of a DataFrame.

Calculates the correlation of two columns of a DataFrame.

Calculate the sample covariance of two numerical columns of a DataFrame.

Computes a pair-wise frequency table of the given columns.

Computes basic statistics for numeric and string columns, including count, mean, stddev, min, and max.

Finding frequent items for columns, possibly with false positives.

Returns a stratified sample without replacement based on the fraction given on each stratum.

Computes specified statistics for numeric and string columns.

StorageLevel for persisting Datasets/Tables.

Commands for a streaming query.

Response for commands on a streaming query.

A tuple that uniquely identifies an instance of streaming query run.

Commands for the streaming query manager.

Response for commands on the streaming query manager.

Relation alias.

See `spark.catalog.tableExists`.

Relation of type [[Tail]] that is used to fetch `limit` rows from the last of the input relation.

Rename columns on the input relation by the same length of names.

See `spark.catalog.uncacheTable`.

UnimplementedSparkConnectServiceServer must be embedded to have forward compatible implementations.

Used for testing purposes only.

Unpivot a DataFrame from wide format to long format, optionally leaving identifier columns set.

User Context is used to refer to one particular user session that is executing queries in the backend.

Adding columns or replacing the existing columns that have the same names.

Rename columns on the input relation by a map with name to name mapping.

As writes are not directly handled during analysis and planning, they are modeled as commands.

As writes are not directly handled during analysis and planning, they are modeled as commands.

Starts write stream operation as streaming query.

SparkConnectServiceClient is the client API for SparkConnectService service.

SparkConnectServiceServer is the server API for SparkConnectService service.

UnsafeSparkConnectServiceServer may be embedded to opt out of forward compatibility for this service.

Plan explanation mode.