org.apache.spark.sql.hive.execution

Class OptimizedCreateHiveTableAsSelectCommand

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>

org.apache.spark.sql.catalyst.plans.logical.LogicalPlan

org.apache.spark.sql.hive.execution.OptimizedCreateHiveTableAsSelectCommand

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.internal.Logging, org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper, org.apache.spark.sql.catalyst.plans.logical.Command, org.apache.spark.sql.catalyst.plans.logical.ConstraintHelper, org.apache.spark.sql.catalyst.plans.logical.QueryPlanConstraints, org.apache.spark.sql.catalyst.plans.logical.statsEstimation.LogicalPlanStats, org.apache.spark.sql.execution.command.DataWritingCommand, CreateHiveTableAsSelectBase, scala.Equals, scala.Product

public class OptimizedCreateHiveTableAsSelectCommand
extends org.apache.spark.sql.catalyst.plans.logical.LogicalPlan
implements CreateHiveTableAsSelectBase, scala.Product, scala.Serializable

Create table and insert the query result into it. This creates Hive table but inserts the query result into it by using data source.

param: tableDesc the table description, which may contain serde, storage handler etc. param: query the query whose result will be insert into the new relation param: mode SaveMode

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
OptimizedCreateHiveTableAsSelectCommand(org.apache.spark.sql.catalyst.catalog.CatalogTable tableDesc, org.apache.spark.sql.catalyst.plans.logical.LogicalPlan query, scala.collection.Seq<String> outputColumnNames, SaveMode mode)

Method Summary

Modifier and Type	Method and Description
abstract static R	apply(T1 v1, T2 v2, T3 v3, T4 v4)
org.apache.spark.sql.execution.command.DataWritingCommand	getWritingCommand(org.apache.spark.sql.catalyst.catalog.SessionCatalog catalog, org.apache.spark.sql.catalyst.catalog.CatalogTable tableDesc, boolean tableExists)
scala.collection.immutable.Map<String,org.apache.spark.sql.execution.metric.SQLMetric>	metrics()
SaveMode	mode()
scala.collection.Seq<String>	outputColumnNames()
org.apache.spark.sql.catalyst.plans.logical.LogicalPlan	query()
org.apache.spark.sql.catalyst.catalog.CatalogTable	tableDesc()
static String	toString()
String	writingCommandClassName()

Methods inherited from class org.apache.spark.sql.catalyst.plans.logical.LogicalPlan

analyzed, assertNotAnalysisRule, childrenResolved, constraints, constructIsNotNullConstraints, inferAdditionalConstraints, initializeForcefully, initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, invalidateStatsCache, isStreaming, isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, maxRows, maxRowsPerPartition, org$apache$spark$internal$Logging$$log__$eq, org$apache$spark$internal$Logging$$log_, org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$_analyzed_$eq, org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$_analyzed, outputOrdering, refresh, resolve, resolve, resolveChildren, resolved, resolveExpressions, resolveOperators, resolveOperatorsDown, resolveOperatorsUp, resolveQuoted, sameOutput, setAnalyzed, statePrefix, stats, statsCache_$eq, statsCache, transformAllExpressions, transformDown, transformUp, validConstraints, verboseStringWithSuffix

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

allAttributes, append, append$default$5, append$default$6, canonicalized, CODEGEN_ID_TAG, collectWithSubqueries, conf, doCanonicalize, expressions, findExpressionAndTrackLineageDown, formattedNodeName, innerChildren, inputSet, isCanonicalizedPlan, mapExpressions, missingInput, normalizeExpressions, normalizePredicates, OP_ID_TAG, output, outputSet, printSchema, producedAttributes, references, sameResult, schema, schemaString, semanticHash, simpleString, simpleStringWithNodeId, subqueries, subqueriesAll, transformExpressions, transformExpressionsDown, transformExpressionsUp, verboseString, verboseStringWithOperatorId

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, clone, collect, collectFirst, collectLeaves, containsChild, copyTagsFrom, fastEquals, find, flatMap, foreach, foreachUp, generateTreeString, generateTreeString$default$5, generateTreeString$default$6, getTagValue, hashCode, jsonFields, makeCopy, map, mapChildren, mapProductIterator, nodeName, numberedTreeString, origin, otherCopyArgs, p, prettyJson, productIterator, productPrefix, setTagValue, stringArgs, toJSON, toString, transform, treeString, treeString, treeString, treeString$default$2, treeString$default$3, treeString$default$4, unsetTagValue, withNewChildren

Methods inherited from class Object

equals, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.hive.execution.CreateHiveTableAsSelectBase

argString, run

Methods inherited from interface org.apache.spark.sql.execution.command.DataWritingCommand

$init$, basicWriteJobStatsTracker, children, logicalPlanOutputWithNames, outputColumns

Methods inherited from interface org.apache.spark.sql.catalyst.plans.logical.Command

$init$, output, stats

Methods inherited from interface scala.Product

$init$, productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper

$init$, allowInvokingTransformsInAnalyzer, markInAnalyzer

Methods inherited from interface org.apache.spark.sql.catalyst.plans.logical.statsEstimation.LogicalPlanStats

$init$

Methods inherited from interface org.apache.spark.sql.catalyst.plans.logical.QueryPlanConstraints

$init$

Methods inherited from interface org.apache.spark.sql.catalyst.plans.logical.ConstraintHelper

$init$

Methods inherited from interface org.apache.spark.internal.Logging

$init$, initLock, uninitialize

Constructor Detail

OptimizedCreateHiveTableAsSelectCommand

public OptimizedCreateHiveTableAsSelectCommand(org.apache.spark.sql.catalyst.catalog.CatalogTable tableDesc,
                                               org.apache.spark.sql.catalyst.plans.logical.LogicalPlan query,
                                               scala.collection.Seq<String> outputColumnNames,
                                               SaveMode mode)

Method Detail

apply

public abstract static R apply(T1 v1,
                               T2 v2,
                               T3 v3,
                               T4 v4)

toString

public static String toString()

metrics

public scala.collection.immutable.Map<String,org.apache.spark.sql.execution.metric.SQLMetric> metrics()

Specified by:

metrics in interface org.apache.spark.sql.execution.command.DataWritingCommand

tableDesc

public org.apache.spark.sql.catalyst.catalog.CatalogTable tableDesc()

Specified by:

tableDesc in interface CreateHiveTableAsSelectBase

query

public org.apache.spark.sql.catalyst.plans.logical.LogicalPlan query()

Specified by:

query in interface org.apache.spark.sql.execution.command.DataWritingCommand

Specified by:

query in interface CreateHiveTableAsSelectBase

outputColumnNames

public scala.collection.Seq<String> outputColumnNames()

Specified by:

outputColumnNames in interface org.apache.spark.sql.execution.command.DataWritingCommand

Specified by:

outputColumnNames in interface CreateHiveTableAsSelectBase

mode

public SaveMode mode()

Specified by:

mode in interface CreateHiveTableAsSelectBase

getWritingCommand

public org.apache.spark.sql.execution.command.DataWritingCommand getWritingCommand(org.apache.spark.sql.catalyst.catalog.SessionCatalog catalog,
                                                                                   org.apache.spark.sql.catalyst.catalog.CatalogTable tableDesc,
                                                                                   boolean tableExists)

Specified by:

getWritingCommand in interface CreateHiveTableAsSelectBase

writingCommandClassName

public String writingCommandClassName()

Specified by:

writingCommandClassName in interface CreateHiveTableAsSelectBase