final class SCollectionTableRowOps[T <: TableRow] extends AnyVal
Enhanced version of SCollection with BigQuery methods.
- Source
- SCollectionSyntax.scala
- Alphabetic
- By Inheritance
- SCollectionTableRowOps
- AnyVal
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new SCollectionTableRowOps(self: SCollection[T])
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- Any
- final def ##: Int
- Definition Classes
- Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def getClass(): Class[_ <: AnyVal]
- Definition Classes
- AnyVal → Any
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def saveAsBigQueryTable(table: Table, schema: TableSchema = TypedTableWriteParam.DefaultSchema, writeDisposition: WriteDisposition = TypedTableWriteParam.DefaultWriteDisposition, createDisposition: CreateDisposition = TypedTableWriteParam.DefaultCreateDisposition, tableDescription: String = TypedTableWriteParam.DefaultTableDescription, timePartitioning: TimePartitioning = TypedTableWriteParam.DefaultTimePartitioning, clustering: Clustering = TypedTableWriteParam.DefaultClustering, method: Method = TypedTableWriteParam.DefaultMethod, triggeringFrequency: Duration = TypedTableWriteParam.DefaultTriggeringFrequency, sharding: Sharding = TypedTableWriteParam.DefaultSharding, failedInsertRetryPolicy: InsertRetryPolicy = TypedTableWriteParam.DefaultFailedInsertRetryPolicy, successfulInsertsPropagation: Boolean = TableWriteParam.DefaultSuccessfulInsertsPropagation, extendedErrorInfo: Boolean = TypedTableWriteParam.DefaultExtendedErrorInfo, configOverride: BigQueryTypedTable.WriteParam.ConfigOverride[TableRow] = TableWriteParam.DefaultConfigOverride): ClosedTap[TableRow]
Save this SCollection as a BigQuery table.
Save this SCollection as a BigQuery table. Note that elements must be of type TableRow.
- returns
a ClosedTap containing some side output(s) depending on the given parameters
- BigQueryIO.SuccessfulTableLoads if
method
is Method.FILE_LOADS. - BigQueryIO.SuccessfulInserts if
method
is Method.STREAMING_INSERTS andsuccessfulInsertsPropagation
istrue
. - BigQueryIO.SuccessfulStorageApiInserts if
method
id Method.STORAGE_WRITE_API or Method.STORAGE_API_AT_LEAST_ONCE. - BigQueryIO.FailedInserts if
method
is Method.FILE_LOADS or Method.STREAMING_INSERTS. - BigQueryIO.FailedInsertsWithErr if
method
is Method.STREAMING_INSERTS andextendedErrorInfo
istrue
. - BigQueryIO.FailedStorageApiInserts if
method
id Method.STORAGE_WRITE_API or Method.STORAGE_API_AT_LEAST_ONCE.
- BigQueryIO.SuccessfulTableLoads if
- def saveAsTableRowJsonFile(path: String, numShards: Int = TableRowJsonWriteParam.DefaultNumShards, suffix: String = TableRowJsonWriteParam.DefaultSuffix, compression: Compression = TableRowJsonWriteParam.DefaultCompression, shardNameTemplate: String = TableRowJsonWriteParam.DefaultShardNameTemplate, tempDirectory: String = TableRowJsonWriteParam.DefaultTempDirectory, filenamePolicySupplier: FilenamePolicySupplier = TableRowJsonWriteParam.DefaultFilenamePolicySupplier, prefix: String = TableRowJsonWriteParam.DefaultPrefix): ClosedTap[TableRow]
Save this SCollection as a BigQuery TableRow JSON text file.
Save this SCollection as a BigQuery TableRow JSON text file. Note that elements must be of type TableRow.
- returns
a ClosedTap containing some side output(s) depending on the given parameters
- BigQueryIO.SuccessfulTableLoads if
method
is Method.FILE_LOADS. - BigQueryIO.SuccessfulInserts if
method
is Method.STREAMING_INSERTS andsuccessfulInsertsPropagation
istrue
. - BigQueryIO.SuccessfulStorageApiInserts if
method
id Method.STORAGE_WRITE_API or Method.STORAGE_API_AT_LEAST_ONCE. - BigQueryIO.FailedInserts if
method
is Method.FILE_LOADS or Method.STREAMING_INSERTS. - BigQueryIO.FailedInsertsWithErr if
method
is Method.STREAMING_INSERTS andextendedErrorInfo
istrue
. - BigQueryIO.FailedStorageApiInserts if
method
id Method.STORAGE_WRITE_API or Method.STORAGE_API_AT_LEAST_ONCE.
- BigQueryIO.SuccessfulTableLoads if
- def toString(): String
- Definition Classes
- Any