Packages

c

com.spotify.scio.jdbc.syntax

JdbcSCollectionOps

final class JdbcSCollectionOps[T] extends AnyVal

Enhanced version of SCollection with JDBC methods.

Source
SCollectionSyntax.scala
Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. JdbcSCollectionOps
  2. AnyVal
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new JdbcSCollectionOps(self: SCollection[T])

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    Any
  2. final def ##: Int
    Definition Classes
    Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def getClass(): Class[_ <: AnyVal]
    Definition Classes
    AnyVal → Any
  6. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  7. def saveAsJdbc(connectionOptions: JdbcConnectionOptions, statement: String, batchSize: Long = WriteParam.BeamDefaultBatchSize, retryConfiguration: RetryConfiguration = WriteParam.BeamDefaultRetryConfiguration, retryStrategy: (SQLException) => Boolean = WriteParam.DefaultRetryStrategy, autoSharding: Boolean = WriteParam.DefaultAutoSharding, dataSourceProviderFn: () => DataSource = WriteParam.DefaultDataSourceProviderFn, configOverride: (Write[T]) => Write[T] = WriteParam.defaultConfigOverride[T])(preparedStatementSetter: (T, PreparedStatement) => Unit): ClosedTap[Nothing]

    Save this SCollection as a JDBC database.

    Save this SCollection as a JDBC database.

    NB: in case of transient failures, Beam runners may execute parts of write multiple times for fault tolerance. Because of that, you should avoid using INSERT statements, since that risks duplicating records in the database, or failing due to primary key conflicts. Consider using MERGE ("upsert") statements supported by your database instead.

    connectionOptions

    connection options

    statement

    query statement

    batchSize

    use apache beam default batch size if the value is -1

    retryConfiguration

    org.apache.beam.sdk.io.jdbc.JdbcIO.RetryConfiguration for specifying retry behavior

    retryStrategy

    A predicate of java.sql.SQLException indicating a failure to retry

    autoSharding

    If true, enables using a dynamically determined number of shards to write.

    dataSourceProviderFn

    function to provide a custom javax.sql.DataSource

    configOverride

    function to override or replace a Write transform before applying it

    preparedStatementSetter

    function to set values in a java.sql.PreparedStatement

  8. def toString(): String
    Definition Classes
    Any

Inherited from AnyVal

Inherited from Any

Ungrouped