Packages

package jdbc

Main package for JDBC APIs. Import all.

import com.spotify.scio.jdbc._
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. jdbc
  2. AllSyntax
  3. SCollectionSyntax
  4. ScioContextSyntax
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Package Members

  1. package sharded
  2. package syntax

Type Members

  1. trait CloudSqlOptions extends PipelineOptions
  2. class CloudSqlOptionsRegistrar extends PipelineOptionsRegistrar
    Annotations
    @AutoService()
  3. final case class JdbcConnectionOptions(username: String, password: Option[String], connectionUrl: String, driverClass: Class[_ <: Driver]) extends Product with Serializable

    Options for a JDBC connection.

    Options for a JDBC connection.

    username

    database login username

    password

    database login password if exists

    connectionUrl

    connection url, i.e "jdbc:mysql://[host]:[port]/db?"

    driverClass

    subclass of java.sql.Driver

  4. sealed trait JdbcIO[T] extends ScioIO[T]
  5. sealed trait JdbcIoOptions extends AnyRef
  6. final case class JdbcReadOptions[T](connectionOptions: JdbcConnectionOptions, query: String, statementPreparator: (PreparedStatement) => Unit = null, rowMapper: (ResultSet) => T, fetchSize: Int = JdbcIoOptions.BeamDefaultFetchSize) extends JdbcIoOptions with Product with Serializable

    Options for reading from a JDBC source.

    Options for reading from a JDBC source.

    connectionOptions

    connection options

    query

    query string

    statementPreparator

    function to prepare a java.sql.PreparedStatement

    rowMapper

    function to map from a SQL java.sql.ResultSet to T

    fetchSize

    use apache beam default fetch size if the value is -1

  7. final case class JdbcSelect[T](readOptions: JdbcReadOptions[T])(implicit evidence$1: Coder[T]) extends JdbcIO[T] with Product with Serializable
  8. final case class JdbcWrite[T](writeOptions: JdbcWriteOptions[T]) extends JdbcIO[T] with Product with Serializable
  9. final case class JdbcWriteOptions[T](connectionOptions: JdbcConnectionOptions, statement: String, preparedStatementSetter: (T, PreparedStatement) => Unit = null, batchSize: Long = JdbcIoOptions.BeamDefaultBatchSize) extends JdbcIoOptions with Product with Serializable

    Options for writing to a JDBC source.

    Options for writing to a JDBC source.

    connectionOptions

    connection options

    statement

    query statement

    preparedStatementSetter

    function to set values in a java.sql.PreparedStatement

    batchSize

    use apache beam default batch size if the value is -1

Value Members

  1. implicit def jdbcSCollectionOps[T](sc: SCollection[T]): JdbcSCollectionOps[T]
    Definition Classes
    SCollectionSyntax
  2. implicit def jdbcScioContextOps(sc: ScioContext): JdbcScioContextOps
    Definition Classes
    ScioContextSyntax
  3. object JdbcIO
  4. object JdbcIoOptions

Inherited from AllSyntax

Inherited from SCollectionSyntax

Inherited from ScioContextSyntax

Inherited from AnyRef

Inherited from Any

Ungrouped