Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##: Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

5.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws(classOf[java.lang.CloneNotSupportedException]) @native()

6.  final def eq(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

7.  def finalize(): Unit

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws(classOf[java.lang.Throwable])

8.  final def getClass(): Class[_ <: AnyRef]

   Definition Classes

   AnyRef → Any

   Annotations

   @native()

9.  final def isInstanceOf[T0]: Boolean

   Definition Classes

   Any

10.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

11.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

12.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

13.  val opts: CassandraOptions
14.  def productElementNames: Iterator[String]

    Definition Classes

    Product

15.  def read(sc: ScioContext, params: ReadP): SCollection[T]

    Read data according to the read configuration provided in params as an SCollection.

    Read data according to the read configuration provided in params as an SCollection.

    Attributes

    protected

    Definition Classes

    CassandraIO → ScioIO

16.  def readTest(sc: ScioContext, params: ReadP): SCollection[T]

    Called only in a JobTest.

    Called only in a JobTest. Return test data for this testId as an SCollection

    Attributes

    protected

    Definition Classes

    ScioIO

17.  final def synchronized[T0](arg0: => T0): T0

    Definition Classes

    AnyRef

18.  def tap(params: ReadP): Tap[Nothing]

    Write options also return a ClosedTap.

    Write options also return a ClosedTap. Once the job completes you can open the Tap. Tap abstracts away the logic of reading the dataset directly as an Iterator[T] or re-opening it in another ScioContext. The Future is complete once the job finishes. This can be used to do light weight pipeline orchestration e.g. WordCountOrchestration.scala.

    Definition Classes

    CassandraIO → ScioIO

19.  val tapT: Aux[T, Nothing]

    Output tap type.

    Output tap type.

    This _must_ be a stable value (a val, not a def) in every implementation, otherwise the return type of write cannot be inferred.

    Definition Classes

    CassandraIO → ScioIO

20.  def testId: String

    Identifier for JobTest IO matching

    Identifier for JobTest IO matching

    Definition Classes

    ScioIO

21.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

22.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

23.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException]) @native()

24.  def write(data: SCollection[T], params: WriteP): Tap[Nothing]

    Save this SCollection as a Cassandra table.

    Save this SCollection as a Cassandra table.

    Cassandra org.apache.cassandra.hadoop.cql3.CqlBulkRecordWriter is used to perform bulk writes for better throughput. The SCollection is grouped by the table partition key before written to the cluster. Therefore writes only occur at the end of each window in streaming mode. The bulk writer writes to all nodes in a cluster so remote nodes in a multi-datacenter cluster may become a bottleneck.

    Attributes

    protected

    Definition Classes

    CassandraIO → ScioIO

25.  def writeTest(data: SCollection[T], params: WriteP): Tap[(tapT)#T]

    Called only in a JobTest.

    Called only in a JobTest. Write data to TestDataManager output and return the Tap type

    Attributes

    protected

    Definition Classes

    ScioIO