Packages

c

com.spotify.scio.cassandra

CassandraSCollection

implicit final class CassandraSCollection[T] extends AnyVal

Enhanced version of SCollection with Cassandra methods.

Source
package.scala
Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CassandraSCollection
  2. AnyVal
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new CassandraSCollection(self: SCollection[T])

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    Any
  2. final def ##: Int
    Definition Classes
    Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def getClass(): Class[_ <: AnyVal]
    Definition Classes
    AnyVal → Any
  6. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  7. def saveAsCassandra(opts: CassandraOptions, parallelism: Int = CassandraIO.WriteParam.DefaultParallelism)(f: (T) => Seq[Any]): ClosedTap[Nothing]

    Save this SCollection as a Cassandra table.

    Save this SCollection as a Cassandra table.

    Cassandra org.apache.cassandra.hadoop.cql3.CqlBulkRecordWriter is used to perform bulk writes for better throughput. The SCollection is grouped by the table partition key before written to the cluster. Therefore writes only occur at the end of each window in streaming mode. The bulk writer writes to all nodes in a cluster so remote nodes in a multi-datacenter cluster may become a bottleneck.

    NOTE: this module is optimized for throughput in batch mode and not recommended for streaming mode.

    opts

    Cassandra options

    parallelism

    number of concurrent bulk writers, default to number of Cassandra nodes

    f

    function to convert input data to values for the CQL statement

  8. def toString(): String
    Definition Classes
    Any

Inherited from AnyVal

Inherited from Any

Ungrouped