implicit final class CassandraSCollection[T] extends AnyVal
- Alphabetic
- By Inheritance
- CassandraSCollection
- AnyVal
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new CassandraSCollection(self: SCollection[T])
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- Any
- final def ##: Int
- Definition Classes
- Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def getClass(): Class[_ <: AnyVal]
- Definition Classes
- AnyVal → Any
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def saveAsCassandra(opts: CassandraOptions, parallelism: Int = CassandraIO.WriteParam.DefaultParallelism)(f: (T) => Seq[Any]): ClosedTap[Nothing]
Save this SCollection as a Cassandra table.
Save this SCollection as a Cassandra table.
Cassandra
org.apache.cassandra.hadoop.cql3.CqlBulkRecordWriter
is used to perform bulk writes for better throughput. The SCollection is grouped by the table partition key before written to the cluster. Therefore writes only occur at the end of each window in streaming mode. The bulk writer writes to all nodes in a cluster so remote nodes in a multi-datacenter cluster may become a bottleneck.NOTE: this module is optimized for throughput in batch mode and not recommended for streaming mode.
- opts
Cassandra options
- parallelism
number of concurrent bulk writers, default to number of Cassandra nodes
- f
function to convert input data to values for the CQL statement
- def toString(): String
- Definition Classes
- Any