class SCollectionWithFanout[T] extends PCollectionWrapper[T]
An enhanced SCollection that uses an intermediate node to combine parts of the data to reduce load on the final global combine step.
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- SCollectionWithFanout
- PCollectionWrapper
- TransformNameable
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- Protected
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- def aggregate[A, U](aggregator: MonoidAggregator[T, A, U])(implicit arg0: Coder[A], arg1: Coder[U]): SCollection[U]
SCollection.aggregate with fan out.
- def aggregate[A, U](aggregator: Aggregator[T, A, U])(implicit arg0: Coder[A], arg1: Coder[U]): SCollection[U]
SCollection.aggregate with fan out.
- def aggregate[U](zeroValue: U)(seqOp: (U, T) => U, combOp: (U, U) => U)(implicit arg0: Coder[U]): SCollection[U]
SCollection.aggregate with fan out.
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- implicit def coder: Coder[T]
- Definition Classes
- PCollectionWrapper
- def combine[C](createCombiner: (T) => C)(mergeValue: (C, T) => C)(mergeCombiners: (C, C) => C)(implicit arg0: Coder[C]): SCollection[C]
SCollection.combine with fan out.
- val context: ScioContext
The ScioContext associated with this PCollection.
The ScioContext associated with this PCollection.
- Definition Classes
- SCollectionWithFanout → PCollectionWrapper
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- def fold(implicit mon: Monoid[T]): SCollection[T]
SCollection.fold with fan out.
- def fold(zeroValue: T)(op: (T, T) => T): SCollection[T]
SCollection.fold with fan out.
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- val internal: PCollection[T]
The PCollection being wrapped internally.
The PCollection being wrapped internally.
- Definition Classes
- SCollectionWithFanout → PCollectionWrapper
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- def reduce(op: (T, T) => T): SCollection[T]
SCollection.reduce with fan out.
- def sum(implicit sg: Semigroup[T]): SCollection[T]
SCollection.sum with fan out.
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- def withName(name: String): SCollectionWithFanout.this.type
Set a custom name for the next transform to be applied.
Set a custom name for the next transform to be applied.
- Definition Classes
- SCollectionWithFanout → TransformNameable