package values
- Alphabetic
- Public
- Protected
Type Members
- sealed trait DistCache[F] extends Serializable
Encapsulate arbitrary data that can be distributed to all workers.
Encapsulate arbitrary data that can be distributed to all workers. Similar to Hadoop distributed cache.
- class DoubleSCollectionFunctions extends AnyRef
Extra functions available on SCollections of
Double
s through an implicit conversion. - class FileSCollectionFunctions extends AnyRef
- sealed trait HotKeyMethod extends AnyRef
Method to compute the hot keys in a SCollection
- class PairHashSCollectionFunctions[K, V] extends AnyRef
Extra functions available on SCollections of (key, value) pairs for hash based joins through an implicit conversion.
- class PairSCollectionFunctions[K, V] extends AnyRef
Extra functions available on SCollections of (key, value) pairs through an implicit conversion.
- class PairSkewedSCollectionFunctions[K, V] extends AnyRef
Extra functions available on SCollections of (key, value) pairs for skewed joins through an implicit conversion.
- sealed trait SCollection[T] extends PCollectionWrapper[T]
A Scala wrapper for PCollection.
A Scala wrapper for PCollection. Represents an immutable, partitioned collection of elements that can be operated on in parallel. This class contains the basic operations available on all SCollections, such as
map
,filter
, andsum
. In addition, PairSCollectionFunctions contains operations available only on SCollections of key-value pairs, such asgroupByKey
andjoin
; DoubleSCollectionFunctions contains operations available only on SCollections ofDouble
s. - class SCollectionWithFanout[T] extends PCollectionWrapper[T]
An enhanced SCollection that uses an intermediate node to combine parts of the data to reduce load on the final global combine step.
- class SCollectionWithHotKeyFanout[K, V] extends TransformNameable
An enhanced SCollection that uses an intermediate node to combine "hot" keys partially before performing the full combine.
- class SCollectionWithSideInput[T] extends PCollectionWrapper[T]
An enhanced SCollection that provides access to one or more SideInput s for some transforms.
An enhanced SCollection that provides access to one or more SideInput s for some transforms. SideInput s are accessed via the additional SideInputContext argument.
- class SCollectionWithSideOutput[T] extends PCollectionWrapper[T]
An enhanced SCollection that provides access to one or more SideOutput s for some transforms.
An enhanced SCollection that provides access to one or more SideOutput s for some transforms. SideOutput s are accessed via the additional SideOutputContext argument. SCollection s of the SideOutput s are accessed via the additional SideOutputCollections return value.
- class SampleSCollectionFunctions[T] extends AnyRef
- trait SideInput[T] extends Serializable
Encapsulate an SCollection when it is being used as a side input.
- class SideInputContext[T] extends AnyRef
Encapsulate context of one or more SideInputs in an SCollectionWithSideInput.
- sealed trait SideOutput[T] extends Serializable
Encapsulate a side output for a transform.
- sealed trait SideOutputCollections extends AnyRef
Encapsulate output of one or more SideOutputs in an SCollectionWithSideOutput.
- class SideOutputContext[T] extends AnyRef
Encapsulate context of one or more SideOutputs in an SCollectionWithSideOutput.
- trait TransformNameable extends AnyRef
Trait for setting custom names on transforms.
- case class WindowOptions(trigger: Trigger = null, accumulationMode: AccumulationMode = null, allowedLateness: Duration = null, closingBehavior: ClosingBehavior = null, timestampCombiner: TimestampCombiner = null, onTimeBehavior: OnTimeBehavior = null) extends Product with Serializable
Window options for an SCollection.
- class WindowedSCollection[T] extends PCollectionWrapper[T]
An enhanced SCollection that provides access to window information via WindowedValue.
- case class WindowedValue[T](value: T, timestamp: Instant, window: BoundedWindow, pane: PaneInfo) extends Product with Serializable
Value with window information to be used inside a WindowedSCollection.
Value Members
- object FileSCollectionFunctions
- object HotKeyMethod
- object MockDistCache extends Serializable
- object SCollection
Convenience functions for creating SCollections.
- object SampleSCollectionFunctions
- object SideInput extends Serializable
Companion object of SideInput.
- object SideOutput extends Serializable
Companion object for SideOutput.
- object SideOutputCollections
- object SkewedJoins