Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##: Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

5.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws(classOf[java.lang.CloneNotSupportedException]) @native()

6.  final def eq(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

7.  def equals(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef → Any

8.  def finalize(): Unit

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws(classOf[java.lang.Throwable])

9.  final def getClass(): Class[_ <: AnyRef]

   Definition Classes

   AnyRef → Any

   Annotations

   @native()

10.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

11.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

12.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

13.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

14.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

15.  def runWithContext(fn: (ScioContext) => Any): ScioExecutionContext

    Test pipeline components with a ScioContext.

    Test pipeline components with a ScioContext.

    fn

    code that tests the components and verifies the result

    runWithContext { sc =>
      sc.parallelize(Seq(1, 2, 3)).sum should containSingleValue (6)
    }

16.  def runWithData[T1, T2, T3, T4, U](data1: Iterable[T1], data2: Iterable[T2], data3: Iterable[T3], data4: Iterable[T4])(fn: (SCollection[T1], SCollection[T2], SCollection[T3], SCollection[T4]) => SCollection[U])(implicit arg0: Coder[T1], arg1: Coder[T2], arg2: Coder[T3], arg3: Coder[T4]): Seq[U]

    Test pipeline components with in-memory data.

    Test pipeline components with in-memory data.

    Input data is passed to fn as SCollection s and the result SCollection from fn is extracted and to be verified.

    data1

    input data

    data2

    input data

    data3

    input data

    data4

    input data

    fn

    transform to be tested

    returns

    output data

17.  def runWithData[T1, T2, T3, U](data1: Iterable[T1], data2: Iterable[T2], data3: Iterable[T3])(fn: (SCollection[T1], SCollection[T2], SCollection[T3]) => SCollection[U])(implicit arg0: Coder[T1], arg1: Coder[T2], arg2: Coder[T3]): Seq[U]

    Test pipeline components with in-memory data.

    Test pipeline components with in-memory data.

    Input data is passed to fn as SCollection s and the result SCollection from fn is extracted and to be verified.

    data1

    input data

    data2

    input data

    data3

    input data

    fn

    transform to be tested

    returns

    output data

18.  def runWithData[T1, T2, U](data1: Iterable[T1], data2: Iterable[T2])(fn: (SCollection[T1], SCollection[T2]) => SCollection[U])(implicit arg0: Coder[T1], arg1: Coder[T2]): Seq[U]

    Test pipeline components with in-memory data.

    Test pipeline components with in-memory data.

    Input data is passed to fn as SCollection s and the result SCollection from fn is extracted and to be verified.

    data1

    input data

    data2

    input data

    fn

    transform to be tested

    returns

    output data

19.  def runWithData[T, U](data: Iterable[T])(fn: (SCollection[T]) => SCollection[U])(implicit arg0: Coder[T]): Seq[U]

    Test pipeline components with in-memory data.

    Test pipeline components with in-memory data.

    Input data is passed to fn as an SCollection and the result SCollection from fn is extracted and to be verified.

    data

    input data

    fn

    transform to be tested

    returns

    output data

    runWithData(Seq(1, 2, 3)) { p =>
      p.sum
    } shouldBe Seq(6)

20.  def runWithLocalOutput[T, U](fn: (ScioContext) => (SCollection[T], SCollection[U])): (ScioResult, Seq[T], Seq[U])

    Test pipeline components with a ScioContext and materialized resulting collections.

    Test pipeline components with a ScioContext and materialized resulting collections.

    fn

    transform to be tested

    returns

    a tuple containing the ScioResult and the materialized results of the SCollections returned by fn as Seqs

21.  def runWithLocalOutput[U](fn: (ScioContext) => SCollection[U]): (ScioResult, Seq[U])

    Test pipeline components with a ScioContext and materialized resulting collection.

    Test pipeline components with a ScioContext and materialized resulting collection.

    The result SCollection from fn is extracted and to be verified.

    fn

    transform to be tested

    returns

    a tuple containing the ScioResult and the materialized result of fn as a Seq

22.  def runWithOutput[T](fn: (ScioContext) => ClosedTap[T]): (ScioResult, Tap[T])

    Test pipeline components with a ScioContext and access to the output's tap.

    Test pipeline components with a ScioContext and access to the output's tap.

    fn

    transform to be tested

    returns

    a tuple containing the ScioResult and the Tap to read back data written by the tested pipeline

23.  def runWithOverrides(overrides: PTransformOverride*)(fn: (ScioContext) => Any): ScioExecutionContext

    Test pipeline components with a ScioContext and replace transforms with the provided override.

    Test pipeline components with a ScioContext and replace transforms with the provided override.

    fn

    code that tests the components and verifies the result

    runWithOverrides(TransformOverride.of("operation", (v: Int) => v.toString)) { sc =>
      val result = sc.parallelize(Seq(1, 2, 3))
        .withName("operation")
        .map(operationFn)
      result should contain theSameElementAs("1", "2", "3")
    }

24.  def runWithRealContext(options: PipelineOptions = PipelineOptionsFactory.create())(fn: (ScioContext) => Any): ScioExecutionContext
25.  final def synchronized[T0](arg0: => T0): T0

    Definition Classes

    AnyRef

26.  def toString(): String

    Definition Classes

    AnyRef → Any

27.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

28.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

29.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException]) @native()