Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##: Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

5.  def baseRead: Read[GenericRecord]

   Attributes

   protected

   Definition Classes

   GenericRecordIO → AvroIO

6.  def baseWrite: Write[GenericRecord]

   Attributes

   protected

   Definition Classes

   GenericRecordIO → AvroIO

7.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws(classOf[java.lang.CloneNotSupportedException]) @native()

8.  def defaultDatumFactory: AvroDatumFactory[GenericRecord]

   Attributes

   protected

   Definition Classes

   GenericRecordIO → AvroIO

9.  final def eq(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

10.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.Throwable])

11.  final def getClass(): Class[_ <: AnyRef]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

12.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

13.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

14.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

15.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

16.  val path: String

    Definition Classes

    GenericRecordIO → AvroIO

17.  def productElementNames: Iterator[String]

    Definition Classes

    Product

18.  def read(sc: ScioContext, params: ReadP): SCollection[GenericRecord]

    Read data according to the read configuration provided in params as an SCollection.

    Read data according to the read configuration provided in params as an SCollection.

    Attributes

    protected

    Definition Classes

    AvroIO → ScioIO

19.  def readTest(sc: ScioContext, params: ReadP): SCollection[GenericRecord]

    Called only in a JobTest.

    Called only in a JobTest. Return test data for this testId as an SCollection

    Attributes

    protected

    Definition Classes

    ScioIO

20.  val schema: Schema

    Definition Classes

    GenericRecordIO → AvroIO

21.  final def synchronized[T0](arg0: => T0): T0

    Definition Classes

    AnyRef

22.  def tap(read: ReadP): Tap[GenericRecord]

    Write options also return a ClosedTap.

    Write options also return a ClosedTap. Once the job completes you can open the Tap. Tap abstracts away the logic of reading the dataset directly as an Iterator[T] or re-opening it in another ScioContext. The Future is complete once the job finishes. This can be used to do light weight pipeline orchestration e.g. WordCountOrchestration.scala.

    Definition Classes

    GenericRecordIO → ScioIO

23.  final val tapT: Aux[GenericRecord, GenericRecord]

    Output tap type.

    Output tap type.

    This _must_ be a stable value (a val, not a def) in every implementation, otherwise the return type of write cannot be inferred.

    Definition Classes

    AvroIO → ScioIO

24.  def testId: String

    Identifier for JobTest IO matching

    Identifier for JobTest IO matching

    Definition Classes

    AvroIO → ScioIO

25.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

26.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

27.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException]) @native()

28.  def write(data: SCollection[GenericRecord], params: WriteP): Tap[GenericRecord]

    Write data out according to write configuration provided in params, returning the Tap type.

    Write data out according to write configuration provided in params, returning the Tap type.

    Attributes

    protected

    Definition Classes

    AvroIO → ScioIO

29.  def writeTest(data: SCollection[GenericRecord], params: WriteP): Tap[(tapT)#T]

    Called only in a JobTest.

    Called only in a JobTest. Write data to TestDataManager output and return the Tap type

    Attributes

    protected

    Definition Classes

    ScioIO