Packages

package scio

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. Protected

Package Members

  1. package annotations
  2. package avro

    Main package for Avro APIs.

    Main package for Avro APIs. Import all.

    import com.spotify.scio.avro._
  3. package bigquery

    Main package for BigQuery APIs.

    Main package for BigQuery APIs. Import all.

    import com.spotify.scio.bigquery._

    There are two BigQuery dialects, legacy and standard. APIs that take a BigQuery query string as argument, e.g. com.spotify.scio.bigquery.client.BigQuery.query.rows, com.spotify.scio.bigquery.client.BigQuery.query.schema, com.spotify.scio.bigquery.client.BigQuery.getTypedRows and BigQueryType.fromQuery, automatically detects the query's dialect. To override this, start the query with either #legacysql or #standardsql comment line.

  4. package bigtable

    Main package for Bigtable APIs.

    Main package for Bigtable APIs. Import all.

    import com.spotify.scio.bigtable._
  5. package cassandra

    Main package for Cassandra APIs.

    Main package for Cassandra APIs. Import all.

    import com.spotify.scio.cassandra._
  6. package coders
  7. package elasticsearch

    Main package for Elasticsearch APIs.

    Main package for Elasticsearch APIs. Import all.

    import com.spotify.scio.elasticsearch._
  8. package extra
  9. package hash

    Main package for hash APIs.

    Main package for hash APIs. Import all.

    import com.spotify.scio.hash._
  10. package io
  11. package jdbc

    Main package for JDBC APIs.

    Main package for JDBC APIs. Import all.

    import com.spotify.scio.jdbc._
  12. package metrics

    This package contains the schema types for metrics collected during a pipeline run.

  13. package options
  14. package parquet
  15. package pubsub
  16. package runners
  17. package schemas
  18. package smb
  19. package spanner
  20. package tensorflow
  21. package testing
  22. package transforms

    Main package for transforms APIs.

    Main package for transforms APIs. Import all.

  23. package util
  24. package values

Type Members

  1. class Args extends Serializable

    Encapsulate parsed commandline arguments.

  2. class DistCacheScioContext extends AnyRef

    An enhanced ScioContext with distributed cache features.

  3. sealed trait IsJavaBean[T] extends AnyRef

    Proof that a type is implemented in Java

  4. trait RunnerContext extends AnyRef

    Runner specific context.

  5. trait RunnerResult extends AnyRef

    Represent a Beam runner specific result.

  6. class ScioContext extends TransformNameable

    Main entry point for Scio functionality.

    Main entry point for Scio functionality. A ScioContext represents a pipeline and can be used to create SCollections and distributed caches on that cluster.

  7. trait ScioExecutionContext extends AnyRef

    ScioExecutionContext is the result of ScioContext#run().

    ScioExecutionContext is the result of ScioContext#run().

    This is a handle to the underlying running job and allows getting the state, checking if it's completed and to wait for it's execution.

  8. abstract class ScioResult extends AnyRef

    Represent a Scio pipeline result.

  9. final case class SysProp(flag: String, description: String) extends Product with Serializable
  10. trait SysProps extends AnyRef
  11. final macro class registerSysProps extends Annotation with StaticAnnotation
    Annotations
    @compileTimeOnly("enable macro paradise (2.12) or -Ymacro-annotations (2.13) to expand macro annotations")

Value Members

  1. object Args extends Serializable

    A simple command line argument parser.

    A simple command line argument parser.

    Arguments can be either properties (--key=value1,value2,...) or booleans (--test).

  2. case object BuildInfo extends Product with Serializable

    This object was generated by sbt-buildinfo.

  3. object ContextAndArgs

    Convenience object for creating ScioContext and Args.

  4. object CoreSysProps
    Annotations
    @registerSysProps()
  5. object IsJavaBean
  6. object JavaConverters

    Converters for Beam Java SDK APIs.

    Converters for Beam Java SDK APIs. Import all.

    import com.spotify.scio.JavaConverters._
  7. object ScioContext

    Companion object for ScioContext.

  8. object ScioMetrics

    Utility object for creating metrics.

    Utility object for creating metrics. The main types available are org.apache.beam.sdk.metrics.Counter, org.apache.beam.sdk.metrics.Distribution and org.apache.beam.sdk.metrics.Gauge.

  9. object SysProps

Ungrouped