com.spotify.flo.contrib.bigquery

Class BigQueryOutput

java.lang.Object

com.spotify.flo.TaskOutput<StagingTableId,com.google.cloud.bigquery.TableId>

com.spotify.flo.contrib.bigquery.BigQueryOutput

All Implemented Interfaces:

TaskContext<StagingTableId,com.google.cloud.bigquery.TableId>, Serializable

public class BigQueryOutput
extends TaskOutput<StagingTableId,com.google.cloud.bigquery.TableId>

See Also:

Serialized Form

Method Summary

Modifier and Type	Method and Description
static BigQueryOutput	create(String project, String dataset, String table)
static BigQueryOutput	create(com.google.cloud.bigquery.TableId tableId)
Optional<com.google.cloud.bigquery.TableId>	lookup(Task<com.google.cloud.bigquery.TableId> task) Perform a lookup of the value this task would have produced if it ran.
static BigQueryMocking	mock()
StagingTableId	provide(EvalContext evalContext) Creates a new instance of type T.
com.google.cloud.bigquery.TableId	tableId()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.spotify.flo.TaskContext

onFail, onSuccess, preRun

Method Detail

create

public static BigQueryOutput create(String project,
                                    String dataset,
                                    String table)

create

public static BigQueryOutput create(com.google.cloud.bigquery.TableId tableId)

tableId

public com.google.cloud.bigquery.TableId tableId()

provide

public StagingTableId provide(EvalContext evalContext)

Description copied from interface: TaskContext

Creates a new instance of type T. The given EvalContext will be the evaluation context for the task. The task itself can be accessed through EvalContext.currentTask().

Parameters:

evalContext - The evaluation context in which the current task is being evaluated

Returns:

An instance of the provided task context type

lookup

public Optional<com.google.cloud.bigquery.TableId> lookup(Task<com.google.cloud.bigquery.TableId> task)

Description copied from class: TaskOutput

Perform a lookup of the value this task would have produced if it ran. Override to be able to short-circuit a task with a previously calculated value.

Overrides:

lookup in class TaskOutput<StagingTableId,com.google.cloud.bigquery.TableId>

Parameters:

task - a task with a TaskOutput to lookup a value for

Returns:

the value for this TaskOutput (e.g. from a previous run)

mock

public static BigQueryMocking mock()