Package | Description |
---|---|
com.spotify.flo | |
com.spotify.flo.context | |
com.spotify.flo.contrib.bigquery | |
com.spotify.flo.freezer |
Modifier and Type | Method and Description |
---|---|
static <T> Task<T> |
Task.create(Fn<T> code,
Class<T> type,
String taskName,
Object... args) |
Task<Z> |
TaskBuilder.process(TaskBuilder.F0<Z> code) |
Task<Z> |
TaskBuilder.TaskBuilder1.process(TaskBuilder.F1<A,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder10.process(TaskBuilder.F10<A,B,C,D,E,F,G,H,I,J,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder11.process(TaskBuilder.F11<A,B,C,D,E,F,G,H,I,J,K,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder12.process(TaskBuilder.F12<A,B,C,D,E,F,G,H,I,J,K,L,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder13.process(TaskBuilder.F13<A,B,C,D,E,F,G,H,I,J,K,L,M,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder14.process(TaskBuilder.F14<A,B,C,D,E,F,G,H,I,J,K,L,M,N,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder15.process(TaskBuilder.F15<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder16.process(TaskBuilder.F16<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder17.process(TaskBuilder.F17<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder18.process(TaskBuilder.F18<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder19.process(TaskBuilder.F19<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder2.process(TaskBuilder.F2<A,B,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder20.process(TaskBuilder.F20<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder21.process(TaskBuilder.F21<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder22.process(TaskBuilder.F22<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder23.process(TaskBuilder.F23<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder24.process(TaskBuilder.F24<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder3.process(TaskBuilder.F3<A,B,C,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder4.process(TaskBuilder.F4<A,B,C,D,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder5.process(TaskBuilder.F5<A,B,C,D,E,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder6.process(TaskBuilder.F6<A,B,C,D,E,F,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder7.process(TaskBuilder.F7<A,B,C,D,E,F,G,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder8.process(TaskBuilder.F8<A,B,C,D,E,F,G,H,Y> code) |
Task<Z> |
TaskBuilder.TaskBuilder9.process(TaskBuilder.F9<A,B,C,D,E,F,G,H,I,Y> code) |
Modifier and Type | Method and Description |
---|---|
default Optional<Task<?>> |
EvalContext.currentTask()
When called during the evaluation of a task, this method will return the
Task
currently being processed. |
Optional<Task<?>> |
EvalContextWithTask.currentTask() |
List<Task<?>> |
Task.inputs() |
Modifier and Type | Method and Description |
---|---|
default <T> EvalContext.Value<T> |
EvalContext.evaluate(Task<T> task)
The entry point for evaluating a
EvalContext.Value from a Task . |
default <T> EvalContext.Value<T> |
EvalContext.evaluateInternal(Task<T> task,
EvalContext context)
A variant of
EvalContext.evaluate(Task) that allows the caller to specify the EvalContext
that should be used within the graph during evaluation. |
Optional<S> |
TaskOutput.lookup(Task<S> task)
Perform a lookup of the value this task would have produced if it ran.
|
static TaskInfo |
TaskInfo.ofTask(Task<?> task) |
static TaskInfo |
TaskInfo.ofTask(Task<?> task,
Set<TaskId> visits) |
default void |
TaskContext.onFail(Task<?> task,
Throwable throwable)
Will be called just after a task that is using this task context has failed evaluating.
|
default void |
TaskContext.onSuccess(Task<?> task,
S z)
Will be called just after a task that is using this task context has successfully evaluated.
|
default void |
TaskContext.preRun(Task<?> task)
Will be called just before a task that is using this task context starts evaluating.
|
Modifier and Type | Method and Description |
---|---|
<A> TaskBuilder.TaskBuilder1<A,Z,Z> |
TaskBuilder.input(Fn<Task<A>> task) |
<B> TaskBuilder.TaskBuilder2<A,B,Y,Z> |
TaskBuilder.TaskBuilder1.input(Fn<Task<B>> task) |
<C> TaskBuilder.TaskBuilder3<A,B,C,Y,Z> |
TaskBuilder.TaskBuilder2.input(Fn<Task<C>> task) |
<D> TaskBuilder.TaskBuilder4<A,B,C,D,Y,Z> |
TaskBuilder.TaskBuilder3.input(Fn<Task<D>> task) |
<E> TaskBuilder.TaskBuilder5<A,B,C,D,E,Y,Z> |
TaskBuilder.TaskBuilder4.input(Fn<Task<E>> task) |
<F> TaskBuilder.TaskBuilder6<A,B,C,D,E,F,Y,Z> |
TaskBuilder.TaskBuilder5.input(Fn<Task<F>> task) |
<G> TaskBuilder.TaskBuilder7<A,B,C,D,E,F,G,Y,Z> |
TaskBuilder.TaskBuilder6.input(Fn<Task<G>> task) |
<H> TaskBuilder.TaskBuilder8<A,B,C,D,E,F,G,H,Y,Z> |
TaskBuilder.TaskBuilder7.input(Fn<Task<H>> task) |
<I> TaskBuilder.TaskBuilder9<A,B,C,D,E,F,G,H,I,Y,Z> |
TaskBuilder.TaskBuilder8.input(Fn<Task<I>> task) |
<J> TaskBuilder.TaskBuilder10<A,B,C,D,E,F,G,H,I,J,Y,Z> |
TaskBuilder.TaskBuilder9.input(Fn<Task<J>> task) |
<K> TaskBuilder.TaskBuilder11<A,B,C,D,E,F,G,H,I,J,K,Y,Z> |
TaskBuilder.TaskBuilder10.input(Fn<Task<K>> task) |
<L> TaskBuilder.TaskBuilder12<A,B,C,D,E,F,G,H,I,J,K,L,Y,Z> |
TaskBuilder.TaskBuilder11.input(Fn<Task<L>> task) |
<M> TaskBuilder.TaskBuilder13<A,B,C,D,E,F,G,H,I,J,K,L,M,Y,Z> |
TaskBuilder.TaskBuilder12.input(Fn<Task<M>> task) |
<N> TaskBuilder.TaskBuilder14<A,B,C,D,E,F,G,H,I,J,K,L,M,N,Y,Z> |
TaskBuilder.TaskBuilder13.input(Fn<Task<N>> task) |
<O> TaskBuilder.TaskBuilder15<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,Y,Z> |
TaskBuilder.TaskBuilder14.input(Fn<Task<O>> task) |
<P> TaskBuilder.TaskBuilder16<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Y,Z> |
TaskBuilder.TaskBuilder15.input(Fn<Task<P>> task) |
<Q> TaskBuilder.TaskBuilder17<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,Y,Z> |
TaskBuilder.TaskBuilder16.input(Fn<Task<Q>> task) |
<R> TaskBuilder.TaskBuilder18<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,Y,Z> |
TaskBuilder.TaskBuilder17.input(Fn<Task<R>> task) |
<S> TaskBuilder.TaskBuilder19<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,Y,Z> |
TaskBuilder.TaskBuilder18.input(Fn<Task<S>> task) |
<T> TaskBuilder.TaskBuilder20<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,Y,Z> |
TaskBuilder.TaskBuilder19.input(Fn<Task<T>> task) |
<U> TaskBuilder.TaskBuilder21<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,Y,Z> |
TaskBuilder.TaskBuilder20.input(Fn<Task<U>> task) |
<V> TaskBuilder.TaskBuilder22<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,Y,Z> |
TaskBuilder.TaskBuilder21.input(Fn<Task<V>> task) |
<W> TaskBuilder.TaskBuilder23<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,Y,Z> |
TaskBuilder.TaskBuilder22.input(Fn<Task<W>> task) |
<X> TaskBuilder.TaskBuilder24<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z> |
TaskBuilder.TaskBuilder23.input(Fn<Task<X>> task) |
<A> TaskBuilder.TaskBuilder1<List<A>,Z,Z> |
TaskBuilder.inputs(Fn<List<Task<A>>> tasks) |
<B> TaskBuilder.TaskBuilder2<A,List<B>,Y,Z> |
TaskBuilder.TaskBuilder1.inputs(Fn<List<Task<B>>> tasks) |
<C> TaskBuilder.TaskBuilder3<A,B,List<C>,Y,Z> |
TaskBuilder.TaskBuilder2.inputs(Fn<List<Task<C>>> tasks) |
<D> TaskBuilder.TaskBuilder4<A,B,C,List<D>,Y,Z> |
TaskBuilder.TaskBuilder3.inputs(Fn<List<Task<D>>> tasks) |
<E> TaskBuilder.TaskBuilder5<A,B,C,D,List<E>,Y,Z> |
TaskBuilder.TaskBuilder4.inputs(Fn<List<Task<E>>> tasks) |
<F> TaskBuilder.TaskBuilder6<A,B,C,D,E,List<F>,Y,Z> |
TaskBuilder.TaskBuilder5.inputs(Fn<List<Task<F>>> tasks) |
<G> TaskBuilder.TaskBuilder7<A,B,C,D,E,F,List<G>,Y,Z> |
TaskBuilder.TaskBuilder6.inputs(Fn<List<Task<G>>> tasks) |
<H> TaskBuilder.TaskBuilder8<A,B,C,D,E,F,G,List<H>,Y,Z> |
TaskBuilder.TaskBuilder7.inputs(Fn<List<Task<H>>> tasks) |
<I> TaskBuilder.TaskBuilder9<A,B,C,D,E,F,G,H,List<I>,Y,Z> |
TaskBuilder.TaskBuilder8.inputs(Fn<List<Task<I>>> tasks) |
<J> TaskBuilder.TaskBuilder10<A,B,C,D,E,F,G,H,I,List<J>,Y,Z> |
TaskBuilder.TaskBuilder9.inputs(Fn<List<Task<J>>> tasks) |
<K> TaskBuilder.TaskBuilder11<A,B,C,D,E,F,G,H,I,J,List<K>,Y,Z> |
TaskBuilder.TaskBuilder10.inputs(Fn<List<Task<K>>> tasks) |
<L> TaskBuilder.TaskBuilder12<A,B,C,D,E,F,G,H,I,J,K,List<L>,Y,Z> |
TaskBuilder.TaskBuilder11.inputs(Fn<List<Task<L>>> tasks) |
<M> TaskBuilder.TaskBuilder13<A,B,C,D,E,F,G,H,I,J,K,L,List<M>,Y,Z> |
TaskBuilder.TaskBuilder12.inputs(Fn<List<Task<M>>> tasks) |
<N> TaskBuilder.TaskBuilder14<A,B,C,D,E,F,G,H,I,J,K,L,M,List<N>,Y,Z> |
TaskBuilder.TaskBuilder13.inputs(Fn<List<Task<N>>> tasks) |
<O> TaskBuilder.TaskBuilder15<A,B,C,D,E,F,G,H,I,J,K,L,M,N,List<O>,Y,Z> |
TaskBuilder.TaskBuilder14.inputs(Fn<List<Task<O>>> tasks) |
<P> TaskBuilder.TaskBuilder16<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,List<P>,Y,Z> |
TaskBuilder.TaskBuilder15.inputs(Fn<List<Task<P>>> tasks) |
<Q> TaskBuilder.TaskBuilder17<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,List<Q>,Y,Z> |
TaskBuilder.TaskBuilder16.inputs(Fn<List<Task<Q>>> tasks) |
<R> TaskBuilder.TaskBuilder18<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,List<R>,Y,Z> |
TaskBuilder.TaskBuilder17.inputs(Fn<List<Task<R>>> tasks) |
<S> TaskBuilder.TaskBuilder19<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,List<S>,Y,Z> |
TaskBuilder.TaskBuilder18.inputs(Fn<List<Task<S>>> tasks) |
<T> TaskBuilder.TaskBuilder20<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,List<T>,Y,Z> |
TaskBuilder.TaskBuilder19.inputs(Fn<List<Task<T>>> tasks) |
<U> TaskBuilder.TaskBuilder21<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,List<U>,Y,Z> |
TaskBuilder.TaskBuilder20.inputs(Fn<List<Task<U>>> tasks) |
<V> TaskBuilder.TaskBuilder22<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,List<V>,Y,Z> |
TaskBuilder.TaskBuilder21.inputs(Fn<List<Task<V>>> tasks) |
<W> TaskBuilder.TaskBuilder23<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,List<W>,Y,Z> |
TaskBuilder.TaskBuilder22.inputs(Fn<List<Task<W>>> tasks) |
<X> TaskBuilder.TaskBuilder24<A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,List<X>,Y,Z> |
TaskBuilder.TaskBuilder23.inputs(Fn<List<Task<X>>> tasks) |
Modifier and Type | Method and Description |
---|---|
<T> EvalContext.Value<T> |
OverridingContext.evaluateInternal(Task<T> task,
EvalContext context) |
<T> EvalContext.Value<T> |
ForwardingEvalContext.evaluateInternal(Task<T> task,
EvalContext context) |
<T> EvalContext.Value<T> |
MemoizingContext.evaluateInternal(Task<T> task,
EvalContext context) |
<T> EvalContext.Value<T> |
InstrumentedContext.evaluateInternal(Task<T> task,
EvalContext context) |
<T> EvalContext.Value<T> |
AsyncContext.evaluateInternal(Task<T> task,
EvalContext context) |
static <T> FloRunner.Result<T> |
FloRunner.runTask(Task<T> task)
Run task and return an asynchronous
FloRunner.Result containing the last value or throwable. |
static <T> FloRunner.Result<T> |
FloRunner.runTask(Task<T> task,
com.typesafe.config.Config config)
Run task and return an asynchronous
FloRunner.Result containing the last value or throwable. |
void |
InstrumentedContext.Listener.task(Task<?> task)
Called when a
Task is discovered. |
Modifier and Type | Method and Description |
---|---|
static Task<com.google.cloud.bigquery.TableId> |
BigQueryTasks.lookup(String project,
String dataset,
String table) |
static Task<com.google.cloud.bigquery.TableId> |
BigQueryTasks.lookup(com.google.cloud.bigquery.TableId tableId) |
static Task<com.google.cloud.bigquery.TableId> |
BigQueryTasks.lookupLatestDaily(String project,
String dataset,
String tableName,
Date start,
int lookBackDays) |
Modifier and Type | Method and Description |
---|---|
Optional<com.google.cloud.bigquery.TableId> |
BigQueryOutput.lookup(Task<com.google.cloud.bigquery.TableId> task) |
Modifier and Type | Method and Description |
---|---|
<T> EvalContext.Value<T> |
PersistingContext.evaluateInternal(Task<T> task,
EvalContext context) |
void |
LoggingListener.task(Task<?> task) |
Copyright © 2020. All rights reserved.