Class | Description |
---|---|
BaseDataPublisher |
A basic implementation of
SingleTaskDataPublisher that publishes the data from the writer output directory
to the final output directory. |
Kafka1ConsumerClient<K,V> |
A
GobblinKafkaConsumerClient that uses kafka 1.1 consumer client. |
Kafka1ConsumerClient.Factory |
A factory class to instantiate
Kafka1ConsumerClient |
Kafka1ConsumerClient.Kafka1ConsumerRecord<K,V> |
A record returned by
Kafka1ConsumerClient |
KafkaSource<S,D> |
A
Source implementation for Kafka source. |
TimePartitionedDataPublisher |
For time partition jobs, writer output directory is
$GOBBLIN_WORK_DIR/task-output/{extractId}/{tableName}/{partitionPath},
where partition path is the time bucket, e.g., 2015/04/08/15.
|
Copyright © 2021. All rights reserved.