Package | Description |
---|---|
org.wikimedia.gobblin.copy | |
org.wikimedia.gobblin.kafka | |
org.wikimedia.gobblin.publisher |
Class and Description |
---|
BaseDataPublisher
A basic implementation of
SingleTaskDataPublisher that publishes the data from the writer output directory
to the final output directory. |
Class and Description |
---|
KafkaSource
A
Source implementation for Kafka source. |
Class and Description |
---|
BaseDataPublisher
A basic implementation of
SingleTaskDataPublisher that publishes the data from the writer output directory
to the final output directory. |
TimePartitionedDataPublisher
For time partition jobs, writer output directory is
$GOBBLIN_WORK_DIR/task-output/{extractId}/{tableName}/{partitionPath},
where partition path is the time bucket, e.g., 2015/04/08/15.
|
Copyright © 2021. All rights reserved.