| Class | Description |
|---|---|
| ParallelRunnerWithTouch | |
| TimePartitionedDataPublisherWithFlag | |
| TimePartitionedFlagDataPublisher |
IMPORTANT NOTES:
- Gobblin published folders are expected to be in the form {PUBLISHERDIR}/{TABLE_NAME}/{PARTITION}
This means that the "writer.file.path.type" property is expected to be "tablename"
- Gobblin writter partition-scheme is expected to follow time-order when sorted alphabetically
Publisher output flag path: {PUBLISHERDIR}/{TABLE_NAME}/{PARTITION}/{FLAG}
For topics having crossed time-partitions boundary across all their kafka-partitions.
|
Copyright © 2021. All rights reserved.