Skip to content

Commit

Permalink
[feat] add dirty manager and resolve conflict.
Browse files Browse the repository at this point in the history
  • Loading branch information
FlechazoW committed Jan 5, 2021
1 parent c145543 commit 29ff102
Showing 1 changed file with 1 addition and 6 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -124,14 +124,9 @@ public DataStreamSink<Tuple2<Boolean, Row>> consumeDataStream(DataStream<Tuple2<
.setClientKeytabFile(clientKeytabFile)
.setBatchSize(Integer.parseInt(batchSize))
.setBatchWaitInterval(Long.parseLong(batchWaitInterval))
.setDirtyManager(DirtyDataManager.newInstance(dirtyProperties))
.finish();

builder.setClientPrincipal(clientPrincipal);
builder.setClientKeytabFile(clientKeytabFile);

builder.setDirtyManager(DirtyDataManager.newInstance(dirtyProperties));

HbaseOutputFormat outputFormat = builder.finish();
RichSinkFunction richSinkFunction = new OutputFormatSinkFunction(outputFormat);
DataStreamSink dataStreamSink = dataStream.addSink(richSinkFunction).name(registerTabName);

Expand Down

0 comments on commit 29ff102

Please sign in to comment.