Flink写Starrocks报错

2025-02-24 12:02:41,206 INFO  com.starrocks.connector.flink.manager.StarRocksSinkManager   [] - Async stream load: db[aaaa] table[dws_content_operation_toutiao_5minute_ev_filter_duplicates_v2] rows[1611] bytes[1109163] label[3d61511c-4e79-406d-be8f-75c395bf5b30].
2025-02-24 12:02:41,222 INFO  com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor [] - Start to join batch data: label[3d61511c-4e79-406d-be8f-75c395bf5b30].
2025-02-24 12:02:41,223 INFO  com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor [] - Executing stream load to: 'http://cm-starrocks12.gy.****:8030/api/aaaa/dws_content_operation_toutiao_5minute_ev_filter_duplicates_v2/_stream_load', size: '1110775', thread: 474205
2025-02-24 12:03:16,443 WARN  com.starrocks.connector.flink.manager.StarRocksSinkManager   [] - Failed to flush batch data to StarRocks, retry times = 0
com.starrocks.connector.flink.manager.StarRocksStreamLoadFailedException: Failed to flush data to StarRocks, Error response: 
{"Status":"Fail","BeginTxnTimeMs":0,"Message":"get database read lock timeout, database=aaaa","NumberUnselectedRows":0,"CommitAndPublishTimeMs":0,"Label":"3d61511c-4e79-406d-be8f-75c395bf5b30","LoadBytes":0,"StreamLoadPlanTimeMs":30000,"NumberTotalRows":0,"WriteDataTimeMs":0,"TxnId":15256344,"LoadTimeMs":0,"ReadDataTimeMs":0,"NumberLoadedRows":0,"NumberFilteredRows":0}
{}

    at com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor.doStreamLoad(StarRocksStreamLoadVisitor.java:116) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.asyncFlush(StarRocksSinkManager.java:331) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.lambda$startAsyncFlushing$0(StarRocksSinkManager.java:174) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at java.lang.Thread.run(Thread.java:750) [?:1.8.0_362]
2025-02-24 12:03:17,449 INFO  com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor [] - Start to join batch data: label[3d61511c-4e79-406d-be8f-75c395bf5b30].
2025-02-24 12:03:17,450 INFO  com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor [] - Executing stream load to: 'http://cm-starrocks13.gy.****:8030/api/aaaa/dws_content_operation_toutiao_5minute_ev_filter_duplicates_v2/_stream_load', size: '1110775', thread: 474205
2025-02-24 12:04:52,794 WARN  com.starrocks.connector.flink.manager.StarRocksSinkManager   [] - Failed to flush batch data to StarRocks, retry times = 1
com.starrocks.connector.flink.manager.StarRocksStreamLoadFailedException: Failed to flush data to StarRocks, Error response: 
{"Status":"Fail","BeginTxnTimeMs":0,"Message":"Commit transaction fail cause FE RPC failure, address=TNetworkAddress(hostname=cm-starrocks13.gy.ntes, port=9020), reason=THRIFT_EAGAIN (timed out), Transaction status unknown, you can retry with same label.","NumberUnselectedRows":0,"CommitAndPublishTimeMs":0,"Label":"3d61511c-4e79-406d-be8f-75c395bf5b30","LoadBytes":1110775,"StreamLoadPlanTimeMs":29029,"NumberTotalRows":1611,"WriteDataTimeMs":45,"TxnId":15256406,"LoadTimeMs":90215,"ReadDataTimeMs":2,"NumberLoadedRows":1611,"NumberFilteredRows":0}
{}

    at com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor.doStreamLoad(StarRocksStreamLoadVisitor.java:116) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.asyncFlush(StarRocksSinkManager.java:331) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.lambda$startAsyncFlushing$0(StarRocksSinkManager.java:174) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at java.lang.Thread.run(Thread.java:750) [?:1.8.0_362]
2025-02-24 12:04:54,802 INFO  com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor [] - Start to join batch data: label[3d61511c-4e79-406d-be8f-75c395bf5b30].
2025-02-24 12:04:54,803 INFO  com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor [] - Executing stream load to: 'http://cm-starrocks11.gy.****:8030/api/aaaa/dws_content_operation_toutiao_5minute_ev_filter_duplicates_v2/_stream_load', size: '1110775', thread: 474205
2025-02-24 12:05:30,025 WARN  com.starrocks.connector.flink.manager.StarRocksSinkManager   [] - Failed to flush batch data to StarRocks, retry times = 2
com.starrocks.connector.flink.manager.StarRocksStreamLoadFailedException: Failed to flush data to StarRocks, Error response: 
{"Status":"Fail","BeginTxnTimeMs":0,"Message":"get database read lock timeout, database=aaaa","NumberUnselectedRows":0,"CommitAndPublishTimeMs":0,"Label":"3d61511c-4e79-406d-be8f-75c395bf5b30","LoadBytes":0,"StreamLoadPlanTimeMs":30000,"NumberTotalRows":0,"WriteDataTimeMs":0,"TxnId":15256510,"LoadTimeMs":0,"ReadDataTimeMs":0,"NumberLoadedRows":0,"NumberFilteredRows":0}
{}

    at com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor.doStreamLoad(StarRocksStreamLoadVisitor.java:116) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.asyncFlush(StarRocksSinkManager.java:331) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.lambda$startAsyncFlushing$0(StarRocksSinkManager.java:174) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at java.lang.Thread.run(Thread.java:750) [?:1.8.0_362]
2025-02-24 12:05:33,030 INFO  com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor [] - Start to join batch data: label[3d61511c-4e79-406d-be8f-75c395bf5b30].
2025-02-24 12:05:33,030 INFO  com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor [] - Executing stream load to: 'http://cm-starrocks12.gy.****:8030/api/aaaa/dws_content_operation_toutiao_5minute_ev_filter_duplicates_v2/_stream_load', size: '1110775', thread: 474205
2025-02-24 12:06:08,302 WARN  com.starrocks.connector.flink.manager.StarRocksSinkManager   [] - Failed to flush batch data to StarRocks, retry times = 3
com.starrocks.connector.flink.manager.StarRocksStreamLoadFailedException: Failed to flush data to StarRocks, Error response: 
{"Status":"Fail","BeginTxnTimeMs":0,"Message":"get database read lock timeout, database=aaaa","NumberUnselectedRows":0,"CommitAndPublishTimeMs":0,"Label":"3d61511c-4e79-406d-be8f-75c395bf5b30","LoadBytes":0,"StreamLoadPlanTimeMs":30000,"NumberTotalRows":0,"WriteDataTimeMs":0,"TxnId":15256593,"LoadTimeMs":0,"ReadDataTimeMs":0,"NumberLoadedRows":0,"NumberFilteredRows":0}
{}

    at com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor.doStreamLoad(StarRocksStreamLoadVisitor.java:116) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.asyncFlush(StarRocksSinkManager.java:331) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.lambda$startAsyncFlushing$0(StarRocksSinkManager.java:174) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at java.lang.Thread.run(Thread.java:750) [?:1.8.0_362]
2025-02-24 12:06:08,306 INFO  org.apache.flink.streaming.runtime.tasks.RegularOperatorChain [] - Could not complete snapshot 80059 for operator Sink: ContentOperationV2_Sink_Name (1/1)#12. Failure reason: Checkpoint was declined.
org.apache.flink.runtime.checkpoint.CheckpointException: Could not complete snapshot 80059 for operator Sink: ContentOperationV2_Sink_Name (1/1)#12. Failure reason: Checkpoint was declined.
    at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:269) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:173) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.api.operators.AbstractStreamOperator.snapshotState(AbstractStreamOperator.java:345) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.checkpointStreamOperator(RegularOperatorChain.java:227) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.buildOperatorSnapshotFutures(RegularOperatorChain.java:212) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.snapshotState(RegularOperatorChain.java:192) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.takeSnapshotSync(SubtaskCheckpointCoordinatorImpl.java:647) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.checkpointState(SubtaskCheckpointCoordinatorImpl.java:320) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$performCheckpoint$12(StreamTask.java:1256) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:1244) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointOnBarrier(StreamTask.java:1201) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.io.checkpointing.CheckpointBarrierHandler.notifyCheckpoint(CheckpointBarrierHandler.java:147) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.io.checkpointing.CheckpointBarrierTracker.triggerCheckpointOnAligned(CheckpointBarrierTracker.java:301) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.io.checkpointing.CheckpointBarrierTracker.processBarrier(CheckpointBarrierTracker.java:141) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.io.checkpointing.CheckpointedInputGate.handleEvent(CheckpointedInputGate.java:181) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.io.checkpointing.CheckpointedInputGate.pollNext(CheckpointedInputGate.java:159) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:110) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:519) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:203) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:807) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:756) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948) [flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927) [flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741) [flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563) [flink-dist-1.15.4.jar:1.15.4]
    at java.lang.Thread.run(Thread.java:750) [?:1.8.0_362]
Caused by: java.lang.RuntimeException: Writing records to StarRocks failed.
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.checkFlushException(StarRocksSinkManager.java:412) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.waitAsyncFlushingDone(StarRocksSinkManager.java:380) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.flushInternal(StarRocksSinkManager.java:266) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.flush(StarRocksSinkManager.java:250) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.table.sink.StarRocksDynamicSinkFunction.snapshotState(StarRocksDynamicSinkFunction.java:201) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at org.apache.flink.streaming.util.functions.StreamingFunctionUtils.trySnapshotFunctionState(StreamingFunctionUtils.java:118) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.util.functions.StreamingFunctionUtils.snapshotFunctionState(StreamingFunctionUtils.java:99) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.snapshotState(AbstractUdfStreamOperator.java:87) ~[flink-dist-1.15.4.jar:1.15.4]
    at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:222) ~[flink-dist-1.15.4.jar:1.15.4]
    ... 27 more
Caused by: com.starrocks.connector.flink.manager.StarRocksStreamLoadFailedException: Failed to flush data to StarRocks, Error response: 
{"Status":"Fail","BeginTxnTimeMs":0,"Message":"get database read lock timeout, database=aaaa","NumberUnselectedRows":0,"CommitAndPublishTimeMs":0,"Label":"3d61511c-4e79-406d-be8f-75c395bf5b30","LoadBytes":0,"StreamLoadPlanTimeMs":30000,"NumberTotalRows":0,"WriteDataTimeMs":0,"TxnId":15256344,"LoadTimeMs":0,"ReadDataTimeMs":0,"NumberLoadedRows":0,"NumberFilteredRows":0}
{}

    at com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor.doStreamLoad(StarRocksStreamLoadVisitor.java:116) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.asyncFlush(StarRocksSinkManager.java:331) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.lambda$startAsyncFlushing$0(StarRocksSinkManager.java:174) ~[blob_p-ca74e17ff4d0ef92256146c4182ead2f38f9e8dd-d56edff536aa611eab805197058bc541:?]
    ... 1 more
2025-02-24 12:06:08,313 INFO  com.starrocks.connector.flink.manager.StarRocksSinkManager   [] - StarRocks Sink is about to close, loadMetrics: LoadMetrics{startTimeNano=21557782524059904, totalRunningTimeNano=2448510314921145, numberOfSuccessLoad=8278, totalSuccessLoadBytes=8225147406, totalSuccessLoadRows=12030064, totalSuccessLoadTimeNano=3408369315194}.
2025-02-24 12:06:08,313 INFO  com.starrocks.connector.flink.manager.StarRocksSinkManager   [] - StarRocks flush thread is about to exit.
2025-02-24 12:06:08,315 WARN  org.apache.flink.runtime.taskmanager.Task                    [] - Sink: ContentOperationV2_Sink_Name (1/1)#12 (f32bfb1fcb527435feefb8424bbabc7f) switched from RUNNING to FAILED with failure cause: java.io.IOException: Could not perform checkpoint 80059 for operator Sink: ContentOperationV2_Sink_Name (1/1)#12.
    at org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointOnBarrier(StreamTask.java:1213)
    at org.apache.flink.streaming.runtime.io.checkpointing.CheckpointBarrierHandler.notifyCheckpoint(CheckpointBarrierHandler.java:147)
    at org.apache.flink.streaming.runtime.io.checkpointing.CheckpointBarrierTracker.triggerCheckpointOnAligned(CheckpointBarrierTracker.java:301)
    at org.apache.flink.streaming.runtime.io.checkpointing.CheckpointBarrierTracker.processBarrier(CheckpointBarrierTracker.java:141)
    at org.apache.flink.streaming.runtime.io.checkpointing.CheckpointedInputGate.handleEvent(CheckpointedInputGate.java:181)
    at org.apache.flink.streaming.runtime.io.checkpointing.CheckpointedInputGate.pollNext(CheckpointedInputGate.java:159)
    at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:110)
    at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:519)
    at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:203)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:807)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:756)
    at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
    at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
    at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
    at java.lang.Thread.run(Thread.java:750)
    Suppressed: java.lang.RuntimeException: Writing records to StarRocks failed.
        at com.starrocks.connector.flink.manager.StarRocksSinkManager.checkFlushException(StarRocksSinkManager.java:412)
        at com.starrocks.connector.flink.manager.StarRocksSinkManager.close(StarRocksSinkManager.java:295)
        at com.starrocks.connector.flink.table.sink.StarRocksDynamicSinkFunction.close(StarRocksDynamicSinkFunction.java:217)
        at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
        at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.close(AbstractUdfStreamOperator.java:114)
        at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.close(StreamOperatorWrapper.java:163)
        at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.closeAllOperators(RegularOperatorChain.java:125)
        at org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:1000)
        at org.apache.flink.util.IOUtils.closeAll(IOUtils.java:254)
        at org.apache.flink.core.fs.AutoCloseableRegistry.doClose(AutoCloseableRegistry.java:72)
        at org.apache.flink.util.AbstractAutoCloseableRegistry.close(AbstractAutoCloseableRegistry.java:127)
        at org.apache.flink.streaming.runtime.tasks.StreamTask.cleanUp(StreamTask.java:919)
        at org.apache.flink.runtime.taskmanager.Task.lambda$restoreAndInvoke$0(Task.java:930)
        at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
        at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:930)
        ... 3 more
    Caused by: com.starrocks.connector.flink.manager.StarRocksStreamLoadFailedException: Failed to flush data to StarRocks, Error response: 
{"Status":"Fail","BeginTxnTimeMs":0,"Message":"get database read lock timeout, database=aaaa","NumberUnselectedRows":0,"CommitAndPublishTimeMs":0,"Label":"3d61511c-4e79-406d-be8f-75c395bf5b30","LoadBytes":0,"StreamLoadPlanTimeMs":30000,"NumberTotalRows":0,"WriteDataTimeMs":0,"TxnId":15256344,"LoadTimeMs":0,"ReadDataTimeMs":0,"NumberLoadedRows":0,"NumberFilteredRows":0}
{}

        at com.starrocks.connector.flink.manager.StarRocksStreamLoadVisitor.doStreamLoad(StarRocksStreamLoadVisitor.java:116)
        at com.starrocks.connector.flink.manager.StarRocksSinkManager.asyncFlush(StarRocksSinkManager.java:331)
        at com.starrocks.connector.flink.manager.StarRocksSinkManager.lambda$startAsyncFlushing$0(StarRocksSinkManager.java:174)
        ... 1 more
Caused by: org.apache.flink.runtime.checkpoint.CheckpointException: Could not complete snapshot 80059 for operator Sink: ContentOperationV2_Sink_Name (1/1)#12. Failure reason: Checkpoint was declined.
    at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:269)
    at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:173)
    at org.apache.flink.streaming.api.operators.AbstractStreamOperator.snapshotState(AbstractStreamOperator.java:345)
    at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.checkpointStreamOperator(RegularOperatorChain.java:227)
    at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.buildOperatorSnapshotFutures(RegularOperatorChain.java:212)
    at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.snapshotState(RegularOperatorChain.java:192)
    at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.takeSnapshotSync(SubtaskCheckpointCoordinatorImpl.java:647)
    at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.checkpointState(SubtaskCheckpointCoordinatorImpl.java:320)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$performCheckpoint$12(StreamTask.java:1256)
    at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:1244)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointOnBarrier(StreamTask.java:1201)
    ... 16 more
Caused by: java.lang.RuntimeException: Writing records to StarRocks failed.
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.checkFlushException(StarRocksSinkManager.java:412)
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.waitAsyncFlushingDone(StarRocksSinkManager.java:380)
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.flushInternal(StarRocksSinkManager.java:266)
    at com.starrocks.connector.flink.manager.StarRocksSinkManager.flush(StarRocksSinkManager.java:250)
    at com.starrocks.connector.flink.table.sink.StarRocksDynamicSinkFunction.snapshotState(StarRocksDynamicSinkFunction.java:201)
    at org.apache.flink.streaming.util.functions.StreamingFunctionUtils.trySnapshotFunctionState(StreamingFunctionUtils.java:118)
    at org.apache.flink.streaming.util.functions.StreamingFunctionUtils.snapshotFunctionState(StreamingFunctionUtils.java:99)
    at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.snapshotState(AbstractUdfStreamOperator.java:87)
    at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.snapshotState(StreamOperatorStateHandler.java:222)
    ... 27 more
Caused by: [CIRCULAR REFERENCE: com.starrocks.connector.flink.manager.StarRocksStreamLoadFailedException: Failed to flush data to StarRocks, Error response: 
{"Status":"Fail","BeginTxnTimeMs":0,"Message":"get database read lock timeout, database=aaaa","NumberUnselectedRows":0,"CommitAndPublishTimeMs":0,"Label":"3d61511c-4e79-406d-be8f-75c395bf5b30","LoadBytes":0,"StreamLoadPlanTimeMs":30000,"NumberTotalRows":0,"WriteDataTimeMs":0,"TxnId":15256344,"LoadTimeMs":0,"ReadDataTimeMs":0,"NumberLoadedRows":0,"NumberFilteredRows":0}
{}
]
一点一滴

Flink写Starrocks报错

没有评论
