Skip to content

[To dev/1.3] Limit concurrent load tsfile type conversions - #18030

Merged
jt2594838 merged 1 commit into
apache:dev/1.3from
Caideyipi:cp-4d05a851-dev-1.3
Jun 26, 2026
Merged

jt2594838 merged 1 commit into
apache:dev/1.3from
Caideyipi:cp-4d05a851-dev-1.3

Conversation

@Caideyipi

Copy link
Copy Markdown
Collaborator

Backport #18014 to dev/1.3.

This PR limits concurrent load tsfile type conversions and keeps active load retryable when conversion is temporarily unavailable due to memory pressure.

Validation:

  • mvn -pl iotdb-core/datanode "-Dtest=ActiveLoadFailedMessageHandlerTest,ActiveLoadTsFileLoaderTest,LoadConvertedInsertTabletStatementExceptionVisitorTest" -DskipITs "-DfailIfNoTests=false" test reached compile but failed due to unrelated local reactor dependency mismatch (IOUtils.readFully/pipe API symbols).
  • mvn -pl iotdb-core/datanode -am "-Dtest=ActiveLoadFailedMessageHandlerTest,ActiveLoadTsFileLoaderTest,LoadConvertedInsertTabletStatementExceptionVisitorTest" -DskipITs "-DfailIfNoTests=false" "-Dsurefire.failIfNoSpecifiedTests=false" test failed before datanode on local thrift dependency mismatch (TProtocol.incrementRecursionDepth/decrementRecursionDepth).

* Limit concurrent load tsfile type conversions

* Keep load conversion retryable on memory pressure

* Use i18n message for active load retry log

* Add active load retry coverage for temporary unavailable

* Fix load conversion memory test compile

(cherry picked from commit 4d05a85)
@Caideyipi
Caideyipi force-pushed the cp-4d05a851-dev-1.3 branch from 583f1cb to 9ff0043 Compare June 25, 2026 07:14
@jt2594838
jt2594838 merged commit 7fdccc9 into apache:dev/1.3 Jun 26, 2026
16 of 17 checks passed
@jt2594838
jt2594838 deleted the cp-4d05a851-dev-1.3 branch June 26, 2026 06:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants