Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature](partial update) Support flexible partial update in stream load with json files #39756

Merged
merged 29 commits into from
Oct 10, 2024
Merged

[Feature](partial update) Support flexible partial update in stream load with json files #39756

merged 29 commits into from
Oct 10, 2024

Commits on Oct 8, 2024

  1. gensrc proto thrift part

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    c1001fc View commit details
    Browse the repository at this point in the history

  2. fe part

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    3eb36ec View commit details
    Browse the repository at this point in the history

  3. be part 

    be
    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    162be7e View commit details
    Browse the repository at this point in the history

  4. case part 

    tmp
    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    563e278 View commit details
    Browse the repository at this point in the history

  5. add json_root and strip_outer_array case

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    5f7d10f View commit details
    Browse the repository at this point in the history

  6. fix when there are row that don't miss columns and add cases

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    63a0492 View commit details
    Browse the repository at this point in the history

  7. addmore restrict case

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    4ecfc63 View commit details
    Browse the repository at this point in the history

  8. add enable_simdjson_reader=false case

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    e760e04 View commit details
    Browse the repository at this point in the history

  9. add data quality case

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b4e4d55 View commit details
    Browse the repository at this point in the history

  10. fix be compatibility

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    1741ff4 View commit details
    Browse the repository at this point in the history

  11. add skip_bitmap_col_idx to TabletSchemaCloudPB

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    703be8a View commit details
    Browse the repository at this point in the history

  12. make enable_skip_bitmap_column_by_default = false by default

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b999cb0 View commit details
    Browse the repository at this point in the history

  13. some fix

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    93d774f View commit details
    Browse the repository at this point in the history

  14. fix cases

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    8cc9ec2 View commit details
    Browse the repository at this point in the history

  15. fix feut

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    01dc416 View commit details
    Browse the repository at this point in the history

  16. copy flexible partial update code to SegmentWriter

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    4cad56c View commit details
    Browse the repository at this point in the history

  17. add case

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    d895532 View commit details
    Browse the repository at this point in the history

  18. fix cases

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    4141d31 View commit details
    Browse the repository at this point in the history

  19. refactor PartialUpdateInfo, BastTable

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    17f8771 View commit details
    Browse the repository at this point in the history

  20. extract generate_flexible_read_plan

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    7d8b99a View commit details
    Browse the repository at this point in the history

  21. tmp add logs for merge sequence col

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    e5a542e View commit details
    Browse the repository at this point in the history

  22. read seq value from pk index

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    fa2809d View commit details
    Browse the repository at this point in the history

  23. handle default seq map value

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    f828f52 View commit details
    Browse the repository at this point in the history

  24. fix sequence col idx

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    c448bae View commit details
    Browse the repository at this point in the history

  25. add case

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    91348da View commit details
    Browse the repository at this point in the history

  26. change log to VLOG_DEBUG

    @bobhan1
    bobhan1 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    2569de0 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. fix resolve conflict in publish phase when tbl has seq column for fle… 

    …xible partial update and add caseS
    @bobhan1
    bobhan1 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    62e231d View commit details
    Browse the repository at this point in the history

  2. add partial update publish conflict seq case

    @bobhan1
    bobhan1 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    c50b8df View commit details
    Browse the repository at this point in the history

  3. fix publish conflict seq for flexible partial update

    @bobhan1
    bobhan1 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    e5b703d View commit details
    Browse the repository at this point in the history