Skip to content

added validate method into TabletMetadata #5340

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
May 15, 2025

Conversation

ArbaazKhan1
Copy link
Contributor

closes issue #5242

Created a Validate method inside Tablet Metadata to check overlap of files and tablet ranges.

@ctubbsii ctubbsii added this to the 3.1.0 milestone Mar 5, 2025
Copy link
Contributor

@keith-turner keith-turner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These changes seem good, it would be nice to add some unit test to TabletMetadataTest

@ctubbsii ctubbsii changed the base branch from 3.1 to main March 13, 2025 23:51
@ctubbsii ctubbsii modified the milestones: 3.1.0, 4.0.0 Mar 13, 2025
@ctubbsii ctubbsii merged commit 208204b into apache:main May 15, 2025
8 checks passed
@kevinrr888 kevinrr888 mentioned this pull request May 19, 2025
keith-turner added a commit to keith-turner/accumulo that referenced this pull request May 29, 2025
The delete rows table operation was clipping a file to a row range like
(f,f] and adding this to tablet with a row range of (f,g].  The files row
range did not overlap the tablets row range causing reads of the tablet
to fail with the changes in apache#5340.  This was causing DeleteRowsIT to
fail, modified the code to avoid adding the non overlapping row range
and now DeleteRowsIT passes.

Made a lot of logging changes while tracking this down, kept those in
this commit.
keith-turner added a commit to keith-turner/accumulo that referenced this pull request May 29, 2025
CloneIT was directly inserting metadata table file entries with row
ranges that did not overlap the tablet range.  After the changes in
 apache#5340 this caused the metadata reads to fail.  Modfied the test to
insert file w/ ranges that overlap.
keith-turner added a commit that referenced this pull request May 29, 2025
CloneIT was directly inserting metadata table file entries with row
ranges that did not overlap the tablet range.  After the changes in
 #5340 this caused the metadata reads to fail.  Modfied the test to
insert file w/ ranges that overlap.
keith-turner added a commit that referenced this pull request May 30, 2025
The delete rows table operation was clipping a file to a row range like
(f,f] and adding this to tablet with a row range of (f,g].  The files row
range did not overlap the tablets row range causing reads of the tablet
to fail with the changes in #5340.  This was causing DeleteRowsIT to
fail, modified the code to avoid adding the non overlapping row range
and now DeleteRowsIT passes.

Made a lot of logging changes while tracking this down, kept those in
this commit.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add check for files that do not overlap tablet
6 participants