feat: MCOL-4889 analyze and vacuum bloat

[amrdb]

New Functionality

This PR introduces three new User-Defined Functions (UDFs) to expose new capabilities to database users:

• mcs_analyze_partition_bloat('schema', 'table', partition_number)
  Analyzes a single specified partition within a table and returns information about the percentage of empty records (bloat).

• mcs_analyze_table_bloat('schema', 'table')
  Extends the analysis to all partitions within a given table, providing a comprehensive view of bloat across the entire table.

• mcs_vacuum_partition('schema', 'table', partition_number)
  Serves as the entry point for manually triggering the partition cleanup process.
  This PR implements the initial framework required for this operation, including creating hidden partitions and enabling targeted data loading.

---

Code Changes and Implementation Details

The implementation spans several components of the ColumnStore engine:

1. Bloat Analysis Engine

• Core logic for bloat analysis is implemented in:
  dbcon/execplan/commandpackageprocessor.cpp
  with new methods: analyzePartitionBloat and analyzeTableBloat.
• The analysis works by executing SQL queries against the system catalog to count empty values and determine the bloat factor.
• Enhancements in:
  dbcon/execplan/CalpontSystemCatalog.cpp
  • New functions: getQueryData, setupQueryTxnCtx
  • Provide querying any data within a from the system catalog which is used for analyze and is useful for future work.

---

2. Vacuuming Framework

The foundation for the vacuuming process is built upon two key changes:

a. Hidden Partition Management

• DBRM and SlaveComm updated to support "hidden" partitions.
  • Enables background data copy without affecting concurrent SELECT queries.
• New functions:
  • createHiddenStripeColumnExtents → creates hidden partitions.
  • makePartitionVisible → atomic swap to make compacted partition visible.
• Changes implemented across:
  • storage-manager/dbrm/
  • utils/slavecomm/
  • utils/slavecomm/slavedbrmnode.cpp
    Ensures functionality in both single-node and distributed environments.

b. Targeted Bulk Loading

• cpimport utility enhanced to support targeted partition loading.
• Changes in:
  • writeengine/bulk/we_cmdargs.cpp → new CLI argument for target partition (Directory.Segment.DBRoot).
  • writeengine/bulk/we_bulkload.cpp (BulkLoad class) → processes new argument.
• Enables vacuum process to SELECT data from bloated partition and pipe it directly into the hidden partition via cpimport.

---

3. UDF Interface

• New UDFs registered and implemented in:
  • dbcon/mysql/ha_mcs_client_udfs.cpp
  • dbcon/mysql/ha_mcs_impl.cpp
• These act as the bridge between MariaDB server and ColumnStore engine, handling:
  • Input validation
  • Invoking backend implementation

---

Future Work

This PR provides the foundational components for bloat analysis and vacuuming.
Upcoming work will address:

• Finishing vacuum partition.
• Implementing vacuum table.
• Use AUX columns in analyze UDFs when they are added as actual queryable columns.

[drrtuy]

untestedACK