November APAC Community Sync

[ChenSammi]

3rd Nov

Attender: Ivan, Yiyang, Bin, Yuanben, Guangbao, Jianghua, Conway, Wei-Chiu, Siddhant, Sammi
Agenda:

1. Shopee
   • Testing ratis streaming write. The performance is not as expected. The discussion is under HDDS-8691.
   • Plan to support s3 object ACL feature.
   • Multi-upload open key cleanup feature is onging.
2. DiDi
   • Discussed the OM performance improvement topic. Shared the RPC data between OM w/o RATIS. Data can be found in https://docs.google.com/document/d/1g1h-63fvA-be-clvyVRAHLWehoadCnjNRWyX8Bp-UIU/edit#heading=h.358h6n518zuj.
     The goal is the performance with OM HA is close to the current performance of single OM without RATIS.
   • Reported one OM fail to start failure. The logs are attached in above google doc.

[ChenSammi]

10th Nov
Attender: Xi, Hao, Minyu, Bin, Yuanben, Guangbao, Jianghua, Conway, Sammi
Agenda:

• Qihoo

  1. Delivered a great short session about the learning and customization of Ozone Manager.
     OM改造分享-Qihoo.pdf

• DiDi

  1. Using a dedicated cluster to reproduce and investigate how to improve the OM IOPS (write and read). Previous cluster can achieve 4K+4K(createKey,commitKey) IOPS.
  2. Is suggested to evaluate HDDS-9279 OM HA: support read from followers.

[ChenSammi]

17 Nov
Attenders: Sidhhant, Wei-Chiu, Sammi, Yiyang, Ivan, Jianghua

Cloudera:

1. Shared the current state of Hbase support.
2. Shared the current state of DN decommission improvements. Under the umbrella JIRA HDDS-8699, lots of corner cases which cause DN decommission are addressed already.
3. Support a new Decommission status command. Will share the document with community later.

Shopee:

1. 1.4.0 release.
   RATIS 3.0 release is under voting.
   There are two remaining blocker issues targeting 1.4.0.

DiDi:

1. Discussed the current DN to SCM heartbeat mechanism.