Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updating MySql configuration for Optimization #419

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

nmalkapuram
Copy link
Contributor

Updating mysql server package to update the sql configuration (configure.py) to optimize server.
Updating profile for seting up optimal environment variables for mysql server.

@nmalkapuram nmalkapuram force-pushed the users/nmalkapuram/sqlconfigupdateforoptimization branch from b9717f3 to a17b365 Compare January 5, 2025 21:29
@@ -10,6 +10,7 @@
"DatabaseName": "sbtest",
"DatabaseScenario": "Balanced",
"DiskFilter": "osdisk:false&sizegreaterthan:256g",
"InnodbBufferPoolSize": "{calculate({SystemMemoryBytes} * 80 / 100)}",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When you change profile parameters please change document accordingly.

@@ -169,7 +170,7 @@
"Parameters": {
"Scenario": "DownloadMySqlServerPackage",
"BlobContainer": "packages",
"BlobName": "mysql-server-8.0.36.zip",
"BlobName": "mysql-server-8.0.36-v2.zip",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What are the changes, need to document what you changed in the package. Also there might be licensing concerns if we modify mysql package.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These are the changes not done to mysql package directly. There are few python scripts we have developed in order to configure and run mysql. I will document the changes made. I was planning to add those scripts in source code too, inorder to have proper version control.

@@ -231,7 +232,8 @@
"Action": "SetGlobalVariables",
"Benchmark": "OLTP",
"DiskFilter": "$.Parameters.DiskFilter",
"Variables": "MAX_PREPARED_STMT_COUNT=1000000;MAX_CONNECTIONS=1000000",
"InnodbBufferPoolSize": "$.Parameters.InnodbBufferPoolSize",
"Variables": "MAX_PREPARED_STMT_COUNT=655350;MAX_CONNECTIONS=10000;innodb_buffer_pool_size={InnodbBufferPoolSize};innodb_lock_wait_timeout=300;innodb_io_capacity=10000;innodb_io_capacity_max=10000;innodb_buffer_pool_dump_at_shutdown=OFF;innodb_change_buffering=0;table_open_cache=20000;",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to document all these default varaibles. If they are compete specific, create an internal compete profile

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These are not specifically for compete. This is optimization for mysql itself. These values help in increasing efficiency of mysql ( observed improved time in database creation).

@yangpanMS
Copy link
Contributor

Also change title accordingly

@nmalkapuram nmalkapuram changed the title Users/nmalkapuram/sqlconfigupdateforoptimization Updating MySql configuration for Optimization Jan 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants