You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
My current hardware configuration consists of an 8-core CPU with 32 GB of RAM. When I run the lm-eval command-line script for inference on the CPU, I observe that only a single core is being utilized (as indicated by %CPU reaching 100% in the top utility). However, when using the simple_evaluate() API within Python, I find that all CPU cores are fully utilized (with my %CPU showing up to 800%). Therefore, I would like to inquire about how I can best leverage all of my CPU cores while running the lm-eval command through the command line. Thank you very much!!
The text was updated successfully, but these errors were encountered:
My current hardware configuration consists of an 8-core CPU with 32 GB of RAM. When I run the lm-eval command-line script for inference on the CPU, I observe that only a single core is being utilized (as indicated by %CPU reaching 100% in the top utility). However, when using the simple_evaluate() API within Python, I find that all CPU cores are fully utilized (with my %CPU showing up to 800%). Therefore, I would like to inquire about how I can best leverage all of my CPU cores while running the lm-eval command through the command line. Thank you very much!!
The text was updated successfully, but these errors were encountered: