You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have a python project use pickle file ,pandas2.1,
when it run in x86 centos7,cost 107s,
but only need 71s in mac m2,
and I upgrade pandas to 2.2.3,and set:pd.options.mode.copy_on_write = True
and edit function df_merge(which is the most cost time fuciton),
change df to arrow first。
then only need 35s。
but,same in x86 centos7,still need 100s,why arrow not work?
Expected Behavior
use arrow twice quickly in x86 centos7,but no effect!
Installed Versions
2.2.3
The text was updated successfully, but these errors were encountered:
There can be few reasons for that like:
Pandas Options: Double-check the Pandas options you're using. Sometimes, tweaking options like pd.options.mode.chained_assignment or pd.options.mode.use_inf_as_na can have an impact on performance.
Arrow Installation: Ensure that Arrow is properly installed and configured on your CentOS 7 system. Sometimes, missing dependencies or incorrect configurations can affect performance
Pandas version checks
I have checked that this issue has not already been reported.
I have confirmed this bug exists on the latest version of pandas.
I have confirmed this bug exists on the main branch of pandas.
Reproducible Example
Issue Description
I have a python project use pickle file ,pandas2.1,
when it run in x86 centos7,cost 107s,
but only need 71s in mac m2,
and I upgrade pandas to 2.2.3,and set:pd.options.mode.copy_on_write = True
and edit function df_merge(which is the most cost time fuciton),
change df to arrow first。
then only need 35s。
but,same in x86 centos7,still need 100s,why arrow not work?
Expected Behavior
use arrow twice quickly in x86 centos7,but no effect!
Installed Versions
2.2.3
The text was updated successfully, but these errors were encountered: