Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[be](ut) fix be ut test invalid case failed #48928

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

zhangstar333
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@zhangstar333
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32480 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d2c889c900631e8c878801df04ace1d8ed60d8b2, data reload: false

------ Round 1 ----------------------------------
q1	17640	5182	5038	5038
q2	2055	300	167	167
q3	10470	1386	714	714
q4	10228	1042	537	537
q5	7663	2385	2382	2382
q6	188	160	131	131
q7	914	739	628	628
q8	9307	1294	1101	1101
q9	4929	4788	4707	4707
q10	6828	2294	1886	1886
q11	471	285	260	260
q12	350	356	221	221
q13	17766	3707	3118	3118
q14	246	232	212	212
q15	557	492	492	492
q16	618	615	564	564
q17	584	878	348	348
q18	6880	6488	6362	6362
q19	1835	962	539	539
q20	324	324	191	191
q21	2752	2194	1902	1902
q22	1087	1045	980	980
Total cold run time: 103692 ms
Total hot run time: 32480 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5202	5104	5140	5104
q2	235	322	228	228
q3	2179	2661	2288	2288
q4	1457	1893	1389	1389
q5	4187	4147	4160	4147
q6	205	161	122	122
q7	1869	1981	1734	1734
q8	2646	2525	2700	2525
q9	7237	7185	7083	7083
q10	2969	3193	2779	2779
q11	609	518	486	486
q12	706	802	650	650
q13	3519	3843	3259	3259
q14	284	291	279	279
q15	566	501	498	498
q16	651	676	653	653
q17	1174	1593	1382	1382
q18	7825	7483	7431	7431
q19	838	855	944	855
q20	1980	2017	1893	1893
q21	5727	4929	4853	4853
q22	1093	1045	1020	1020
Total cold run time: 53158 ms
Total hot run time: 50658 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185307 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d2c889c900631e8c878801df04ace1d8ed60d8b2, data reload: false

query1	1026	385	388	385
query2	6522	1873	1869	1869
query3	6794	218	211	211
query4	26556	23731	22954	22954
query5	4324	649	503	503
query6	293	201	201	201
query7	4612	510	292	292
query8	300	249	249	249
query9	8617	2655	2647	2647
query10	451	309	253	253
query11	15806	15086	14853	14853
query12	158	114	104	104
query13	1663	542	409	409
query14	10243	6613	6869	6613
query15	215	193	180	180
query16	7689	645	466	466
query17	1196	721	590	590
query18	2021	407	308	308
query19	203	188	161	161
query20	119	116	117	116
query21	208	119	106	106
query22	4055	4324	4162	4162
query23	34150	33014	33131	33014
query24	7680	2375	2369	2369
query25	514	446	399	399
query26	1221	268	146	146
query27	2129	492	326	326
query28	3881	2457	2451	2451
query29	724	553	429	429
query30	292	214	196	196
query31	953	876	747	747
query32	80	64	64	64
query33	553	384	296	296
query34	790	859	503	503
query35	784	804	728	728
query36	946	982	897	897
query37	115	106	73	73
query38	4100	4141	4031	4031
query39	1446	1400	1397	1397
query40	207	119	104	104
query41	56	53	51	51
query42	119	105	105	105
query43	503	502	465	465
query44	1277	800	779	779
query45	179	170	162	162
query46	845	1025	619	619
query47	1738	1778	1692	1692
query48	368	414	303	303
query49	799	504	417	417
query50	694	730	398	398
query51	4162	4181	4126	4126
query52	109	110	94	94
query53	229	265	189	189
query54	486	515	412	412
query55	83	77	85	77
query56	259	247	263	247
query57	1120	1141	1067	1067
query58	254	241	227	227
query59	2701	2645	2570	2570
query60	288	273	269	269
query61	123	124	120	120
query62	811	727	657	657
query63	216	191	187	187
query64	4312	1028	665	665
query65	4437	4331	4324	4324
query66	1063	395	307	307
query67	15660	15384	15304	15304
query68	8595	879	509	509
query69	455	300	257	257
query70	1226	1118	1074	1074
query71	468	297	284	284
query72	5772	3593	3805	3593
query73	786	743	351	351
query74	9147	9162	9010	9010
query75	3790	3189	2686	2686
query76	3678	1186	730	730
query77	772	368	281	281
query78	9980	9996	9240	9240
query79	3801	827	567	567
query80	804	530	465	465
query81	468	255	221	221
query82	684	125	94	94
query83	210	169	161	161
query84	285	93	74	74
query85	786	354	300	300
query86	348	313	271	271
query87	4475	4571	4353	4353
query88	3442	2314	2298	2298
query89	438	313	282	282
query90	1960	213	214	213
query91	150	139	112	112
query92	78	61	58	58
query93	2671	1062	581	581
query94	682	413	296	296
query95	366	272	260	260
query96	483	564	275	275
query97	3341	3396	3302	3302
query98	230	215	202	202
query99	1457	1432	1272	1272
Total cold run time: 278355 ms
Total hot run time: 185307 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.75 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d2c889c900631e8c878801df04ace1d8ed60d8b2, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.04
query3	0.24	0.06	0.07
query4	1.62	0.10	0.11
query5	0.56	0.55	0.54
query6	1.16	0.73	0.71
query7	0.02	0.02	0.01
query8	0.06	0.03	0.04
query9	0.60	0.53	0.51
query10	0.55	0.63	0.57
query11	0.16	0.11	0.11
query12	0.15	0.11	0.11
query13	0.61	0.59	0.61
query14	2.81	2.85	2.68
query15	0.92	0.84	0.84
query16	0.38	0.38	0.38
query17	1.06	1.05	1.01
query18	0.22	0.20	0.19
query19	1.94	1.82	2.03
query20	0.02	0.01	0.02
query21	15.36	0.91	0.55
query22	0.75	1.18	0.64
query23	14.98	1.36	0.62
query24	7.58	1.39	0.91
query25	0.48	0.24	0.14
query26	0.74	0.15	0.12
query27	0.05	0.05	0.05
query28	9.16	0.81	0.44
query29	12.57	4.03	3.32
query30	0.25	0.09	0.06
query31	2.85	0.58	0.38
query32	3.23	0.54	0.47
query33	2.96	3.03	2.97
query34	15.74	5.16	4.47
query35	4.60	4.47	4.50
query36	0.68	0.49	0.49
query37	0.10	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.14	0.13
query41	0.09	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.66 s
Total hot run time: 30.75 s

BiteTheDDDDt
BiteTheDDDDt previously approved these changes Mar 11, 2025
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 11, 2025
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@zhangstar333
Copy link
Contributor Author

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Mar 12, 2025
@doris-robot
Copy link

TPC-H: Total hot run time: 32444 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6d74953a67253f53c623c6f21211a3c7c2e95575, data reload: false

------ Round 1 ----------------------------------
q1	17656	5269	5071	5071
q2	2061	298	163	163
q3	10478	1315	716	716
q4	10233	1036	534	534
q5	7588	2405	2426	2405
q6	195	166	131	131
q7	916	740	610	610
q8	9316	1343	1128	1128
q9	5006	4664	4753	4664
q10	6824	2309	1882	1882
q11	484	272	254	254
q12	348	344	217	217
q13	17775	3681	3060	3060
q14	237	245	211	211
q15	525	477	482	477
q16	623	623	585	585
q17	563	879	347	347
q18	7004	6385	6291	6291
q19	1819	950	600	600
q20	327	319	188	188
q21	2886	2122	1925	1925
q22	1022	1023	985	985
Total cold run time: 103886 ms
Total hot run time: 32444 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5215	5100	5135	5100
q2	243	333	232	232
q3	2154	2667	2303	2303
q4	1511	1814	1353	1353
q5	4247	4131	4133	4131
q6	207	165	122	122
q7	1902	2015	1783	1783
q8	2638	2693	2577	2577
q9	7311	7228	7184	7184
q10	3021	3248	2768	2768
q11	566	531	490	490
q12	682	763	572	572
q13	3480	3907	3304	3304
q14	275	293	268	268
q15	530	479	471	471
q16	656	669	631	631
q17	1152	1613	1331	1331
q18	7717	7626	7366	7366
q19	896	847	963	847
q20	1961	2074	1829	1829
q21	5459	4944	4908	4908
q22	1126	1083	1017	1017
Total cold run time: 52949 ms
Total hot run time: 50587 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184518 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6d74953a67253f53c623c6f21211a3c7c2e95575, data reload: false

query1	1022	394	374	374
query2	6533	1869	1904	1869
query3	6792	221	210	210
query4	26393	23689	22896	22896
query5	4306	666	482	482
query6	291	198	205	198
query7	4604	500	294	294
query8	299	239	253	239
query9	8646	2642	2645	2642
query10	486	319	265	265
query11	15572	15443	14857	14857
query12	162	113	108	108
query13	1675	532	388	388
query14	9048	6668	6632	6632
query15	204	191	178	178
query16	7490	641	488	488
query17	1230	717	561	561
query18	1962	397	304	304
query19	188	187	161	161
query20	119	117	118	117
query21	210	124	106	106
query22	4136	4214	4086	4086
query23	33985	32891	33117	32891
query24	7671	2366	2372	2366
query25	532	454	391	391
query26	1231	272	153	153
query27	2114	487	326	326
query28	3909	2417	2379	2379
query29	736	567	415	415
query30	283	212	189	189
query31	921	833	750	750
query32	70	64	65	64
query33	561	350	296	296
query34	806	836	505	505
query35	798	802	729	729
query36	958	968	905	905
query37	113	99	74	74
query38	4119	4182	4141	4141
query39	1484	1381	1406	1381
query40	217	112	116	112
query41	52	50	49	49
query42	118	103	101	101
query43	504	506	480	480
query44	1317	776	784	776
query45	174	169	162	162
query46	865	1026	626	626
query47	1721	1777	1707	1707
query48	385	412	298	298
query49	768	498	429	429
query50	690	743	410	410
query51	4246	4221	4132	4132
query52	113	111	94	94
query53	237	253	184	184
query54	490	503	430	430
query55	83	81	83	81
query56	270	260	249	249
query57	1140	1142	1086	1086
query58	239	234	229	229
query59	2388	2540	2547	2540
query60	297	267	252	252
query61	130	154	120	120
query62	768	749	660	660
query63	220	192	190	190
query64	4339	999	655	655
query65	4503	4335	4344	4335
query66	1118	402	293	293
query67	15641	15394	15183	15183
query68	8247	865	498	498
query69	464	306	249	249
query70	1207	1120	1085	1085
query71	457	284	259	259
query72	5704	3573	3724	3573
query73	784	735	354	354
query74	9000	9246	8668	8668
query75	3863	3138	2683	2683
query76	3705	1178	735	735
query77	776	373	279	279
query78	10020	10075	9326	9326
query79	2544	897	575	575
query80	632	524	434	434
query81	504	258	219	219
query82	701	123	99	99
query83	175	178	151	151
query84	246	87	70	70
query85	815	363	391	363
query86	390	314	290	290
query87	4395	4540	4265	4265
query88	3659	2231	2244	2231
query89	397	328	276	276
query90	1881	207	206	206
query91	150	135	111	111
query92	75	66	57	57
query93	1694	1065	582	582
query94	659	404	303	303
query95	347	270	258	258
query96	472	565	276	276
query97	3290	3368	3263	3263
query98	242	206	214	206
query99	1432	1378	1301	1301
Total cold run time: 273619 ms
Total hot run time: 184518 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.71 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6d74953a67253f53c623c6f21211a3c7c2e95575, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.04	0.04
query3	0.24	0.06	0.06
query4	1.62	0.10	0.10
query5	0.56	0.57	0.54
query6	1.20	0.72	0.72
query7	0.03	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.52	0.50
query10	0.56	0.62	0.57
query11	0.15	0.11	0.11
query12	0.14	0.12	0.11
query13	0.61	0.62	0.59
query14	2.72	2.85	2.80
query15	0.92	0.83	0.86
query16	0.38	0.38	0.38
query17	1.08	1.04	1.03
query18	0.20	0.20	0.20
query19	1.85	1.84	2.01
query20	0.01	0.01	0.02
query21	15.38	0.86	0.54
query22	0.75	1.16	0.61
query23	15.04	1.38	0.59
query24	7.25	1.28	0.69
query25	0.51	0.25	0.17
query26	0.67	0.16	0.13
query27	0.05	0.05	0.05
query28	9.73	0.89	0.42
query29	12.54	3.96	3.31
query30	0.25	0.09	0.06
query31	2.82	0.57	0.38
query32	3.23	0.57	0.46
query33	3.01	2.97	3.03
query34	15.66	5.16	4.50
query35	4.57	4.55	4.52
query36	0.67	0.50	0.51
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.14	0.13
query41	0.09	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.63 s
Total hot run time: 30.71 s

@zhangstar333
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32914 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 581ca966487363de2a4a4484e12348eb25db623e, data reload: false

------ Round 1 ----------------------------------
q1	17664	5236	5222	5222
q2	2054	299	161	161
q3	10412	1261	767	767
q4	10192	1041	540	540
q5	7514	2397	2334	2334
q6	184	160	134	134
q7	926	744	617	617
q8	9292	1291	1084	1084
q9	4904	4944	4831	4831
q10	6818	2323	1879	1879
q11	473	270	256	256
q12	354	362	223	223
q13	17805	3698	3124	3124
q14	232	231	207	207
q15	531	478	492	478
q16	634	605	588	588
q17	578	896	349	349
q18	6971	6389	6393	6389
q19	1736	944	560	560
q20	331	337	189	189
q21	2802	2200	1999	1999
q22	1046	1017	983	983
Total cold run time: 103453 ms
Total hot run time: 32914 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5148	5138	5119	5119
q2	238	336	229	229
q3	2139	2663	2292	2292
q4	1485	1855	1415	1415
q5	4271	4123	4205	4123
q6	211	164	125	125
q7	1909	1906	1739	1739
q8	2656	2539	2489	2489
q9	7289	7187	7246	7187
q10	3041	3257	2761	2761
q11	591	499	483	483
q12	699	725	575	575
q13	3455	4012	3330	3330
q14	277	307	273	273
q15	540	518	511	511
q16	611	674	661	661
q17	1143	1605	1347	1347
q18	7786	7647	7389	7389
q19	839	888	1009	888
q20	1962	2031	1866	1866
q21	5527	5105	4675	4675
q22	1135	1100	1036	1036
Total cold run time: 52952 ms
Total hot run time: 50513 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants