Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](nereids) fix range inference generate an empty range #47434

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

yujun777
Copy link
Collaborator

@yujun777 yujun777 commented Jan 24, 2025

What problem does this PR solve?

for a >= 8 and a <8 will generate a range(a>=8) interset range(a <8) = range[8, 8), this is a empty range.

PR #46303 introduce a RangeSet to hold the union of RangeValues, for a empty range[8, 8), RangeSet.asRanges() will return empty. Then cause a index out of bound exception.

Caused by: java.lang.IndexOutOfBoundsException: Index 0 out of bounds for length 0
        at jdk.internal.util.Preconditions.outOfBounds(Preconditions.java:64) ~[?:?]
        at jdk.internal.util.Preconditions.outOfBoundsCheckIndex(Preconditions.java:70) ~[?:?]
        at jdk.internal.util.Preconditions.checkIndex(Preconditions.java:266) ~[?:?]
        at java.util.Objects.checkIndex(Objects.java:359) ~[?:?]
        at java.util.ArrayList.get(ArrayList.java:427) ~[?:?]
        at org.apache.doris.nereids.rules.expression.rules.RangeInference.simplify(RangeInference.java:166) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.nereids.rules.expression.rules.RangeInference.visitOr(RangeInference.java:130) ~[doris-fe.jar:1.2-SNAPSHOT]
        at org.apache.doris.nereids.rules.expression.rules.RangeInference.visitOr(RangeInference.java:59) ~[doris-fe.jar:1.2-SNAPSHOT]

Fix: for a empty RangeValue like [8, 8), replace it with an EmptyValue.

What's more, this PR will also replace singleton RangeValue like ([8, 8]) to DiscreteValue([8]), so after this PR, simplify range will rewrite a >= 8 and a <= 8 to a = 8. This is just BetweenToEqual rule do. After this PR, we can remove rule BetweenToEqual.

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Jan 24, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32516 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 58d5288a12bc13424a5db61d37d2364d557474c0, data reload: false

------ Round 1 ----------------------------------
q1	17609	5598	5531	5531
q2	2047	326	185	185
q3	10682	1282	736	736
q4	10238	998	550	550
q5	7935	2438	2178	2178
q6	209	175	136	136
q7	914	774	601	601
q8	9244	1501	1268	1268
q9	5276	4946	5129	4946
q10	6915	2351	1876	1876
q11	477	276	249	249
q12	358	392	223	223
q13	17789	3903	3107	3107
q14	233	235	207	207
q15	527	460	462	460
q16	622	641	587	587
q17	566	908	334	334
q18	6898	6486	6290	6290
q19	2038	1037	567	567
q20	326	328	187	187
q21	2883	2276	1982	1982
q22	366	338	316	316
Total cold run time: 104152 ms
Total hot run time: 32516 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5802	5639	5670	5639
q2	243	337	232	232
q3	2232	2678	2326	2326
q4	1440	1803	1391	1391
q5	4336	4790	4854	4790
q6	190	166	131	131
q7	2082	2004	1775	1775
q8	2690	2910	2799	2799
q9	7354	7136	7273	7136
q10	3028	3320	2906	2906
q11	585	506	524	506
q12	685	804	613	613
q13	3542	3982	3336	3336
q14	276	311	271	271
q15	524	471	481	471
q16	670	692	643	643
q17	1277	1750	1263	1263
q18	7733	7511	7366	7366
q19	817	1219	1216	1216
q20	2061	2083	1884	1884
q21	6141	5127	5119	5119
q22	636	617	631	617
Total cold run time: 54344 ms
Total hot run time: 52430 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191969 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 58d5288a12bc13424a5db61d37d2364d557474c0, data reload: false

query1	1322	950	914	914
query2	6201	2203	2204	2203
query3	10941	4370	4428	4370
query4	33095	23341	22894	22894
query5	3632	612	452	452
query6	287	201	195	195
query7	3983	478	311	311
query8	305	239	226	226
query9	9251	2622	2604	2604
query10	459	314	245	245
query11	17728	15190	15102	15102
query12	151	106	101	101
query13	1553	504	386	386
query14	9289	7384	6785	6785
query15	256	220	184	184
query16	7869	620	468	468
query17	1565	759	577	577
query18	2145	419	327	327
query19	201	187	163	163
query20	125	115	121	115
query21	209	126	102	102
query22	4536	4471	4482	4471
query23	34426	33953	33460	33460
query24	6648	2321	2270	2270
query25	455	466	422	422
query26	1207	274	148	148
query27	2334	478	349	349
query28	4944	2525	2440	2440
query29	664	563	438	438
query30	215	184	151	151
query31	950	910	835	835
query32	71	64	57	57
query33	534	364	310	310
query34	757	899	537	537
query35	819	850	766	766
query36	1030	1049	992	992
query37	114	100	74	74
query38	4376	4368	4384	4368
query39	1484	1457	1432	1432
query40	217	119	106	106
query41	53	55	55	55
query42	115	100	102	100
query43	563	540	487	487
query44	1353	835	817	817
query45	187	183	167	167
query46	871	1041	675	675
query47	1892	1901	1825	1825
query48	382	434	322	322
query49	762	521	457	457
query50	666	693	409	409
query51	4307	4293	4237	4237
query52	112	106	96	96
query53	231	257	197	197
query54	498	514	432	432
query55	89	85	77	77
query56	260	263	267	263
query57	1205	1224	1153	1153
query58	245	248	234	234
query59	3282	3406	3231	3231
query60	269	289	300	289
query61	128	113	120	113
query62	812	758	686	686
query63	224	198	199	198
query64	3935	1035	653	653
query65	3301	3226	3240	3226
query66	951	392	306	306
query67	15491	15469	15427	15427
query68	2257	818	551	551
query69	411	312	322	312
query70	1228	1150	1141	1141
query71	301	286	266	266
query72	4960	3788	3790	3788
query73	647	749	367	367
query74	10096	9134	8948	8948
query75	3176	3149	2657	2657
query76	2006	1185	775	775
query77	326	370	282	282
query78	10133	10180	9289	9289
query79	1001	858	597	597
query80	631	535	458	458
query81	491	274	249	249
query82	1193	153	120	120
query83	277	170	161	161
query84	280	90	76	76
query85	739	357	300	300
query86	331	321	303	303
query87	4533	4694	4410	4410
query88	3087	2238	2168	2168
query89	401	329	296	296
query90	1738	190	197	190
query91	135	140	106	106
query92	63	58	54	54
query93	932	924	556	556
query94	481	387	287	287
query95	333	272	260	260
query96	491	593	280	280
query97	2822	2887	2762	2762
query98	220	198	195	195
query99	1305	1410	1283	1283
Total cold run time: 275557 ms
Total hot run time: 191969 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.27 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 58d5288a12bc13424a5db61d37d2364d557474c0, data reload: false

query1	0.04	0.03	0.02
query2	0.08	0.04	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.44	0.42	0.40
query6	1.14	0.66	0.67
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.52	0.49
query10	0.56	0.57	0.56
query11	0.14	0.11	0.11
query12	0.14	0.12	0.11
query13	0.61	0.60	0.60
query14	2.76	2.72	2.72
query15	0.90	0.82	0.83
query16	0.39	0.38	0.39
query17	1.01	1.07	1.04
query18	0.23	0.20	0.21
query19	1.85	1.81	2.05
query20	0.02	0.01	0.01
query21	15.36	0.94	0.58
query22	0.77	0.78	0.68
query23	15.24	1.37	0.56
query24	3.66	0.67	1.46
query25	0.17	0.15	0.05
query26	0.28	0.14	0.13
query27	0.05	0.05	0.04
query28	13.93	1.01	0.44
query29	12.64	3.98	3.24
query30	0.25	0.08	0.06
query31	2.84	0.58	0.39
query32	3.22	0.55	0.46
query33	2.96	2.99	3.03
query34	16.52	5.19	4.54
query35	4.56	4.47	4.51
query36	0.65	0.49	0.50
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.16	0.14	0.12
query41	0.07	0.02	0.02
query42	0.03	0.03	0.02
query43	0.03	0.02	0.02
Total cold run time: 106.39 s
Total hot run time: 30.27 s

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32335 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f86c29f1ef1a9c9bee52624238b69d0004f2bbcd, data reload: false

------ Round 1 ----------------------------------
q1	17574	5466	5405	5405
q2	2040	309	164	164
q3	10439	1285	782	782
q4	10226	960	521	521
q5	7754	2421	2178	2178
q6	199	178	134	134
q7	892	761	590	590
q8	9230	1362	1164	1164
q9	5166	4903	4950	4903
q10	6862	2350	1899	1899
q11	488	282	250	250
q12	350	358	218	218
q13	17770	3746	3151	3151
q14	221	224	211	211
q15	522	483	468	468
q16	632	610	605	605
q17	582	870	323	323
q18	6996	6451	6319	6319
q19	1901	993	571	571
q20	312	315	187	187
q21	2976	2216	1989	1989
q22	378	338	303	303
Total cold run time: 103510 ms
Total hot run time: 32335 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5639	5520	5533	5520
q2	242	328	231	231
q3	2255	2697	2314	2314
q4	1448	1849	1404	1404
q5	4334	4857	4749	4749
q6	182	179	141	141
q7	2090	1992	1856	1856
q8	2672	2953	2752	2752
q9	7430	7306	7463	7306
q10	3105	3345	2871	2871
q11	595	530	508	508
q12	700	796	632	632
q13	3745	4000	3387	3387
q14	285	295	281	281
q15	513	470	470	470
q16	649	687	664	664
q17	1230	1753	1276	1276
q18	7716	7546	7516	7516
q19	833	1138	1156	1138
q20	2061	2056	1976	1976
q21	5754	5272	4979	4979
q22	593	580	600	580
Total cold run time: 54071 ms
Total hot run time: 52551 ms

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32536 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ccffd6ea7d5768bfaefca539131a13180e39a09a, data reload: false

------ Round 1 ----------------------------------
q1	17594	5547	5393	5393
q2	2043	312	174	174
q3	10406	1318	741	741
q4	10226	968	533	533
q5	7536	2450	2188	2188
q6	197	164	139	139
q7	925	764	637	637
q8	9226	1375	1167	1167
q9	5302	4913	4904	4904
q10	6893	2354	1909	1909
q11	494	282	251	251
q12	348	357	219	219
q13	17769	3734	3133	3133
q14	241	224	215	215
q15	528	488	480	480
q16	639	631	597	597
q17	573	867	314	314
q18	6977	6471	6501	6471
q19	1207	947	531	531
q20	319	330	191	191
q21	2942	2481	2029	2029
q22	381	339	320	320
Total cold run time: 102766 ms
Total hot run time: 32536 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5552	5459	5552	5459
q2	237	323	232	232
q3	2281	2670	2368	2368
q4	1401	1836	1386	1386
q5	4363	4775	4703	4703
q6	170	157	123	123
q7	2009	1871	1787	1787
q8	2555	2741	2687	2687
q9	7056	6918	6928	6918
q10	2938	3183	2698	2698
q11	560	506	482	482
q12	633	711	567	567
q13	3360	3756	3133	3133
q14	289	293	263	263
q15	515	466	459	459
q16	633	697	673	673
q17	1191	1726	1228	1228
q18	7276	7177	6946	6946
q19	802	1082	1087	1082
q20	1930	1988	1838	1838
q21	5590	5152	4838	4838
q22	604	600	558	558
Total cold run time: 51945 ms
Total hot run time: 50428 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185759 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ccffd6ea7d5768bfaefca539131a13180e39a09a, data reload: false

query1	947	397	386	386
query2	6292	2098	2061	2061
query3	6153	219	215	215
query4	33418	23259	23301	23259
query5	4444	618	450	450
query6	300	203	200	200
query7	3996	511	316	316
query8	294	248	225	225
query9	8212	2693	2679	2679
query10	443	342	256	256
query11	17491	15148	14874	14874
query12	155	108	106	106
query13	1272	534	404	404
query14	9293	7479	6983	6983
query15	239	195	187	187
query16	8294	577	455	455
query17	1694	714	545	545
query18	1901	385	294	294
query19	216	196	158	158
query20	119	115	111	111
query21	214	119	100	100
query22	4377	4318	4226	4226
query23	33955	33198	33081	33081
query24	6870	2261	2269	2261
query25	494	441	378	378
query26	777	263	156	156
query27	1988	460	330	330
query28	5302	2479	2447	2447
query29	609	545	425	425
query30	238	185	155	155
query31	960	877	799	799
query32	81	59	57	57
query33	512	361	284	284
query34	736	837	510	510
query35	785	810	735	735
query36	1006	1049	957	957
query37	119	105	83	83
query38	4236	4281	4020	4020
query39	1483	1403	1426	1403
query40	206	123	103	103
query41	61	67	63	63
query42	117	104	98	98
query43	524	522	499	499
query44	1339	814	818	814
query45	175	172	162	162
query46	857	1032	652	652
query47	1799	1851	1777	1777
query48	393	395	333	333
query49	747	490	423	423
query50	610	645	400	400
query51	4173	4239	4093	4093
query52	104	107	96	96
query53	233	262	188	188
query54	488	498	404	404
query55	82	85	85	85
query56	257	268	248	248
query57	1144	1164	1099	1099
query58	245	238	227	227
query59	2942	3064	2960	2960
query60	285	274	262	262
query61	121	114	116	114
query62	773	743	650	650
query63	220	192	189	189
query64	3085	1069	703	703
query65	3235	3154	3163	3154
query66	857	412	309	309
query67	15696	15610	15466	15466
query68	2345	849	566	566
query69	417	301	256	256
query70	1237	1144	1158	1144
query71	327	290	281	281
query72	6104	3844	3851	3844
query73	634	777	360	360
query74	9643	9231	8839	8839
query75	3145	3169	2685	2685
query76	2134	1199	787	787
query77	337	366	282	282
query78	10116	10266	9356	9356
query79	999	888	617	617
query80	1273	539	453	453
query81	538	272	232	232
query82	709	157	125	125
query83	243	190	157	157
query84	244	93	70	70
query85	791	406	305	305
query86	395	317	303	303
query87	4544	4599	4485	4485
query88	3318	2236	2183	2183
query89	403	340	289	289
query90	1789	194	197	194
query91	132	139	106	106
query92	58	59	58	58
query93	967	858	542	542
query94	671	394	293	293
query95	342	266	261	261
query96	507	605	291	291
query97	2793	2825	2794	2794
query98	219	198	198	198
query99	1282	1394	1261	1261
Total cold run time: 269339 ms
Total hot run time: 185759 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.51 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ccffd6ea7d5768bfaefca539131a13180e39a09a, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.25	0.07	0.07
query4	1.61	0.11	0.10
query5	0.42	0.42	0.41
query6	1.13	0.67	0.66
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.51	0.49
query10	0.56	0.56	0.56
query11	0.15	0.11	0.10
query12	0.14	0.11	0.11
query13	0.62	0.60	0.61
query14	2.80	2.74	2.70
query15	0.90	0.85	0.83
query16	0.39	0.38	0.39
query17	1.07	1.04	1.03
query18	0.23	0.22	0.20
query19	1.92	1.82	2.05
query20	0.02	0.01	0.01
query21	15.38	0.88	0.58
query22	0.76	0.75	0.74
query23	15.31	1.44	0.52
query24	3.04	1.67	1.72
query25	0.16	0.17	0.07
query26	0.31	0.15	0.14
query27	0.06	0.05	0.03
query28	14.03	0.94	0.44
query29	12.60	3.93	3.22
query30	0.25	0.09	0.07
query31	2.81	0.62	0.39
query32	3.23	0.55	0.48
query33	3.03	3.05	3.06
query34	16.49	5.21	4.60
query35	4.54	4.59	4.56
query36	0.66	0.50	0.48
query37	0.10	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.03	0.02
query40	0.17	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.14 s
Total hot run time: 31.51 s

@yujun777 yujun777 force-pushed the fix-range-inference branch from ccffd6e to 6eb9034 Compare February 5, 2025 07:43
@yujun777
Copy link
Collaborator Author

yujun777 commented Feb 5, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32438 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6eb903481ce14a395c3abe2201871fe8be8bf3ab, data reload: false

------ Round 1 ----------------------------------
q1	17580	5593	5436	5436
q2	2046	302	177	177
q3	10552	1314	737	737
q4	10284	967	544	544
q5	8914	2430	2150	2150
q6	201	171	135	135
q7	908	786	610	610
q8	9249	1336	1145	1145
q9	5399	4972	4835	4835
q10	6842	2354	1910	1910
q11	473	271	268	268
q12	345	359	221	221
q13	17778	3709	3157	3157
q14	225	224	204	204
q15	516	485	482	482
q16	629	619	580	580
q17	564	858	318	318
q18	7274	6434	6460	6434
q19	2138	955	556	556
q20	314	319	191	191
q21	2839	2297	2027	2027
q22	361	346	321	321
Total cold run time: 105431 ms
Total hot run time: 32438 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5696	5512	5529	5512
q2	234	337	238	238
q3	2288	2710	2369	2369
q4	1444	1826	1411	1411
q5	4369	4762	4879	4762
q6	170	165	133	133
q7	2072	2055	1900	1900
q8	2584	2816	2707	2707
q9	7234	7253	7212	7212
q10	2986	3314	2780	2780
q11	588	517	493	493
q12	667	777	640	640
q13	3539	4010	3360	3360
q14	273	285	271	271
q15	523	474	466	466
q16	650	702	654	654
q17	1243	1733	1244	1244
q18	7687	7461	7190	7190
q19	822	1110	1148	1110
q20	1982	2030	1872	1872
q21	5851	5305	4908	4908
q22	610	579	527	527
Total cold run time: 53512 ms
Total hot run time: 51759 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184327 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6eb903481ce14a395c3abe2201871fe8be8bf3ab, data reload: false

query1	985	378	383	378
query2	6527	2061	2047	2047
query3	6796	216	222	216
query4	33530	23280	23141	23141
query5	4314	617	452	452
query6	304	211	191	191
query7	4612	501	304	304
query8	295	248	233	233
query9	9581	2639	2631	2631
query10	462	316	257	257
query11	18073	15324	15117	15117
query12	165	108	104	104
query13	1667	537	404	404
query14	9782	6466	6437	6437
query15	210	202	192	192
query16	7885	621	501	501
query17	1628	729	576	576
query18	2046	405	292	292
query19	237	190	160	160
query20	117	113	108	108
query21	212	124	106	106
query22	4272	4161	4311	4161
query23	34103	32882	32952	32882
query24	6525	2289	2296	2289
query25	494	457	417	417
query26	1209	275	152	152
query27	2304	450	326	326
query28	5409	2448	2436	2436
query29	670	570	405	405
query30	234	187	158	158
query31	947	858	789	789
query32	73	60	60	60
query33	502	373	301	301
query34	732	845	511	511
query35	784	821	740	740
query36	993	1042	934	934
query37	114	110	80	80
query38	4199	4108	4045	4045
query39	1445	1403	1410	1403
query40	207	116	101	101
query41	52	53	58	53
query42	118	109	100	100
query43	492	518	475	475
query44	1344	802	799	799
query45	183	175	166	166
query46	847	1063	629	629
query47	1824	1840	1780	1780
query48	376	403	324	324
query49	794	494	401	401
query50	635	675	385	385
query51	4191	4163	4120	4120
query52	110	105	98	98
query53	228	253	185	185
query54	478	512	418	418
query55	77	78	80	78
query56	252	266	263	263
query57	1156	1159	1058	1058
query58	260	225	241	225
query59	2907	3149	2930	2930
query60	271	263	255	255
query61	118	117	152	117
query62	776	724	706	706
query63	227	189	185	185
query64	4115	1016	639	639
query65	3255	3132	3142	3132
query66	1080	409	311	311
query67	15898	15567	15389	15389
query68	4302	817	536	536
query69	490	291	282	282
query70	1191	1128	1113	1113
query71	382	285	262	262
query72	5779	3911	3828	3828
query73	648	753	351	351
query74	9987	9072	8700	8700
query75	3196	3164	2636	2636
query76	3067	1149	765	765
query77	471	353	278	278
query78	10062	9953	9264	9264
query79	2316	795	594	594
query80	698	518	503	503
query81	519	274	239	239
query82	244	149	128	128
query83	175	172	150	150
query84	244	87	73	73
query85	752	361	297	297
query86	399	318	299	299
query87	4575	4626	4350	4350
query88	3799	2167	2130	2130
query89	375	327	359	327
query90	1975	194	200	194
query91	149	143	109	109
query92	67	58	54	54
query93	2060	874	523	523
query94	657	422	309	309
query95	338	269	259	259
query96	490	608	284	284
query97	2814	2858	2751	2751
query98	224	199	198	198
query99	1267	1390	1283	1283
Total cold run time: 280420 ms
Total hot run time: 184327 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.24 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6eb903481ce14a395c3abe2201871fe8be8bf3ab, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.03	0.03
query3	0.24	0.07	0.06
query4	1.61	0.11	0.11
query5	0.42	0.42	0.40
query6	1.16	0.67	0.67
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.59	0.48	0.51
query10	0.56	0.56	0.55
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	2.77	2.75	2.74
query15	0.92	0.82	0.82
query16	0.38	0.39	0.37
query17	0.96	1.02	0.99
query18	0.23	0.21	0.21
query19	1.89	1.80	1.99
query20	0.02	0.01	0.01
query21	15.36	0.93	0.56
query22	0.74	0.86	0.56
query23	15.30	1.51	0.55
query24	3.10	1.37	0.64
query25	0.17	0.09	0.17
query26	0.32	0.15	0.14
query27	0.06	0.04	0.04
query28	13.90	1.05	0.44
query29	12.55	3.94	3.29
query30	0.25	0.10	0.07
query31	2.83	0.59	0.38
query32	3.23	0.56	0.47
query33	3.07	3.00	3.06
query34	16.46	5.13	4.55
query35	4.54	4.54	4.57
query36	0.65	0.48	0.52
query37	0.10	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.03
query40	0.17	0.13	0.13
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.86 s
Total hot run time: 30.24 s

@yujun777 yujun777 force-pushed the fix-range-inference branch from 6eb9034 to e942dcb Compare February 7, 2025 07:24
@yujun777
Copy link
Collaborator Author

yujun777 commented Feb 7, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31884 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e942dcbe0c31233acfc3dfd74ae32baee891c61c, data reload: false

------ Round 1 ----------------------------------
q1	17587	5260	5110	5110
q2	2056	304	170	170
q3	10421	1257	761	761
q4	10310	1028	564	564
q5	8584	2384	2330	2330
q6	199	160	135	135
q7	897	757	593	593
q8	9296	1306	1166	1166
q9	4910	4701	4712	4701
q10	6866	2301	1911	1911
q11	471	279	261	261
q12	352	364	221	221
q13	17764	3693	3123	3123
q14	235	229	213	213
q15	520	464	468	464
q16	650	618	604	604
q17	586	885	346	346
q18	6646	6184	6237	6184
q19	1544	938	563	563
q20	313	329	189	189
q21	2822	2196	1970	1970
q22	360	326	305	305
Total cold run time: 103389 ms
Total hot run time: 31884 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5204	5220	5098	5098
q2	243	330	237	237
q3	2182	2701	2291	2291
q4	1498	1884	1441	1441
q5	4226	4112	4167	4112
q6	216	167	125	125
q7	1871	1865	1789	1789
q8	2600	2531	2649	2531
q9	7226	7094	7106	7094
q10	3050	3206	2776	2776
q11	585	507	483	483
q12	676	757	654	654
q13	3364	3889	3285	3285
q14	279	302	273	273
q15	500	469	467	467
q16	638	684	635	635
q17	1152	1604	1348	1348
q18	7577	7412	7192	7192
q19	859	808	961	808
q20	1977	2017	1827	1827
q21	5420	4936	4825	4825
q22	615	592	559	559
Total cold run time: 51958 ms
Total hot run time: 49850 ms

@yujun777
Copy link
Collaborator Author

yujun777 commented Feb 7, 2025

run cloud_p0

@doris-robot
Copy link

TPC-DS: Total hot run time: 190944 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e942dcbe0c31233acfc3dfd74ae32baee891c61c, data reload: false

query1	1328	960	936	936
query2	6209	1886	1808	1808
query3	11134	4496	4489	4489
query4	55907	24994	23661	23661
query5	5195	580	499	499
query6	356	224	217	217
query7	5023	536	301	301
query8	333	258	235	235
query9	5943	2517	2510	2510
query10	424	329	255	255
query11	15216	15036	15040	15036
query12	162	111	112	111
query13	1121	518	403	403
query14	10657	6386	6530	6386
query15	202	218	184	184
query16	7011	707	509	509
query17	1096	737	552	552
query18	1507	427	302	302
query19	197	200	162	162
query20	120	123	133	123
query21	210	130	105	105
query22	4562	4523	4373	4373
query23	33859	33405	33322	33322
query24	5922	2437	2409	2409
query25	479	462	397	397
query26	656	308	164	164
query27	1680	488	335	335
query28	2803	2458	2415	2415
query29	595	587	415	415
query30	238	197	155	155
query31	910	897	824	824
query32	78	62	65	62
query33	432	381	306	306
query34	778	887	506	506
query35	818	859	757	757
query36	991	1038	918	918
query37	136	110	96	96
query38	4296	4302	4364	4302
query39	1492	1469	1443	1443
query40	208	125	108	108
query41	52	51	48	48
query42	126	115	109	109
query43	515	527	485	485
query44	1350	805	783	783
query45	179	178	169	169
query46	957	1134	671	671
query47	1852	1893	1782	1782
query48	393	443	330	330
query49	712	538	437	437
query50	787	831	429	429
query51	4216	4282	4254	4254
query52	112	113	99	99
query53	269	271	198	198
query54	489	495	435	435
query55	82	85	84	84
query56	296	290	293	290
query57	1191	1195	1078	1078
query58	252	265	253	253
query59	2680	2834	2641	2641
query60	298	306	280	280
query61	146	137	144	137
query62	779	790	659	659
query63	235	201	202	201
query64	1477	1029	702	702
query65	3366	3195	3126	3126
query66	718	428	312	312
query67	15835	15589	15388	15388
query68	5591	794	516	516
query69	549	307	287	287
query70	1236	1128	1091	1091
query71	444	295	270	270
query72	5997	3758	3913	3758
query73	1263	866	355	355
query74	9045	8938	8980	8938
query75	3288	3228	2703	2703
query76	3924	1274	750	750
query77	538	381	284	284
query78	10075	10242	9403	9403
query79	2400	837	591	591
query80	625	556	448	448
query81	506	281	241	241
query82	470	167	122	122
query83	179	173	153	153
query84	286	95	79	79
query85	783	337	311	311
query86	379	312	269	269
query87	4462	4589	4478	4478
query88	3508	2185	2138	2138
query89	441	322	279	279
query90	1750	194	189	189
query91	136	141	111	111
query92	72	64	56	56
query93	1913	1037	581	581
query94	699	460	276	276
query95	342	270	261	261
query96	491	608	271	271
query97	2804	2839	2781	2781
query98	228	202	202	202
query99	1365	1429	1281	1281
Total cold run time: 295437 ms
Total hot run time: 190944 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e942dcbe0c31233acfc3dfd74ae32baee891c61c, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.24	0.06	0.06
query4	1.64	0.09	0.10
query5	0.42	0.42	0.40
query6	1.16	0.66	0.66
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.58	0.51	0.51
query10	0.58	0.58	0.57
query11	0.15	0.10	0.10
query12	0.14	0.11	0.12
query13	0.61	0.60	0.61
query14	2.80	2.69	2.72
query15	0.91	0.85	0.84
query16	0.39	0.38	0.37
query17	1.08	1.01	1.05
query18	0.22	0.20	0.19
query19	1.96	2.01	1.84
query20	0.02	0.02	0.01
query21	15.35	0.93	0.55
query22	0.74	1.16	0.65
query23	14.96	1.38	0.62
query24	6.74	2.62	0.76
query25	0.58	0.19	0.06
query26	0.48	0.17	0.15
query27	0.05	0.04	0.04
query28	9.66	0.79	0.43
query29	12.54	3.97	3.28
query30	0.25	0.08	0.06
query31	2.82	0.58	0.38
query32	3.22	0.55	0.47
query33	3.01	3.08	2.98
query34	15.73	5.20	4.56
query35	4.57	4.53	4.59
query36	0.66	0.49	0.48
query37	0.08	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 104.91 s
Total hot run time: 30.45 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants