0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (1 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (5 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (17 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (0 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (2 rows)
8. All tests: outcomes (3861 rows)
9. All tests: durations (3871 rows)
A. Skipped: tests which was intentionally excluded from execution (6 rows)

Generated 22.09.2021 20:16
Tested: FB30.   Build: 3.0.8.33501;   CS: 22.09.21 18:14:59 - 22.09.21 20:14:57;   SS: 22.09.21 16:34:22 - 22.09.21 18:13:11;
OS and hardware info:  Windows 2008ServerR2 6.1.7601 ; logical CPUs: 4 ; total memory: 8.0 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 3.0.8.33501
2021-09-22
3.0.8.33498
2021-09-20
3.0.8.33497
2021-09-16
3.0.8.33496
2021-09-15
3.0.8.33495
2021-09-14
3.0.8.33494
2021-09-09
3.0.8.33493
2021-09-08
3.0.8.33492
2021-09-07
3.0.8.33491
2021-09-04
3.0.8.33490
2021-08-31
3.0.8.33489
2021-08-20
3.0.8.33488
2021-08-14
3.0.8.33487
2021-08-07
3.0.8.33486
2021-07-20
3.0.8.33476
2021-06-23
3.0.8.33475
2021-06-21
3.0.8.33474
2021-06-16
3.0.8.33473
2021-06-12
3.0.8.33472
2021-06-09
3.0.8.33471
2021-06-02
3.0.8.33470
2021-06-01
3.0.8.33468
2021-05-29
3.0.8.33467
2021-05-06
3.0.8.33465
2021-05-05
3.0.8.33463
2021-05-04
3.0.8.33462
2021-05-03
3.0.8.33461
2021-05-01
3.0.8.33460
2021-04-30
3.0.8.33459
2021-04-29
3.0.8.33457
2021-04-28
Test TITLE
1 SS P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P
ANY user can drop procedures, generators, exceptions.
2 CS P P P P P P P P P P P P P P X P P P P P P P P     F     P P P P P P
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
3 SS P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P P P
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
4 SS P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
5 CS P P     F         F     P     F     P     F     P P P P     F     P X P P P P P P P P P P P P P P P
Increase speed of creating package when number of its functions more than several hundreds
6 SS     F         F         F     P P P P     F     P     F         F     P P P P P P P P P P P P P P P P P P P
Increase speed of creating package when number of its functions more than several hundreds
7 SS P P P P P P P P     F     P P P P P P P P P P P P P P P P P P P P P
Detach using Linux client takes much longer than from Windows
8 CS     F         F         F         F         F         F         F         F         F         F         F         F         F         F     X     F         F         F         F         F     P P P P P P P P P P
Wire compression causes freezes
9 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P
Wire compression causes freezes
10 CS P P P P P P P P P P P P P P X P P P P P P P P P P P     F     P     F         F    
Implementation of SUBSTRING for UTF8 character set is inefficient
11 SS P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F     P
Implementation of SUBSTRING for UTF8 character set is inefficient
12 CS X X X X X X     F         F         F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F     X X X X X X
Many indexed reads in a compound index with NULLs [CORE2709]
13 SS X X X X X X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     X X X X X X
Many indexed reads in a compound index with NULLs [CORE2709]
14 CS     F         F         F         F         F         F         F         F         F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
15 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
16 CS P P P P P P     F         F         F         F         F         F         F         F     X     F         F         F         F         F         F     P P P P P P P P P
Check list of files in the current Firebird snapshot
17 SS P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     P P P P P P P P P
Check list of files in the current Firebird snapshot

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.8.33501
2021-09-22
3.0.8.33498
2021-09-20
3.0.8.33497
2021-09-16
3.0.8.33496
2021-09-15
3.0.8.33495
2021-09-14
3.0.8.33494
2021-09-09
3.0.8.33493
2021-09-08
3.0.8.33492
2021-09-07
3.0.8.33491
2021-09-04
3.0.8.33490
2021-08-31
3.0.8.33489
2021-08-20
3.0.8.33488
2021-08-14
3.0.8.33487
2021-08-07
3.0.8.33486
2021-07-20
3.0.8.33476
2021-06-23
3.0.8.33475
2021-06-21
3.0.8.33474
2021-06-16
3.0.8.33473
2021-06-12
3.0.8.33472
2021-06-09
3.0.8.33471
2021-06-02
3.0.8.33470
2021-06-01
3.0.8.33468
2021-05-29
3.0.8.33467
2021-05-06
3.0.8.33465
2021-05-05
3.0.8.33463
2021-05-04
3.0.8.33462
2021-05-03
3.0.8.33461
2021-05-01
3.0.8.33460
2021-04-30
3.0.8.33459
2021-04-29
3.0.8.33457
2021-04-28
Test TITLE
1 SS 3499 3619 3000 3559 3540 3559 3490 3490 3510 3590 3490 3610 4009 3490 3509 3559 3529 3609 3509 3539 3569 2580 2559 2000 2569 2619 2619 2579 2559 2650 2549
ANY user can drop procedures, generators, exceptions.
2 CS 5940 6079 6039 6119 6089 6039 6020 5940 6009 5920 6009 5949 6039 5939 5980 5990 5879 5940 7079 6539 5210 5210 4909 5000 5060 5009 5009 4939 4950 4950
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
3 SS 4725 4779 4779 4829 4759 4789 4759 4000 4000 4759 4819 4809 4000 4819 4710 4810 4740 4920 4730 4869 4720 4350 4379 4269 4449 4279 4430 4299 4429 4480 4369
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
4 SS 54849 54589 55599 53690 61990 59880 56829 60950 57119 54970 54769 55840 55219 57410 59150 57940 51710 59220 50740 54930 56799 50759 53519 52089 50240 47849 50660 49940 49589 52149 48610
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
5 CS 24350 28000 27799 27000 27269 27400 27440 27269 27470 27439 27410 27929 27550 27399 27059 24029 24350 24160 24090 23920 23279 23140 22899 23019 23690 23009 23000 23340 23420 23130
Increase speed of creating package when number of its functions more than several hundreds
6 SS 24210 26720 25880 25960 25970 25940 26029 25880 25939 25869 26120 26279 26370 25840 25740 26809 22610 22680 22549 22519 22640 22490 22000 22049 22279 22069 22289 22399 22259 22279 22600
Increase speed of creating package when number of its functions more than several hundreds
7 SS 2914 3000 2900 2919 2920 2919 2919 2950 2970 3340 2920 2930 2910 2950 2910 2930 2950 2850 2920 2860 2870 2809 2850 2740 2759 2759 2809 2000 2950 2779 2779
Detach using Linux client takes much longer than from Windows
8 CS 27890 27889 27759 27819 28049 29220 27970 28069 27990 28029 40660 28240 28000 27920 27900 27700 27979 27890 45990 28040 11000 12269 11309 11609 11509 11000 11490 11670 11860 11559
Wire compression causes freezes
9 SS 26445 26479 26679 26470 26420 26230 26419 26509 26049 26559 26360 27190 26919 26910 27149 26869 27220 26589 27519 26720 26660 10480 10000 10000 10230 10200 10460 10420 10599 10619 10349
Wire compression causes freezes
10 CS 2389 2359 2490 2399 2340 2510 2400 2439 2440 2360 2490 2359 2420 2410 2339 2559 2450 2730 2430 2430 2200 2130 2000 2019 2039 2040 2159 2389 2230 2159
Implementation of SUBSTRING for UTF8 character set is inefficient
11 SS 1920 1980 1919 1980 1920 1930 1960 1900 1930 2000 1920 1920 1950 1919 1920 1900 1920 1979 1919 1920 1910 1930 1920 1909 1860 1919 1920 1990 1920 2019 1900
Implementation of SUBSTRING for UTF8 character set is inefficient
12 CS 8019 8030 7940 8139 7880 8130 7920 7970 8019 8069 8059 8329 8170 8049 6939 7239 7069 6690
Many indexed reads in a compound index with NULLs [CORE2709]
13 SS 6549 6619 6509 6599 6529 6519 6490 6460 6779 6569 6569 6600 6630 6599 6599 5910 5839 5820 5740
Many indexed reads in a compound index with NULLs [CORE2709]
14 CS 5740 6019 5740 5769 5789 5710 5909 5640 5689 5740 5779 5819 5799 5799 5920 5789 5769 5799 5859 5940 2590 2599 2309 2769 2440 2440 2619 2789 2779 2369
INNER JOIN join order
15 SS 5359 5450 5289 5349 5370 5440 5519 5410 5469 5329 5400 5419 5000 5559 5460 5480 5440 5509 5380 5320 5459 2289 2279 2259 2339 2319 2210 2319 2259 2230 2259
INNER JOIN join order
16 CS 2029 2029 2089 1960 2169 2000 2170 2200 2029 2029 2149 2159 2170 2059 2129 2120 2140 2170 2590 1970 1619 1590 1470 1460 1000 1450 1460 1529 1480 1490
Check list of files in the current Firebird snapshot
17 SS 1400 1469 1399 1410 1470 1400 1480 1409 1399 1400 1400 1409 1409 1400 1420 1440 1400 1419 1430 1409 1420 1400 1410 1389 1390 1369 1370 1369 1379 1350 1349
Check list of files in the current Firebird snapshot

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2531
http://tracker.firebirdsql.org/browse/core-304
http://tracker.firebirdsql.org/browse/core-4236
http://tracker.firebirdsql.org/browse/core-4880
http://tracker.firebirdsql.org/browse/core-4977
http://tracker.firebirdsql.org/browse/core-6348
http://tracker.firebirdsql.org/browse/core-6542
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/build/snapshot-files-check-list.fbt
https://github.com/FirebirdSQL/firebird/issues/3106

=== end of list ===