0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
[CURRENT] 4. STILL FAILS: tests which fail for at least two last runs (7 rows)
5. Has fails: tests with at least one fail for previous runs (130 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (330 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (0 rows)
8. All tests: outcomes (2170 rows)
9. All tests: durations (3844 rows)
A. Skipped: tests which was intentionally excluded from execution (6 rows)

Generated 07.01.2022 18:16
Tested: HQ30.   Build: 3.0.9.33548;   CS: 07.01.22 16:56:09 - 07.01.22 18:10:54;   SS: 07.01.22 15:50:34 - 07.01.22 16:53:21;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Tests which fail for at least two last runs:
NN Test name mode 3.0.9.33548
2022-01-07
3.0.8.33540
2021-12-20
3.0.8.33533
2021-12-01
3.0.8.33528
2021-11-08
3.0.8.33501
2021-11-06
3.0.8.33490
2021-09-17
3.0.8.33489
2021-08-10
3.0.8.33488
2021-08-07
3.0.8.33487
2021-07-31
3.0.8.33471
2021-07-26
3.0.8.33470
2021-06-02
3.0.8.33468
2021-05-29
3.0.8.33452
2021-05-06
3.0.8.33430
2021-04-21
3.0.8.33423
2021-03-30
3.0.8.33415
2021-03-04
3.0.8.33403
2021-02-08
X X X X X X X X X X X X X
Test TITLE
1 CS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     X X X X X X X X X X X X X
CREATE COLLATION connection lost under Posix
2 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     X X X X X X X X X X X X X
CREATE COLLATION connection lost under Posix
3 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         E     X X X X X X X X X X X X X
Wrong transaction can be passed to external engine
4 CS     F         F         F         F         F         F         F         F         F         F         F         F     P P P P P X X X X X X X X X X X X X
LEFT OUTER JOIN with full match, but limited in ON clause
5 SS     F         F         F         F         F         F         F         F         F         F         F         F     P P P P P X X X X X X X X X X X X X
LEFT OUTER JOIN with full match, but limited in ON clause
6 CS     F         F         F         F         F         F         F         F         F         F         F         F     P P P P P X X X X X X X X X X X X X
LEFT OUTER JOIN with STARTING WITH in WHERE clause
7 SS     F         F         F         F         F         F         F         F         F         F         F         F     P P P P P X X X X X X X X X X X X X
LEFT OUTER JOIN with STARTING WITH in WHERE clause

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.9.33548
2022-01-07
3.0.8.33540
2021-12-20
3.0.8.33533
2021-12-01
3.0.8.33528
2021-11-08
3.0.8.33501
2021-11-06
3.0.8.33490
2021-09-17
3.0.8.33489
2021-08-10
3.0.8.33488
2021-08-07
3.0.8.33487
2021-07-31
3.0.8.33471
2021-07-26
3.0.8.33470
2021-06-02
3.0.8.33468
2021-05-29
3.0.8.33452
2021-05-06
3.0.8.33430
2021-04-21
3.0.8.33423
2021-03-30
3.0.8.33415
2021-03-04
3.0.8.33403
2021-02-08
X X X X X X X X X X X X X
Test TITLE
1 CS 870 870 820 910 930 820 980 870 870 840 730 840 870 1080 920 860 910 890
CREATE COLLATION connection lost under Posix
2 SS 560 540 530 550 570 820 580 550 540 630 560 590 530 850 580 550 520 560
CREATE COLLATION connection lost under Posix
3 SS 3060 3270 2990 3030 3060 2900 3040 3160 2970 3140 3090 3220 3080 3590 3030 2940 3070 1510
Wrong transaction can be passed to external engine
4 CS 1740 1000 1670 1740 2090 1880 1690 1740 1920 1690 1650 1810 1770 2200 1830 1670 1710 1700
LEFT OUTER JOIN with full match, but limited in ON clause
5 SS 1400 1000 1300 1440 1400 1440 1490 1360 1300 1350 1000 1460 1490 1780 1480 1390 1350 1740
LEFT OUTER JOIN with full match, but limited in ON clause
6 CS 1810 1790 1780 1790 1870 1860 1810 1840 1770 1860 1670 1910 1890 2210 1800 1700 1760 1810
LEFT OUTER JOIN with STARTING WITH in WHERE clause
7 SS 1450 1340 1560 1460 1400 1440 1380 1570 1420 1460 1450 1000 1350 1860 1420 1490 1460 1490
LEFT OUTER JOIN with STARTING WITH in WHERE clause

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1885
http://tracker.firebirdsql.org/browse/core-5645
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_06.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_11.fbt

=== end of list ===