01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (8 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 05. STILL FAILS: tests which fail for at least TWO LAST runs (8 rows)
06. Has fails: tests with at least one fail for previous 30 runs (114 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
10. All tests: outcomes for previous 30 runs (2542 rows)
11. All tests: durations for previous 30 runs (4962 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated 16.05.2024 11:15
Tested: HQ50.   Build: 5.0.1.1398;   SS: 16.05.24 09:34:51 - 16.05.24 10:18:13;   CS: 16.05.24 10:18:59 - 16.05.24 11:14:55;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests which fail for at least two last runs:

Jump to LIST of unique test names from this report

NN Test name mode 5.0.1.1398
2024-05-16
5.0.1.1397
2024-05-10
5.0.1.1392
2024-05-08
5.0.1.1386
2024-04-27
5.0.1.1378
2024-04-20
5.0.1.1346
2024-04-07
5.0.1.1340
2024-02-21
5.0.1.1325
2024-02-15
5.0.1.1318
2024-01-26
X X X X X X X X X X X X X X X X X X X X X
Test TITLE
1 CS F F F F F F F F P X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
2 SS F F F F F F F F P X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
3 CS F F F F F F F F P X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
4 SS F F F F F F F F P X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
5 CS F F F F F F F F P X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
6 SS F F F F F F F F P X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
7 CS F F F F F F F F F X X X X X X X X X X X X X X X X X X X X X
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
8 SS F F F F F F F F F X X X X X X X X X X X X X X X X X X X X X
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms 5.0.1.1398
2024-05-16
5.0.1.1397
2024-05-10
5.0.1.1392
2024-05-08
5.0.1.1386
2024-04-27
5.0.1.1378
2024-04-20
5.0.1.1346
2024-04-07
5.0.1.1340
2024-02-21
5.0.1.1325
2024-02-15
5.0.1.1318
2024-01-26
X X X X X X X X X X X X X X X X X X X X X
Test TITLE
1 CS 811 811 1087 795 1170 801 812 803 821 794 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
2 SS 482 715 1124 480 823 465 477 772 473 482 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
3 CS 782 782 781 788 778 769 830 775 811 802 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
4 SS 491 613 484 482 515 492 473 1028 480 491 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
5 CS 496 488 482 559 558 542 483 496 542 496 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
6 SS 336 340 336 341 395 324 331 994 322 312 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
7 CS 1518 1508 1537 1490 1495 1556 1579 1466 1629 1518 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
8 SS 1051 1077 1088 1048 1049 1051 1042 1066 1068 1024 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py

=== end of list ===