01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 05. STILL FAILS: tests which fail for at least TWO LAST runs (8 rows)
06. Has fails: tests with at least one fail for previous 30 runs (76 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (9 rows)
10. All tests: outcomes for previous 30 runs (2501 rows)
11. All tests: durations for previous 30 runs (4910 rows)
12. Skipped: tests which was intentionally excluded from execution (75 rows)

Generated 15.05.2024 06:41
Tested: HQ50.   Build: 5.0.1.1398;   SS: 14.05.24 07:16:31 - 14.05.24 08:08:03;   CS: 15.05.24 05:31:04 - 15.05.24 06:40:53;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.9, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests which fail for at least two last runs:

NN Test name mode 5.0.1.1398
2024-05-15
5.0.1.1392
2024-05-10
5.0.1.1386
2024-04-26
5.0.1.1378
2024-04-21
5.0.1.1346
2024-04-07
5.0.1.1340
2024-03-01
5.0.1.1325
2024-02-18
5.0.1.1318
2024-01-26
X X X X X X X X X X X X X X X X X X X X X X
Test TITLE
1 CS F F X F F F F F X X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
2 SS F F X F F F F F X X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
3 CS F F X F F F F F X X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
4 SS F F X F F F F F X X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
5 CS F F X F F F F F X X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
6 SS F F X F F F F F X X X X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
7 CS F F X F F F F F X X X X X X X X X X X X X X X X X X X X X X
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
8 SS F F X F F F F F X X X X X X X X X X X X X X X X X X X X X X
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms 5.0.1.1398
2024-05-15
5.0.1.1392
2024-05-10
5.0.1.1386
2024-04-26
5.0.1.1378
2024-04-21
5.0.1.1346
2024-04-07
5.0.1.1340
2024-03-01
5.0.1.1325
2024-02-18
5.0.1.1318
2024-01-26
X X X X X X X X X X X X X X X X X X X X X X
Test TITLE
1 CS 742 839 621 0 633 611 742 759 757 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
2 SS 412 501 412 0 326 332 533 534 389 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
3 CS 701 894 564 0 613 637 704 754 701 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
4 SS 399 506 388 0 354 319 490 564 399 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
5 CS 579 791 466 0 403 532 599 589 579 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
6 SS 302 456 250 0 241 241 439 485 302 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
7 CS 1615 1660 2333 0 1290 1443 1558 1615 1640 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
8 SS 894 1203 1342 0 894 822 867 872 1101 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py

=== end of list ===