01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (3 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 05. STILL FAILS: tests which fail for at least TWO LAST runs (8 rows)
06. Has fails: tests with at least one fail for previous 30 runs (150 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (5 rows)
10. All tests: outcomes for previous 30 runs (2474 rows)
11. All tests: durations for previous 30 runs (4782 rows)
12. Skipped: tests which was intentionally excluded from execution (70 rows)

Generated 15.05.2024 17:56
Tested: HQ40.   Build: 4.0.5.3097;   SS: 15.05.24 15:11:13 - 15.05.24 16:25:31;   CS: 15.05.24 16:26:26 - 15.05.24 17:54:23;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests which fail for at least two last runs:

Jump to LIST of unique test names from this report

NN Test name mode 4.0.5.3097
2024-05-15		 4.0.5.3091
2024-05-08		 4.0.5.3089
2024-04-27		 4.0.5.3083
2024-04-20		 4.0.5.3052
2024-04-06		 4.0.5.3049
2024-01-26		 4.0.5.3034
2023-12-30		 4.0.4.3013
2023-11-30		 4.0.4.2991
2023-11-09		 4.0.4.2977
2023-09-15		 4.0.3.2955
2023-08-11		 4.0.3.2943
2023-06-22		 4.0.3.2936
2023-05-25		 4.0.3.2931
2023-04-30		 4.0.3.2920
2023-04-21		 4.0.3.2913
2023-04-02		 4.0.3.2908
2023-03-22		 4.0.3.2900
2023-03-14		 4.0.3.2891
2023-02-09		 4.0.3.2885
2023-01-27		 X X X X X X X X X X
Test TITLE
1
bugs gh 7436 
 tracker
 CS F F F F F F X X X X X X X X X X X X X X X X X X X X X X X X
Backup error for wide table
2
bugs gh 7436 
 tracker
 SS F F F F F F X X X X X X X X X X X X X X X X X X X X X X X X
Backup error for wide table
3
functional arno optimizer opt sort by index 10 
 CS F F F F F F F F F F F F F F F F F F F F X X X X X X X X X X
ORDER BY ASC using index (multi)
4
functional arno optimizer opt sort by index 10 
 SS F F F F F F F F F F F F F F F F F F F F X X X X X X X X X X
ORDER BY ASC using index (multi)
5
functional arno optimizer opt sort by index 13 
 CS F F F F F F F F F F F F F F F F F F F F X X X X X X X X X X
ORDER BY ASC using index (multi)
6
functional arno optimizer opt sort by index 13 
 SS F F F F F F F F F F F F F F F F F F F F X X X X X X X X X X
ORDER BY ASC using index (multi)
7
functional arno optimizer opt sort by index 19 
 CS F F F F F F F F F F F F F F F F F F F F X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
8
functional arno optimizer opt sort by index 19 
 SS F F F F F F F F F F F F F F F F F F F F X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause

Elapsed time, milliseconds:

NN Test name mode median_ms 4.0.5.3097
2024-05-15		 4.0.5.3091
2024-05-08		 4.0.5.3089
2024-04-27		 4.0.5.3083
2024-04-20		 4.0.5.3052
2024-04-06		 4.0.5.3049
2024-01-26		 4.0.5.3034
2023-12-30		 4.0.4.3013
2023-11-30		 4.0.4.2991
2023-11-09		 4.0.4.2977
2023-09-15		 4.0.3.2955
2023-08-11		 4.0.3.2943
2023-06-22		 4.0.3.2936
2023-05-25		 4.0.3.2931
2023-04-30		 4.0.3.2920
2023-04-21		 4.0.3.2913
2023-04-02		 4.0.3.2908
2023-03-22		 4.0.3.2900
2023-03-14		 4.0.3.2891
2023-02-09		 4.0.3.2885
2023-01-27		 X X X X X X X X X X
Test TITLE
1
bugs gh 7436 
 tracker
 CS 1226 961 838 1423 1205 1247 1484 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
2
bugs gh 7436 
 tracker
 SS 1024 2342 886 1139 891 910 1298 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
3
functional arno optimizer opt sort by index 10 
 CS 828 1196 790 829 846 804 807 801 773 775 828 738 822 823 864 867 835 833 835 932 934 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
4
functional arno optimizer opt sort by index 10 
 SS 496 582 489 485 495 484 500 494 490 542 467 497 499 496 506 511 478 509 512 572 447 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
5
functional arno optimizer opt sort by index 13 
 CS 825 1017 834 824 827 809 856 804 762 796 702 750 781 838 829 843 843 822 818 932 900 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
6
functional arno optimizer opt sort by index 13 
 SS 505 580 480 485 489 503 495 495 511 532 467 509 495 509 508 510 516 513 490 577 446 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
7
functional arno optimizer opt sort by index 19 
 CS 547 607 553 547 548 495 584 517 493 565 499 490 563 513 542 597 522 605 520 658 736 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
8
functional arno optimizer opt sort by index 19 
 SS 348 370 336 345 329 339 360 338 362 355 327 336 335 351 359 348 366 348 354 429 337 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird/issues/7436

=== end of list ===