01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (23 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (106 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2629 rows)
12. Skipped: tests which was intentionally excluded from execution (84 rows)

Generated UTC 02.05.2025 06:14
Tested: HQ50.   Build / date: 5.0.3.1651-141ef4cc / 2025.04.30;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.21
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.08
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.09.05
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
Test TITLE
1 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F P
Compress Data over the Network
2 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F P
Compress Data over the Network
3 CS F F F F F F F F F F F F F F F F P P P P P P P P P P P P P P
GSec incorrectly processes some switches
4 SS F F F F F F F F F F F F F F F F P P P P P P P P P P P P P P
GSec incorrectly processes some switches
5 CS F F F F F F F F F F F F F F F F F F F P P P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS F F F F F F F F F F F F F F F F F F F P P P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 SS F F F F F F F F F F F F F F F F F F F F X X X X X X X X X X
Events in system attachments (like garbage collector) are not traced
8 SS F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X
Internal consistency check (page in use during flush) with small number of DefaultDbCachePages
9 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
10 CS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
11 SS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
12 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
13 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
14 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
15 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
16 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
17 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
18 CS F F F F F F F F F F F F F F F F P P P P P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
19 SS F F F F F F F F F F F F F F F F P P P P P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
20 CS F F F F F F F F F F F F F F F F X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
21 SS F F F F F F F F F F F F F F F F X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
22 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
23 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.21
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.08
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.09.05
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
Test TITLE
1 CS 817 37420 40243 37666 33362 39272 33374 39827 36894 857 893 831 776 804 843 625 582 665 580 590 582 688 678 603 661 682 1292 1280 783 892 542
Compress Data over the Network
2 SS 451 36015 38790 35390 32253 35410 32196 34778 34557 453 462 453 449 464 438 319 334 369 340 326 355 345 372 344 343 388 450 694 466 528 354
Compress Data over the Network
3 CS 746 602 665 665 607 625 624 527 599 1023 1049 902 964 958 947 803 703 749 744 687 693 729 721 767 751 754 1391 1350 912 940 666
GSec incorrectly processes some switches
4 SS 416 376 373 371 407 382 356 382 384 544 540 539 520 508 554 401 384 410 400 403 443 422 405 426 437 437 597 1425 581 585 367
GSec incorrectly processes some switches
5 CS 798 1964 2469 2162 2122 2184 1972 2001 2135 803 1203 775 830 762 798 589 656 605 593 601 575 680 680 605 714 668 1219 1102 799 802 504
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS 424 1286 1359 1361 1104 1220 1160 1164 1260 469 434 402 395 416 433 325 311 321 306 333 337 328 366 312 343 348 590 710 493 450 273
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 SS 1060 373 386 380 320 394 345 391 354 1532 1488 1608 1188 1358 1600 1035 1054 1078 1137 1067 1161 0 0 0 0 0 0 0 0 0 0
Events in system attachments (like garbage collector) are not traced
8 SS 1732 1732 1769 1412 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Internal consistency check (page in use during flush) with small number of DefaultDbCachePages
9 CS 1209 1949 1935 1966 1864 2005 1865 2058 2154 1295 1170 1164 1288 1388 1249 934 925 1025 932 969 961 925 925 929 996 0 0 0 0 0 0
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
10 CS 735 844 847 842 744 920 727 751 776 26 15 15 14 11 19 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
11 SS 531 468 424 408 391 441 373 595 424 17443 17909 17138 17208 16855 16595 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
12 CS 816 1038 987 972 1041 1017 1013 991 965 858 959 846 781 785 931 617 652 614 695 642 624 627 653 674 701 663 1170 1442 865 787 537
ORDER BY ASC using index (multi)
13 SS 479 591 601 552 591 594 575 744 615 553 481 527 439 498 432 352 350 357 306 365 337 374 377 379 370 385 540 732 477 488 317
ORDER BY ASC using index (multi)
14 CS 976 1024 1098 976 1094 1078 1082 901 1184 1072 1027 1050 933 989 1015 750 726 799 745 725 746 758 764 801 788 760 1594 1440 977 1010 732
ORDER BY ASC using index (multi)
15 SS 550 515 630 579 585 560 560 750 774 552 570 549 537 600 563 447 425 452 419 453 435 408 497 471 434 433 659 897 564 585 403
ORDER BY ASC using index (multi)
16 CS 8 780 822 745 829 817 839 808 774 9 10 8 5 7 8 7 4 6 7 5 7 12 9 6 6 7 19 12 5 7 7
ORDER BY ASC using index (multi) and WHERE clause
17 SS 8 534 453 509 471 533 405 667 433 9 10 7 8 8 9 6 7 6 5 7 5 7 5 7 6 6 14 12 10 7 9
ORDER BY ASC using index (multi) and WHERE clause
18 CS 771 779 838 811 847 797 841 737 772 868 780 794 782 724 800 592 572 655 567 499 581 630 588 618 628 611 924 1257 780 770 529
ISQL - SHOW SYSTEM TABLES
19 SS 417 448 439 441 429 421 444 505 400 497 427 399 434 414 434 305 316 373 320 316 332 351 364 340 305 314 549 622 440 428 287
ISQL - SHOW SYSTEM TABLES
20 CS 42461 50610 53054 50745 53171 47749 50475 50360 50470 34906 37174 34965 32370 34664 35780 27040 27677 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
21 SS 40991 49564 50551 50553 50843 50694 50997 46826 50510 34671 35156 31666 32251 31753 31808 23582 26433 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
22 CS 178907 1684 1807 1596 1776 1885 1846 1794 1717 405388 431273 362977 365115 354287 317811 178556 176816 180575 171808 181481 194450 192180 193229 194275 193538 194428 179258 4586 3096 3049 2758
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
23 SS 179329 1073 1071 1080 1170 1182 1086 1373 1032 411086 179039 364065 360746 362390 331814 179619 176212 181790 175699 182188 192466 188410 194723 194220 195183 192151 180579 3465 2251 2241 2020
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1263
http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8194
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
=== end of list ===

Last commits information (all timestamps in UTC):