01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (1 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (30 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (2 rows)
07. Has fails: tests with at least one fail for previous 30 runs (109 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1114 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (1 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (3728 rows)
12. Skipped: tests which was intentionally excluded from execution (82 rows)

Generated UTC 02.05.2025 05:02
Tested: HQ50.   Build / date: 5.0.3.1651-141ef4cc / 2025.04.30;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
Test TITLE
1 CS F F P P F F F F F P P F F P F F F P P P F F F F F P F F P P
Compress Data over the Network
2 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F E F X
Events in system attachments (like garbage collector) are not traced
5 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
6 CS F F F F F F F F F F F F F F F F F F F X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
7 SS F F F F P F F F F P P P P P P P P F F X X X X X X X X X X X
gbak: Incorrect total statistics for restore
8 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
9 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
10 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
11 CS F F F F F F F F F F F F F F F F F F F F F F F F F P P P P P
ISQL - SHOW SYSTEM TABLES
12 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Add REPLICA MODE to the output of the isql SHOW DATABASE command
13 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
ISQL showing publication status
14 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Characters are garbled when replicating fields with type BLOB SUB_TYPE TEXT if the character set of the connection and the field are different
15 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Error "BLOB is not found" while replication converts INSERT into UPDATE for a conflicting record
16 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Problem with replication of BLOB segments longer than 32KB
17 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Replica DB must not fire DB-level triggers but their activity on master must be eventually seen in replica
18 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
DDL-triggers must fire only on master DB
19 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Disallow replication of RDB$BACKUP_HISTORY
20 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Conflicting INSERT propagated into a read-write replica may cause duplicate records to appear
21 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Failed DDL commands can be replicated
22 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Generator values may not replicate after commit
23 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set
24 CS F F F F F F F F F F F F F F F F F F F F F X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
25 SS F F F F F F F F F F F F F F F F F F F F F X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
26 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Applying full DDL from OLTP-EMUL test on master with further check replica
27 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Crash or hang while shutting down the replica database if segments are being applied
28 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Some updates can crash Firebird server on replica side
29 SS F F F F P F F F F P P P P P P F P P P P P P P P P P P F P P
Replication gets stuck due to "Blob xxx.xx is not found for table xxx" error
30 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
Test TITLE
1 CS 16811 16624 16966 16304 16353 16455 16787 16977 17080 17338 16997 17108 19684 17369 17187 17231 17656 16996 16698 16271 16309 18168 16591 16359 16553 16017 16161 16695 16836 17062 16205
Compress Data over the Network
2 CS 1510 1533 1506 1845 1803 1465 1476 1497 1514 1515 1841 1826 1570 1536 1917 1483 1506 1354 1474 1482 1832 1518 1260 1350 1445 1253 1833 1471 1468 2706 2708
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS 1057 1228 826 1249 999 1239 1234 921 1315 771 1131 1203 1032 1063 1150 762 1037 1073 743 956 741 1052 660 732 749 662 1067 1063 1071 1898 1940
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 SS 313 291 331 295 302 297 298 325 318 413 325 328 291 571 326 324 295 429 301 570 304 299 239 482 243 470 298 313 2384 301 0
Events in system attachments (like garbage collector) are not traced
5 CS 1077 1034 1033 1103 1084 1041 1063 1070 1077 1076 1078 1390 1044 1031 1089 1148 1069 1072 1092 1091 1104 1088 984 1102 3251 973 1060 1059 1311 1087 1427
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
6 CS 1094 1093 1092 1101 1102 1109 1109 1104 1094 1133 1094 1108 1079 1115 1089 1084 1094 1089 1094 1133 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
7 SS 2748 3020 3050 2969 2894 2593 3042 3127 3309 3026 2748 2678 2718 2747 2569 2415 2587 2793 2644 2641 0 0 0 0 0 0 0 0 0 0 0
gbak: Incorrect total statistics for restore
8 CS 834 840 885 844 855 831 828 856 867 1108 840 853 833 843 849 894 828 810 831 827 818 826 749 807 858 742 819 826 868 825 835
ORDER BY ASC using index (multi)
9 CS 847 833 844 868 849 816 850 851 858 916 856 854 836 844 889 898 851 833 842 811 854 812 775 873 912 763 853 829 845 810 830
ORDER BY ASC using index (multi)
10 CS 625 621 642 623 878 632 637 649 628 716 668 629 594 629 619 642 647 615 599 607 611 607 545 571 657 572 607 594 877 618 634
ORDER BY ASC using index (multi) and WHERE clause
11 CS 614 634 625 627 644 594 624 666 633 677 626 615 597 586 615 658 875 589 589 599 594 599 573 608 642 531 613 589 623 606 611
ISQL - SHOW SYSTEM TABLES
12 SS 374 2082 2081 2081 2078 311 2082 2080 2091 2336 393 381 380 359 377 313 2076 371 356 308 311 309 281 351 347 350 384 307 2097 311 322
Add REPLICA MODE to the output of the isql SHOW DATABASE command
13 SS 158 2081 2090 2077 2076 157 2075 2071 2077 2120 157 173 154 156 155 156 2077 158 159 155 154 156 139 144 143 141 158 155 2077 159 158
ISQL showing publication status
14 SS 8738 2205 2377 2396 2432 8717 2210 2399 2194 2438 9291 8631 9544 8769 8759 8903 2394 8548 9701 9560 9734 9558 9511 9032 9357 9498 8589 9548 2199 8694 9745
Characters are garbled when replicating fields with type BLOB SUB_TYPE TEXT if the character set of the connection and the field are different
15 SS 9090 2387 2396 2196 2401 9988 2382 2208 2401 2405 9057 9149 9112 10217 10029 9138 2200 9040 9127 9037 9195 9044 9381 10056 10030 9512 10130 9082 2627 10160 9099
Error "BLOB is not found" while replication converts INSERT into UPDATE for a conflicting record
16 SS 5924 2209 2193 2382 2203 5458 2397 2421 2198 2437 7077 6925 7428 5406 5817 6527 2372 6419 6422 6471 6445 6412 6088 6109 6031 6161 5662 6483 2201 5772 6457
Problem with replication of BLOB segments longer than 32KB
17 SS 6140 2380 2390 2212 2395 6174 2200 2214 2388 2210 5231 6218 6225 6176 6177 6446 2200 6138 6201 6219 6221 6170 6059 6041 6257 6030 6142 6161 2428 6158 6407
Replica DB must not fire DB-level triggers but their activity on master must be eventually seen in replica
18 SS 6396 2404 2202 2385 2413 7354 2391 2374 2395 2420 7422 6411 7475 7347 6413 6404 2388 7398 6368 7395 6389 7411 6252 6245 7696 6293 6409 7410 2430 7417 6422
DDL-triggers must fire only on master DB
19 SS 8385 2193 2381 2396 2209 8710 2225 2380 2226 2217 8661 8586 8762 8671 9329 9632 2406 8473 8857 8352 6259 8936 6702 6092 8359 8870 9629 8412 2197 9060 9405
Disallow replication of RDB$BACKUP_HISTORY
20 SS 8716 2403 2404 2204 2395 8710 2424 2200 2392 2403 8789 9663 8719 9740 8790 8637 2248 9580 9681 9544 8715 8726 8526 9368 9477 9497 8718 9705 2383 8700 9026
Conflicting INSERT propagated into a read-write replica may cause duplicate records to appear
21 SS 6129 2199 2195 2390 2206 6130 2392 2389 2204 2193 6462 6164 6147 5260 6523 6196 2407 6132 6136 6130 6129 6172 6017 6013 7301 6029 6137 6149 2203 6137 6211
Failed DDL commands can be replicated
22 SS 6055 2420 2378 2198 2433 6042 2201 2194 2387 2393 6122 6128 6097 6440 6077 6097 2199 6079 6057 6068 6076 6056 6926 5925 6029 5953 6057 6149 2390 6054 6134
Generator values may not replicate after commit
23 SS 12627 2469 2390 2405 2381 12155 2207 2382 2197 2254 12172 12235 13236 13265 13556 12165 2402 13131 13142 12129 13151 13124 13019 14084 13478 14025 13185 13162 2413 13168 13601
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set
24 CS 50861 50859 50807 50807 52753 49836 52056 50861 49736 51556 50014 54476 53461 49856 50610 50918 50244 50821 53798 53754 53472 52888 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
25 SS 49221 2387 2395 2198 2422 53263 2391 2205 2398 2392 50393 54471 50426 51374 52927 53414 2213 54560 51399 53443 49221 48625 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
26 SS 15636 2207 2194 2384 2199 14111 2400 2395 2205 2389 14570 16587 16843 17267 16922 16760 2391 16335 16708 14426 14084 15931 16332 15626 15995 15646 16818 15857 2213 16386 15787
Applying full DDL from OLTP-EMUL test on master with further check replica
27 SS 13278 2398 2411 2212 2434 13155 2385 2199 2427 2394 13196 13770 13159 13921 13837 13255 2203 14149 13544 13374 14777 13783 13420 14422 13301 13214 14286 14389 2401 14184 14151
Crash or hang while shutting down the replica database if segments are being applied
28 SS 6117 2194 2207 2411 2218 7834 2198 2398 2207 2409 6132 7160 7152 7166 6158 6147 2389 6075 6078 6076 6069 6214 6953 6942 7035 6966 7067 7090 2195 6102 6180
Some updates can crash Firebird server on replica side
29 SS 5992 2405 2394 2220 2404 5062 2392 2219 2391 2204 6122 6135 5659 6271 6091 7112 2202 6082 6059 6054 6080 7105 5972 5929 6013 5944 6073 6114 2416 6076 6656
Replication gets stuck due to "Blob xxx.xx is not found for table xxx" error
30 CS 1467 1469 1459 1458 1560 1434 1455 1484 1506 1861 1550 1511 1550 1458 1536 1521 1461 1505 1478 1467 1430 1445 1328 1369 1479 1420 1445 1454 1467 1426 1480
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_07.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_08.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_blob_characters_garbled_when_conn_charset_differs.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_blob_not_found_in_rw_replica_if_target_row_exists.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_blob_segments_longer_32kb_are_not_replicated.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_dblevel_triggers_must_not_fire_on_replica.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_ddl_triggers_must_not_fire_on_replica.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_disallow_rdb_backup_history_replication.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_duplicates_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_failed_ddl_commands_can_be_replicated.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_generator_could_not_be_transferred_to_replica.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_invalid_msg_if_target_db_has_no_replica_flag.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_oltp_emul_ddl.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_shutdown_during_applying_segments_leads_to_crash.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_some_updates_crash_server_on_replica_side.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_updating_blob_with_empty_string_stops_replication.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
https://github.com/FirebirdSQL/firebird/issues/8391
=== end of list ===

Last commits information (all timestamps in UTC):