01. Total results for each kind of outcome and server mode, for previous 35 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (21 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (14 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (50 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (26 rows)
07. Has fails: tests with at least one fail for previous 35 runs (83 rows)
08. Has runtime errors: tests with at least one runtime error for previous 35 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 35 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (183 rows)
11. All tests: outcomes for previous 35 runs (2721 rows)
12. Skipped: tests which was intentionally excluded from execution (170 rows)

Generated UTC 31.10.2025 15:22
Tested: HQ40.   Build / date: 4.0.6.3223-970bec8a / 2025.08.18;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 2.0.2; firebird.Qa: 0.21.0 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3223
2025.08.18
970be
4.0.6.3222
2025.07.22
685b7
4.0.6.3189
2025.02.25
1a1a5
4.0.6.3184
2025.02.24
9388c
4.0.6.3183
2025.02.16
cf6ca
4.0.6.3169
2024.12.13
42cc1
4.0.6.3169
2024.12.08
50eb6
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.16
2bb10
4.0.6.3163
2024.10.15
f387e
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.25
4b9c7
X X X X X X X X X X X X X
Test TITLE
1
bugs core 0214 
 tracker
 CS 2025.01.18 11:26
41087 15102 14686 14562 9377 9289 9289 9289 9691 12385 12385 X 12385 9206 X X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
2
bugs core 0214 
 tracker
 SS 2025.01.18 11:26
38706 14646 14638 14423 8971 8879 8879 8971 9507 12582 12582 12582 12301 9203 X X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
3
bugs core 0856 
 tracker
 CS 2025.06.25 15:39
737 720 665 654 523 519 516 7 7 7 9 9 9 8 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2025.06.25 15:39
511 500 466 423 396 373 339 11 11 8 10 10 8 8 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46
684 714 684 684 579 561 541 13 13 7 9 9 7 7 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46
421 469 469 469 418 383 372 8 8 6 8 8 5 5 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2216 
 tracker
 CS 2025.06.26 15:41
913 907 826 763 704 672 642 12 12 7 6 6 6 6 X X X X X X X X X X X X X X X X X
Nbackup as online dump
8
bugs core 2216 
 tracker
 SS 2025.06.26 15:41
611 611 603 594 449 448 444 15 9 8 9 8 7 7 X X X X X X X X X X X X X X X X X
Nbackup as online dump
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46
681 747 747 747 702 648 632 13 6 6 6 6 6 6 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46
449 588 588 588 478 478 475 10 8 8 8 8 7 6 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 4054 
 tracker
 SS 2024.06.09 15:53
509 362 335 292 262 258 258 262 277 361 361 361 317 162 X X X X X X X X X X X X X X X X X
role not passed on external execute stmt
12
bugs core 5225 
 tracker
 CS 2024.06.09 15:53
1713 1043 1024 996 805 785 785 805 843 998 998 998 762 8 X X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
13
bugs core 5225 
 tracker
 SS 2024.06.09 15:53
1088 573 558 517 438 405 405 438 462 561 562 562 561 6 X X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
14
bugs core 5414 
 tracker
 CS 2022.02.02 14:46
602 12 7 6 6 6 6 7 9 9 9 9 8 5 X X X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
15
bugs core 5431 
 tracker
 SS 2025.07.01 19:02
396 346 337 331 260 253 253 253 265 324 324 324 311 168 X X X X X X X X X X X X X X X X X
Support for DROP IDENTITY clause
16
bugs core 5463 
 tracker
 CS 2025.07.01 19:15
720 894 894 894 718 703 685 17 10 10 8 8 7 6 X X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
17
bugs core 5463 
 tracker
 SS 2025.07.01 19:15
460 641 641 641 530 520 519 20 9 9 9 9 7 7 X X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
18
bugs core 6138 
 tracker
 SS 2022.02.02 14:46
409 10 10 8 5 5 5 5 6 6 6 5 5 5 X X X X X X X X X X X X X X X X X
Inconsistent behavior regarding visibility of master record on detail inserts
19
bugs gh 6609 
 tracker
 CS 2024.12.24 08:06
44484 54558 54558 54558 39829 39829 39829 41537 41537 41537 4807 X X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
20
bugs gh 6609 
 tracker
 SS 2024.12.24 08:06
43189 56258 56258 56258 40651 40651 40651 43047 43047 43047 3038 X X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
21
functional database create 02 
 SS 2025.01.13 11:44
1013 14 8 7 6 5 5 6 8 8 9 8 6 5 X X X X X X X X X X X X X X X X X
Create database: non sysdba user
22
functional intfunc string left 01 
 CS 2022.02.04 18:05
592 4211 4211 4211 4211 4046 4013 11 11 11 11 9 9 9 X X X X X X X X X X X X X X X X X
LEFT function
23
functional intfunc string left 01 
 SS 2022.02.04 18:05
453 4074 4074 4290 4290 3942 3929 12 9 7 7 7 7 7 X X X X X X X X X X X X X X X X X
LEFT function
24
functional intfunc string right 01 
 CS 2022.02.04 18:05
620 4244 4244 4244 4244 4131 3999 16 14 10 10 10 10 10 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
25
functional intfunc string right 01 
 SS 2022.02.04 18:05
437 4139 4139 4139 4128 3867 3859 8 8 6 8 8 6 6 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
26
functional table create 01 
 CS 2023.10.07 10:57
790 14 8 8 6 6 6 6 5 6 5 6 6 6 X X X X X X X X X X X X X X X X X
CREATE TABLE - types

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3223
2025.08.18
970be
4.0.6.3222
2025.07.22
685b7
4.0.6.3189
2025.02.25
1a1a5
4.0.6.3184
2025.02.24
9388c
4.0.6.3183
2025.02.16
cf6ca
4.0.6.3169
2024.12.13
42cc1
4.0.6.3169
2024.12.08
50eb6
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.16
2bb10
4.0.6.3163
2024.10.15
f387e
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.25
4b9c7
X X X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0214 
 tracker
 CS 2025.01.18 11:26 49061 41087 41215 15102 14562 14686 9377 9207 9289 7994 9691 X 12385 13028 12534 9206 8182 8704 X X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
2
bugs core 0214 
 tracker
 SS 2025.01.18 11:26 48214 40739 38706 14638 14646 14423 8879 8249 8971 8632 9507 18346 12685 12582 12301 9203 8270 8703 X X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
3
bugs core 0856 
 tracker
 CS 2025.06.25 15:39 769 759 665 720 737 654 516 519 523 6 5 7 9 9 9 5 8 7 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2025.06.25 15:39 511 527 522 500 423 466 373 339 396 5 7 11 13 8 10 5 6 9 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46 617 736 532 684 714 722 579 541 561 5 6 13 13 7 9 7 7 7 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46 421 398 413 553 494 469 418 372 383 6 6 8 9 5 9 5 5 7 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2216 
 tracker
 CS 2025.06.26 15:41 936 996 907 826 913 763 704 642 672 7 6 12 13 5 5 6 7 6 X X X X X X X X X X X X X X X X X
Nbackup as online dump
8
bugs core 2216 
 tracker
 SS 2025.06.26 15:41 611 705 675 603 611 594 449 448 444 5 9 15 8 7 11 6 6 8 X X X X X X X X X X X X X X X X X
Nbackup as online dump
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46 681 676 565 937 747 895 632 648 702 5 6 13 5 6 4 7 6 5 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46 449 424 379 600 620 588 478 475 478 8 5 10 8 7 11 5 5 6 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 4054 
 tracker
 SS 2024.06.09 15:53 571 509 543 292 362 335 258 262 218 240 277 580 362 361 162 317 158 151 X X X X X X X X X X X X X X X X X
role not passed on external execute stmt
12
bugs core 5225 
 tracker
 CS 2024.06.09 15:53 1899 1713 1947 1043 996 1024 776 805 785 783 843 1424 998 1131 762 8 7 5 X X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
13
bugs core 5225 
 tracker
 SS 2024.06.09 15:53 1230 1186 1088 558 573 517 405 405 438 394 462 772 561 642 562 6 5 5 X X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
14
bugs core 5414 
 tracker
 CS 2022.02.02 14:46 643 602 646 12 6 7 6 5 7 6 9 11 9 8 13 5 5 5 X X X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
15
bugs core 5431 
 tracker
 SS 2025.07.01 19:02 429 468 396 346 331 337 260 247 253 220 265 523 335 324 168 311 128 134 X X X X X X X X X X X X X X X X X
Support for DROP IDENTITY clause
16
bugs core 5463 
 tracker
 CS 2025.07.01 19:15 666 720 617 904 894 940 703 718 685 17 6 10 7 11 8 6 6 6 X X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
17
bugs core 5463 
 tracker
 SS 2025.07.01 19:15 460 454 439 649 730 641 520 519 530 7 6 20 9 11 7 6 6 7 X X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
18
bugs core 6138 
 tracker
 SS 2022.02.02 14:46 456 450 409 8 10 10 5 5 5 5 6 12 6 5 5 5 6 6 X X X X X X X X X X X X X X X X X
Inconsistent behavior regarding visibility of master record on detail inserts
19
bugs gh 6609 
 tracker
 CS 2024.12.24 08:06 41609 44484 39672 57303 57676 54558 39750 39301 39829 41537 45033 93011 3507 4807 2957 X X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
20
bugs gh 6609 
 tracker
 SS 2024.12.24 08:06 40273 43189 37690 56258 57063 57340 39595 39799 40651 43047 45948 96442 2960 3038 2578 X X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
21
functional database create 02 
 SS 2025.01.13 11:44 1013 1104 1077 14 7 8 5 6 5 5 9 12 8 5 12 5 6 4 X X X X X X X X X X X X X X X X X
Create database: non sysdba user
22
functional intfunc string left 01 
 CS 2022.02.04 18:05 592 583 554 4466 4615 4211 4046 4013 4301 6 11 11 9 20 9 5 11 5 X X X X X X X X X X X X X X X X X
LEFT function
23
functional intfunc string left 01 
 SS 2022.02.04 18:05 453 420 411 4074 4362 4290 3942 4636 3929 6 7 12 9 6 7 7 7 7 X X X X X X X X X X X X X X X X X
LEFT function
24
functional intfunc string right 01 
 CS 2022.02.04 18:05 581 620 581 4574 5287 4244 4131 3999 4249 5 6 16 14 10 10 5 11 5 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
25
functional intfunc string right 01 
 SS 2022.02.04 18:05 427 404 437 4139 4583 4223 3859 4128 3867 6 5 8 9 5 9 5 6 7 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
26
functional table create 01 
 CS 2023.10.07 10:57 829 852 790 8 8 14 6 6 5 6 5 11 5 7 5 6 6 5 X X X X X X X X X X X X X X X X X
CREATE TABLE - types

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2216
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-4054
http://tracker.firebirdsql.org/browse/CORE-5225
http://tracker.firebirdsql.org/browse/CORE-5414
http://tracker.firebirdsql.org/browse/CORE-5431
http://tracker.firebirdsql.org/browse/CORE-5463
http://tracker.firebirdsql.org/browse/CORE-6138
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/create/test_01.py
https://github.com/FirebirdSQL/firebird/issues/6609
=== end of list ===

Last commits information (all timestamps in UTC):