01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (15 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
10. All tests: outcomes for previous 30 runs (2377 rows)
11. All tests: durations for previous 30 runs (4603 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated 20.04.2024 09:40
Tested: FB40.   Build: 4.0.5.3089;   SS: 20.04.24 08:00:30 - 20.04.24 08:45:48;   CS: 20.04.24 08:46:51 - 20.04.24 09:39:40;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.1; Firebird.Qa: 0.19.1

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 4.0.5.3089
2024-04-20
4.0.5.3088
2024-04-19
4.0.5.3086
2024-04-17
4.0.5.3083
2024-04-14
4.0.5.3082
2024-03-29
4.0.5.3081
2024-03-24
4.0.5.3080
2024-03-22
4.0.5.3078
2024-03-16
4.0.5.3077
2024-03-15
4.0.5.3066
2024-03-13
4.0.5.3064
2024-03-09
4.0.5.3062
2024-03-05
4.0.5.3061
2024-02-21
4.0.5.3059
2024-02-18
4.0.5.3058
2024-02-13
4.0.5.3057
2024-02-12
4.0.5.3056
2024-02-11
4.0.5.3055
2024-02-09
4.0.5.3054
2024-02-04
4.0.5.3053
2024-01-30
4.0.5.3052
2024-01-26
4.0.5.3051
2024-01-24
4.0.5.3050
2024-01-16
4.0.5.3049
2023-12-29
4.0.5.3042
2023-12-20
4.0.5.3041
2023-12-19
4.0.5.3040
2023-12-12
4.0.5.3038
2023-12-04
4.0.5.3034
2023-12-01
4.0.5.3033
2023-11-30
Test TITLE
1 CS P F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
2 SS P P P P P P P P P P P P P P P P P P P P P F P P P P P P P P
Alter computed field type does not work
3 CS P P P P P P P P P P P P P P P P P P P P P P P P F P P P P P
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
4 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Restore (without replace) when database already exists crashes gbak or Firebird (when run through service manager)
5 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P
Wire compression causes freezes
6 CS P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
7 SS P F P P P P P P P P P P P P P F F P P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
8 CS P P P P P P P P P P P P P P P P P P F P P P P P P P P P P P
With multiple trace sessions user may receive trace events related to engine's requests
9 CS P P P P P P P P P P P P P P P P P P P P P P P F P P P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
10 SS P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
11 SS P P P P P P P P P P P P P P P P P P P P P P P F P P P P P P
Performance issue with time zones
12 CS P P P P P F F P P X X X X X X X X X X X X X X X X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
13 SS P P P P P F F P P X X X X X X X X X X X X X X X X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
14 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P
Crash or hang while shutting down the replica database if segments are being applied
15 CS P P P P P P P P P P P P P P P P P P P P P P P P P F P P P P
Check ability to trace any attachment by non-sysdba user who is granted with necessary system privileges

Elapsed time, milliseconds:

NN Test name mode median_ms 4.0.5.3089
2024-04-20
4.0.5.3088
2024-04-19
4.0.5.3086
2024-04-17
4.0.5.3083
2024-04-14
4.0.5.3082
2024-03-29
4.0.5.3081
2024-03-24
4.0.5.3080
2024-03-22
4.0.5.3078
2024-03-16
4.0.5.3077
2024-03-15
4.0.5.3066
2024-03-13
4.0.5.3064
2024-03-09
4.0.5.3062
2024-03-05
4.0.5.3061
2024-02-21
4.0.5.3059
2024-02-18
4.0.5.3058
2024-02-13
4.0.5.3057
2024-02-12
4.0.5.3056
2024-02-11
4.0.5.3055
2024-02-09
4.0.5.3054
2024-02-04
4.0.5.3053
2024-01-30
4.0.5.3052
2024-01-26
4.0.5.3051
2024-01-24
4.0.5.3050
2024-01-16
4.0.5.3049
2023-12-29
4.0.5.3042
2023-12-20
4.0.5.3041
2023-12-19
4.0.5.3040
2023-12-12
4.0.5.3038
2023-12-04
4.0.5.3034
2023-12-01
4.0.5.3033
2023-11-30
Test TITLE
1 CS 11488 11336 11311 11382 11343 11449 11627 11349 11436 11493 11483 11283 11367 11540 11507 11727 11769 11626 11618 11513 11385 11688 11898 11553 11424 11600 11287 11360 11315 11536 11560
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
2 SS 601 518 526 476 516 534 546 500 542 530 504 539 525 668 593 627 667 642 670 615 589 615 620 749 609 706 685 571 626 624 654
Alter computed field type does not work
3 CS 5951 5788 5791 5803 5789 5870 5818 5816 5843 5849 5895 5841 5805 5986 5952 6076 6168 6093 6129 5977 6014 5958 6081 6239 6055 1544 5998 5950 5902 6115 6004
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
4 SS 854 732 729 793 774 773 753 760 826 777 806 797 771 977 992 1020 949 1030 1044 945 1020 916 927 985 980 887 775 869 834 872 840
Restore (without replace) when database already exists crashes gbak or Firebird (when run through service manager)
5 CS 71304 45737 47652 49748 45549 52385 48639 48855 51580 49461 54478 45859 45692 73374 71976 74199 69357 77520 78091 71561 71891 71449 71159 79864 69210 72168 71779 73752 72331 74593 72820
Wire compression causes freezes
6 CS 4210 3583 3779 3795 3531 4195 3885 3762 3710 3764 4225 3730 3665 4292 4789 5863 5552 6469 6279 4708 5729 4576 4666 5212 4402 5012 4371 3944 4063 4148 4052
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
7 SS 3878 3417 3713 3621 3432 3685 3506 3606 3514 3350 3800 3587 3686 4283 4302 4924 4952 6507 4766 4541 4530 4378 4525 4866 4428 5291 4322 3674 3909 3757 3848
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
8 CS 5156 5049 5068 5035 5053 5044 5008 5067 5036 5069 5092 5080 5042 5160 5466 5190 5451 5512 5441 4027 5431 5160 5493 5342 5225 5172 5399 5318 5152 5386 5118
With multiple trace sessions user may receive trace events related to engine's requests
9 CS 5352 4585 4872 4757 4653 5175 4653 5124 4781 5219 5236 4760 4756 5728 5707 6450 5647 6126 6391 5686 5712 5469 6272 6192 6376 6387 6064 5511 3847 3968 3887
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
10 SS 5315 5126 5457 5527 4253 5507 5241 4534 4315 4660 5586 4339 4352 6053 4829 6481 5302 6772 5406 4833 6040 5805 5328 6122 5333 7053 4877 5601 3379 2352 2376
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
11 SS 4169 3458 3344 3558 3522 3761 3625 3782 3755 3841 3652 3493 3660 4428 4603 5641 5613 5972 5482 4188 4532 4643 4922 5208 4404 5338 4957 3796 4238 3917 4150
Performance issue with time zones
12 CS 6873 6447 6873 6528 6503 6461 69211 68993 13598 13825 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
13 SS 6207 6207 6123 6146 6118 6186 68767 69367 13237 13322 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
14 CS 14091 13626 13903 13840 13779 14012 13894 14060 14165 14236 14147 14074 13831 13544 14057 14697 14118 14296 14108 13439 13832 16356 16894 14188 14423 16639 16858 14035 13946 16873 14168
Crash or hang while shutting down the replica database if segments are being applied
15 CS 4354 3961 4003 4109 3949 4180 3921 3954 4061 4098 4122 3936 4080 4413 4462 4886 4744 5018 5024 4495 4451 4295 4614 4695 4493 4875 4213 4729 4213 4704 4828
Check ability to trace any attachment by non-sysdba user who is granted with necessary system privileges

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-4236
http://tracker.firebirdsql.org/browse/core-5093
http://tracker.firebirdsql.org/browse/core-5210
http://tracker.firebirdsql.org/browse/core-5771
http://tracker.firebirdsql.org/browse/core-6348
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_shutdown_during_applying_segments_leads_to_crash.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_trace_any_attachment.py
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7139
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7854

=== end of list ===