01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (1 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (8 rows)
06. Has fails: tests with at least one fail for previous 30 runs (162 rows)
[CURRENT] 07. Has runtime errors: tests with at least one runtime error for previous 30 runs (7 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (1 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (5 rows)
10. All tests: outcomes for previous 30 runs (2470 rows)
11. All tests: durations for previous 30 runs (4737 rows)
12. Skipped: tests which was intentionally excluded from execution (86 rows)

Generated 15.05.2024 09:00
Tested: HQ40.   Build: 4.0.5.3097;   SS: 13.05.24 19:45:44 - 13.05.24 20:33:55;   CS: 15.05.24 07:51:14 - 15.05.24 08:57:50;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.9, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Test with at least one result = "ERROR" for last 30 runs:

NN Test name mode 4.0.5.3097
2024-05-15
4.0.5.3091
2024-05-09
4.0.5.3089
2024-04-29
4.0.5.3083
2024-04-20
4.0.5.3052
2024-04-04
4.0.5.3049
2024-01-26
4.0.5.3034
2023-12-29
4.0.4.3013
2023-11-28
4.0.4.2991
2023-11-09
4.0.4.2977
2023-09-20
4.0.3.2955
2023-08-09
4.0.3.2943
2023-06-22
4.0.3.2936
2023-05-28
4.0.3.2931
2023-05-02
4.0.3.2930
2023-04-21
4.0.3.2908
2023-04-18
4.0.3.2900
2023-03-14
4.0.3.2891
2023-02-08
4.0.3.2885
2023-01-18
4.0.3.2884
2023-01-06
4.0.3.2882
2023-01-06
4.0.3.2861
2023-01-18
X X X X X X X X
Test TITLE
1 SS P P P P P P P P P P P P P P P E P P P P P P X X X X X X X X
Full shutdown mode doesn't work on Classic if there are other connections to the database
2 CS P P P P P P P P P P P P E P P E E P P P P P X X X X X X X X
Unable to specify new 32k page size
3 SS P P P P P P P P P E P P P P P P P X X X X X X X X X X X X X
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
4 SS P P P P P P P E X X X X X X X X X X X X X X X X X X X X X X
Crash potentially caused by BETWEEN Operator
5 SS P P P P P P P P P P P P P E P P P P P P P P X X X X X X X X
UPDATE OR INSERT
6 SS P P P P P P P P P P P P P P E P P P P P P P X X X X X X X X
CREATE DOMAIN - TIMESTAMP
7 SS P P P P P P P P P P E X X X X X X X X X X X X X X X X X X X
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode median_ms 4.0.5.3097
2024-05-15
4.0.5.3091
2024-05-09
4.0.5.3089
2024-04-29
4.0.5.3083
2024-04-20
4.0.5.3052
2024-04-04
4.0.5.3049
2024-01-26
4.0.5.3034
2023-12-29
4.0.4.3013
2023-11-28
4.0.4.2991
2023-11-09
4.0.4.2977
2023-09-20
4.0.3.2955
2023-08-09
4.0.3.2943
2023-06-22
4.0.3.2936
2023-05-28
4.0.3.2931
2023-05-02
4.0.3.2930
2023-04-21
4.0.3.2908
2023-04-18
4.0.3.2900
2023-03-14
4.0.3.2891
2023-02-08
4.0.3.2885
2023-01-18
4.0.3.2884
2023-01-06
4.0.3.2882
2023-01-06
4.0.3.2861
2023-01-18
X X X X X X X X
Test TITLE
1 SS 1268 1293 1233 1263 1214 1191 1262 1300 1321 1318 1249 1298 1247 1273 1244 408 50 1251 1386 1334 1337 1344 1346 0 0 0 0 0 0 0 0
Full shutdown mode doesn't work on Classic if there are other connections to the database
2 CS 57937 58233 56557 58456 54585 59826 54303 59134 53037 55134 59312 58130 57745 93 55190 58302 100 108 55358 60576 65310 65071 60960 0 0 0 0 0 0 0 0
Unable to specify new 32k page size
3 SS 4049 4345 4547 5472 5217 4537 5645 6828 3432 2476 147 3392 3325 3998 4049 2194 4199 1994 0 0 0 0 0 0 0 0 0 0 0 0 0
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
4 SS 277 255 266 274 252 280 350 382 442 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash potentially caused by BETWEEN Operator
5 SS 415 400 380 388 374 376 446 440 418 413 551 454 409 396 63 428 391 367 538 484 507 503 561 0 0 0 0 0 0 0 0
UPDATE OR INSERT
6 SS 288 246 259 264 257 275 306 352 304 276 371 293 272 261 283 92 299 259 445 381 390 379 370 0 0 0 0 0 0 0 0
CREATE DOMAIN - TIMESTAMP
7 SS 164 164 142 158 159 137 196 219 219 207 188 4 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1249
http://tracker.firebirdsql.org/browse/core-6316
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/dml/update_or_insert/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_09.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7860

=== end of list ===