01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (6 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (8 rows)
06. Has fails: tests with at least one fail for previous 30 runs (155 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (5 rows)
10. All tests: outcomes for previous 30 runs (2479 rows)
11. All tests: durations for previous 30 runs (4788 rows)
[CURRENT] 12. Skipped: tests which was intentionally excluded from execution (70 rows)

Generated 16.05.2024 13:01
Tested: HQ40.   Build: 4.0.5.3097;   SS: 16.05.24 11:18:18 - 16.05.24 12:02:15;   CS: 16.05.24 12:03:39 - 16.05.24 12:59:33;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests that were SKIPPED at least once for last 30 runs:

Jump to LIST of unique test names from this report

NN Test name mode 4.0.5.3097
2024-05-16
4.0.5.3091
2024-05-08
4.0.5.3089
2024-04-27
4.0.5.3083
2024-04-20
4.0.5.3052
2024-04-06
4.0.5.3049
2024-01-26
4.0.5.3034
2023-12-30
4.0.4.3013
2023-11-30
4.0.4.2991
2023-11-09
4.0.4.2977
2023-09-15
4.0.3.2955
2023-08-11
4.0.3.2943
2023-06-22
4.0.3.2936
2023-05-25
4.0.3.2931
2023-04-30
4.0.3.2920
2023-04-21
4.0.3.2913
2023-04-02
4.0.3.2908
2023-03-22
4.0.3.2900
2023-03-14
4.0.3.2891
2023-02-09
4.0.3.2885
2023-01-27
X X X X X X X X X X
Test TITLE
1 ALL P P P P P P P P S S S S S S S S S S S S X X X X X X X X X X
INPUT file not properly closed
2 ALL P P P P P P P P S S S S S S S S S S S S X X X X X X X X X X
File description on Firebird executables should be specific
3 ALL P P P P P P P S S S S S S S S S S S S S X X X X X X X X X X
MERGE statement loses parameters in WHEN (NOT) MATCHED clause that will never be matched, crashes server in some situations
4 ALL P P P P P P P P P P P P P P S S S S S S X X X X X X X X X X
Applying full DDL from OLTP-EMUL test on master with further check replica
5 ALL P P P P P P P P P S S S S S S S S P P P X X X X X X X X X X
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-01.
6 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
Non-SYSDBA user can change FW mode of database
7 SS S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
MON$IO_STATS doesn't report page writes performed asynchronously (at the AST level)
8 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
Can't select from table with ICU column when database (.FDB) is created on LINUX with icu 4.2.1 and then copied to WINDOWS
9 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
At least 5 seconds delay on disconnect could happen if disconnect happens close after Event Manager initialization
10 ALL S S S S S S S S S S S P P P P P P P P P X X X X X X X X X X
ISQL plan output is unexpectedly truncated after a query is simplified to become shorter
11 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
12 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
Inconsistent output when retrieving the server log via Services API
13 SS S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
Minor performance optimization - avoid additional database attachment from security objects mapping code
14 CS S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
Read-only transactions in SuperServer could avoid immediate write of Header and TIP pages after change
15 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
isc_vax_integer() and isc_portable_integer() work wrongly with short negative numbers
16 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
fbsvcmgr action_repair rpr_list_limbo_trans does not show list of transactions in LIMBO state
17 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
fbsvcmgr can not decode information buffer returned by gfix list limbo service
18 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
Connection to server may hang when working with encrypted databases over non-TCP protocol
19 ALL S X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
READ COMMITTED READ CONSISTENCY mode is broken in Classic / SuperClassic on Linux (the newly created users are not visible to execute statement)
20 ALL S S S S S S S X X X X X X X X X X X X X X X X X X X X X X X
Hang in a case of error when sweep thread is attaching to database
21 SS S S S S S S S X X X X X X X X X X X X X X X X X X X X X X X
Some default values is set incorrectly for SC/CS architectures
22 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$DATABASE content
23 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$CHARACTER_SETS
24 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$COLLATIONS
25 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$EXCEPTIONS
26 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$DEPENDENCIES
27 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$FIELD_DIMENSIONS
28 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$FIELDS
29 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$FILES
30 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$FILTERS
31 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$FORMATS
32 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$FUNCTION_ARGUMENTS
33 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$FUNCTIONS content
34 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$GENERATORS
35 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$CHECK_CONSTRAINTS
36 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$INDEX_SEGMENTS content
37 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$INDICES content
38 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$LOG_FILES content
39 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$DATABASE content
40 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$PROCEDURE_PARAMETERS content
41 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$PROCEDURES content
42 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$REF_CONSTRAINTS content
43 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$DATABASE content
44 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$RELATIONS content
45 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$RELATION_FIELDS content
46 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$ROLES content
47 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$SECURITY_CLASSES content
48 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$TRANSACTIONS content
49 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$TRIGGER_MESSAGES content
50 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$TRIGGERS content
51 ALL S X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
New DB - RDB$TYPES content
52 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$USER_PRIVILEGES content
53 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
New DB - RDB$VIEW_RELATIONS content
54 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
Check list of files in the current Firebird snapshot
55 ALL S S S S S S S P P P P P P P P P P P P P X X X X X X X X X X
Create database: with PAGE_SIZE=1024: check actual size of page in the created database.
56 ALL S S S S S S S P P P P P P P P P P P P P X X X X X X X X X X
Create database: with PAGE_SIZE=2048: check actual size of page in the created database.
57 ALL S S S S S S S P P P P P P P P P P P P P X X X X X X X X X X
Create database: with PAGE_SIZE=4096: check actual size of page in the created database.
58 ALL S S S S S S S P P P P P P P P P P P P P X X X X X X X X X X
Create database: with PAGE_SIZE=8192: check actual size of page in the created database.
59 ALL S S S S S S S P P P P P P P P P P P P P X X X X X X X X X X
Create database: with PAGE_SIZE=16384: check actual size of page in the created database.
60 ALL S S S S S S S P P P P P P P P P P P P P X X X X X X X X X X
Create database: with PAGE_SIZE=32768: check actual size of page in the created database.
61 ALL S S S S S S S S S P P P P P P P P P P P X X X X X X X X X X
CREATE DOMAIN - BLOB SUB_TYPE CHARACTER SET
62 ALL S S S S S S S S S P P P P P P P P P P P X X X X X X X X X X
CREATE DOMAIN - DEFAULT CURRENT_USER
63 ALL S S S S S S S S S P P P P P P P P P P P X X X X X X X X X X
CREATE DOMAIN - COLLATE
64 ALL S S S S S S S S S P P P P P P P P P P P X X X X X X X X X X
COLLATE IN STORED PROCEDURE
65 ALL S S S S S S S S S P P P P P P P P P P P X X X X X X X X X X
CREATE TABLE - column properties
66 ALL S S S S S S S S S P P P P P P P P P P P X X X X X X X X X X
CREATE TABLE - charset + colations + domain
67 ALL S S S S S S S S S S S S S S S S S S S S X X X X X X X X X X
Check ability to create database with total length of path and file name about maximal allowed limit in Windows
68 CS S S S S S S S S S S S S S S S S S S F F X X X X X X X X X X
Verify ability to make REMOTE connect to security.db
69 SS S S S S S S S S S S S S S S S S S S F F X X X X X X X X X X
Verify ability to make REMOTE connect to security.db
70 ALL S S S S S S S S S P P P P P P P P P P P X X X X X X X X X X
CREATE VIEW as SELECT ....

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1972
http://tracker.firebirdsql.org/browse/core-3625
http://tracker.firebirdsql.org/browse/core-4571
http://tracker.firebirdsql.org/browse/core-4578
http://tracker.firebirdsql.org/browse/core-5034
http://tracker.firebirdsql.org/browse/core-5061
http://tracker.firebirdsql.org/browse/core-5229
http://tracker.firebirdsql.org/browse/core-5418
http://tracker.firebirdsql.org/browse/core-5433
http://tracker.firebirdsql.org/browse/core-5434
http://tracker.firebirdsql.org/browse/core-5675
http://tracker.firebirdsql.org/browse/core-5691
http://tracker.firebirdsql.org/browse/core-6141
http://tracker.firebirdsql.org/browse/core-6280
http://tracker.firebirdsql.org/browse/core-6309
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_04.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_05.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_06.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_07.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_08.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_09.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_11.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_12.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_14.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_15.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_16.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_17.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_18.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_20.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_21.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_22.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_23.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_24.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_25.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_26.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_27.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_28.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_29.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_30.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_31.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_32.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/test_snapshot_files_check_list.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_04.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_05.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_06.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_07.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_12.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_30.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_35.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_39.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/procedure/create/test_15.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_oltp_emul_ddl.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/create/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/create/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_max_path_length.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_remote_access_to_security_db.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/transactions/test_read_consist_sttm_restart_on_update_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/view/create/test_10.py
https://github.com/FirebirdSQL/firebird/issues/5995
https://github.com/FirebirdSQL/firebird/issues/7255
https://github.com/FirebirdSQL/firebird/issues/7917
https://github.com/FirebirdSQL/firebird/issues/7927

=== end of list ===