01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (1 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (8 rows)
06. Has fails: tests with at least one fail for previous 30 runs (162 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (7 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (1 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (5 rows)
10. All tests: outcomes for previous 30 runs (2470 rows)
11. All tests: durations for previous 30 runs (4737 rows)
[CURRENT] 12. Skipped: tests which was intentionally excluded from execution (86 rows)

Generated 15.05.2024 09:00
Tested: HQ40.   Build: 4.0.5.3097;   SS: 13.05.24 19:45:44 - 13.05.24 20:33:55;   CS: 15.05.24 07:51:14 - 15.05.24 08:57:50;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.9, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests that were SKIPPED at least once for last 30 runs:

Jump to LIST of unique test names from this report

NN Test name mode 4.0.5.3097
2024-05-15
4.0.5.3091
2024-05-09
4.0.5.3089
2024-04-29
4.0.5.3083
2024-04-20
4.0.5.3052
2024-04-04
4.0.5.3049
2024-01-26
4.0.5.3034
2023-12-29
4.0.4.3013
2023-11-28
4.0.4.2991
2023-11-09
4.0.4.2977
2023-09-20
4.0.3.2955
2023-08-09
4.0.3.2943
2023-06-22
4.0.3.2936
2023-05-28
4.0.3.2931
2023-05-02
4.0.3.2930
2023-04-21
4.0.3.2908
2023-04-18
4.0.3.2900
2023-03-14
4.0.3.2891
2023-02-08
4.0.3.2885
2023-01-18
4.0.3.2884
2023-01-06
4.0.3.2882
2023-01-06
4.0.3.2861
2023-01-18
X X X X X X X X
Test TITLE
1 ALL P P P P P P S S S S S S S S S S S S S S S S X X X X X X X X
MERGE statement loses parameters in WHEN (NOT) MATCHED clause that will never be matched, crashes server in some situations
2 CS P P P P P P P P P P P S S S S S F F F F F F X X X X X X X X
Error "BLOB is not found" while replication converts INSERT into UPDATE for a conflicting record
3 CS P P P P P P P P P P P S S S S S F F F F F F X X X X X X X X
Problem with replication of BLOB segments longer than 32KB
4 CS P P P P P P P P P P P S S S S S P P P P P F X X X X X X X X
Replica DB must not fire DB-level triggers but their activity on master must be eventually seen in replica
5 CS P P P P P P P P P P P S S S S S F F F F F F X X X X X X X X
DDL-triggers must fire only on master DB
6 CS P P P P P P P P P P P S X X X X X X X X X X X X X X X X X X
Disallow replication of RDB$BACKUP_HISTORY
7 CS P P P P P P P P P P P S S S S P P P P P P P X X X X X X X X
Conflicting INSERT propagated into a read-write replica may cause duplicate records to appear
8 CS P P P P P P P P P P P S S S S P P P P P P P X X X X X X X X
Failed DDL commands can be replicated
9 CS P P P P P P P P P P P S S S S P P P P P P P X X X X X X X X
Generator values may not replicate after commit
10 CS P P P P P P P P P P F S S S X X X X X X X X X X X X X X X X
Applying full DDL from OLTP-EMUL test on master with further check replica
11 CS P P P P P P P P P P P S S S S S F F F F F P X X X X X X X X
Permission error with replication
12 CS P P P P P P P P P P P S S S S F F F F F F F X X X X X X X X
Crash or hang while shutting down the replica database if segments are being applied
13 CS P P P P P P P P P P P S S S S P P P P P P P X X X X X X X X
Some updates can crash Firebird server on replica side
14 CS P P P P P P P P P P P S S S S P P P P P P P X X X X X X X X
Replication gets stuck due to "Blob xxx.xx is not found for table xxx" error
15 ALL P P P P P P P P P S S S S S S S P P P P P P X X X X X X X X
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-01.
16 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
Containing not working correctly
17 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
French insensitive collation FR_FR_CI_AI
18 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
Non-SYSDBA user can change FW mode of database
19 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
Problem with column names with Accents and triggers
20 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
Blob transliteration may not happen inside the union
21 SS S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
MON$IO_STATS doesn't report page writes performed asynchronously (at the AST level)
22 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
At least 5 seconds delay on disconnect could happen if disconnect happens close after Event Manager initialization
23 ALL S S S S S S S S S S S P P P P P P P P P P P X X X X X X X X
ISQL plan output is unexpectedly truncated after a query is simplified to become shorter
24 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
25 CS S S S S S S S S S S S S S S S S F F P P P P X X X X X X X X
Expression index may become inconsistent if CREATE INDEX was interrupted after b-tree creation but before commiting
26 SS S S S S S S S S S S S S S S S S P P F P P P X X X X X X X X
Expression index may become inconsistent if CREATE INDEX was interrupted after b-tree creation but before commiting
27 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
Inconsistent output when retrieving the server log via Services API
28 SS S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
Minor performance optimization - avoid additional database attachment from security objects mapping code
29 CS S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
Read-only transactions in SuperServer could avoid immediate write of Header and TIP pages after change
30 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
AV in fbclient when reading blob stored in incompatible encoding
31 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
isc_vax_integer() and isc_portable_integer() work wrongly with short negative numbers
32 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
Sometime it is impossible to cancel/kill connection executing external query
33 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
fbsvcmgr action_repair rpr_list_limbo_trans does not show list of transactions in LIMBO state
34 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
fbsvcmgr can not decode information buffer returned by gfix list limbo service
35 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
gfix cannot set big value for buffers
36 ALL S S S S S X X X X X X X X X X X X X X X X X X X X X X X X X
Hang in a case of error when sweep thread is attaching to database
37 SS S S S S S S S X X X X X X X X X X X X X X X X X X X X X X X
Some default values is set incorrectly for SC/CS architectures
38 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$DATABASE content
39 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$CHARACTER_SETS
40 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$COLLATIONS
41 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$EXCEPTIONS
42 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$DEPENDENCIES
43 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$FIELD_DIMENSIONS
44 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$FIELDS
45 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$FILES
46 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$FILTERS
47 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$FORMATS
48 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$FUNCTION_ARGUMENTS
49 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$FUNCTIONS content
50 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$GENERATORS
51 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$CHECK_CONSTRAINTS
52 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$INDEX_SEGMENTS content
53 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$INDICES content
54 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$LOG_FILES content
55 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$DATABASE content
56 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$PROCEDURE_PARAMETERS content
57 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$PROCEDURES content
58 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$REF_CONSTRAINTS content
59 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$DATABASE content
60 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$RELATIONS content
61 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$RELATION_FIELDS content
62 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$ROLES content
63 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$SECURITY_CLASSES content
64 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$TRANSACTIONS content
65 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$TRIGGER_MESSAGES content
66 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$TRIGGERS content
67 ALL S X X X X X X X X X X X X X X X X X X P P X X X X X X X X X
New DB - RDB$TYPES content
68 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$USER_PRIVILEGES content
69 ALL S S S S S S S S S S S S S S S S S S S P P S X X X X X X X X
New DB - RDB$VIEW_RELATIONS content
70 ALL S S S S S S S P P P P P P P P P P P P P P P X X X X X X X X
Create database: with PAGE_SIZE=1024: check actual size of page in the created database.
71 ALL S S S S S S S P P P P P P P P P P P P P P P X X X X X X X X
Create database: with PAGE_SIZE=2048: check actual size of page in the created database.
72 ALL S S S S S S S P P P P P P P P P P P P P P P X X X X X X X X
Create database: with PAGE_SIZE=4096: check actual size of page in the created database.
73 ALL S S S S S S S P P P P P P P P P P P P P P P X X X X X X X X
Create database: with PAGE_SIZE=8192: check actual size of page in the created database.
74 ALL S S S S S S S P P P P P P P P P P P P P P P X X X X X X X X
Create database: with PAGE_SIZE=16384: check actual size of page in the created database.
75 ALL S S S S S S S P P P P P P P P P P P P P P P X X X X X X X X
Create database: with PAGE_SIZE=32768: check actual size of page in the created database.
76 ALL S S S S S S S S S P P P P P P P P P P P P P X X X X X X X X
CREATE DOMAIN - BLOB SUB_TYPE CHARACTER SET
77 ALL S S S S S S S S S P P P P P P P P P P P P P X X X X X X X X
CREATE DOMAIN - DEFAULT CURRENT_USER
78 ALL S S S S S S S S S P P P P P P P P P P P P P X X X X X X X X
CREATE DOMAIN - COLLATE
79 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
LPAD function, including non-ascii characters
80 ALL S S S S S S S S S S S S S S S S S S S S S S X X X X X X X X
RPAD function, including non-ascii characters
81 ALL S S S S S S S S S P P P P P P P P P P P P P X X X X X X X X
COLLATE IN STORED PROCEDURE
82 ALL S S S S S S S S S P P P P P P P P P P P P P X X X X X X X X
CREATE TABLE - column properties
83 ALL S S S S S S S S S P P P P P P P P P P P P P X X X X X X X X
CREATE TABLE - charset + colations + domain
84 CS S S S S S S S S S S S S S S S S S F F F F F X X X X X X X X
Verify ability to make REMOTE connect to security.db
85 SS S S S S S S S S S S S S S S S S S F F F F F X X X X X X X X
Verify ability to make REMOTE connect to security.db
86 ALL S S S S S S S S S P P P P P P P P P P P P P X X X X X X X X
CREATE VIEW as SELECT ....

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1366
http://tracker.firebirdsql.org/browse/core-1972
http://tracker.firebirdsql.org/browse/core-2227
http://tracker.firebirdsql.org/browse/core-3489
http://tracker.firebirdsql.org/browse/core-3625
http://tracker.firebirdsql.org/browse/core-5034
http://tracker.firebirdsql.org/browse/core-5061
http://tracker.firebirdsql.org/browse/core-5229
http://tracker.firebirdsql.org/browse/core-5275
http://tracker.firebirdsql.org/browse/core-5418
http://tracker.firebirdsql.org/browse/core-5433
http://tracker.firebirdsql.org/browse/core-5434
http://tracker.firebirdsql.org/browse/core-5464
http://tracker.firebirdsql.org/browse/core-5675
http://tracker.firebirdsql.org/browse/core-5685
http://tracker.firebirdsql.org/browse/core-6141
http://tracker.firebirdsql.org/browse/core-6280
http://tracker.firebirdsql.org/browse/core-6309
http://tracker.firebirdsql.org/browse/core-6437
http://tracker.firebirdsql.org/browse/core-857
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_04.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_05.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_06.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_07.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_08.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_09.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_11.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_12.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_14.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_15.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_16.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_17.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_18.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_20.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_21.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_22.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_23.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_24.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_25.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_26.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_27.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_28.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_29.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_30.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_31.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/db/test_32.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_04.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_05.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_06.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_07.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_12.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_30.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_35.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_39.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_lpad_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_rpad_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/procedure/create/test_15.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_blob_not_found_in_rw_replica_if_target_row_exists.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_blob_segments_longer_32kb_are_not_replicated.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_dblevel_triggers_must_not_fire_on_replica.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_ddl_triggers_must_not_fire_on_replica.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_disallow_rdb_backup_history_replication.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_duplicates_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_failed_ddl_commands_can_be_replicated.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_generator_could_not_be_transferred_to_replica.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_oltp_emul_ddl.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_permission_error_on_ddl_issued_by_non_sysdba.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_shutdown_during_applying_segments_leads_to_crash.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_some_updates_crash_server_on_replica_side.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_updating_blob_with_empty_string_stops_replication.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/create/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/create/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_remote_access_to_security_db.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/transactions/test_read_consist_sttm_restart_on_update_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/view/create/test_10.py
https://github.com/FirebirdSQL/firebird/issues/7917
https://github.com/FirebirdSQL/firebird/issues/7927

=== end of list ===