01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (16 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
10. All tests: outcomes for previous 30 runs (2459 rows)
11. All tests: durations for previous 30 runs (4743 rows)
12. Skipped: tests which was intentionally excluded from execution (77 rows)

Generated 26.03.2024 07:47
Tested: FB50.   Build: 5.0.1.1372;   SS: 26.03.24 05:57:49 - 26.03.24 06:46:11;   CS: 26.03.24 06:47:21 - 26.03.24 07:46:24;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.1; Firebird.Qa: 0.19.1

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 5.0.1.1372
2024-03-26
5.0.1.1371
2024-03-24
5.0.1.1370
2024-03-22
5.0.1.1369
2024-03-17
5.0.1.1368
2024-03-16
5.0.1.1363
2024-03-15
5.0.1.1360
2024-03-14
5.0.1.1358
2024-03-13
5.0.1.1348
2024-03-09
5.0.1.1347
2024-03-05
5.0.1.1344
2024-02-21
5.0.1.1342
2024-02-19
5.0.1.1340
2024-02-18
5.0.1.1339
2024-02-13
5.0.1.1338
2024-02-12
5.0.1.1336
2024-02-11
5.0.1.1335
2024-02-10
5.0.1.1332
2024-02-07
5.0.1.1331
2024-02-04
5.0.1.1330
2024-02-03
5.0.1.1329
2024-02-02
5.0.1.1328
2024-01-31
5.0.1.1327
2024-01-30
5.0.1.1325
2024-01-26
5.0.1.1324
2024-01-25
5.0.1.1322
2024-01-24
5.0.1.1316
2024-01-17
5.0.0.1305
2023-12-31
5.0.0.1304
2023-12-19
5.0.0.1303
2023-12-15
Test TITLE
1 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Suboptimal join plan if there are selective non-indexed predicates involved
2 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Suboptimal join plan if there are selective non-indexed predicates involved
3 CS P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
4 CS P P P P P P P P P P P P P P P P P P P P P P P P P F P P P P
Alter computed field type does not work
5 SS P P P P P P P P P P P P P P P P P P P P P P P P P F P P P P
Alter computed field type does not work
6 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
7 CS F F F F F F F F F P P P P P P P P P P P P P P P P P P P P P
Slow changes on domain
8 SS F F F F F F F F F P P P P P P P P P P P P P P P P P P P P P
Slow changes on domain
9 SS P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
10 SS P P P P P P P P P P P P P P P P P P P P P P F P P P P P P P
The size of the database with big records becomes bigger after backup/restore
11 SS P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P
garbage collection in indexes and blobs is not performed in VIO_backout
12 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
INNER JOIN join order LIKE and STARTING WITH
13 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
INNER JOIN join order LIKE and STARTING WITH
14 CS F F F F P P X X X X X X X X X X X X X X X X X X X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
15 SS F F F F P P X X X X X X X X X X X X X X X X X X X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
16 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P
External Connections Pool, functionality test 01

Elapsed time, milliseconds:

NN Test name mode median_ms 5.0.1.1372
2024-03-26
5.0.1.1371
2024-03-24
5.0.1.1370
2024-03-22
5.0.1.1369
2024-03-17
5.0.1.1368
2024-03-16
5.0.1.1363
2024-03-15
5.0.1.1360
2024-03-14
5.0.1.1358
2024-03-13
5.0.1.1348
2024-03-09
5.0.1.1347
2024-03-05
5.0.1.1344
2024-02-21
5.0.1.1342
2024-02-19
5.0.1.1340
2024-02-18
5.0.1.1339
2024-02-13
5.0.1.1338
2024-02-12
5.0.1.1336
2024-02-11
5.0.1.1335
2024-02-10
5.0.1.1332
2024-02-07
5.0.1.1331
2024-02-04
5.0.1.1330
2024-02-03
5.0.1.1329
2024-02-02
5.0.1.1328
2024-01-31
5.0.1.1327
2024-01-30
5.0.1.1325
2024-01-26
5.0.1.1324
2024-01-25
5.0.1.1322
2024-01-24
5.0.1.1316
2024-01-17
5.0.0.1305
2023-12-31
5.0.0.1304
2023-12-19
5.0.0.1303
2023-12-15
Test TITLE
1 CS 1627 1385 1413 1515 1414 1442 1400 1584 1412 1392 1292 1664 1664 1803 1793 1837 1954 1766 1599 1794 1804 1817 1834 1647 1672 1608 1659 1658 1371 1297 1345
Suboptimal join plan if there are selective non-indexed predicates involved
2 SS 1082 938 900 883 969 1007 998 953 1322 883 891 1037 1068 1091 1289 1143 1174 1239 1239 1094 1259 1206 1199 971 1254 1093 1152 1181 971 1073 978
Suboptimal join plan if there are selective non-indexed predicates involved
3 CS 18790 18447 18663 18527 18592 18398 18543 18585 18641 18693 18797 19432 18748 18816 20110 19141 19931 19035 18784 19129 19035 18994 19031 19168 18988 19013 18637 22294 18599 18445 18740
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
4 CS 870 775 785 733 773 772 815 754 766 716 747 1019 901 878 1044 985 923 1013 940 841 928 919 1033 886 899 929 835 1084 822 863 843
Alter computed field type does not work
5 SS 586 648 465 449 629 411 477 675 465 475 476 529 593 637 597 611 523 597 660 501 643 567 586 587 575 583 587 956 556 586 623
Alter computed field type does not work
6 CS 6052 5895 5900 5895 5959 5925 6042 5918 5961 5878 5885 6250 6062 6184 6171 6266 6160 6198 6100 6152 6145 6201 6143 6144 6154 6111 6034 1831 5958 6003 6000
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
7 CS 7930 8867 8929 9084 10507 10666 10876 10549 11289 10762 6620 7092 7497 7490 7444 8598 8449 8904 7065 7429 7883 8423 8455 7667 7786 7542 7977 6485 7193 7239 6960
Slow changes on domain
8 SS 7612 8631 8420 8441 10370 10252 10207 14003 10115 13824 6285 6653 6798 7267 7644 7580 7945 7830 7580 6729 7882 7504 7321 7180 7127 6833 7823 8049 6671 6501 6455
Slow changes on domain
9 SS 4592 3637 3721 3957 3759 4036 3976 3867 3756 3919 3820 4483 4723 4427 5697 4585 5408 5833 5726 4828 5701 5336 5941 4599 4838 4747 5083 5335 4439 4304 4616
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
10 SS 1224 1018 1082 1189 1212 1134 1231 1084 1286 1030 1053 1127 1324 1208 1262 1279 1193 1377 1367 1171 1308 1307 1270 1481 1146 1243 1228 1626 1264 1220 1170
The size of the database with big records becomes bigger after backup/restore
11 SS 509 415 383 434 403 415 430 428 403 395 383 548 571 584 556 495 509 535 558 464 566 536 521 494 458 561 515 715 574 509 518
garbage collection in indexes and blobs is not performed in VIO_backout
12 CS 733 674 666 663 734 733 634 683 714 637 599 667 722 755 869 929 793 1018 794 815 853 789 811 1113 713 808 741 953 669 662 714
INNER JOIN join order LIKE and STARTING WITH
13 SS 507 420 377 397 481 456 456 462 476 412 396 622 559 548 561 508 516 541 551 473 504 687 547 562 496 484 571 730 506 532 581
INNER JOIN join order LIKE and STARTING WITH
14 CS 69198 69234 70064 69162 69242 13777 13727 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
15 SS 68459 68463 68456 69609 68495 13166 13247 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
16 CS 29544 28998 29051 29130 29169 29030 29084 29020 29231 28961 28945 29587 29647 29652 30032 29861 29828 29987 29467 29623 30082 29864 29875 29595 29501 29663 29601 31784 29434 29145 28962
External Connections Pool, functionality test 01

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2078
http://tracker.firebirdsql.org/browse/core-5087
http://tracker.firebirdsql.org/browse/core-5093
http://tracker.firebirdsql.org/browse/core-5210
http://tracker.firebirdsql.org/browse/core-5602
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_inner_join_05.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7627
https://github.com/FirebirdSQL/firebird/issues/7747

=== end of list ===