01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (3 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (39 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
10. All tests: outcomes for previous 30 runs (2535 rows)
11. All tests: durations for previous 30 runs (4886 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated 15.05.2024 05:39
Tested: FB60.   Build: 6.0.0.351;   SS: 15.05.24 03:07:24 - 15.05.24 04:08:00;   CS: 15.05.24 04:08:58 - 15.05.24 05:37:00;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Test with at least one result = "FAIL" for last 30 runs:

Jump to LIST of unique test names from this report

NN Test name mode 6.0.0.351
2024-05-15		 6.0.0.348
2024-05-14		 6.0.0.346
2024-05-08		 6.0.0.345
2024-05-07		 6.0.0.344
2024-05-03		 6.0.0.342
2024-04-30		 6.0.0.339
2024-04-29		 6.0.0.336
2024-04-27		 6.0.0.333
2024-04-24		 6.0.0.328
2024-04-23		 6.0.0.327
2024-04-21		 6.0.0.325
2024-04-19		 6.0.0.324
2024-04-18		 6.0.0.321
2024-04-17		 6.0.0.315
2024-04-16		 6.0.0.313
2024-04-15		 6.0.0.312
2024-04-10		 6.0.0.310
2024-04-04		 6.0.0.308
2024-04-03		 6.0.0.303
2024-04-02		 6.0.0.301
2024-03-26		 6.0.0.299
2024-03-23		 6.0.0.295
2024-03-22		 6.0.0.294
2024-03-21		 6.0.0.293
2024-03-19		 6.0.0.292
2024-03-16		 6.0.0.291
2024-03-15		 6.0.0.288
2024-03-14		 6.0.0.287
2024-03-13		 6.0.0.286
2024-03-12
Test TITLE
1
bugs core 0165 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
Query using VIEW with UNION causes crash
2
bugs core 0165 
 tracker
 SS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
Query using VIEW with UNION causes crash
3
bugs core 0733 
 tracker
 CS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Compress Data over the Network
4
bugs core 0733 
 tracker
 SS F F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Compress Data over the Network
5
bugs core 4492 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
OR/IN predicates for RDB$DBKEY lead to NATURAL plan
6
bugs core 4492 
 tracker
 SS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
OR/IN predicates for RDB$DBKEY lead to NATURAL plan
7
bugs core 5602 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P F F F F F F F F
Slow changes on domain
8
bugs core 5602 
 tracker
 SS P P P P P P P P P P P P P P P P P P P P P P F F F F F F F F
Slow changes on domain
9
bugs core 5854 
 tracker
 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Very poor "similar to" performance
10
bugs core 5876 
 tracker
 CS P P P P P P P P P P P P P P P P P P P F F F F F F F F F F F
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
11
bugs core 5876 
 tracker
 SS P P P P P P P P P P P P P P P P P P P F F F F F F F F F F F
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
12
bugs core 5931 
 tracker
 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
SIMILAR TO does not return result when invalid pattern is used (with two adjacent special characters that should be escaped but aren't)
13
bugs core 6142 
 tracker
 CS P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P
Error "connection lost to database" could happen when application creates few local attachments (using XNET) simultaneously
14
bugs core 6278 
 tracker
 CS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
Efficient table scans for DBKEY-based range conditions
15
bugs core 6278 
 tracker
 SS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
Efficient table scans for DBKEY-based range conditions
16
bugs gh 0310 
 tracker
 CS P P P P P P P P P P P P P P P P P P F F F P P P P P P P P P
System table with keywords
17
bugs gh 0310 
 tracker
 SS P P P P P P P P P P P P P P P P P P F F F P P P P P P P P P
System table with keywords
18
bugs gh 6802 
 tracker
 CS P P P P P P F P P P P P P P P P P P P P P P P P P F P P P P
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
19
bugs gh 6802 
 tracker
 SS P P P P P P P P P P P P P P P P P P P P P P P P P F P P P P
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
20
bugs gh 6875 
 tracker
 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
21
bugs gh 7086 
 tracker
 CS P P P P P P P P P P P P P P P P P F F F F F F F F F F F F F
PSQL and SQL profiler
22
bugs gh 7086 
 tracker
 SS P P P P P P P P P P P P P P P P P F F F F F F F F F F F F F
PSQL and SQL profiler
23
bugs gh 7553 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
Firebird 5 profiler error with subselects
24
bugs gh 7553 
 tracker
 SS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
Firebird 5 profiler error with subselects
25
bugs gh 7804 
 tracker
 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
The partial index is not involved when filtering conditions through OR.
26
bugs gh 7804 
 tracker
 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
The partial index is not involved when filtering conditions through OR.
27
bugs gh 8066 
 tracker
 CS P P F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
28
bugs gh 8066 
 tracker
 SS P P F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
29
functional blob rdb blob util basic 
 CS P P P P P P P P P P P P P P P P P P P F F F F F F F F F F F
Basic test of RDB$BLOB_UTIL package functionality
30
functional blob rdb blob util basic 
 SS P P P P P P P P P P P P P P P P P P P F F F F F F F F F F F
Basic test of RDB$BLOB_UTIL package functionality
31
functional domain create 41 
 CS P P P P P P P P P P P P F F F F P P P P P P P P P P P P P P
CREATE DOMAIN - create two domain with same name
32
functional domain create 41 
 SS P P P P P P P P P P P P F F F F P P P P P P P P P P P P P P
CREATE DOMAIN - create two domain with same name
33
functional replication bugcheck in rw replica after conflicting insert 
 CS P P P P P P P P P P P P P P P P P P F F F F F F F P P X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
34
functional replication bugcheck in rw replica after conflicting insert 
 SS P P P P P P P P P P P P P P P P P P F F F F F F F P P X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
35
functional session ext conn pool 01 
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P
External Connections Pool, functionality test 01
36
functional tabloid dbp 1940 20040130 1740 
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
Common SQL. Check correctness of the results
37
functional tabloid dbp 1940 20040130 1740 
 SS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
Common SQL. Check correctness of the results
38
functional tabloid dbp 2146 distinct not in 
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
Common SQL. Check correctness of the results
39
functional tabloid dbp 2146 distinct not in 
 SS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
Common SQL. Check correctness of the results

Elapsed time, milliseconds:

NN Test name mode median_ms 6.0.0.351
2024-05-15		 6.0.0.348
2024-05-14		 6.0.0.346
2024-05-08		 6.0.0.345
2024-05-07		 6.0.0.344
2024-05-03		 6.0.0.342
2024-04-30		 6.0.0.339
2024-04-29		 6.0.0.336
2024-04-27		 6.0.0.333
2024-04-24		 6.0.0.328
2024-04-23		 6.0.0.327
2024-04-21		 6.0.0.325
2024-04-19		 6.0.0.324
2024-04-18		 6.0.0.321
2024-04-17		 6.0.0.315
2024-04-16		 6.0.0.313
2024-04-15		 6.0.0.312
2024-04-10		 6.0.0.310
2024-04-04		 6.0.0.308
2024-04-03		 6.0.0.303
2024-04-02		 6.0.0.301
2024-03-26		 6.0.0.299
2024-03-23		 6.0.0.295
2024-03-22		 6.0.0.294
2024-03-21		 6.0.0.293
2024-03-19		 6.0.0.292
2024-03-16		 6.0.0.291
2024-03-15		 6.0.0.288
2024-03-14		 6.0.0.287
2024-03-13		 6.0.0.286
2024-03-12
Test TITLE
1
bugs core 0165 
 tracker
 CS 492 598 490 526 483 479 483 489 484 536 567 533 539 480 521 478 510 494 477 519 488 469 506 470 477 481 452 853 903 1117 1010
Query using VIEW with UNION causes crash
2
bugs core 0165 
 tracker
 SS 320 409 323 313 324 309 308 316 314 308 325 313 313 315 351 338 314 327 327 306 309 341 317 309 348 324 296 674 670 634 625
Query using VIEW with UNION causes crash
3
bugs core 0733 
 tracker
 CS 23979 105606 25711 24532 25243 23367 24216 23701 23497 23669 24190 23970 23924 23392 24798 23993 24194 24983 23560 23592 23822 23358 23627 23949 23761 23989 23968 24528 24113 24153 24426
Compress Data over the Network
4
bugs core 0733 
 tracker
 SS 23756 112289 107908 23147 23188 23700 22964 24616 23585 23856 24555 23899 23698 23277 24375 24125 23407 23364 23884 23257 23368 23934 24117 23108 23738 23774 23405 23505 24553 23788 23910
Compress Data over the Network
5
bugs core 4492 
 tracker
 CS 475 598 657 471 479 531 469 480 470 480 507 461 460 490 470 530 512 461 519 464 469 455 534 467 497 468 452 526 492 470 466
OR/IN predicates for RDB$DBKEY lead to NATURAL plan
6
bugs core 4492 
 tracker
 SS 310 398 303 321 320 312 311 310 310 313 298 328 300 297 333 331 292 311 296 302 312 290 310 297 296 303 296 694 691 704 645
OR/IN predicates for RDB$DBKEY lead to NATURAL plan
7
bugs core 5602 
 tracker
 CS 4762 5190 5344 4756 4742 4767 4805 4767 4700 5018 4720 4757 4693 4703 5147 4675 4724 4729 4655 4656 4725 4639 4620 6625 6322 8299 7468 7257 7211 7224 7308
Slow changes on domain
8
bugs core 5602 
 tracker
 SS 4217 6177 4455 4185 4120 4150 4335 4137 4916 4191 4138 4245 4190 4543 4116 4170 4225 4163 4117 4209 4153 4145 4186 6023 5859 7117 6999 6732 6984 7117 7635
Slow changes on domain
9
bugs core 5854 
 tracker
 SS 309 2153 328 296 309 310 315 298 312 297 295 312 316 311 315 332 317 292 321 315 294 300 301 298 298 297 296 313 308 311 304
Very poor "similar to" performance
10
bugs core 5876 
 tracker
 CS 482 620 492 468 482 543 523 473 467 468 492 462 469 522 548 523 482 497 465 465 832 831 848 455 472 466 437 691 477 492 457
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
11
bugs core 5876 
 tracker
 SS 313 349 324 309 314 298 308 303 308 313 299 310 333 322 338 315 296 307 305 303 961 864 644 310 308 322 280 545 558 321 329
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
12
bugs core 5931 
 tracker
 SS 299 940 334 312 300 294 297 295 299 296 295 296 319 294 354 289 313 299 306 302 290 297 473 303 296 302 281 306 292 313 305
SIMILAR TO does not return result when invalid pattern is used (with two adjacent special characters that should be escaped but aren't)
13
bugs core 6142 
 tracker
 CS 3479 4454 3365 3486 3527 3381 3471 3863 3377 3473 3690 3410 3648 3419 3395 3502 3762 3704 3529 3552 3584 3366 3289 3356 3319 3714 3264 3531 3426 3628 3456
Error "connection lost to database" could happen when application creates few local attachments (using XNET) simultaneously
14
bugs core 6278 
 tracker
 CS 2860 823 740 578 3069 2860 2640 2884 2875 2880 2881 2877 2894 2880 3288 2860 2853 2872 2682 2852 2862 2850 2867 2849 2862 2862 2627 2856 2659 2855 2843
Efficient table scans for DBKEY-based range conditions
15
bugs core 6278 
 tracker
 SS 2446 626 394 346 2806 2461 2442 2438 3029 2445 2464 2456 2444 2452 2441 2458 2455 2447 2438 2453 2434 2442 2442 2450 2449 2455 2800 2451 2434 2441 2444
Efficient table scans for DBKEY-based range conditions
16
bugs gh 0310 
 tracker
 CS 500 569 675 502 505 499 473 563 495 472 472 502 574 499 568 471 485 532 472 855 521 514 484 462 552 487 452 506 534 469 471
System table with keywords
17
bugs gh 0310 
 tracker
 SS 316 363 356 362 329 302 317 318 303 322 316 321 317 313 318 303 314 302 312 664 341 333 331 313 312 307 312 313 300 312 469
System table with keywords
18
bugs gh 6802 
 tracker
 CS 21563 21837 21769 21575 21570 21676 21578 21897 21602 21555 21560 21559 21749 21596 21593 21561 21563 21563 21551 21543 21559 21554 21562 21559 21570 21575 21499 21550 21906 21561 21552
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
19
bugs gh 6802 
 tracker
 SS 21356 21409 21389 21346 21396 21363 21352 21373 21356 21369 21357 21355 21323 21362 21367 21354 21348 21352 21352 21369 21364 21346 21347 21375 21325 21344 22343 21370 21354 21348 21388
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
20
bugs gh 6875 
 tracker
 SS 2777 4068 2789 2765 2768 2782 3018 2752 2732 2775 2773 2752 2771 2785 2861 2780 2835 2873 2857 2830 2771 3033 2764 2769 2773 2763 2765 2831 2789 2774 2808
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
21
bugs gh 7086 
 tracker
 CS 627 702 639 662 609 656 602 639 625 662 597 617 685 590 725 588 604 593 949 629 610 599 687 596 636 615 577 651 648 684 622
PSQL and SQL profiler
22
bugs gh 7086 
 tracker
 SS 427 549 419 415 428 422 425 413 419 438 417 403 427 410 426 409 402 406 746 442 430 730 450 427 436 437 453 485 731 688 453
PSQL and SQL profiler
23
bugs gh 7553 
 tracker
 CS 693 1132 760 688 701 764 715 697 807 689 729 688 703 682 746 694 678 723 733 714 686 674 693 669 678 773 655 614 627 616 622
Firebird 5 profiler error with subselects
24
bugs gh 7553 
 tracker
 SS 413 493 426 422 425 418 411 423 413 408 413 426 424 412 411 410 443 544 408 412 410 407 439 412 429 413 421 406 401 635 403
Firebird 5 profiler error with subselects
25
bugs gh 7804 
 tracker
 CS 1136 6137 1936 1497 1077 1480 1502 1103 1460 1474 1437 1440 1464 1476 1450 1513 1166 1618 1059 1063 1080 1107 1072 1058 1068 1063 1031 1054 1061 1105 1059
The partial index is not involved when filtering conditions through OR.
26
bugs gh 7804 
 tracker
 SS 894 1458 762 919 666 1152 1221 944 916 918 1143 920 925 927 916 1164 921 1152 594 593 602 815 624 588 619 596 577 615 857 872 588
The partial index is not involved when filtering conditions through OR.
27
bugs gh 8066 
 tracker
 CS 2362 5006 1665 2349 2376 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
28
bugs gh 8066 
 tracker
 SS 1253 1059 1008 1448 1462 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
29
functional blob rdb blob util basic 
 CS 478 706 507 529 533 525 530 470 506 482 544 475 510 469 497 472 515 467 469 469 470 469 534 473 471 481 452 539 473 468 472
Basic test of RDB$BLOB_UTIL package functionality
30
functional blob rdb blob util basic 
 SS 312 330 310 308 310 312 313 320 308 308 315 312 313 319 311 307 309 304 310 305 322 536 325 329 327 330 312 342 324 548 311
Basic test of RDB$BLOB_UTIL package functionality
31
functional domain create 41 
 CS 690 1341 741 742 690 735 692 727 724 689 690 691 685 745 769 739 718 734 674 683 675 688 735 678 690 682 608 678 678 681 774
CREATE DOMAIN - create two domain with same name
32
functional domain create 41 
 SS 456 467 452 507 436 454 455 457 459 495 457 436 487 451 466 474 459 454 465 442 443 457 468 443 452 469 421 435 463 454 439
CREATE DOMAIN - create two domain with same name
33
functional replication bugcheck in rw replica after conflicting insert 
 CS 6747 9445 6781 6766 5796 6731 5760 5747 5903 6680 5697 5688 5706 6792 5770 6747 5724 6640 6665 68018 69075 68994 69120 69013 69043 69030 12627 13867 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
34
functional replication bugcheck in rw replica after conflicting insert 
 SS 6252 6413 6128 6055 6080 6085 6048 6084 6214 6211 6232 6254 6263 6230 6154 6252 6232 6222 7075 68304 68519 69312 69304 68455 68552 68500 13231 13133 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
35
functional session ext conn pool 01 
 CS 28985 29289 29375 29012 28972 28978 29084 28985 29109 29023 28952 28954 28955 29035 29108 28994 29267 28891 28907 28875 28883 28842 28881 28985 28973 28995 28827 29075 29422 29102 28919
External Connections Pool, functionality test 01
36
functional tabloid dbp 1940 20040130 1740 
 CS 1184 1493 1212 1195 1171 1298 1932 1283 1214 1185 1179 1252 1184 1245 1220 1212 1179 1174 1159 1171 1170 1262 1336 1157 1174 1176 1125 1179 1180 1172 1222
Common SQL. Check correctness of the results
37
functional tabloid dbp 1940 20040130 1740 
 SS 821 852 834 843 807 833 841 817 819 819 818 818 804 817 859 823 817 810 823 803 809 808 807 856 826 854 780 871 880 860 837
Common SQL. Check correctness of the results
38
functional tabloid dbp 2146 distinct not in 
 CS 1061 1219 1067 1057 1083 1032 1066 1036 1065 1054 1049 1088 1093 1104 1110 1033 1014 1030 1124 1014 1011 1016 1016 1075 1134 1127 984 1129 1080 1024 1012
Common SQL. Check correctness of the results
39
functional tabloid dbp 2146 distinct not in 
 SS 682 1796 682 675 685 682 710 677 671 716 669 677 674 676 726 678 1141 671 666 674 699 667 689 671 682 691 640 697 689 710 707
Common SQL. Check correctness of the results

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-165
http://tracker.firebirdsql.org/browse/core-4492
http://tracker.firebirdsql.org/browse/core-5602
http://tracker.firebirdsql.org/browse/core-5854
http://tracker.firebirdsql.org/browse/core-5876
http://tracker.firebirdsql.org/browse/core-5931
http://tracker.firebirdsql.org/browse/core-6142
http://tracker.firebirdsql.org/browse/core-6278
http://tracker.firebirdsql.org/browse/core-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/blob/test_rdb_blob_util_basic.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_41.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_dbp_1940_20040130_1740.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_dbp_2146_distinct_not_in.py
https://github.com/FirebirdSQL/firebird/issues/310
https://github.com/FirebirdSQL/firebird/issues/6802
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7086
https://github.com/FirebirdSQL/firebird/issues/7553
https://github.com/FirebirdSQL/firebird/issues/7804
https://github.com/FirebirdSQL/firebird/issues/8066

=== end of list ===