01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 05. STILL FAILS: tests which fail for at least TWO LAST runs (16 rows)
06. Has fails: tests with at least one fail for previous 30 runs (74 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (4 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
10. All tests: outcomes for previous 30 runs (2044 rows)
11. All tests: durations for previous 30 runs (4004 rows)
12. Skipped: tests which was intentionally excluded from execution (62 rows)

Generated 18.03.2024 13:52
Tested: HQ30.   Build: 3.0.12.33726;   SS: 18.03.24 12:47:07 - 18.03.24 13:13:12;   CS: 18.03.24 13:13:40 - 18.03.24 13:50:58;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.1; Firebird.Qa: 0.19.1

Tests which fail for at least two last runs:

Jump to LIST of unique test names from this report

NN Test name mode 3.0.12.33726
2024-03-18
3.0.12.33725
2023-12-30
3.0.12.33722
2023-11-30
3.0.12.33712
2023-11-09
3.0.12.33706
2023-09-15
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-23
3.0.11.33685
2023-06-04
3.0.11.33683
2023-04-30
3.0.11.33673
2023-04-17
3.0.11.33666
2023-04-03
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-09
3.0.11.33648
2023-01-24
3.0.11.33646
2022-12-18
3.0.11.33639
2022-12-06
3.0.11.33636
2022-12-09
3.0.11.33631
2022-12-09
3.0.11.33622
2022-12-09
3.0.11.33621
2022-12-09
3.0.11.33620
2022-12-09
3.0.11.33618
2022-12-09
3.0.11.33616
2022-12-09
3.0.11.33612
2022-12-09
X X X X X X
Test TITLE
1 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Can't create table using long username and UTF8 as attachment charset
2 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Can't create table using long username and UTF8 as attachment charset
3 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
ISQL does not show encryption status of database
4 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
ISQL does not show encryption status of database
5 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Unique constraint not working in encrypted database on first command
6 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Unique constraint not working in encrypted database on first command
7 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
8 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
9 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
gstat may produce faulty report about presence of some none-encrypted pages in database
10 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
gstat may produce faulty report about presence of some none-encrypted pages in database
11 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Not user friendly output of gstat at encrypted database
12 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Not user friendly output of gstat at encrypted database
13 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
14 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
15 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Generator pages are not encrypted
16 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Generator pages are not encrypted

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33726
2024-03-18
3.0.12.33725
2023-12-30
3.0.12.33722
2023-11-30
3.0.12.33712
2023-11-09
3.0.12.33706
2023-09-15
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-23
3.0.11.33685
2023-06-04
3.0.11.33683
2023-04-30
3.0.11.33673
2023-04-17
3.0.11.33666
2023-04-03
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-09
3.0.11.33648
2023-01-24
3.0.11.33646
2022-12-18
3.0.11.33639
2022-12-06
3.0.11.33636
2022-12-09
3.0.11.33631
2022-12-09
3.0.11.33622
2022-12-09
3.0.11.33621
2022-12-09
3.0.11.33620
2022-12-09
3.0.11.33618
2022-12-09
3.0.11.33616
2022-12-09
3.0.11.33612
2022-12-09
X X X X X X
Test TITLE
1 CS 1041 1043 1088 1041 1042 1046 1018 1058 1042 1048 1136 1051 1040 893 900 969 2023 1100 1085 1031 1016 1022 1017 999 1014 0 0 0 0 0 0
Can't create table using long username and UTF8 as attachment charset
2 SS 682 705 728 720 700 671 681 716 694 695 709 693 684 477 415 447 876 522 514 447 984 446 453 467 438 0 0 0 0 0 0
Can't create table using long username and UTF8 as attachment charset
3 CS 485 384 409 412 393 421 389 388 401 400 424 412 413 579 547 578 701 700 700 683 684 682 666 652 667 0 0 0 0 0 0
ISQL does not show encryption status of database
4 SS 218 185 187 190 201 187 185 187 202 200 191 192 188 295 234 253 299 299 300 299 299 299 299 283 300 0 0 0 0 0 0
ISQL does not show encryption status of database
5 CS 697 594 605 603 648 608 572 587 587 599 589 604 603 797 757 747 930 901 883 836 847 827 863 835 832 0 0 0 0 0 0
Unique constraint not working in encrypted database on first command
6 SS 351 319 317 322 315 327 547 318 320 329 350 324 315 444 363 362 436 426 432 345 362 367 368 353 363 0 0 0 0 0 0
Unique constraint not working in encrypted database on first command
7 CS 499 392 412 394 394 405 383 385 400 401 396 430 400 584 568 588 663 668 680 678 684 668 668 715 658 0 0 0 0 0 0
Error returned from DbCryptPlugin::setKey() is not shown
8 SS 218 188 190 190 187 187 184 187 196 194 194 194 194 310 240 253 299 299 313 279 315 299 298 297 282 0 0 0 0 0 0
Error returned from DbCryptPlugin::setKey() is not shown
9 CS 5841 5585 5745 5610 5653 5515 5604 5562 5644 5821 5669 5648 5621 5861 5880 5968 6103 5921 6016 5941 6460 6208 6063 6144 6865 0 0 0 0 0 0
gstat may produce faulty report about presence of some none-encrypted pages in database
10 SS 5823 5805 5994 5858 5859 5499 5857 5771 5844 5542 5803 5894 5776 5882 5789 5899 5841 5489 5623 6005 5764 5645 5941 5987 5578 0 0 0 0 0 0
gstat may produce faulty report about presence of some none-encrypted pages in database
11 CS 500 390 415 425 389 405 390 389 399 398 434 423 402 607 566 573 668 667 669 683 683 663 737 683 669 0 0 0 0 0 0
Not user friendly output of gstat at encrypted database
12 SS 257 187 195 191 188 187 189 186 197 197 193 349 195 290 261 253 299 298 298 300 299 298 315 314 300 0 0 0 0 0 0
Not user friendly output of gstat at encrypted database
13 CS 786 613 788 777 774 764 759 762 766 764 785 779 777 765 851 830 965 864 891 873 861 853 894 855 859 0 0 0 0 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
14 SS 530 519 390 386 577 375 609 384 392 389 393 392 385 599 419 518 631 559 552 583 563 577 585 635 541 0 0 0 0 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
15 CS 693 582 605 588 582 577 602 587 639 582 588 609 579 767 815 747 874 900 868 831 801 831 814 831 827 0 0 0 0 0 0
Generator pages are not encrypted
16 SS 343 321 315 326 324 312 325 309 334 332 329 329 332 414 352 364 431 434 430 384 377 382 368 367 367 0 0 0 0 0 0
Generator pages are not encrypted

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1292
http://tracker.firebirdsql.org/browse/core-5077
http://tracker.firebirdsql.org/browse/core-5673
http://tracker.firebirdsql.org/browse/core-5793
http://tracker.firebirdsql.org/browse/core-5796
http://tracker.firebirdsql.org/browse/core-5831
http://tracker.firebirdsql.org/browse/core-6108
http://tracker.firebirdsql.org/browse/core-6163

=== end of list ===