01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
[CURRENT] 03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (3 rows)
06. Has fails: tests with at least one fail for previous 30 runs (39 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
10. All tests: outcomes for previous 30 runs (2535 rows)
11. All tests: durations for previous 30 runs (4886 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated 15.05.2024 05:39
Tested: FB60.   Build: 6.0.0.351;   SS: 15.05.24 03:07:24 - 15.05.24 04:08:00;   CS: 15.05.24 04:08:58 - 15.05.24 05:37:00;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests with result = "FAIL" for last run:

Jump to LIST of unique test names from this report

NN Test name mode 6.0.0.351
2024-05-15
6.0.0.348
2024-05-14
6.0.0.346
2024-05-08
6.0.0.345
2024-05-07
6.0.0.344
2024-05-03
6.0.0.342
2024-04-30
6.0.0.339
2024-04-29
6.0.0.336
2024-04-27
6.0.0.333
2024-04-24
6.0.0.328
2024-04-23
6.0.0.327
2024-04-21
6.0.0.325
2024-04-19
6.0.0.324
2024-04-18
6.0.0.321
2024-04-17
6.0.0.315
2024-04-16
6.0.0.313
2024-04-15
6.0.0.312
2024-04-10
6.0.0.310
2024-04-04
6.0.0.308
2024-04-03
6.0.0.303
2024-04-02
6.0.0.301
2024-03-26
6.0.0.299
2024-03-23
6.0.0.295
2024-03-22
6.0.0.294
2024-03-21
6.0.0.293
2024-03-19
6.0.0.292
2024-03-16
6.0.0.291
2024-03-15
6.0.0.288
2024-03-14
6.0.0.287
2024-03-13
6.0.0.286
2024-03-12
Test TITLE
1 CS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Compress Data over the Network
2 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Very poor "similar to" performance
3 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
SIMILAR TO does not return result when invalid pattern is used (with two adjacent special characters that should be escaped but aren't)
4 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)

Elapsed time, milliseconds:

NN Test name mode median_ms 6.0.0.351
2024-05-15
6.0.0.348
2024-05-14
6.0.0.346
2024-05-08
6.0.0.345
2024-05-07
6.0.0.344
2024-05-03
6.0.0.342
2024-04-30
6.0.0.339
2024-04-29
6.0.0.336
2024-04-27
6.0.0.333
2024-04-24
6.0.0.328
2024-04-23
6.0.0.327
2024-04-21
6.0.0.325
2024-04-19
6.0.0.324
2024-04-18
6.0.0.321
2024-04-17
6.0.0.315
2024-04-16
6.0.0.313
2024-04-15
6.0.0.312
2024-04-10
6.0.0.310
2024-04-04
6.0.0.308
2024-04-03
6.0.0.303
2024-04-02
6.0.0.301
2024-03-26
6.0.0.299
2024-03-23
6.0.0.295
2024-03-22
6.0.0.294
2024-03-21
6.0.0.293
2024-03-19
6.0.0.292
2024-03-16
6.0.0.291
2024-03-15
6.0.0.288
2024-03-14
6.0.0.287
2024-03-13
6.0.0.286
2024-03-12
Test TITLE
1 CS 23979 105606 25711 24532 25243 23367 24216 23701 23497 23669 24190 23970 23924 23392 24798 23993 24194 24983 23560 23592 23822 23358 23627 23949 23761 23989 23968 24528 24113 24153 24426
Compress Data over the Network
2 SS 309 2153 328 296 309 310 315 298 312 297 295 312 316 311 315 332 317 292 321 315 294 300 301 298 298 297 296 313 308 311 304
Very poor "similar to" performance
3 SS 299 940 334 312 300 294 297 295 299 296 295 296 319 294 354 289 313 299 306 302 290 297 473 303 296 302 281 306 292 313 305
SIMILAR TO does not return result when invalid pattern is used (with two adjacent special characters that should be escaped but aren't)
4 SS 2777 4068 2789 2765 2768 2782 3018 2752 2732 2775 2773 2752 2771 2785 2861 2780 2835 2873 2857 2830 2771 3033 2764 2769 2773 2763 2765 2831 2789 2774 2808
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-5854
http://tracker.firebirdsql.org/browse/core-5931
http://tracker.firebirdsql.org/browse/core-733
https://github.com/FirebirdSQL/firebird/issues/6875

=== end of list ===