nix-3x new_perf

01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (3 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (45 rows)
07. Has fails: tests with at least one fail for previous 30 runs (46 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (8 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
11. All tests: outcomes for previous 30 runs (2050 rows)
12. Skipped: tests which was intentionally excluded from execution (68 rows)

Generated UTC 02.05.2025 11:13
Tested: HQ30. Build / date: 3.0.13.33808-28426dc5 / 2025.04.25;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:

NN	Test name	mode	Test last update	3.0.13.33808 2025.04.25 28426	3.0.13.33803 2025.02.25 08ebd	3.0.13.33796 2025.01.29 0ab85	3.0.13.33796 2025.01.14 99b3b	3.0.13.33795 2024.11.24 b8847	3.0.13.33794 2024.10.15 abe09	3.0.13.33793 2024.10.04 82ccc	3.0.13.33792 2024.08.31 d8791	3.0.13.33787 2024.08.17 2e0d6	3.0.13.33787 2024.08.09 df740	3.0.12.33746 2024.07.15 11dd4	3.0.12.33746 2024.06.11 8a5eb	3.0.12.33744 2024.05.09 9cf37	3.0.12.33744 2024.04.20 af6b2	X	X	X	X	X	X	X	X	X	X	X	X	Test TITLE
1	bugs core 5965 tracker	SS	2022.02.02 14:46	2175	1164	1140	1087	1087	1087	1422	1422	1422	919	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	FB3 Optimiser chooses less efficient plan than FB2.5 optimiser
2	functional arno optimizer opt sort by index 19	SS	2022.02.04 18:05	10	6	6	6	6	6	7	9	9	8	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	ORDER BY ASC using index (multi) and WHERE clause
3	functional domain create 34	CS	2023.10.07 07:53	11	7	7	7	7	7	7	7	7	7	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	CREATE DOMAIN - DEFAULT USER

Elapsed time, milliseconds:

NN	Test name	mode	3.0.13.33808 2025.04.25 28426	3.0.13.33803 2025.02.25 08ebd	3.0.13.33796 2025.01.29 0ab85	3.0.13.33796 2025.01.14 99b3b	3.0.13.33795 2024.11.24 b8847	3.0.13.33794 2024.10.15 abe09	3.0.13.33793 2024.10.04 82ccc	3.0.13.33792 2024.08.31 d8791	3.0.13.33787 2024.08.17 2e0d6	3.0.13.33787 2024.08.09 df740	3.0.12.33746 2024.07.15 11dd4	3.0.12.33746 2024.06.11 8a5eb	3.0.12.33744 2024.05.09 9cf37	3.0.12.33744 2024.04.20 af6b2	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Test TITLE
1	bugs core 5965 tracker	SS	2175	2385	2201	1164	1140	886	1016	1087	2000	1422	1535	919	754	768	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	FB3 Optimiser chooses less efficient plan than FB2.5 optimiser
2	functional arno optimizer opt sort by index 19	SS	561	524	6	10	6	5	6	6	11	7	16	9	8	6	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	ORDER BY ASC using index (multi) and WHERE clause
3	functional domain create 34	CS	1091	1069	6	7	11	7	5	5	11	7	9	7	5	6	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	CREATE DOMAIN - DEFAULT USER

List of tests in this report:

http://tracker.firebirdsql.org/browse/CORE-5965
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_34.py

=== end of list ===

Tests with performance slowdown for LAST 5 runs - moving medians

Elapsed time, milliseconds:

List of tests in this report:

Last commits information (all timestamps in UTC):