-
-
Notifications
You must be signed in to change notification settings - Fork 2.9k
Closed as not planned
Description
In release 8.0.0, the order of test execution has changed.
The logic of the new order is not clear.
For illustration simple parameterized tests
import pytest
@pytest.mark.parametrize('proto', ['serial', 'telnet', 'ssh'], scope='class')
@pytest.mark.parametrize('unit', [1, 2, 3], scope='class')
class TestA:
def test_one(self, proto, unit):
pass
def test_two(self, proto, unit):
passOrder in pytest <=7.4.4
<Package tests>
<Module test_asd.py>
<Class TestA>
<Function test_one[1-serial]>
<Function test_two[1-serial]>
<Function test_one[1-telnet]>
<Function test_two[1-telnet]>
<Function test_one[1-ssh]>
<Function test_two[1-ssh]>
<Function test_one[2-serial]>
<Function test_two[2-serial]>
<Function test_one[2-telnet]>
<Function test_two[2-telnet]>
<Function test_one[2-ssh]>
<Function test_two[2-ssh]>
<Function test_one[3-serial]>
<Function test_two[3-serial]>
<Function test_one[3-telnet]>
<Function test_two[3-telnet]>
<Function test_one[3-ssh]>
<Function test_two[3-ssh]>
Order in pytest >=8.0.0
<Dir pytest>
<Package tests>
<Module test_asd.py>
<Class TestA>
<Function test_one[1-serial]>
<Function test_two[1-serial]>
<Function test_one[2-serial]>
<Function test_two[2-serial]>
<Function test_one[2-telnet]>
<Function test_two[2-telnet]>
<Function test_one[1-telnet]>
<Function test_two[1-telnet]>
<Function test_one[3-telnet]>
<Function test_two[3-telnet]>
<Function test_one[3-serial]>
<Function test_two[3-serial]>
<Function test_one[3-ssh]>
<Function test_two[3-ssh]>
<Function test_one[2-ssh]>
<Function test_two[2-ssh]>
<Function test_one[1-ssh]>
<Function test_two[1-ssh]>
Metadata
Metadata
Assignees
Labels
No labels