I believe the test tests/repo_finder/test_commit_finder.py is the culprit causing this, after running unit tests a temporary directory tests/repo_finder/mock_repos still exists and has to be removed manually. It would be good to have this removal done automatically in the tests.