With #1679 we provide a sub-par experience in the non-interactive case. We do want to interrupt people and force them to choose yes or no for error handling, but we should notice when they're non-interactive and give them a more helpful error message vs. blocking forever (until reaped) on the y or n prompt.