May be I misssed an option, but in latest release 3.5.3 it doesn't work.
As a solution I can suggest to save in .git\gitversion_cache\effective_config.yml effective config and compare it with calculated effective config. As I understand how configuration is being overriden we have dynamic override (from command line and other sources) and static through GitVersion(Config).(yaml|yml) or other data in repository.
if It is dynamic - ignore caches and didn't persist result in cache
if it is static - compare cached effective config and calculated - if there are not equal - clear caches and run.
and add option /force to clean up everything and recalculate it each time.
Is my suggestion correct?