Bug Description
By default Jan will choose CPU mode. My local AI models are marked as "Recommended".
When enabling Experimental Mode and Vulkan support, all local models are marked as "Slow on your device" (probably due to my GPU's 4GB of VRAM).
After disabling Vulkan support and Experimental Mode (returning to the default settings), all local models will still appear as "Slow on your device" and will fail to start.
Steps to reproduce
Local models appear as "Recommended"
- Open Jan Settings
- Open the Advanced Settings tab
- Enable Experimental Mode and Vulkan Support
Local models will now appear as "Slow on your device"
- Disable Experimental Mode and Vulkan Support
Local models will still be marked as "Slow on your device" despite having returned to the default settings.
Expected behavior
After disabling Experimental and Vulkan settings, all local models will return to the previous state and appear as "Recommended" (if they ever did in the first place).
Environment details
- Operating System: Windows 11 23H2
- Jan Version: v0.4.10
- Processor: AMD Ryzen 5 3600
- RAM: 32GB
- GPU: RX570 4GB
Solution
Settings > Advanced Settings > Reset to Factory Default
Then, you can import your models again and they will run using the default CPU mode (just like it did at the start, before changing any Experimental or Vulkan settings), and they will be marked as "Recommended".