Text classification cancel hangs - Reopening mbconfig shows no compatible GPU

[luisquintanilla]

System Information (please complete the following information):

• Model Builder Version (available in Manage Extensions dialog): 16.14.0.2255703
• Visual Studio Version: 17.3.6

Describe the bug

• On which step of the process did you run into an issue: Environment and Train
• Clear description of the problem:

For the text classification scenario, when I cancel training, it hangs and the the process never seems to finish. Closing the .mbconfig file and opening it again shows that the there is no compatible GPU, even though I do have a compatible GPU.

To Reproduce
Steps to reproduce the behavior: Train a text classification GPU on a Local GPU environment.

Expected behavior
Training cancels successfully and reopening mbconfig shows my GPU.

Screenshots

Additional context

Log from cancelled training:

TextClassification-ELQVV5.txt

[luisquintanilla]

Workaround - Restart Visual Studio.

[luisquintanilla]

@v-Hailishi can you please try and validate this. Thanks.

[luisquintanilla]

Hypothesis: ML.NET needs to handle cancellation better for Text Classification (maybe all deep learning) scenario.

[v-Hailishi]

@luisquintanilla Tried on the latest main build 16.14.0.2256701, the following are the result.

1. There is no compatible GPU, even though I have a compatible GPU.
   

2. When training a text classification on Local GPU environment I, I met the following error.
   On my PC, VS2022 always opens with elevated 'Admin' mode. I have tried many methods, but still cannot open VS using a non-elevated mode. Would you have any valid method to cancel the 'Admin' model?
   

3. But I have also tried on Local CPU environment, when I cancel training, the training can be trained completed successfully.
   

[luisquintanilla]

@v-Hailishi thanks for validating. However, the issue displayed here is accurate because Intel integrated GPUs are not CUDA compatible.

@zewditu to implement change that should fix this. @luisquintanilla to help validate.

[luisquintanilla]

@zewditu here is the mbconfig for GPU training.

TCGPU.mbconfig.zip

[zewditu]

@LittleLittleCloud does the GPU has impact on training session cancellation?