File tree Expand file tree Collapse file tree 1 file changed +16
-0
lines changed Expand file tree Collapse file tree 1 file changed +16
-0
lines changed Original file line number Diff line number Diff line change @@ -32,3 +32,19 @@ torch._C._LinAlgError: linalg.cholesky: The factorization could not be completed
3232[ AutoGPTQ/AutoGPTQ #196 ] ( https://github.com/AutoGPTQ/AutoGPTQ/issues/196 ) .
3333Try increasing ` percdamp ` (percent of the average Hessian diagonal to use for dampening),
3434or increasing ` nsamples ` (the number of calibration samples).
35+ #### Issue 7:
36+ If you run GPTQ quantization with transformers-like API on xpu device, then you may encounter the following error:
37+ ``` shell
38+ [ERROR][modeling_auto.py:128] index 133 is out of bounds for dimension 0 with size 128
39+ [ERROR][modeling_auto.py:129] Saved low bit model loading failed, please check your model.
40+ HINT:
41+ XPU device does not support ` g_idx` for GPTQ quantization now. Please stay tuned.
42+ You can set desc_act=False.
43+ ```
44+ #### Issue 8:
45+ UnicodeEncodeError: 'charmap' codec can't encode character '\u2191' in position 195: character maps to <undefined >
46+ ** Solution:**
47+ ```
48+ set PYTHONIOENCODING=UTF-8 # for windows
49+ export PYTHONIOENCODING=UTF-8 # for linux
50+ ```
You can’t perform that action at this time.
0 commit comments