Skip to content

Commit 61916fe

Browse files
authored
Update Habana Gaudi doc (#3863)
* Update Habana Gaudi doc * Fix typo
1 parent fc6acb6 commit 61916fe

File tree

1 file changed

+8
-8
lines changed

1 file changed

+8
-8
lines changed

docs/source/en/optimization/habana.mdx

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -16,8 +16,8 @@ specific language governing permissions and limitations under the License.
1616

1717
## Requirements
1818

19-
- Optimum Habana 1.5 or later, [here](https://huggingface.co/docs/optimum/habana/installation) is how to install it.
20-
- SynapseAI 1.9.
19+
- Optimum Habana 1.6 or later, [here](https://huggingface.co/docs/optimum/habana/installation) is how to install it.
20+
- SynapseAI 1.10.
2121

2222

2323
## Inference Pipeline
@@ -41,7 +41,7 @@ pipeline = GaudiStableDiffusionPipeline.from_pretrained(
4141
scheduler=scheduler,
4242
use_habana=True,
4343
use_hpu_graphs=True,
44-
gaudi_config="Habana/stable-diffusion",
44+
gaudi_config="Habana/stable-diffusion-2",
4545
)
4646
```
4747

@@ -62,18 +62,18 @@ For more information, check out Optimum Habana's [documentation](https://hugging
6262

6363
## Benchmark
6464

65-
Here are the latencies for Habana first-generation Gaudi and Gaudi2 with the [Habana/stable-diffusion](https://huggingface.co/Habana/stable-diffusion) Gaudi configuration (mixed precision bf16/fp32):
65+
Here are the latencies for Habana first-generation Gaudi and Gaudi2 with the [Habana/stable-diffusion](https://huggingface.co/Habana/stable-diffusion) and [Habana/stable-diffusion-2](https://huggingface.co/Habana/stable-diffusion-2) Gaudi configurations (mixed precision bf16/fp32):
6666

6767
- [Stable Diffusion v1.5](https://huggingface.co/runwayml/stable-diffusion-v1-5) (512x512 resolution):
6868

6969
| | Latency (batch size = 1) | Throughput (batch size = 8) |
7070
| ---------------------- |:------------------------:|:---------------------------:|
71-
| first-generation Gaudi | 4.22s | 0.29 images/s |
72-
| Gaudi2 | 1.70s | 0.925 images/s |
71+
| first-generation Gaudi | 3.80s | 0.308 images/s |
72+
| Gaudi2 | 1.33s | 1.081 images/s |
7373

7474
- [Stable Diffusion v2.1](https://huggingface.co/stabilityai/stable-diffusion-2-1) (768x768 resolution):
7575

7676
| | Latency (batch size = 1) | Throughput |
7777
| ---------------------- |:------------------------:|:-------------------------------:|
78-
| first-generation Gaudi | 23.3s | 0.045 images/s (batch size = 2) |
79-
| Gaudi2 | 7.75s | 0.14 images/s (batch size = 5) |
78+
| first-generation Gaudi | 10.2s | 0.108 images/s (batch size = 4) |
79+
| Gaudi2 | 3.17s | 0.379 images/s (batch size = 8) |

0 commit comments

Comments
 (0)