@@ -16,8 +16,8 @@ specific language governing permissions and limitations under the License.
1616
1717## Requirements
1818
19- - Optimum Habana 1.5 or later, [here](https://huggingface.co/docs/optimum/habana/installation) is how to install it.
20- - SynapseAI 1.9 .
19+ - Optimum Habana 1.6 or later, [here](https://huggingface.co/docs/optimum/habana/installation) is how to install it.
20+ - SynapseAI 1.10 .
2121
2222
2323## Inference Pipeline
@@ -41,7 +41,7 @@ pipeline = GaudiStableDiffusionPipeline.from_pretrained(
4141 scheduler =scheduler,
4242 use_habana =True,
4343 use_hpu_graphs =True,
44- gaudi_config = " Habana/stable-diffusion" ,
44+ gaudi_config = " Habana/stable-diffusion-2 " ,
4545)
4646```
4747
@@ -62,18 +62,18 @@ For more information, check out Optimum Habana's [documentation](https://hugging
6262
6363## Benchmark
6464
65- Here are the latencies for Habana first-generation Gaudi and Gaudi2 with the [Habana/stable-diffusion](https://huggingface.co/Habana/stable-diffusion) Gaudi configuration (mixed precision bf16/fp32):
65+ Here are the latencies for Habana first-generation Gaudi and Gaudi2 with the [Habana/stable-diffusion](https://huggingface.co/Habana/stable-diffusion) and [Habana/stable-diffusion-2](https://huggingface.co/Habana/stable-diffusion-2) Gaudi configurations (mixed precision bf16/fp32):
6666
6767- [Stable Diffusion v1.5](https://huggingface.co/runwayml/stable-diffusion-v1-5) (512x512 resolution):
6868
6969| | Latency (batch size = 1) | Throughput (batch size = 8) |
7070| ---------------------- |:------------------------:|:---------------------------:|
71- | first-generation Gaudi | 4.22s | 0.29 images/s |
72- | Gaudi2 | 1.70s | 0.925 images/s |
71+ | first-generation Gaudi | 3.80s | 0.308 images/s |
72+ | Gaudi2 | 1.33s | 1.081 images/s |
7373
7474- [Stable Diffusion v2.1](https://huggingface.co/stabilityai/stable-diffusion-2-1) (768x768 resolution):
7575
7676| | Latency (batch size = 1) | Throughput |
7777| ---------------------- |:------------------------:|:-------------------------------:|
78- | first-generation Gaudi | 23.3s | 0.045 images/s (batch size = 2 ) |
79- | Gaudi2 | 7.75s | 0.14 images/s (batch size = 5) |
78+ | first-generation Gaudi | 10.2s | 0.108 images/s (batch size = 4 ) |
79+ | Gaudi2 | 3.17s | 0.379 images/s (batch size = 8) |
0 commit comments