Reduced model for realtime applications?

[Mh-Magdy]

I ran the model on a high-quality image and it took about 8 Seconds to infer the depth. I'm wondering if there is a smaller model suitable for real-time application or any other suitable edits for this use case?
Device: NVIDIA RTX 3060

[YCHAOSK]

same issue

[harism]

I've reached 1-2 seconds with these changes running Depth Pro 1024x1024 float16 on MacBook Pro M2 Neural Engine; #45 - I believe you can do something very similar with normal execution also and reduce the model inference size.