Error running Phi2 Models

[jasonw247]

When attempting to run dolphin-2_6-phi-2.Q4_0.gguf I'm getting error loading model: unknown model architecture: 'phi2'.

Phi2 support was added a couple of weeks ago: ggml-org/llama.cpp#4490.

Is there a way to include this?

For reference, I am using this repo as part of a different package using current master:

[dependencies]
llama_cpp_rs = { git = "https://github.com/mdrokz/rust-llama.cpp.git", rev = "4922cac", features = ["metal"] }