How to set mixture of experts related options?

[n-k]

How can I set MoE related options: --cpu-moe and --n-cpu-moe ?

[MarcusDunn]

is this as a library or for the example files?

With respect to the library, I don't believe we've added bindings for those yet - the CLI as a result won't have it (nor should it, it's meant to be pretty simple)

PRs welcome!

[n-k]

I want it as configuration when using as a library.

I'll give updating the bindings a go 🤞

[MarcusDunn]

llama.cpp were updated to latest in #850, this may make implementing this much easier (or at least less steps!)

[n-k]

Raised PR: #855

Happy to modify on feedback :)

[MarcusDunn]

couple questions (as comments on #855), but looks good!

[MarcusDunn]

fixed in #855