This repository was archived by the owner on Jul 4, 2025. It is now read-only.

41 feat batch inference for nitro#101

Merged

tikikun merged 6 commits intomainfrom

41-feat-batch-inference-for-nitro

Nov 6, 2023

Commits on Oct 26, 2023

chore: pump llama cpp to latest version with batch inference
tikikun
committed

Commits on Nov 3, 2023

Commits on Nov 6, 2023