Orchestration

[hammad93]

pending ggml-org/llama.cpp#15852

Apertus

• The current implementation utilizes the 70 billion parameter model quantized at 8 bits
• This model is preferred because it's fully open and transparent
• Apertus is massively multilingual and covers more languages than others
• Testing and analysis of benchmarks indicate that the model is sufficient for our purposes