model support request: CohereForAI/c4ai-command-r-v01

[sweetcard]

Prerequisites

Please answer the following questions for yourself before submitting an issue.

• I am running the latest code. Development is very rapid so there are no tagged versions as of now.

• I carefully followed the README.md.

• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).

• I reviewed the Discussions, and have a new bug or useful enhancement to share.

Feature Description

CohereForAI/c4ai-command-r-v01 has some amazing feature. Such as long context size, high performance for RAG.

Could you support this model?

Motivation

It can be very cool for RAG with llama.cpp.

Possible Implementation

Maybe the python code in hf repository and the blog of cohere can help implementation.

[sweetcard]

Good news.
Please check this pr:

#6033

[sweetcard]

command-R model is supported in main branch!