From 6d4d367aa23575afa9c78311f587276f2538b1cf Mon Sep 17 00:00:00 2001 From: Asankhaya Sharma Date: Thu, 24 Oct 2024 15:21:18 +0800 Subject: [PATCH] Update README.md --- README.md | 12 ++++++++++++ 1 file changed, 12 insertions(+) diff --git a/README.md b/README.md index cc3d67d2..916021e0 100644 --- a/README.md +++ b/README.md @@ -8,6 +8,18 @@ optillm is an OpenAI API compatible optimizing inference proxy which implements ## Installation +### Using pip + +```bash +pip install optillm +optillm +2024-10-22 07:45:05,612 - INFO - Loaded plugin: privacy +2024-10-22 07:45:06,293 - INFO - Loaded plugin: memory +2024-10-22 07:45:06,293 - INFO - Starting server with approach: auto +``` + +### Install from source + Clone the repository with `git` and use `pip install` to setup the dependencies. ```bash