Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Conversation

@vansangpfiev
Copy link

No description provided.

@vansangpfiev vansangpfiev marked this pull request as ready for review August 5, 2024 03:24
@vansangpfiev vansangpfiev merged commit 3d5a0cc into feature/cicd-v0.11.0 Aug 5, 2024
vansangpfiev added a commit that referenced this pull request Aug 5, 2024
* Add Dockerfile for runner windows

* Add Dockerfile for linux

* Change CI agent

* fix: build linux (#70)

Co-authored-by: vansangpfiev <[email protected]>

---------

Co-authored-by: Hien To <[email protected]>
Co-authored-by: vansangpfiev <[email protected]>
Co-authored-by: vansangpfiev <[email protected]>
vansangpfiev added a commit that referenced this pull request Aug 6, 2024
* TensorRT-LLM v0.10 update

* TensorRT-LLM Release 0.10.0

---------

Co-authored-by: Loki <[email protected]>
Co-authored-by: meghagarwal <[email protected]>

* TensorRT-LLM v0.11 Update (NVIDIA#1969)

* fix: add formatter

* fix: use executor API

* fix: sync

* fix: remove requests thread

* fix: support unload endpoint for server example, handle release resources properly

* refactor: InferenceState

* fix: new line character for Mistral and Openhermes

* fix: add benchmark script

* Add Dockerfile for runner windows (#69)

* Add Dockerfile for runner windows

* Add Dockerfile for linux

* Change CI agent

* fix: build linux (#70)

Co-authored-by: vansangpfiev <[email protected]>

---------

Co-authored-by: Hien To <[email protected]>
Co-authored-by: vansangpfiev <[email protected]>
Co-authored-by: vansangpfiev <[email protected]>

* fix: default batch_size

* chore: only linux build

---------

Co-authored-by: Kaiyu Xie <[email protected]>
Co-authored-by: Loki <[email protected]>
Co-authored-by: meghagarwal <[email protected]>
Co-authored-by: sangjanai <[email protected]>
Co-authored-by: hiento09 <[email protected]>
Co-authored-by: Hien To <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants