Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Conversation

@vansangpfiev
Copy link

No description provided.

@vansangpfiev vansangpfiev marked this pull request as ready for review July 16, 2024 03:50
@vansangpfiev vansangpfiev merged commit 5cf9f82 into sync-0.10.0 Jul 16, 2024
vansangpfiev added a commit that referenced this pull request Jul 25, 2024
* TensorRT-LLM v0.10 update

* TensorRT-LLM Release 0.10.0

---------

Co-authored-by: Loki <[email protected]>
Co-authored-by: meghagarwal <[email protected]>

* Update Makefile and CICD for rel 0.10.0

* Update breaking change for 0.10.0

* fix: use tensorrt 10.1.0

* fix: revert tensorrt version windows

* fix: synk report fixup (#56)

Co-authored-by: vansangpfiev <[email protected]>

* Fix error read timeout minio

* feat: tiktoken integration (#60)

* cpp-tiktoken integration init

* remove cpp-tiktoken folder

* tiktoken integration init

* move fmt to third-party dependency

* remove unnecessary option in cortex CMakeLists

* remove unnecessary submodule

* make pcre2 as third-party lib

* fix CI bug build in window

* fix CI bug in linux

* link directory pcre2

* Fix CI bug in linux 'pcre2.h' not found

* Fix bug build static third party lib

* Integate Llama3 successfully

* refactor with model type

* remove unnecessary comment

* format and code convention

* fix logic of mistral when preparing input

* Add remove end_of_text and end_of_turn token feature for llama3

* fix: patch pcre2 CMakeLists.txt file

* fix: do not add fPIC to cpp-tiktoken cmake file

* fix: suppress warnings

* fix: add CMAKE_C_FLAGS

* fix: CI bug build for window in cpp-tiktoken

* fix: CI bug for window fmt build fail without utf-8 flag

* fix: CI bug for window stop using fmt

* fix: build bugs for window - using latest pcre2 third party

* fix: build bugs for window - pcre2 static runtime on

* fix CI bug for window build pcre2

* rename link lib to pcre2-8-static in windows

* fix: use pcre2 dynamic lib for windows

* fix: pack tensorrt_llm_nvrtc_wrapper.dll

* test: only windows

* fix: disable setLoggerFinder for msvc

* fix: cleanup cmake files

* fix: remove fmt

* fix: pack libtensorrt_llm_nvrtc_wrapper

* fix: patches windows

* fix: rm fmt

---------

Co-authored-by: sangjanai <[email protected]>

---------

Co-authored-by: Kaiyu Xie <[email protected]>
Co-authored-by: Loki <[email protected]>
Co-authored-by: meghagarwal <[email protected]>
Co-authored-by: Hien To <[email protected]>
Co-authored-by: sangjanai <[email protected]>
Co-authored-by: vansangpfiev <[email protected]>
Co-authored-by: nguyenhoangthuan99 <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants