Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Conversation

@namchuai
Copy link
Contributor

@namchuai namchuai commented Oct 24, 2024

Describe Your Changes

  • Clean up, gonna removing nlohmann::json
  • Refactoring InferenceService, moving engine logic to EngineService

Fixes Issues

Self Checklist

  • Added relevant comments, esp in complex areas
  • Updated docs (for bug fixes / features)
  • Created issues for follow-up changes or refactoring needed

@namchuai namchuai force-pushed the j/engine-management branch 3 times, most recently from 308068c to 3dba0ce Compare October 28, 2024 14:23
@namchuai namchuai marked this pull request as ready for review October 29, 2024 11:11
@namchuai namchuai force-pushed the j/engine-management branch from 549f1ef to 3edfb66 Compare October 29, 2024 19:49
@namchuai namchuai force-pushed the j/engine-management branch 4 times, most recently from 2a4662c to d344f30 Compare October 30, 2024 09:38
@namchuai namchuai force-pushed the j/engine-management branch from d344f30 to 027bb54 Compare October 31, 2024 01:33
@namchuai namchuai requested review from a team and nguyenhoangthuan99 October 31, 2024 01:45
@github-actions
Copy link
Contributor

github-actions bot commented Oct 31, 2024

Preview URL: https://2caa50b4.cortex-docs.pages.dev


auto on_finished = [engine](const DownloadTask& finishedTask) {
auto engine_path = file_manager_utils::GetEnginesContainerPath() / engine;
auto engine_path = file_manager_utils::GetCudaToolkitPath(engine);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we rename to cuda_path?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will update in following pr.

@namchuai namchuai merged commit 3e04350 into dev Nov 5, 2024
5 checks passed
@namchuai namchuai deleted the j/engine-management branch November 5, 2024 11:10
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

epic: Improve Cortex Engine Management

3 participants