Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Commit bfd766b

Browse files
fix: release resources in destructor (#179)
Co-authored-by: vansangpfiev <[email protected]>
1 parent ee12d64 commit bfd766b

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

src/llama_engine.cc

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -125,7 +125,13 @@ LlamaEngine::LlamaEngine() {
125125
log_disable();
126126
}
127127

128-
LlamaEngine::~LlamaEngine() {}
128+
LlamaEngine::~LlamaEngine() {
129+
for(auto& [_, si]: server_map_) {
130+
auto& l = si.ctx;
131+
l.ReleaseResources();
132+
}
133+
server_map_.clear();
134+
}
129135

130136
void LlamaEngine::HandleChatCompletion(
131137
std::shared_ptr<Json::Value> json_body,

0 commit comments

Comments
 (0)