Skip to content

[Olmo2]: Add Support for Olmo2 CausalLM Model in QEff #509

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

[Olmo2]: Add Support for Olmo2 CausalLM Model in QEff #509

wants to merge 3 commits into from
+410 −0

Conversation

vbaddi
Copy link
Contributor

@vbaddi vbaddi commented Jul 9, 2025 •
edited
Loading

  • Add support for Olmo2 CausalLM Model.
  • Verified on "allenai/OLMo-2-0425-1B", PL32, CL128

image

@vbaddi vbaddi self-assigned this Jul 9, 2025
@vbaddi vbaddi added the enhancement New feature or request label Jul 9, 2025
@vbaddi vbaddi added the 1.21.0 label Jul 9, 2025
vbaddi and others added 2 commits July 10, 2025 08:11
@vbaddi
Copy link
Contributor Author

vbaddi commented Sep 5, 2025

Perplexity is verified. Thanks @tchawada
Good to merge now: @quic-hemagnih

image

quic-hemagnih
quic-hemagnih approved these changes Sep 5, 2025
View reviewed changes
Copy link
Contributor

@quic-hemagnih quic-hemagnih left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will merge once CI passes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@quic-hemagnih quic-hemagnih quic-hemagnih approved these changes

@quic-rishinr quic-rishinr Awaiting requested review from quic-rishinr quic-rishinr is a code owner

@ochougul ochougul Awaiting requested review from ochougul ochougul is a code owner

@quic-amitraj quic-amitraj Awaiting requested review from quic-amitraj quic-amitraj is a code owner

Assignees

@vbaddi vbaddi

Labels
1.21.0 enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vbaddi @quic-hemagnih