Skip to content

CePO #152

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 41 commits into from
Jan 24, 2025
Merged

CePO #152

merged 41 commits into from
Jan 24, 2025

Conversation

@pawelf-cerebras
Copy link
Contributor

@pawelf-cerebras pawelf-cerebras commented Jan 22, 2025

Added CePO as an optional method:

  • Added CePO implementation
  • Updated README to document parameters
  • Added Cerebras API as optional inference provider

@CLAassistant
Copy link

CLAassistant commented Jan 22, 2025 •
edited
Loading

CLA assistant check
All committers have signed the CLA.

@codelion
Copy link
Member

codelion commented Jan 22, 2025 •
edited
Loading

Hi, thanks for contributing your changes upstream.

Can we organize the code in its own cepo folder under /optillm/cepo/

You can put a detailed README.md in that folder as well along with the configs/

We can keep the main results table under the https://github.com/codelion/optillm?tab=readme-ov-file#sota-results-on-benchmarks-with-optillm and move the rest of the details into its own README.

pawelf-cerebras and others added 28 commits January 23, 2025 15:06
@pawelf-cerebras
Update requirements to include Cerebras dependency
ce62922
@pawelf-cerebras
Add support for CePO
d0d2570
@pawelf-cerebras
Initial version of CePO
e83d89c
@pawelf-cerebras
Add support for Cerebras client
8f55a56
@pawelf-cerebras
Add pairwise rating and clean up
82bc4b8
@pawelf-cerebras
Fix default rating type
0617e0c
@erich-cerebras @pawelf-cerebras
Add modification of CePO configs through yaml and cli arguments
8b4617e 
This will allow users to do the following:
1. Cli where if they can pass in anything that's "cepo_<name-of-attribute>"
2. Yaml file where if they pass it in as "<name-of-attribute>"
3. If none of them have a specific attribute, we use the default setting
4. If both of them have the specific attribute, we error out
@erich-cerebras @pawelf-cerebras
Fix default CePO config yaml
48a13eb
@pawelf-cerebras
Fix check if cepo_config_file provided
3ef183b
@pawelf-cerebras
Add cepo to readme
83dfb30
@pawelf-cerebras
Minor cleaning
581e26f
@pawelf-cerebras
Add VS Code to ignore list
20c98a0
@pawelf-cerebras
Minor readibility improvements
e168ea4
@pawelf-cerebras
Removed unnecessary comment
1b3aa8a
@pawelf-cerebras
Add cepo results
05ff108
@pawelf-cerebras
Make cepo_config.yaml define the default values instead of the datacl…
bef08cf 
…ass for single source of truth
@pawelf-cerebras
Updated documentation of CePO
cbebb2c
@pawelf-cerebras
Add description of CePO method
c39c1cf
@pawelf-cerebras
Update CePO section of README
d845eef
@pawelf-cerebras
Add results for LiveCodeBench and SimpleQA
a1ae99e
@pawelf-cerebras
Correct type of the output of cepo
3807724
@pawelf-cerebras
Minor fixes and add docstrings
2337abb
@emmac-cerebras @pawelf-cerebras
Updatee README.md to add the discord/research channel link
643ad9c
@emmac-cerebras @pawelf-cerebras
Create NOTICE.md
76b6181
@emmac-cerebras @pawelf-cerebras
Update .gitignore
d75239b 
Added a license header
@emmac-cerebras @pawelf-cerebras
Update NOTICE.md
9ad5957 
Added a link to view the file changes
@emmac-cerebras @pawelf-cerebras
Update optillm.py
5f5553c 
Added a license header
@emmac-cerebras @pawelf-cerebras
Update cepo.py
23035b5 
Added a license header
@pawelf-cerebras
Copy link
Contributor Author

pawelf-cerebras commented Jan 23, 2025

Thank you, @codelion! Certainly! I moved the code, config, and the CePO part of README into optillm/cepo, I only left the results for CePO vs base models in the SOTA results section.

@codelion
Copy link
Member

codelion commented Jan 24, 2025

Looks, good. I will merge the PR. Thank you for your contributions. I will also cut a new release of the PYPI package with these changes later today.

@codelion codelion merged commit 63b25fb into algorithmicsuperintelligence:main Jan 24, 2025
1 check passed
@pawelf-cerebras pawelf-cerebras deleted the cepo_rc branch September 18, 2025 18:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@pawelf-cerebras @CLAassistant @codelion @erich-cerebras @emmac-cerebras