Skip to content

Add NERCut tokenization engine #503

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 9 commits into from
Dec 27, 2020
Merged

Add NERCut tokenization engine #503

merged 9 commits into from
Dec 27, 2020

Conversation

wannaphong
Copy link
Member

NERCut is a word segmentation powered by newmm and ThaiNER from PyThaiNLP.

Your checklist for this pull request

🚨Please review the guidelines for contributing to this repository.

  • Passed code styles and structures
  • Passed code linting checks and unit test

@coveralls
Copy link

coveralls commented Dec 16, 2020 •
edited
Loading

Coverage Status

Coverage decreased (-1.5%) to 93.965% when pulling 1a7cbc9 on add-nercut into 03cd2c3 on dev.

@wannaphong
Copy link
Member Author

https://i.imgur.com/6TGxc3y.png
time word tokenizer https://colab.research.google.com/drive/1Z6ap2rpFm4DQO9O8XEQ6prT61ZhUqErW?usp=sharing

@bact bact changed the title Add NERCut Add NERCut tokenization engine Dec 16, 2020
@bact bact self-requested a review December 16, 2020 16:59
@bact bact added the enhancement enhance functionalities label Dec 17, 2020
@bact bact added this to the 2.3 milestone Dec 17, 2020
@bact bact merged commit 3e622d7 into dev Dec 27, 2020
@bact bact deleted the add-nercut branch December 27, 2020 12:15
@bact bact mentioned this pull request Dec 27, 2020
Closed
@wannaphong wannaphong mentioned this pull request Apr 4, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bact bact Awaiting requested review from bact

Assignees

No one assigned

Labels

enhancement enhance functionalities

Projects

None yet

Milestone

2.3

Development

Successfully merging this pull request may close these issues.

3 participants

@wannaphong @coveralls @bact