This is an attempt to make one of the shortest sentence tokenizers.(possibly 25 lines)
The tokenizer is ready and shall be put up on 3rd April upon conclusion of the demonstration, it tokenizes 3500+ texts in a second on my Machine.
-
Notifications
You must be signed in to change notification settings - Fork 1
utkarshrai/Sentence-Tokenizer
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
This is an attempt to make one of the shortest sentence tokenizers.(possibly 25 lines)
Resources
Stars
Watchers
Forks
Releases
No releases published