Bilou on refactored iob#65

Open

Kebniss wants to merge 585 commits intomasterfrom

BILOU-on-refactored-IOB

This pull request is big! We're only showing the most recent 250 commits

Commits on Sep 8, 2017

add description for punctuation removing (#42)

whalebot-helmsman
authored and
kmike
committed

Commits on Sep 12, 2017

Commits on Sep 14, 2017

tests for html tools
whalebot-helmsman
committed

Commits on Sep 15, 2017

Commits on Sep 20, 2017

Commits on Sep 22, 2017

letter perfect detokenization
whalebot-helmsman
committed

Commits on Sep 25, 2017

do not cleanup tokenized tree by default, separate method for tree cleanup
Vostretsov Nikita
committed
update tests for separate tree cleaning
Vostretsov Nikita
committed
update tests for correct punctuation positions
Vostretsov Nikita
committed
correct length for replaced quotes
Vostretsov Nikita
committed

Commits on Sep 29, 2017

pep8
Vostretsov Nikita
committed
new html tree based to webannotator transformer
Vostretsov Nikita
committed
ignore scripts and styles
Vostretsov Nikita
committed
ignore elements with non-text tokens
Vostretsov Nikita
committed
as we search use our regexp for text and tail in same moment, our starts and end not in DFS order
Vostretsov Nikita
committed
pep8
Vostretsov Nikita
committed
comma at line end, not start
Vostretsov Nikita
committed
one join instead of many additions, dont be Schleimel
Vostretsov Nikita
committed
correct formatting
Vostretsov Nikita
committed
add clarification
Vostretsov Nikita
committed
fix typo
Vostretsov Nikita
committed
pep8
Vostretsov Nikita
committed
preserve tokenize method for compatibility
Vostretsov Nikita
committed
function to reduce code in tests
Vostretsov Nikita
committed
remove test for nltk tokenizer
Vostretsov Nikita
committed
test our behaviour, which difers from original treebank tokenizer
Vostretsov Nikita
committed
remove useless conversion
Vostretsov Nikita
committed
rename method to avoid confusion with nltk tokenize_span method
Vostretsov Nikita
committed
remove brittle tests
Vostretsov Nikita
committed
small benchmark for html tokenizer
Vostretsov Nikita
committed

Commits on Oct 3, 2017

Commits on Oct 4, 2017

Commits on Oct 17, 2017

Commits on Oct 19, 2017

Commits on Dec 29, 2017

Commits on May 3, 2018

fix boolean bug
Kebniss
committed

Commits on May 10, 2018

add test case
Kebniss
committed

Commits on May 16, 2018

Commits on May 18, 2018

Commits on May 31, 2018

almost working version of refactored tokenize
Kebniss
committed

Commits on Jun 1, 2018

tmp debugging with possible solution for fixing HtmlToken index issue
Kebniss
committed

Commits on Jun 5, 2018

create htmlTokens after encoding
Kebniss
committed

Commits on Jun 8, 2018

fix call to bilou_group and add bilou grouping test
Kebniss
committed

Commits on Jun 11, 2018

add wapiti tests similar to crfsuite
Kebniss
committed

Commits on Jun 12, 2018

fixed merge_tp_n for bilou and added bilou tests for wapiti
Kebniss
committed

Commits on Jul 6, 2018

rebase and add BilouEncoder
Kebniss
committed

Commits on Jul 7, 2018

update files to new BilouEncoder format
Kebniss
committed

Commits on Jul 11, 2018

update wapiti to work with BilouEncoder
Kebniss
committed

Commits on Jul 12, 2018

fix comments tests
Kebniss
committed

Commits on Jul 13, 2018

Commits on Aug 2, 2018

Commits on Aug 3, 2018

Commits on Aug 27, 2018

Commits on Aug 28, 2018

Commits on Aug 30, 2018