Read on Twitter
I'm current reading a paper that is claiming lg independence based on a train/test split of the 37 UD 1.2 treebanks.
External Tweet loading...
If nothing shows, it may have been deleted
by @emilymbender view original on Twitter
The paper claims that those treebanks represent 37 languages. They don't. It's 33.
Worse -- one of the doubly represented languages is put once in train (fi) and once in test (fi_ftb).
Worse -- they claim to have gotten this split from Wang & @adveisner 2016, published in TACL.
Making datasets available to world is good, making fundamentally flawed datasets available to the world is bad.
And shame on the TACL reviewers for not catching this!
In sum: If you don't understand the data (in #NLProc or any other field), you are not in a position to make valid claims.
• • •
Missing some Tweet in this thread? You can try to
force a refresh
