-
Notifications
You must be signed in to change notification settings - Fork 4
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
8 changed files
with
73,536 additions
and
50,885 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,5 +1,5 @@ | ||
Universal Dependencies - English Dependency Treebank | ||
Universal Dependencies English Web Treebank v2.7 -- 2020-11-15 | ||
Universal Dependencies English Web Treebank v2.13 -- 2023-11-15 | ||
https://github.com/UniversalDependencies/UD_English-EWT | ||
|
||
|
||
|
@@ -12,7 +12,7 @@ LDC2012T13 (https://catalog.ldc.upenn.edu/LDC2012T13). | |
|
||
# Introduction | ||
|
||
The corpus comprises 254,830 words and 16,622 sentences, taken from five genres | ||
The corpus comprises 254,820 words and 16,622 sentences, taken from five genres | ||
of web media: weblogs, newsgroups, emails, reviews, and Yahoo! answers. See the | ||
LDC2012T13 documentation for more details on the sources of the sentences. The | ||
trees were automatically converted into Stanford Dependencies and then | ||
|
@@ -25,7 +25,7 @@ mainly been done automatically, with very limited hand-correction. | |
|
||
# License/Copyright | ||
|
||
Universal Dependencies English Web Treebank annotations © 2013-2020 | ||
Universal Dependencies English Web Treebank annotations © 2013-2021 | ||
by The Board of Trustees of The Leland Stanford Junior University. | ||
All Rights Reserved. | ||
|
||
|
@@ -46,7 +46,7 @@ Portions may be © 2012 Google Inc., © 2011 Yahoo! Inc., | |
# Structure | ||
|
||
This directory contains a corpus of sentences annotated using Universal | ||
Dependencies annotation. The corpus comprises 254,830 words and 16,622 | ||
Dependencies annotation. The corpus comprises 254,820 words and 16,622 | ||
sentences, taken from various web media including weblogs, newsgroups, emails, | ||
reviews, and Yahoo! answers; see the LDC2012T13 documentation for more details | ||
on the source of the sentences. The trees were automatically converted into | ||
|
@@ -74,16 +74,75 @@ manually checked. | |
|
||
# Deviations from UD | ||
|
||
Version 2.7 of the English UD treebank conforms to the UD guidelines in | ||
Version 2.13 of the English UD treebank conforms to the UD guidelines in | ||
almost all respects, but there remain the following deviations: | ||
|
||
- The UD dependency `flat` is largely only used for person names. | ||
- Dates are not annotated consistently. | ||
- The attachment of punctuation tokens is sometimes not according to the | ||
guidelines. | ||
|
||
# Changelog | ||
|
||
**2023-11-15 v2.13** | ||
|
||
Highlights: | ||
|
||
- Structural | ||
- **Adopt subtype `obl:agent` for passive *by*-phrases**, and apply the feature `Voice=Pass` more widely [to distinguish passive uses from active perfect uses of the past participle form](https://universaldependencies.org/en/feat/Voice.html) ([#290](https://github.com/UniversalDependencies/UD_English-EWT/issues/290)) | ||
- **Remove use of `flat:foreign`** in line with most other English treebanks ([#459](https://github.com/UniversalDependencies/UD_English-EWT/issues/459)) | ||
- Implement new guidelines on sufficiency/excess constructions ([#423](https://github.com/UniversalDependencies/UD_English-EWT/issues/423)) | ||
- Use Udapi to standardize `punct` attachments (thanks to [@martin-popel](https://github.com/martinpopel)) | ||
- Features | ||
- Flesh out features on [DETs](https://universaldependencies.org/en/pos/DET.html) ([#416](https://github.com/UniversalDependencies/UD_English-EWT/issues/416)) | ||
- Make features on numbers more uniform and consistent with other treebanks (flagged by [@rhdunn](https://github.com/rhdunn): [#451](https://github.com/UniversalDependencies/UD_English-EWT/issues/451), [#458](https://github.com/UniversalDependencies/UD_English-EWT/issues/458), [#464](https://github.com/UniversalDependencies/UD_English-EWT/issues/464), [#465](https://github.com/UniversalDependencies/UD_English-EWT/issues/465)) | ||
- Ensure verb features are complete and consistent with tags | ||
- Use AUX (not VERB) for "have" and "do" when stranded due to ellipsis ([#403](https://github.com/UniversalDependencies/UD_English-EWT/issues/403)) | ||
- Mark verbal contractions missing apostrophes as typos (flagged by [@rhdunn](https://github.com/rhdunn): [#443](https://github.com/UniversalDependencies/UD_English-EWT/issues/443)) | ||
- Extensive cleanup of/based on UPOS | ||
|
||
**2023-05-15 v2.12** | ||
|
||
Highlights: | ||
|
||
- Implement new policy on [sole `iobj`](https://universaldependencies.org/changes.html#sole-iobj) ([#55](https://github.com/UniversalDependencies/UD_English-EWT/issues/55)) | ||
- Cleanup of free relatives (part of [#278](https://github.com/UniversalDependencies/UD_English-EWT/issues/278)) | ||
- Make use of `xcomp` more consistent | ||
- For "etc.", change `Number=Sing` to `Number=Plur` | ||
|
||
**2022-11-15 v2.11** | ||
|
||
Highlights: | ||
|
||
- Implement `:outer` per [multiple subjects](https://universaldependencies.org/changes.html#multiple-subjects) policy ([#310](https://github.com/UniversalDependencies/UD_English-EWT/issues/310)) | ||
- Implement `advcl:relcl` ([#346](https://github.com/UniversalDependencies/UD_English-EWT/issues/346)) | ||
- Implement revised guidelines for English pronouns (lemmas, features) ([issue](https://github.com/UniversalDependencies/docs/issues/517)) | ||
- Revise WH-adverbs to attach in a subordinate clause as `advmod` not `mark` ([#88](https://github.com/UniversalDependencies/UD_English-EWT/issues/88)) | ||
- Improved lemmas/features for numeric values/entities | ||
- Tag "etc." as `NOUN` ([#353](https://github.com/UniversalDependencies/UD_English-EWT/issues/353)) | ||
- Add neaten.py, which implements English-specific validation rules | ||
|
||
**2022-05-15 v2.10** | ||
|
||
Highlights: | ||
|
||
- Fixed all validation errors | ||
- Implement new [`goeswith` policy](https://universaldependencies.org/changes.html#typos-and-goeswith) ([#314](https://github.com/UniversalDependencies/UD_English-EWT/pull/314)) | ||
- Use `parataxis` for "X so Y" and similar ([#313](https://github.com/UniversalDependencies/UD_English-EWT/pull/313)) | ||
|
||
**2021-11-15 v2.9** | ||
- Fixed all validation errors | ||
- Many other improvements to annotation of assorted words and constructions | ||
|
||
**2021-05-15 v2.8** | ||
- Fixed many wrong lemmata, POS tags, and relations | ||
- Reanalyzed many dependencies to conform to UD validation | ||
- Retagged words in names to limit PROPN to true nouns | ||
- Fixed certain metadata issues | ||
- Fixed some typos, added CorrectForms | ||
- Added missing multiword tokens for clitics/contractions | ||
- Added Style=Expr feature for expressive spellings | ||
- Fixed many incorrectly non-projective graphs, reanalyzing as projective | ||
- Reannotated list items as NUM not X | ||
|
||
**2020-11-15 v2.7** | ||
- Added multiword tokens where appropriate for contracted verb forms | ||
- Fixed some wrong lemmata and POS tags | ||
|
@@ -94,12 +153,12 @@ almost all respects, but there remain the following deviations: | |
- Fixed directionality of some `goeswith` dependencies | ||
|
||
**2019-11-15 v2.5** | ||
- Fixed miscellaneous syntactic issues | ||
- Fixed miscellaneous syntactic issues | ||
- Fixed CoNLL-U syntax error | ||
|
||
**2019-05-15 v2.4** | ||
- Fixed some wrong lemmata and POS tags | ||
- Fixed miscellaneous syntactic issues | ||
- Fixed miscellaneous syntactic issues | ||
- Fixed some punctuation attachments | ||
- Fixed malformed enhanced graphs | ||
|
||
|
@@ -165,7 +224,7 @@ The best way to do this is to file a github issue at: | |
https://github.com/UniversalDependencies/UD_English-EWT/issues | ||
|
||
We also welcome pull requests. If you want to make edits, please modify the | ||
trees in the idividual files in the `not-to-release/sources` directory instead | ||
trees in the individual files in the `not-to-release/sources` directory instead | ||
of making direct changes to `en_ewt-ud-{dev,test,train}.conllu`. | ||
|
||
|
||
|
@@ -182,9 +241,9 @@ Annotation of the Universal Dependencies English Web Treebank was carried out by | |
- Nathan Schneider | ||
- Ethan Chi | ||
- Samuel Bowman | ||
- Christopher Manning | ||
- Hanzhi Zhu | ||
- Daniel Galbraith | ||
- Christopher Manning | ||
- John Bauer | ||
|
||
Creation of the CoNLL-U files, including calculating UPOS, feature, and lemma | ||
|
@@ -202,7 +261,6 @@ partially funded by a gift from Google, Inc., which we gratefully acknowledge. | |
You are encouraged to cite this paper if you use the Universal Dependencies | ||
English Web Treebank: | ||
|
||
|
||
@inproceedings{silveira14gold, | ||
year = {2014}, | ||
author = {Natalia Silveira and Timothy Dozat and Marie-Catherine de | ||
|
@@ -213,20 +271,21 @@ English Web Treebank: | |
Resources and Evaluation (LREC-2014)} | ||
} | ||
|
||
|
||
# Metadata | ||
|
||
``` | ||
=== Machine-readable metadata (DO NOT REMOVE!) ================================ | ||
Data available since: UD v1.0 | ||
License: CC BY-SA 4.0 | ||
Includes text: yes | ||
Genre: blog social reviews email | ||
Genre: blog social reviews email web | ||
Lemmas: automatic with corrections | ||
UPOS: converted with corrections | ||
XPOS: manual native | ||
Features: automatic | ||
Features: converted with corrections | ||
Relations: manual native | ||
Contributors: Silveira, Natalia; Dozat, Timothy; Manning, Christopher; Schuster, Sebastian; Chi, Ethan; Bauer, John; Connor, Miriam; de Marneffe, Marie-Catherine; Schneider, Nathan; Bowman, Sam; Zhu, Hanzhi; Galbraith, Daniel | ||
Contributors: Silveira, Natalia; Dozat, Timothy; Manning, Christopher; Schuster, Sebastian; Chi, Ethan; Bauer, John; Connor, Miriam; de Marneffe, Marie-Catherine; Schneider, Nathan; Bowman, Sam; Zhu, Hanzhi; Galbraith, Daniel; Bauer, John | ||
Contributing: here source | ||
Contact: [email protected] | ||
=============================================================================== | ||
|
Oops, something went wrong.