Introduction

WiCoPaCo is a corpus of natural rewritings extracted from the revision history of Wikipedia. It includes spelling corrections, reformulations, and other local text transformations, which can be of great interest for many NLP applications, such as text correction, text normalization, paraphrasing or summarization.

The following table provides examples of the corrections that can be found in the WiCoPaCo corpus.

Licence

The WiCoPaCo is realesed under the GNU Free Documentation License (GFDL)

Any research using this corpus for running experiments should include the following citation:

Aurélien Max and Guillaume Wisniewski, Mining Naturally-occurring Corrections and Paraphrases from Wikipedia’s Revision History, LREC 2010.

Here is the Bibtex entry:

@InProceedings{max10wicopaco,
    author = {Aurélien Max and Guillaume Wisniewski},
    title = {Mining Naturally-occurring Corrections and Paraphrases from 
             Wikipedia’s Revision History},
    booktitle = {Proceedings of the Seventh conference on International 
                 Language Resources and Evaluation (LREC'10)},
    year = {2010},
    month = {may},
    date = {19-21},
    address = {Valletta, Malta},
    editor = {Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, 
              Joseph Mariani, Jan Odjik, Stelios Piperidis, 
              Mike Rosner, Daniel Tapias},
    publisher = {European Language Resources Association (ELRA)},
    isbn = {2-9517408-6-7},
    language = {english}
}
             

File Format

The corpus is avaible in a simple XML format. Here is an example of an entry of the WiCoPaCo corpus that illustrates all the available information:

<modif id="23" wp_page_id="7" wp_before_rev_id="4649540"
    wp_after_rev_id="4671967" wp_user_id="0" wp_user_num_modif="1096911"
    wp_comment="Définition"> 
    <before>On nomme <m num_words="1">Algebre</m> linéaire...</before> 
    <after>On nomme <m num_words="1">Algèbre</m> linéaire...</after>  
</modif>