User Tools

Site Tools


shared_task_description

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
shared_task_description [2015/01/07 15:34]
dseddah
shared_task_description [2015/02/20 19:10] (current)
dseddah
Line 105: Line 105:
 === Evaluating All Scenarios === === Evaluating All Scenarios ===
  
-  * For constituent evaluation on gold word segmentation of bracketed output (eg. PTB), we will use a modified version of Parseval'​s evalb: [[http://​pauillac.inria.fr/​~seddah/​evalb_spmrl2013.tar.gz]] ​or {{:​dldata:​evalb_spmrl2013.tar.gz}}. Add -fPIC to gcc to compile for Linux.+  * For constituent evaluation on gold word segmentation of bracketed output (eg. PTB), we will use a modified version of Parseval'​s evalb: [[http://​pauillac.inria.fr/​~seddah/​evalb_spmrl2013.tar.gz]]. Add -fPIC to gcc to compile for Linux. 
 +**update *February 2014: the evalb package that was available on Djame'​s site was not the correct one. if your version doesn'​t have the -X switch, it's the buggy one.** 
   *    * 
   * For dependency evaluation on gold word segmentation,​ we will use the CoNLL 2007 evaluation: [[http://​nextens.uvt.nl/​depparse-wiki/​SoftwarePage#​eval07.pl]]   * For dependency evaluation on gold word segmentation,​ we will use the CoNLL 2007 evaluation: [[http://​nextens.uvt.nl/​depparse-wiki/​SoftwarePage#​eval07.pl]]
shared_task_description.txt · Last modified: 2015/02/20 19:10 by dseddah