View source for Center for the Evaluation of Language and Communication Technologies

The '''Center for the Evaluation of Language and Communication Technologies (CELCT)''' was an organisation devoted to the evaluation of language technologies, located in [[Povo]], [[Trento]] ([[Italy]]).

CELCT was established in 2003 by [[Fondazione Bruno Kessler|FBK]] (Fondazione Bruno Kessler) and [[German Research Centre for Artificial Intelligence|DFKI]] (Deutsches Forschungszentrum für Künstliche Intelligenz), and was funded by the [[Trentino|Autonomous Province of Trento]]. The goals of CELCT were "to set up infrastructures and develop skills in order to operate successfully in the field of the evaluation of language and communication technologies, becoming a reference point in the field at the national and European levels."<ref name="CELCT">{{cite web|title=CELCT web site|url=http://www.celct.it/about-us.php|accessdate=10 January 2014|archive-url=https://web.archive.org/web/20140218215340/http://www.celct.it/about-us.php|archive-date=18 February 2014|url-status=dead}}</ref>
CELCT interpreted its mission by carrying out several activities in the field of [[language technology|HLT]] evaluation, mainly focusing on the organization of national and international evaluation campaigns and on the creation of [[speech corpus|speech]] and [[text corpus|text]] corpora in different [[language]]s and at different linguistic [[annotation]] levels.<ref name="CELCT" />

CELCT's activities were closed on December 31, 2013. The staff working at CELCT at the time of its closure is continuing their research activities within [[Fondazione Bruno Kessler|FBK]].<ref>{{cite web|title= Fondazione Bruno Kessler website|url=http://www.fbk.eu/|accessdate=10 January 2014}}</ref>

== European projects ==

* TOSCA-MP:<ref>{{cite web|title=TOSCA-MP European project website|url=http://tosca-mp.eu/|accessdate=18 January 2014}}</ref><ref>{{cite web|title=Deliverable D2.1 of TOSCA-MP project|url=http://tosca-mp.eu/wp-content/uploads/2012/10/TOSCAMP-D2.1-HHI-Metadata-Extraction-Enrichment-and-Linking-v1-v07.pdf|accessdate=10 January 2014}}</ref><ref>{{cite web|title=Deliverable D2.2 of TOSCA-MP project|url=http://tosca-mp.eu/wp-content/uploads/2013/07/TOSCAMP-D2.2-RAI-Metadata-Extraction-Enrichment-and-Linking_FINAL.pdf|accessdate=10 January 2014}}</ref> Task-oriented search and content annotation for media production
* EXCITEMENT:<ref>{{cite web|title=EXCITEMENT European project website|url=http://excitement-project.eu|accessdate=18 January 2014}}</ref> EXploring Customer Interactions through Textual EntailMENT
* PROMISE:<ref>{{cite web|title=PROMISE website|url=http://www.promise-noe.eu/|accessdate=18 January 2014}}</ref><ref>{{cite web|title=Partners of PROMISE|url=http://www.promise-noe.eu/partners|accessdate=13 January 2014}}</ref> Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation
* TrebleCLEF: Evaluation, Best Practice & Collaboration for Multilingual Information Access
* [[Euromatrix|EuroMatrix]]:<ref>{{cite web|title=Euromatrix European project website|url=http://www.euromatrix.net/|access-date=2014-01-17|archive-url=https://web.archive.org/web/20160905140224/http://www.euromatrix.net/|archive-date=2016-09-05|url-status=dead}}</ref> Statistical and Hybrid Machine Translation Between All European Languages

== Other projects ==

* LiveMemories:<ref>{{cite web|title=LiveMemories website|url=http://www.livememories.org/|accessdate=26 February 2014}}</ref> Active Digital Memories of Collective Life - Project funded by the [[Autonomous Province of Trento]]  
* OntoText:<ref>{{cite web|title=Ontotext project website|url=http://ontotext.fbk.eu/index.html|accessdate=18 January 2014}}</ref> From Text to Knowledge for the Semantic Web - Project funded by the [[Autonomous Province of Trento]]
* Law Making Environment<ref>{{cite web|title=Law Making Environment project website|url=http://nir.ittig.cnr.it/lme/index.php?option=com_content&view=article&id=46&Itemid=53|accessdate=18 January 2014|archive-url=https://web.archive.org/web/20160304001432/http://nir.ittig.cnr.it/lme/index.php?option=com_content&view=article&id=46&Itemid=53|archive-date=4 March 2016|url-status=dead}}</ref> - Project in collaboration with [[Consiglio Nazionale delle Ricerche]]

== Evaluation campaigns ==

CELCT was involved in the following initiatives devoted to the evaluation of [[Natural language processing|Natural Language Processing]] tools, collaborating with various organizations and networks of excellence both at the national and international level:
* Document Understanding Conference: DUC 2005<ref>{{cite web|title=DUC 2005 website|url=http://www-nlpir.nist.gov/projects/duc/duc2005/}}</ref>
* Multilingual [[Question Answering]] Track at [[Cross Language Evaluation Forum|CLEF]]<ref>{{cite web|title=CLEF web site|url=http://www.clef-initiative.eu/|archive-url=https://web.archive.org/web/20120131211642/http://www.clef-initiative.eu/|url-status=dead|archive-date=31 January 2012|accessdate=10 January 2014}}</ref> (from 2005 to 2013)
* Recognizing [[Textual entailment|Textual Entailment]] (RTE) Challenges<ref>{{cite web|title=RTE challenges website|url=http://aclweb.org/aclwiki/index.php?title=Recognizing_Textual_Entailment|accessdate=18 January 2014}}</ref> (from 2005 to 2013)
* International Workshop on [[Machine translation|Spoken Language Translation]]: IWSLT 2006,<ref>{{cite web|title=IWSLT2006 website|url=http://www2.nict.go.jp/univ-com/multi_trans/WS/IWSLT2006/index.html|accessdate=18 January 2014|archive-url=https://web.archive.org/web/20130202221943/http://www2.nict.go.jp/univ-com/multi_trans/WS/IWSLT2006/index.html|archive-date=2013-02-02|url-status=dead}}</ref><ref>{{cite web|title=Organizers of IWSLT 2006|url=http://www2.nict.go.jp/univ-com/multi_trans/WS/IWSLT2006/archives/2005/11/organizers.html|accessdate=10 January 2014|archive-url=https://web.archive.org/web/20130204071310/http://www2.nict.go.jp/univ-com/multi_trans/WS/IWSLT2006/archives/2005/11/organizers.html|archive-date=2013-02-04|url-status=dead}}</ref> IWSLT 2007,<ref>{{cite web|title=IWSLT2007 website|url=http://iwslt07.fbk.eu/|accessdate=18 January 2014}}</ref><ref>{{cite web|title=Organizers of IWSLT 2007|url=http://iwslt07.fbk.eu/menu/organization.html|accessdate=10 January 2014}}</ref> IWSLT 2011,<ref>{{cite web|title=IWSLT2011 website|url=http://www.iwslt2011.org/|accessdate=18 January 2014}}</ref><ref>{{cite web|title=Organizers of IWSLT 2011 evaluation campaign|url=http://www.iwslt2011.org/doku.php?id=06_evaluation|accessdate=10 January 2014|url-status=dead|archiveurl=https://web.archive.org/web/20140130045300/http://iwslt2011.org/doku.php?id=06_evaluation|archivedate=30 January 2014}}</ref> and IWSLT 2012<ref>{{cite web|title=IWSLT2012 website|url=http://hltc.cs.ust.hk/iwslt/|accessdate=18 January 2014}}</ref><ref>{{cite web|title=MT Track organizers of IWSLT 2012|url=http://hltc.cs.ust.hk/iwslt/index.php/evaluation-campaign/ted-task.html#MTtrack|accessdate=10 January 2014}}</ref>
* Evalita:<ref>{{cite web|title=Evalita website|url=http://www.evalita.org/|accessdate=18 January 2014}}</ref> Evaluation of NLP and Speech Tools for Italian (2007, 2009, 2011)
* Cross-Lingual [[textual entailment|Textual Entailment]] task  at [[Semeval]] (2012<ref>{{cite web|title=CLTE@Semeval-2012 website|url=http://www.cs.york.ac.uk/semeval-2012/task8/|accessdate=18 January 2014}}</ref> and 2013<ref>{{cite web|title=CLTE@Semeval-2013 website|url=http://www.cs.york.ac.uk/semeval-2013/task8/|accessdate=22 January 2014}}</ref>)

== Publications ==

CELCT produced a number of scientific publications in all its activity fields.<ref>{{cite web|title=Complete list of CELCT publications|url=http://www.celct.it/publication.php|accessdate=18 January 2014|archive-url=https://web.archive.org/web/20140627023931/http://www.celct.it/publication.php|archive-date=27 June 2014|url-status=dead}}</ref><ref>{{cite web|title=List of CELCT publications in the ACL Anthology Network|url=http://clair.eecs.umich.edu/aan/organization.php?org_id=118#ui-tabs-2|accessdate=18 January 2014|archive-url=https://web.archive.org/web/20160304091937/http://clair.eecs.umich.edu/aan/organization.php?org_id=118#ui-tabs-2|archive-date=4 March 2016|url-status=dead}}</ref><ref>{{cite web|title=List of CELCT publications in the ACL Anthology Searchbench|url=http://aclasb.dfki.de/?#org~%7CCELCT*|accessdate=18 January 2014}}</ref>

== References ==

{{reflist}}

{{authority control}}

[[Category:Science and technology in Italy]]
[[Category:Linguistics organizations]]
[[Category:Linguistic research institutes]]