[loginf] Call for Participation: The First International Competition on Computational Models of Argumentation (ICCMA'15)

Matthias Thimm thimm at uni-koblenz.de
Mon Sep 29 09:00:48 CEST 2014


[Apologies if you receive multiple copies. Please distribute this call to interested parties.]

======================================================================
The First International Competition on Computational Models of Argumentation
(ICCMA’15)

http://argumentationcompetition.org
======================================================================
The objectives of the competition are to provide a forum for empirical comparison of 
solvers, to highlight challenges to the community, to propose new directions for research 
and to provide a core of common benchmark problems and a representation formalism that can 
aid in the comparison and evaluation of solvers.

The First International Competition on Computational Models of Argumentation (ICCMA'15) 
will be conducted in the first half of 2015. The precise evaluation criteria will be known 
to the competitors well ahead of time (check the website for further details), in order to 
prepare their solvers accordingly. ICCMA'15 will focus on reasoning tasks in abstract 
argumentation frameworks. Submitted solvers will be tested on several artificially 
generated argumentation frameworks and some frameworks formalizing real-world problems.

For the first instance of the competition we will evaluate solvers based on their 
performance in solving the following computational tasks:

* Given an abstract argumentation framework, determine some extension
* Given an abstract argumentation framework, determine all extensions
* Given an abstract argumentation framework and some argument, decide whether the given 
 argument is credulously inferred
* Given an abstract argumentation framework and some argument, decide whether the given 
 argument is skeptically inferred

The above computational tasks are to be solved with respect to the following standard 
semantics:

* Complete Semantics
* Preferred Semantics
* Grounded Semantics
* Stable Semantics

Developers of solvers may decide to only provide support for a subset of the above 
computational tasks and/or semantics (and are also welcomed to support further semantics). 
For each track (task+semantics) we will provide a separate ranking of the submitted 
solvers if there are at least two solvers participating in the track.

The evaluation process will consist of two phases: Initially, the competitors will be 
given a set of representative AFs to test their solvers on their own machines. Then, they 
will submit a final version of the source code of their solvers that will be run by the 
organizers on the actual competition benchmarks (unknown to the competitors till this 
time). This way no fine-tuning of the solvers will be possible.

All competitors must submit a 2-page system description paper describing their solvers. 
The system description will be published as part of the proceedings of TAFA'15.

Registration
------------
Potential participants are invited to register for our mailing list 
"argumentationcompetition at inria.fr". In order to register, simply send a mail with the 
subject "subscribe argumentationcompetition <Your_Name> <Your_Surname>" to 
"sympa_inria at inria.fr". Details on the competition, news, and updates will be disseminated 
via this mailing list. Registering for the mailing list is not an automatic declaration of 
intent to participate in the competition. 

In order to register for the competition send a mail to Matthias Thimm 
(thimm at uni-koblenz.de) no later than Jan 30, 2015. The mail should indicate also name and 
affiliations of each team member, name of the solver and the tasks that the solver will be 
able to handle. The final submission of the solver software is Mar 30, 2015.

Early expression of interest will provide opportunity to help shape the structure of the 
competition.

Schedule
--------
The preliminary schedule of the competition activities goes as follows:

- Nov 21, 2014: Release of final solver interface
- Jan 30, 2015: Declaration of intent by participants
- Mar 30, 2015: Submission of solvers
- Apr, 2015: Submission of system descriptions
- Jul 25-Aug 1, 2015: Presentation of results at TAFA'15

Possible additional (intermediate) deadlines will be communicated to the registered 
participants by the organizers.

We are looking forward to an exciting competition!


Organizers
----------
Matthias Thimm, Institute for Web Science and Technologies, University of Koblenz-Landau, 
Germany
Serena Villata, INRIA Sophia Antipolis, France

The ICCMA steering committee:
---------------------------
Federico Cerutti, Department of Computing Science, University of Aberdeen, UK
Nir Oren, Department of Computing Science, University of Aberdeen, UK
Hannes Strass, Computer Science Institute, Leipzig University, Germany
Matthias Thimm, Institute for Web Science and Technologies, University of Koblenz-Landau, 
Germany
Mauro Vallati, School of Computing and Engineering, University of Huddersfield, UK
Serena Villata, WIMMICS Research Team, INRIA Sophia Antipolis, France


********************************************************************************
Dr. Matthias Thimm
Institute for Web Science and Technologies (WeST)
Universität Koblenz, Germany
Tel.: +49-261-287-2715
http://west.uni-koblenz.de/ -- http://www.mthimm.de



More information about the loginf mailing list