D1.4.3 - Final Framework for Measuring and Evaluating Heuristic Problem Solving
Date: April 15th, 2011, 15:00 - 16:00 CET
Participants: Gaston(VUA), Zhisheng (VUA), Danica (UFSD), Iker (UIBK), Hans (MPG), Ioan Toma (Softgres)
Agenda
- Discuss aim and goal of deliverable
- What plug-ins are available for testing?
Discuss content of deliverable (see LarkcProject/WP1/D1.4.3 for the initial template of the deliverable)
Minutes
Discussion
- Hans: One possibility is to focus on heuristic problem solving and thus, we should start with a definition of what we consider heuristic problem solving. The idea is to make it general enough so every WP can work with and make evaluation of their own plug-ins/workflows.
- Hans: Extend the contribution made in D1.4.1 by making an emphasis on evaluation of heuristic problem solving.
- Ioan: WP11 provides the means for making the measurements. Give a description of the methods/techniques provided by WP11's work to make evaluations and measurements of the different metrics defined in D1.4.1 and D1.4.2.
- Zhisheng: What has happened with Anytime reasoning in LarKC? Should we mention this in this deliverable?
Concrete Tasks
- Send a list to each WPs asking about the list of available plug-ins.workflows, their status and the possibility to report evaluation results using the metrics proposed in D1.4.1 and D1.4.2
- Hans and MPG to write a section on evaluation of heuristic problem solving
- Ioan and VUA to write section on integration of WP11's and WP1's work on evaluation of heuristic problem solving.