D1.4.3: Final Framework for measuring and evaluating heuristic problem solving
This deliverable will provide the last version of the framework and will provide evaluation results that show how to evaluate each of the plug-ins implemented in LarKC using the parameters/measures defined by the framework in D1.4.1 and D1.4.2.
Contents
Tasks
- Send a list of questions to WP2, 3 and 4 asking about how do they plan to evaluate their plug-ins and workflows using the framework. How difficult would be for each developer to do this?
Meetings and Telcos Related to this Deliverable
Friday April 15th at 15:00 CET (Minutes: TelCo-April-15-2011)
Content of the Deliverable
- Chapter 1: Introduction (VUA)
- Chapter 2: Framework (VUA + Someone from WP11, Ioan?)
- Describe the final version of the framework
- Integrate with the work in WP11. How does this relate to the MPG's work on heuristics and the work on the instrumentation and evaluation being done in WP11
- Chapter 3: Evaluation Results: Plug-ins
- Evaluation of Identify/Select Plug-ins (Someone from WP2 and developers)
- Evaluation of Transform Plug-ins (Someone from WP3 and developers)
- Evaluation of Reason Plug-ins (Someone from WP4 and developers)
- Chapter 4: Evaluation Results: Workflows (Someone from WP5)
- Chapter 5: Conclusion (All)
Resources
The URL of the SVN is: http://svn.larkc.eu/wp1/larkc143/
Timeline
- Deadline for answering questions regarding practical aspects of evaluation (done by developers of plug-ins and workflows): April 15th, 2011.
- Deadline for reporting evaluation results: July 1st., 2011.
- First draft ready: August 1st, 2011.
- Final integration of contributions from each partner: August 15th, 2011.
- Final draft ready for internal review: September 10th, 2011.
- Submission to EU: September 30th. 2011