The tutorial will cover theory and practice of Performance Evaluation. The main structure will be following the components and stages of Performance Evaluation systems, with concrete treatment of Document Image Analysis subfields within each component:

• Overview of Performance Evaluation in Document Image Analysis
  • Components and stages
• Datasets
  • Selection principles
• Criteria for different DIA subfields
  • Organisation challenges
  • Available datasets
• Ground truth
  • Definition
• Need in different DIA subfields
  • Representation
  • Production workflow (local and outsourced)
• Ground-truthing tools
  • For different DIA subfields
  • Presentation and demo
• Evaluation Metrics /scenarios
  • For different DIA subfields
• Evaluation tools
  • For different DIA subfields
  • Presentation and demo
• Guided hands-on experimentation