Activities of the Working Group

If you want to join in: Please contact the chair. We are open for any ideas or initatives.

The working group had a successful workshop on GEP-HI: Introducing guidelines for good evaluation practice in health informatics at MIE2009 in Sarajevo, Aug30-Sept2 2009. Please find some slides of this workshop here.

The working group had a successfull workshop with > 60 participants on "Guidelines for good evaluation practice and reporting" at MIE 2008 in Göteborg, 26. - 28. May 2008.

Please find here the workshop schedule and the minutes of the workshop.

Please find here the slides: GEP-HI (jytte Brender), STARE-HI (Jan Talmon), Future Plans (Nicolette de Keizer)

Scientific presentation by Jan Talmon, Elske Ammenwerth, Thom Geven: The quality of reporting of Health Informatics evaluation studies. Describes a first study using STARE-HI to evaluated the quality of evaluation reports.

Workshop presentation by Pirkko Nykänen: Good evaluation practice guidelines for health informatics GEP-HI. Presents the state of work on GEP-HI.

The working group had a successful workhop at MIE 2006 on Monday August 28th, 2006 in Maastricht on "Publication of Evaluation Studies - Challenges and Guidelines for Authors".

You can find the programme of this workshop here.

Here are the materials of the workshop:

• Elske Ammenwerth: Evidence-Based Health Informatics, Publication and Publication Bias in Health Informatics
• Nicolette de Keizer: Results of a Survey on Publication Bias
• Christof Machan: Funnel Plot to detect Publication Bias (will be posted a.s.a.p.)
• Jan Talmon: Motivation and Overview on STARE-HI

The working group had a successful workhop at MIE 2005 on Tuesday 30th August in Geneva on "Development of Good Evaluation Practice Guidelines in Health Care".

You can find the programme of this workshop here.

Here are the materials of the workshop:

• Pirkko Nykänen: Good evaluation practice guidelines for health informatics - A shared European networked initiative for guidelines development GEP-HI
• Pirkko Nykänen: Handout
• Jytte Brender: Success and failure factors in health information systems development
• Jytte Brender: Handout

NEW: Report on the outcome of the workshop

In this context, please find here the slides of the MIE2005 Keynote on "Without evaluation no proper implementation" (1,1 MB). This track keynote was held by Jytte Brender as stand-in for Jan Talmon.

Medinfo 2004 San Fransicso

The Working Group has co-organized a workshop at Medinfo 2004 (September 7th 2004) on "Good evaluation of Health Informatics Applications", together with the IMIA Working Group on Technology Assessment and Quality Improvement. You can here find the links to the handhouts and slides:

Workshop programm (Doc) and Agenda (PPT)

Introduction: EFMI WG EVAL and the Declaration of Innsbruck (Ammenwerth)

The Declaration of Innsbruck (published in IJMI 73, 2004, 479-491)

GEP-HI: Approaches towards Good Evaluation Practice Guidelines - Slides (Nykänen)

GEP-HI: Approaches towards Good Evaluation Practice Guidelines - Handout (Nykänen)

STARE-HI: Standards for Reporting on Evaluation Studies (Talmon)

Overview an assessment methods: Handout and Slides (Brender)

We also had our business meeting there at Medinfo 2004, at Wednesday, 8 September 2004.

EFMI STC 2004: Contribution of Medical Informatics to Health

The working group has co-organized the EFMI Special Topic Conference 2004 in Munich, June 14th - 15th 2004. The topic of this event was "The contribution of Medical Informatics to Health". A special issue of this confernece, co-edited by the working group, is just being prepared.

The working group organized a tutorial on "introduction to evaluation of health information systems" on Sunday June 13th. You can find the programme as well the slides and other materials in the next paragraphe:

Part 1: Introduction to Evaluation

Introduction (Ammenwerth)

Basic of Evaluation of ICT in Health Care - Part 1 (Talmon)

Basic of Evaluation of ICT in Health Care - Part 2 (Brender)

Part 2: Recent and future activities of EFMI WG Evaluation of Health Information Systems

Overview on aims and activities of EFMI WG EVAL (Ammenwerth)

Good Evaluation Practice Guidelines for health informatics - GEP-HI (Nykänen)

Standards for Reporting of Evaluation Studies in Health Informatics - STARE-HI - and Evaluation Portal (Talmon)

Additional material

Evaluation of Health Informatics Applications in a Lifecycle Perspective (Brender; published in EFMI STC 2004 proceedings)

Visions and Strategies to improve evaluation of health information systems (published in IJMI 73, 2004, 479-491)

Report of activities 2004, presented during EFMI Council meeting at MIE STC 2004 in Munich, June 2004.

As a result of the ESF Exploratoy Workshop on Evaluation of Health Information Systems (HIS-EVAL) in April 2003 in Innsbruck, several activities are just under way and being discussed within the participants, mainly

• Declaration of Innsbruck on Evaluation of Health Information Systems: Ammenwerth E, Brender J, Nykanen P, Prokosch HU, Rigby M, Talmon J, et al. Visions and strategies to improve evaluation of health information systems; Reflections and lessons based on the HIS-EVAL workshop in Innsbruck. Int J Med Inf. 2004 Jun 30;73(6):479-91.
• Standards for Reporting on Evaluation Studies of Health Information Systems (STARE-HI)
• Good Evaluation Practice of Health Information Systems (GEP-HI)

Report of activities 2003, presented during EFMI Council meeting at MIE 2003 in St. Malo, May 2003.

The working group organizes two workshop and one tutorial during MIE 2003, 4 - 7 May 2003, St. Malo, France:

• Workshop: Evaluation of Health Information Systems: What theory and practice to include in our curricula?
• Workshop: How to systematically conduct evaluation studies in health information systems?
• Tutorial: An introduction into the evaluation of information technology in health care.

More information

On 4th - 6th April 2003, in Innsbruck an ESF Exploratory Workshop on New Approaches to the Systematic Evaluation of Health Information Systems took place. The number of participants (many of them were members of this EFMI working group) was restricted. Some more information.