Publications of the Working Groups

Here you can find some of the paper that have been published by the IMIA or EFMI Working Group or in close cooperation with them.

Paper in peer-reviewed Journals

Ammenwerth E, Rigby M. Evidence-based Health Informatics - Promoting Safety and Efficiency Through Scientific Methods and Ethical Policy. Stud Health Tech Inform. Vol 222. 2016. IOS Press.

Ammenwerth E, de Keizer N, Brender J, Craven CK, Eisenstein E, Georgiou A, Khairat S, Magrabi F, Nykänen P, Otero P, Rigby M, Scott P, Weir C. Recommendations for Health IT Evaluation Training as a Key Prerequisite to Obtaining Evidence. Poster at the MIE2016/HEC2016 conference, 28.8.-2.9.2016, Munich.

Magrabi F, Ammenwerth E, Hyppönen H, de Keizer N, Nykänen P, Rigby M, Scott P, Talmon J, Georgiou A. Improving Evaluation to Address the Unintended Consequences of Health Information Technology. Yearb Med Inform 2016; 61-69.

Ammenwerth E. Evidence-Based Health Informatics: How do we know what we know? Methods Inf Med 2015; 54(4): 298-307.

Rigby M, Magrabi F, Scott P, Doupi P, Hypponen H, Ammenwerth E. Steps in Moving Evidence-Based Health Informatics from Theory to Practice. Health Informatics Research 2016; 22(4): 255-60.

Rigby M, Georgiou A, Hyppönen H, Ammenwerth E, de Keizer N, Magrabi F, Scott P. Patient Portals as a Means of Information and Communication Technology Support to Patient- Centric Care Coordination - the Missing Evidence and the Challenges of Evaluation. A joint contribution of IMIA WG EVAL and EFMI WG EVAL. Yearb Med Inform 2015;10(1): 148-59.

Scott P. Exploiting the information revolution: call for independent evaluation of the latest English national experiment. Journal of Innovation in Health Informatics 2015; 22 (1). http://dx.doi.org/10.14236/jhi.v22i1.139.

Ammenwerth E, Nykänen P, Rigby M, de Keizer N. Clinical decision support systems: Need for evidence, need for evaluation. Artif Intell Med 2013; 59(1): 1-3.

Rigby M, Ammenwerth E, Beuscart-Zephir MC, Brender J, Hyppönen H, Melia S, Nykänen P, Talmon J, de Keizer N. Evidence Based Health Informatics: 10 Years of Efforts to Promote the Principle. IMIA Yearbook of Medical Informatics 2013; 34-46.

Brender J, Talmon J, de Keizer N, Nykänen P, Rigby M, Ammenwerth E. STARE-HI – Statement on Reporting of Evaluation Studies in Health Informatics Explanation and Elaboration. Appl Clin Inform 2013; 4: 331–58. http://dx.doi.org/10.4338/ACI-2013-04-RA-0024

Nykänen P, Brender J, Talmon J, de Keizer N, Rigby M, Beuscare-Zephir MC, Ammenwerth E. Guideline for Good Evaluation Practice in Health Informatics (GEP-HI). Int J Med Inform 2011; 80: 815-827

de Keizer NF, Talmon J, Ammenwerth E, Brender J, Rigby M, Nykänen P. Systematic Prioritization of the STARE-HI Reporting Items. An Application to Short Conference Papers on Health Informatics Evaluation. Methods Inf Med. 2011 Mar 4;50(3). Selected as "Best Paper" for the IMIA Yearbook of Medical Informatics 2012, Schattauer.

Rigby M, Ammenwerth E, Talmon J, Nykänen P, Brender J, de Keizer N. Health Informatics 3.0 and other Increasingly Dispersed Technologies Require Even Greater Trust: Promoting Safe Evidence-based Health Informatics. IMIA Yearbook of Medical Informatics 2011. Stuttgart: Schattauer. 105-111.

Talmon J, Ammenwerth E, Brender J, de Keizer N, Nykänen P, Rigby M. STARE-HI - Statement on reporting of evaluation studies in Health Informatics, Int J Med Inform 2009; 78(1): 1-9. Reprinted in: Yearbook of Medical Informatics 2009: 23-31.

de Keizer N, Ammenwerth E. The quality of evidence in health informatics: How did the quality of healthcare IT evaluation publications develop from 1982 to 2005? Int J Med Inform. 2008; 77(1): 41-49.

Ammenwerth E, de Keizer N. A viewpoint on Evidence-based Health Informatics, based on a pilot survey on evaluation studies in health care informatics. JAMIA 2007; 14(3): 368-371.

Ammenwerth E, Talmon J, Ash JS, Bates DW, Beuscart-Zéphir MC, Duhamel A, Elkin PL, Gardner RM, Geissbuhler A. Impact of CPOE on mortality rates--contradictory findings, important messages. Methods Inf Med. 2006;45(6):586-93.

Brender J, Ammenwerth E, Nykänen P, Talmon J. Factors influencing success and failure of health informatics systems--a pilot Delphi study. Methods Inf Med. 2006;45(1):125-36.

Rigby M. Evaluation--the Cinderella science of ICT in health. Yearbook of Medical Informatics 2006: 114-20.

Talmon JL. Evaluation and implementation: a call for action. Yearbook of Medical Informatics 2006:11-5.

Ammenwerth E, de Keizer N. An inventory of evaluation studies of information technology in health care: Trends in evaluation research 1982 - 2002. Methods of Information in Medicine. 2005;44:44-56.

Ammenwerth E, Brender J, Nykänen P, Prokosch H-U, Rigby M, Talmon J, et al. Visions and strategies to improve evaluation of health information systems Reflections and lessons based on the HIS-EVAL workshop in Innsbruck. Int J Med Inf. 2004 Jun 30;73(6):479-91.

Rigby M. Health Informatics as a Tool to Improve Quality in Non-acute Care - New Opportunities and a Matching Need for a New Evaluation Paradigm; International Journal of Medical Informatics, 56, 141-150, 1999.

Contributions to conferences

Ammenwerth E, Magrabi F, Nykänen P, Rigby M. Evidence-Based Health Informatics and the Evaluation of Health Information Systems. In: Quaglini S, Cesarelli M, Giacomini M, Pinciroli F (eds.): eHealth - Medicina Digitale. Pàtron editore No 36. 2017. pp. 319-334.

Ammenwerth E, de Keizer N, Brender J, Craven C, Eisenstein E, Georgiou A, Khairat S, Magrabi F, Nykänen P, Otero P, Rigby M, Scott P, Weir C. How to Teach Health IT Evaluation: Recommendations for Health IT Evaluation Courses. Stud Health Technol Inform. 2017;243:3-7.

Ammenwerth E, de Keizer N, Brender J, Craven CK, Eisenstein E, Georgiou A, Khairat S, Magrabi F, Nykänen P, Otero P, Rigby M, Scott P, Weir C. Recommendations for Health IT Evaluation Training as a Key Prerequisite to Obtaining Evidence. Poster at the MIE2016/HEC2016 conference, 28.8.-2.9.2016, Munich.

Ammenwerth E, de Keizer N, Rigby MJ, Nykänen P, Talmon J, Brender J. Promoting Evidence-Based Health Informatics – A Decade of Effort. Poster at the Evidence Live 2013 conference. 25. - 26.3.2013, Oxford, UK.

de Keizer NF, Rigby M, Ammenwerth E, Talmon J, Nykänen P, Melia S, Fraser H, Oluoch T. Evaluation and Evidence: Applying Guidelines for Health IT Evaluation in Developed and Developing Countries. In: Lehmann CU, Ammenwerth E, Nohr C (eds.). Medinfo 2013 - Proceedings of the 14th World Congress on Medical and Health Informatics. Amsterdam: IOS Press. 2013. Stud Health Technol Inform. 2013;192:1251.

Hyppönen H, Ammenwerth E, de Keizer N. Exploring a Methodology for eHealth Indicator Development. In: Mantas J et al (Eds.). Quality of Life through Quality of Information: Proceedings of Medical Informatics Europe 2012 (MIE 2012), Pisa, 26. - 29.8.2012. IOS Press. 2012. pp. 338 - 341.

Hyppönen H, Ammenwerth E, Nohr C, Faxvaag A, Walldius A. eHealth-Indicators: Results of an Expert Workshop. In: Mantas J et al (Eds.). Quality of Life through Quality of Information: Proceedings of Medical Informatics Europe 2012 (MIE 2012), Pisa, 26. - 29.8.2012. IOS Press. 2012. pp. 328 - 332.

Rigby M, Brender J, Beuscart-Zephi MC, Hyppönen H, Nykänen P, Talmon J, de Keizer N, Ammenwerth E. Next Steps in Evaluation and Evidence - from Generic to Context-Related. In: Moen A, Anderson SK, Aarts J, Hurlen P (Eds.): User-centred Networked Care: Proceedings of Medical Informatics Europe (MIE 2011), Oslo. ISSN 0926-9630. pp. 208-212.

de Keizer N, Talmon J, Ammenwerth E, Brender J, Nykänen P, Rigby M. Mini Stare-HI: Guidelines for Reporting Health Informatics Evaluations in Conference Papers. In: Safran C, Marin H, Reti S (Eds.): Proceedings of Medinfo 2010, 12 - 15 September 2010, Cape Town. Studies in Health Technology and Informatics 2010: 160. pp. 1206-1210.

Nykänen Pirkko; Brender Jytte; Ammenwerth Elske; Talmon Jan; de Keizer Nicolette; Rigby Michael. Introducing guidelines for good evaluation practice in health informatics. In: Adlassnig K.-P. et al. (Eds.): Medical Informatics in a United and Healthy Europe. Proceedings of MIE 2009. Studies in Health Technology and Informatics vol. 150. Amsterdam: IOS Press. p. 958-62. ISBN 978-1-60750-044-5

Rigby M, Talmon J, Ammenwerth E, Brender J, de Keizer N, Nykänen P. Planning to test success - Employing the guidelines for Good Evaluation Practice in Health Informatics (GEP-HI). In: Macedo M (eds): Proceedings of e-Health 2009 (EH 2009) - IADIS Multi Conference on Computer Science and Information Systems, June 21 - 23, 2009, Algarve, Portugal. e-Health 2009. International Association for Development of the Information Society (IADIS). pp. 209 - 213. ISBN: 978-972-8924-81-2.

Rigby Michael; Talmon Jan; Brender Jytte; Ammenwerth Elske; De Keizer Nicolette F; Nykänen Pirkko. Linking Informaticians and End Users - Using the STARE-HI Evaluation Reporting Framework as a Unifying Design Approach. In: Adlassnig K.-P. et al. (Eds.): Medical Informatics in a United and Healthy Europe. Proceedings of MIE 2009. Studies in Health Technology and Informatics vol. 150. Amsterdam: IOS Press. p. 66-70. ISBN 978-1-60750-044-5

Rigby M, Ammenwerth E et al. International Standards for the Evaluation of IT Systems in Healthcare – the new STARE-HI Standard Using IT to improve Clinical Practice. HC2009 Congress of the British Computer Society. 28.-30. April 2009, Harrigote International Centre, UK.

Talmon J. Improving the quality of the evidence base of health informatics. AMIA Annu Symp Proc. 2008 Nov 6:1211-2.

Talmon T, Ammenwerth E, Geven T. The Quality of Reporting of Health Informatics Evaluation Studies: A Pilot Study. In: MEDINFO 2007 Building Sustainable Health Systems (K.A. Kuhn, J.R. Warren and T.Y. Leong, Eds). Studies in Health Technology and Informatics vol 129, IOS Press, 2007, 193-197.

de Keizer N, Ammenwerth E. The effects and quality of IT evaluation studies: Trends in 1982 - 2002. In: Friedman CP, Ash J, Tarczy-Hornoch P (Hrsg.): American Medical Informatics Association 2005 Proceedings - Biomedical and Heatlh Informatics: From Foundations to Applications to Policy.Oct 22-26 2005, Washington DC. p. 186-190.

de Keizer N, Ammenwerth E. Trends in evaluation research 1982 - 2002: A study on how the quality of IT evaluation studies develop. In: Engelbrecht R, Geissbuhler A, Lovis C, Mihalas G (Hrsg.): Connecting Medical Informatics and Bio-Informatics. Proceedings of Medical Informatics Europe (MIE 2005), Geneva, Aug 08 - Sep 01 2005. Studies in Health Technology and Informatics, Volume 116. Amsterdam: IOS Press. 581-586.

Ammenwerth E, de Keizer N. An inventory of evaluation studies of information technology in health care: Trends in evaluation research 1982 - 2002. In: Fieschi M, Coiera E, Jack LI Y-C (Eds.). Proceedings of the IIth World Congress on Medical Informatics (Medinfo 2004); 7 - 11 September 2004, San Francisco: 1289-1294. ISBN 158603-4448. Also available on CD.

Talmon J, Ammenwerth E. "The declaration of Innsbruck": some reflections. In: Roger France FH, de Clercq E, de Moor G, van der Lei J, editors. Health Continuum and Data Exchange in Belgium and in The Netherlands - Proceedings of Medical Informatics Congress (MIC 2004) & 5th Belgium E-Health Conference. Amsterdam: IOS Press; 2004. p. 68-74. ISBN 1-58603-487-1.

Rigby M. Evaluation: 16 Powerful Reasons Why Not to Do It - And 6 Over-Riding Imperatives; in Patel V, Rogers R, Haux R (eds.): Medinfo 2001: Proceedings of the 10th. World Congress on Medical Informatics, IOS Press, Amsterdam, 2001, 1198-1202.

Books

Ammenwerth E, Rigby M. Evidence-based Health Informatics - Promoting Safety and Efficiency Through Scientific Methods and Ethical Policy. Stud Health Tech Inform. Vol 222. IOS Press. 978-1-61499-634-7 (print) | 978-1-61499-635-4 (online). Open access!

Journal special issues

Ammenwerth E, Nykänen P, Rigby M, de Keizer N (Hrsg): Special Issue: Evaluation of Clinical Decision Support Systems. Artif Intell Med 2013; 59(1): 1-54.

Book chapters

Rigby M, Ammenwerth E. The need for Evidence in Health Informatics. In: Ammenwerth E, Rigby M. Evidence-based Health Informatics - Promoting Safety and Efficiency Through Scientific Methods and Ethical Policy. Stud Health Tech Inform. Vol 222. IOS Press. pp. 3 - 13.

Ammenwerth E, de Keizer N. Publishing Health IT Evaluation Studies. In: Ammenwerth E, Rigby M. Evidence-based Health Informatics - Promoting Safety and Efficiency Through Scientific Methods and Ethical Policy. Stud Health Tech Inform. Vol 222. IOS Press. pp. 304-311.

Rigby M, Ammenwerth E, Talmon J. Forward Outlook: The Need for Evidence and for Action in Health Informatics. In: Ammenwerth E, Rigby M. Evidence-based Health Informatics - Promoting Safety and Efficiency Through Scientific Methods and Ethical Policy. Stud Health Tech Inform. Vol 222. IOS Press. pp. 355-366.

Ammenwerth E, Brender J, Nykänen P, Prokosch H-U, Rigby M, Talmon J. The Evaluation Roadmap. In: Spil TAM, Schuring RW (Hrsg.): E-Health Systems - Diffusion and Use. The Innovation, The User and the Use IT Model. Hershey: Idea Group Publishing. 324-329. ISBN 1-591-40424-X.

Ammenwerth E. Evidence Based Health Informatics. In: Hovenga EJS, Kidd MR, Garde S, Cossio CHL (eds). Health Informatics: An Overview. Amsterdam: IOS Press. 2010.

Reports

Magrabi F. Clinical safety of England’s national program for IT: an analysis of all reported safety events over six years. Webinar of AMIA EVAL & POI WG, 2015, available at: http://knowledge.amia.org/webinars/webinars-working-group-1.1423688/2015-webinars-1.1826210/2015-webinars-1.1857520/eval-poi-wg-clinical-safety-of-england-s-national-program-for-it-1.2029572/eval-poi-wg-clinical-safety-of-england-s-national-program-for-it-1.2029573

Aarts, Ammenwerth, Berghold, Beuscart-Zephir, Brender, Bürkle, Deibl, Denz, Eminovic, Holle, Jones, Liu, Nohr, Nykänen, Prokosch, Rigby, Ruland, Sander, Shaw, Stoop, Talmon, Vimarlund, Wyatt. Declaration of Innsbruck - Results from the European Science Foundation Sponsored Workshop on Systematic Evaluation of Health Information Systems (HIS-EVAL), April 4 - 6th, 2003