Skip to content

Assessing quality and impact of eHealth tools – a Practical Toolbox

Technological advancements have opened the path to many providers to easily develop and introduce eHealth tools to the public. The use of these tools is increasingly recognized as a critical quality driver in healthcare. However, choosing a quality tool in the myriad of tools available for a certain health purpose doesn’t come without challenges. To name a few, users are typically faced with tools that have not been evaluated for quality and fit and that often lack relevant features and functionality, making it quite challenging for both clinicians and patients to find, evaluate, and use the right tools. 

Although there are various initiatives working on finding ways to assess the quality of eHealth tools, there is limited information and methods describing how to realistically assess and evaluate these tools in practice. Many of the existing initiatives have not been validated with the relevant stakeholders, and/or are conceptual without granular guidance on how to use and apply them in day-to-day decision making.

We want to contribute to this discussion to advance this area that is still being shaped and developed by analyzing and aggregating existing criteria through rigorous academic research and systematic review of existing frameworks, combined with a practice-oriented approach through discussing, pressure-testing, and co-creating a relevant and accessible toolbox with a diverse group of industry experts spanning all relevant stakeholder groups (clinicians, patient experts, pharma executives, insurance experts, investors, researchers, compliance experts, and med tech providers).

A practice-oriented and accessible toolbox

Having identified the conceptual nature of many existing assessment frameworks as a challenge, as practitioners oftentimes do not know how to use these frameworks in practice, we would like to adopt a more practice-oriented approach. Our goal is to create an easy-to-use and practical toolbox that equips the relevant stakeholders with the relevant checklists, definitions, and interactive dashboard that makes the task of assessing the quality and impact of eHealth tools as practical and as accessible as possible. We intend to discuss potential solutions with the industry experts, and to pressure test the potential toolbox with them to ensure its clarity and usability. We will also develop and offer on-demand webinars and training workshops to equip potential users with the knowledge they need to properly use the toolbox.

Combining academic rigor with experiences from practice

Bringing academic research rigor together with the practical experience from the practice partners and industry experts will ensure a solid approach to this research project that also balances the practical challenges that the stakeholders face in their day-to-day work and decision-making. Gaps and shortages of previous initiatives will be discussed in detail with the practice partners and industry experts in order to close these gaps and offer a validated and practical toolbox.

An assessment toolbox that goes beyond technical criteria

Another gap that we identified was the focus on the technical criteria that characterized many of the existing frameworks and initiatives. However, healthcare technologies are generally more complex than tools that address one specific user need. They typically serve patients with comorbidities that are mostly treated by multidisciplinary teams of clinicians, potentially working across more than one organization. This particular nature of the healthcare sector calls for a wider view that goes beyond a tool’s technical aspects, since healthcare technology cannot be successfully implemented in isolation from the broader context in which it is being used. Therefore, our approach will also take social and organizational contexts into account in order to take a more comprehensive approach to eHealth tools’ assessment.

Many stakeholder groups in the healthcare ecosystem will benefit from the eHealth assessment toolbox:

Having identified the conceptual nature of many existing assessment frameworks as a challenge, as practitioners oftentimes do not know how to use these frameworks in practice, we would like to adopt a more practice-oriented approach. Our goal is to create an easy-to-use and practical toolbox that equips the relevant stakeholders with the relevant checklists, definitions, and interactive dashboard that makes the task of assessing the quality and impact of eHealth tools as practical and as accessible as possible. We intend to discuss potential solutions with the industry experts, and to pressure test the potential toolbox with them to ensure its clarity and usability. We will also develop and offer on-demand webinars and training workshops to equip potential users with the knowledge they need to properly use the toolbox.

Learn more about this project’s key deliverables, timeline, funding, and the team behind it, about how to join the discussion and participate in this effort as an industry expert, and about the publications and practical tools resulting from this work (the toolbox page will be constantly updated as new results, publications and tools emerge).