Welcome to My HIT Thoughts!

Becoming an expert to get HIT!

Sep 15, 2010

Analyzing search failures

Search queries on Two National Library of Medicine Web-based consumer health sites, ClinicalTrials.gov and MEDLINEplus, were examined to develop intervention for failed search results.  The issues examined in this study were query formulation, content coverage, and system functionality.  

Even though the accessibility of health information is growing, consumers are still unable seek this information properly.  Examples of search failures are the improper use of queries, terminology, and terms.  This article sought to determine the seeking behavior of uses to make improvements.  The issues addressed were query formulation, content coverage, and system functionality.  However, there were a few challenges in this study.  Searches are usually only 1.7 words long and it may be unknown if an application or a user imputed the data.  

The majority of the queries were in scope, system relevant, and exhibited the proper terminology.  The failures detected were categorized into four groups.  One was related to user queries and the others were due to issues with system design.  The majority of search failures were found in the first category, mostly due to erroneous use of supported and unsupported operators.  Query misspellings were also another cause.  Failures in the other groups were due to an absence of relevant information in the system or its limitations in searches.  

These results can be used to improve health information systems.  Frequent searches for information not stored in the system can signal possible additions.  Out-of-scope queries might mean that the coverage requires clarification.  Errors in query formulation may lead to interactive query intervention, and failures due to system limitations can mark a possible area for improvement.