+1 Recommend
1 collections
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      On Searching Relevant Studies in Software Engineering


      14th International Conference on Evaluation and Assessment in Software Engineering (EASE) (EASE)

      Evaluation and Assessment in Software Engineering

      12 - 13 April 2010

      Search strategy, quasi-gold standard, systematic literature review, evidence-based software engineering

      Read this article at

          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.


          BACKGROUND: Systematic Literature Review (SLR) has become an important research methodology in software engineering since 2004. One critical step in applying this methodology is to design and execute appropriate and effective search strategy. This is quite time consuming and error-prone step, which needs to be carefully planned and implemented. There is an apparent need of a systematic approach to designing, executing, and evaluating a suitable search strategy for optimally retrieving the target literature from digital libraries.

          OBJECTIVE: The main objective of the research reported in this paper is to improve the search step of doing SLRs in SE by devising and evaluating systematic and practical approaches to identifying relevant studies in SE.

          OUTCOMES: We have systematically selected and analytically studied a large number of papers to understand the state-of-the-practice of search strategies in EBSE. Having identified the limitations of the current ad-hoc nature of search strategies used by SE researchers for SLR, we have devised a systematic approach to developing and executing optimal search strategies in SLRs. The proposed approach incorporates the concept of ‘quasi-gold standard’, which consists of collection of known studies and corresponding ‘quasi-sensitivity’ into the search process for evaluating search performance. We report the case study and its finding to demonstrate that the approach is able to improve the rigor of search process in an SLR, and can serves as the supplements to the guidelines for SLRs in EBSE. We plan to further evaluate the proposed approach using several case studies with varying topics in software engineering.

          Related collections

          Author and article information

          April 2010
          April 2010
          : 1-10
          Lero Software Engineering Research Centre, UL, Ireland National ICT Australia
          IT University of Copenhagen, Denmark
          © He Zhang et al. Published by BCS Learning and Development Ltd. 14th International Conference on Evaluation and Assessment in Software Engineering (EASE), Keele University, UK

          This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

          14th International Conference on Evaluation and Assessment in Software Engineering (EASE)
          Keele University, UK
          12 - 13 April 2010
          Electronic Workshops in Computing (eWiC)
          Evaluation and Assessment in Software Engineering
          Product Information: 1477-9358BCS Learning & Development
          Self URI (journal page): https://ewic.bcs.org/
          Electronic Workshops in Computing


          Comment on this article