by Stefan Fischer, Roberto E. Lopez-Herrejon, Rudolf Ramler, Alexander Egyed
Abstract:
Extensive work on Search-Based Software Testing for Software Product Lines has been published in the last few years. Salient among them is the use of similarity as a surrogate metric for t-wise coverage whenever higher strengths are needed or whenever the size of the test suites is infeasible because of technological or budget limitations. Though promising, this metric has not been assessed with real fault data. In this paper, we address this limitation by using Drupal, a widely used open source web content management system, as an industry-strength case study for which both variability information and fault data have been recently made available. Our preliminary assessment corroborates some of the previous findings but also raises issues on some assumptions and claims made. We hope our work encourages further empirical evaluations of Combinatorial Interaction Testing approaches for Software Product Lines.
Reference:
A Preliminary Empirical Assessment of Similarity for Combinatorial Interaction Testing of Software Product Lines (Stefan Fischer, Roberto E. Lopez-Herrejon, Rudolf Ramler, Alexander Egyed), 2016.
Bibtex Entry:
@Workshop{DBLP:conf/icse/0006LRE16,
author = {Stefan Fischer and Roberto E. Lopez-Herrejon and Rudolf Ramler and Alexander Egyed},
booktitle = {Proceedings of the 9th International Workshop on Search-Based Software Testing, ICSE 2016, Austin, Texas, USA, May 14-22, 2016},
title = {A Preliminary Empirical Assessment of Similarity for Combinatorial Interaction Testing of Software Product Lines},
year = {2016},
abstract = {Extensive work on Search-Based Software Testing for Software Product
Lines has been published in the last few years. Salient among them
is the use of similarity as a surrogate metric for t-wise coverage
whenever higher strengths are needed or whenever the size of the
test suites is infeasible because of technological or budget limitations.
Though promising, this metric has not been assessed with real fault
data. In this paper, we address this limitation by using Drupal,
a widely used open source web content management system, as an industry-strength
case study for which both variability information and fault data
have been recently made available. Our preliminary assessment corroborates
some of the previous findings but also raises issues on some assumptions
and claims made. We hope our work encourages further empirical evaluations
of Combinatorial Interaction Testing approaches for Software Product
Lines.},
pages = {15--18},
bibsource = {dblp computer science bibliography, http://dblp.org},
biburl = {http://dblp.uni-trier.de/rec/bib/conf/icse/0006LRE16},
crossref = {DBLP:conf/icse/2016sbsttter},
doi = {10.1145/2897010.2897011},
file = {:Conferences\\ICSE DS 2016 - A Preliminary Empirical Assessment of Similarity for Combinatorial Interaction Testing of Software Product Lines\\A Preliminary Empirical Assessment of Similarity-preprint.pdf:PDF},
keywords = {FWF P25289, FWF P25513},
timestamp = {Wed, 20 Jul 2016 09:47:06 +0200},
url = {http://doi.acm.org/10.1145/2897010.2897011},
}