A Preliminary Empirical Assessment of Similarity for Combinatorial Interaction Testing of Software Product Lines (bibtex)
by Stefan Fischer, Roberto E. Lopez-Herrejon, Rudolf Ramler, Alexander Egyed
Abstract:
Extensive work on Search-Based Software Testing for Software Product Lines has been published in the last few years. Salient among them is the use of similarity as a surrogate metric for t-wise coverage whenever higher strengths are needed or whenever the size of the test suites is infeasible because of technological or budget limitations. Though promising, this metric has not been assessed with real fault data. In this paper, we address this limitation by using Drupal, a widely used open source web content management system, as an industry-strength case study for which both variability information and fault data have been recently made available. Our preliminary assessment corroborates some of the previous findings but also raises issues on some assumptions and claims made. We hope our work encourages further empirical evaluations of Combinatorial Interaction Testing approaches for Software Product Lines.
Reference:
A Preliminary Empirical Assessment of Similarity for Combinatorial Interaction Testing of Software Product Lines (Stefan Fischer, Roberto E. Lopez-Herrejon, Rudolf Ramler, Alexander Egyed), 2016.
Bibtex Entry:
@Workshop{DBLP:conf/icse/0006LRE16,
  author    = {Stefan Fischer and Roberto E. Lopez{-}Herrejon and Rudolf Ramler and Alexander Egyed},
  booktitle = {Proceedings of the 9th International Workshop on Search-Based Software Testing, ICSE 2016, Austin, Texas, USA, May 14-22, 2016},
  title     = {A Preliminary Empirical Assessment of Similarity for Combinatorial Interaction Testing of Software Product Lines},
  year      = {2016},
  abstract  = {Extensive work on Search-Based Software Testing for Software Product
	Lines has been published in the last few years. Salient among them
	is the use of similarity as a surrogate metric for t-wise coverage
	whenever higher strengths are needed or whenever the size of the
	test suites is infeasible because of technological or budget limitations.
	Though promising, this metric has not been assessed with real fault
	data. In this paper, we address this limitation by using Drupal,
	a widely used open source web content management system, as an industry-strength
	case study for which both variability information and fault data
	have been recently made available. Our preliminary assessment corroborates
	some of the previous findings but also raises issues on some assumptions
	and claims made. We hope our work encourages further empirical evaluations
	of Combinatorial Interaction Testing approaches for Software Product
	Lines.},
  pages     = {15--18},
  bibsource = {dblp computer science bibliography, http://dblp.org},
  biburl    = {http://dblp.uni-trier.de/rec/bib/conf/icse/0006LRE16},
  crossref  = {DBLP:conf/icse/2016sbsttter},
  doi       = {10.1145/2897010.2897011},
  file      = {:Conferences\\ICSE DS 2016 - A Preliminary Empirical Assessment of Similarity for Combinatorial Interaction Testing of Software Product Lines\\A Preliminary Empirical Assessment of Similarity-preprint.pdf:PDF},
  keywords  = {FWF P25289, FWF P25513},
  timestamp = {Wed, 20 Jul 2016 09:47:06 +0200},
  url       = {http://doi.acm.org/10.1145/2897010.2897011},
}
Powered by bibtexbrowser