Integrating a large-scale testing campaign in the CK framework
arXiv:1511.02725 [cs.SE], (9 Nov 2015)
@article{lascu2015integrating,
title={Integrating a large-scale testing campaign in the CK framework},
author={Lascu, Andrei and Donaldson, Alastair F.},
year={2015},
month={nov},
archivePrefix={"arXiv"},
primaryClass={cs.SE}
}
We consider the problem of conducting large experimental campaigns in computer science research. Most research efforts require a certain level of bookkeeping of results. This is manageable via quick, on-the-fly infrastructure implementations. However, it becomes a problem for large-scale testing initiatives, especially as the needs of the project evolve along the way. We look at how the Collective Knowledge generalized testing framework can help with such a project and its overall applicability and ease of use. The project in question is an OpenCL compiler testing campaign. We take particular interest in its storing capabilities and how it handles presenting the information it holds. We also provide an initial implementation, publicly available.
November 11, 2015 by hgpu
