Hostname: page-component-7b7567c8c-7pwfn Total loading time: 0 Render date: 2026-11-15T10:35:06.951Z Has data issue: false hasContentIssue false

Operationalizing community-based open scientific design research benchmarks: application to model-based architecture design synthesis

Published online by Cambridge University Press:  16 May 2024

Romain Pinquié*
Affiliation:
Univ. Grenoble Alpes, CNRS, Grenoble INP, G-SCOP, France
Lionel Roucoules
Affiliation:
Arts et Métiers ParisTech, France
Pierre-Alain Yvars
Affiliation:
ISAE-Supméca, France
Raphaël Chenouard
Affiliation:
École Centrale de Nantes, France

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

The point has repeatedly been made that validation is a crucial success factor in demonstrating the scientific contribution and ensuring the adoption of results. Still, researchers in design science validate their research findings too infrequently. We must all evaluate our claimed contributions on open benchmarks to improve validation quality and foster cumulative research. In this paper, we propose a meta-model to standardise and operationalise the concept of open scientific benchmarks in design science and to guide communities of researchers in the co-development of scientific benchmarks.

Information

Type
Design Theory and Research Methods
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2024.