Hostname: page-component-74656f9884-skzmx Total loading time: 0 Render date: 2026-11-04T15:27:02.449Z Has data issue: false hasContentIssue false

Characterising design tasks for assessing Learners’ Design Competence

Published online by Cambridge University Press:  30 September 2026

Sona M*
Affiliation:
Department of Design and Manufacturing, Indian Institute of Science , India
Abhijit Biswas
Affiliation:
Department of Design and Manufacturing, Indian Institute of Science , India
Amaresh Chakrabarti
Affiliation:
Department of Design and Manufacturing, Indian Institute of Science , India
*
Corresponding author: Sona M sonam@iisc.ac.in
Rights & Permissions [Opens in a new window]

Abstract

Learners’ Design Competence (LDC) is the ability of the learner to integrate and apply relevant knowledge, skills and attitudes to effectively perform a given design task in more than one context. This article aims to characterise this design task, specific to its context, so that it may be administered to assess the design learner. A comprehensive review of the literature suggested a suitable model of design competence for its validation. To begin with, its construct was validated using the Kipling method to check if it can identify the primary (sub)factors that determine a design task. This has led to the proposal of a design task ontology. Next, the comprehensiveness of its content was validated with the thematic analyses of empirical evidence by comparing the Inter-Coder Reliability and Krippendorff’s alpha (K-α) against the ground truth, which suggested revisions in the ontology. Finally, the criterion validity was assessed by defining the relationships among its factors through a design task syntax. This validated its application in real-life situations. The complete set of design tasks thus framed were reposited in a design task generator tool to facilitate the statement of design tasks necessary for assessing LDC.

Information

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2026. Published by Cambridge University Press
Figure 0

Figure 1. Overall research methodology with tools and methods to fulfil the corresponding objectives of the study.Figure 1. long description.

Figure 1

Figure 2. Design Aspects model as proposed by Chakrabarti 2024. (Sub)aspects marked with an asterisk (*) found inconsistent with the construct of Learners’ Design Competence by the authors, upon validation as detailed in Section 3.2.Figure 2. long description.

Figure 2

Figure 3. Proposed ontology for design task (sub)factors, highlighting revisions to the Design Aspects model, in orange.Figure 3. long description.

Figure 3

Figure 4. (a) Data cleaning steps to pre-process the collected LOs before sampling for code-based thematic analysis. (b) Experimental setup for code-based deductive thematic analysis of the LO sample with training and triangulation.Figure 4. long description.

Figure 4

Figure 5. (a) Confusion matrix between coders 1 and 2 for tallying their agreements and disagreements on occurrence of a subfactor X. (b) Sample confusion matrix for the subfactor “Product.”

Figure 5

Figure 6. Confusion matrices for C1 (vs) C2 with decreasing ICR for the subfactors of Artefact.Figure 6. long description.

Figure 6

Figure 7. Confusion matrices for C1 (vs) C2 with decreasing ICR for the subfactors of implementation.Figure 7. long description.

Figure 7

Figure 8. Confusion matrices for C1 (vs) C2 with decreasing ICR for the subfactors of Techne.Figure 8. long description.

Figure 8

Figure 9. Confusion matrices for C1 (vs) C2 with decreasing ICR for the subfactors of Focus.Figure 9. long description.

Figure 9

Figure 10. Confusion matrices for C1 (vs) C2 with decreasing ICR for the subfactors of Needs.Figure 10. long description.

Figure 10

Figure 11. Confusion matrices for C1 (vs) C2 with decreasing ICR for the subfactors of Stakeholder.Figure 11. long description.

Figure 11

Figure 12. Plot showing the observed ICRs in relation to the thresholds for agreement and improbability by chance, p < 0.01.Figure 12. long description.

Figure 12

Table 1. Triangulated instances of identified keywords with ambiguity in the LO sample, as per coder responsesTable 1. long description.

Figure 13

Figure 13. Revised ontology for design task (sub)factors, highlighting corresponding revisions (in green) to the original proposal in Figure 3. * is used to refer to the revision adopted after coding session 2.Figure 13. long description.

Figure 14

Table 2. Comparison of the ICRs observed in coding sessions 1 (below) and 2 (above), among the coder pairsTable 2. long description.

Figure 15

Figure 14. Mapping diagram of the relation among the design task (sub)factors of the ontology, characterising a design task.Figure 14. long description.

Figure 16

Figure 15. Relation-mapping diagram tracing the sampled design tasks for assessing criterion validity, including the exhaustive set of all-for-one artefact (in green) and the representative one-for-all artefacts (in pink).Figure 15. long description.

Figure 17

Table 3. Real-world examples of a design task at multiple implementation stages with their respective task factors in boldTable 3. long description.

Figure 18

Table 4. Real-world examples of a design task for any artefact with their respective task factors in boldTable 4. long description.

Figure 19

Table 5. Real-world examples of a design task manipulating techne with their respective task factors in boldTable 5. long description.

Figure 20

Table 6. Real-world examples of a design task in varying foci with their respective task factors in boldTable 6. long description.

Figure 21

Table 7. Real-world examples of a design task for multiple stakeholders with their respective task factors in boldTable 7. long description.

Figure 22

Table 8. Real-world examples of a design task towards changing needs with their respective task factors in boldTable 8. long description.

Figure 23

Table 9. Real-world examples of a design task applied in diverse disciplines with their respective task factors in boldTable 9. long description.

Figure 24

Figure 16. Screenshot of the interactive dashboard of the online Design Task Generator tool retrieving a relevant design task.Figure 16. long description.

Figure 25

Table 10. Revised Design Task ontology comprising all the primary factors and their corresponding subfactors to comprehensively determine any design task specific to its context, irrespective of its field of applicationTable 10. long description.

Figure 26

Figure A1. Figure A1. long description.

Figure 27

Figure B1. Figure B1. long description.