Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-16T09:28:29.058Z Has data issue: false hasContentIssue false

Human-in-the-Loop Design with Machine Learning

Published online by Cambridge University Press:  26 July 2019

Pan Wang*
Affiliation:
Imperial College London, United Kingdom;
Danlin Peng
Affiliation:
Imperial College London, United Kingdom;
Ling Li
Affiliation:
University of Kent, United Kingdom;
Liuqing Chen
Affiliation:
Imperial College London, United Kingdom;
Chao Wu
Affiliation:
Zhejiang University, China
Xiaoyi Wang
Affiliation:
Zhejiang University, China
Peter Childs
Affiliation:
Imperial College London, United Kingdom;
Yike Guo
Affiliation:
Imperial College London, United Kingdom;
*
Contact: Wang, Pan, Imperial College London, Dyson school of Design Engineering, United Kingdom, pan.wang15@imperial.ac.uk

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

Deep learning methods have been applied to randomly generate images, such as in fashion, furniture design. To date, consideration of human aspects which play a vital role in a design process has not been given significant attention in deep learning approaches. In this paper, results are reported from a human- in-the-loop design method where brain EEG signals are used to capture preferable design features. In the framework developed, an encoder extracting EEG features from raw signals recorded from subjects when viewing images from ImageNet are learned. Secondly, a GAN model is trained conditioned on the encoded EEG features to generate design images. Thirdly, the trained model is used to generate design images from a person's EEG measured brain activity in the cognitive process of thinking about a design. To verify the proposed method, a case study is presented following the proposed approach. The results indicate that the method can generate preferred designs styles guided by the preference related brain signals. In addition, this method could also help improve communication between designers and clients where clients might not be able to express design requests clearly.

Information

Type
Article
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
© The Author(s) 2019