Schyns et al. make a strong case for context-dependent feature discovery. The features computed from specialized and diverse data-sets help to coordinate their activity by adapting so as to emphasize what is related across sets. Their perspective can be strengthened and extended by formal arguments for the contextual guidance of learning and processing and by neurobiological and psychological evidence of structures and processes that implement this guidance.