We argue that the Rules-Similarity continuum is only a useful formalism for particular, isolated tasks and must rest on the assumption that representations formed during a particular task are independent of other tasks. We show this to be an unrealistic conjecture. We additionally point out that describing categorization as selective weighing and abstracting of features misses the important step of discovering what the possible features are.