The title of the target article is a little confusing, particularly with regard to what is meant by “language models.” In any science, the starting point for research is the formulation of a model, a theory of the underlying mechanisms that could go towards explaining the particular phenomenon at hand. In linguistics, the Strong Minimalist Thesis (Chomsky, Reference Chomsky, Martin, Michaels and Uriagereka2000) is such a theory, a model for the mechanism of language. It becomes clear from the target article itself that Futrell and Mahowald specifically refer to Large Language Models (LLMs). We disagree with all the arguments that the authors offer to support their claim that LLMs can be useful for our understanding of “linguistic structure, language processing, and learning.” This is because human language is a computational system that works in a fundamentally different way from LLMs (Bolhuis et al., Reference Bolhuis, Crain and Roberts2023, Reference Bolhuis, Crain, Fong and Moro2024; Fong, Reference Fong2025; Moro, Greco, & Cappa, Reference Moro, Greco and Cappa2023). LLMs are probabilistic models that analyze externalized – “flattened” – strings of words. As such, they are not new: already in 1913, Markov (Reference Markov1913/2006) published a probabilistic analysis of vowels and consonants confirming a strong bias in favor of an alternating vowel/consonant pattern in the poetry of Pushkin’s Eugene Onegin. The probabilistic nature of LLMs is in complete contrast to the recursive function by which the human mind generatively forms hierarchical thought structures that may or may not be externalizable (Everaert et al., Reference Everaert, Huybregts, Chomsky, Berwick and Bolhuis2015; Fong, Reference Fong2025; Friederici et al., Reference Friederici, Chomsky, Berwick, Moro and Bolhuis2017). The nature of those structures determines meaning (semantics) (Everaert et al., Reference Everaert, Huybregts, Chomsky, Berwick and Bolhuis2015). LLMs are not generative in this sense, and they do not form structures that determine meaning.
In addition, LLMs “acquire” language in a fundamentally different way from human infants, who can build syntactic structures in their mind even without any relevant input (Bolhuis et al., Reference Bolhuis, Crain and Roberts2023; Crain, Koring, & Thornton, Reference Crain, Koring and Thornton2017; Yang et al., Reference Yang, Crain, Berwick, Chomsky and Bolhuis2017) – the “Poverty of the Stimulus” argument that the target authors discuss. This is in stark contrast to the enormous amount of training plus trillion-parameter models that are absolutely required for LLMs to generate natural output (Fong, Reference Fong2025). The contrast between the two is aptly illustrated by the differences in energy use. Although it is not often made public, we know that the environmental impact and power requirements of the latest language models are quite staggering. For example, it has been reported that xAI in Memphis, TN requires 70MW to run 100,000 GPUs concurrently, a power that the local utility was initially unable to supply. As a result, 18 natural gas generators (2.5MW each) had to be parked outside (Kerr, Reference Kerr2024). Similarly, Google has ordered six or seven small nuclear reactors for its AI datacenters, according to Lawson (Reference Lawson2024). In contrast, it is estimated that the human brain consumes about 20W, not all of which is available to language (Ling, Reference Ling2001).
The manner in which LLMs learn linguistic patterns is also quite unlike the developmental stages children go through in the transition to adult language. At some stages, children’s production and understanding of language systematically differ from that of adults, and include linguistic structures that are not attested in the adult input (Crain, Reference Crain2012). The stages of child language development have no semblance to the way LLMs assimilate linguistic patterns from training regimes. LLMs therefore, shed no light on the cognitive architecture that enables human children to acquire languages.
Unlike human brains, machines based on LLMs are unable to distinguish between possible and impossible languages (Bolhuis et al., Reference Bolhuis, Crain, Fong and Moro2024; Moro, Reference Moro2016; Moro et al., Reference Moro, Greco and Cappa2023). That the human brain can make this distinction is based on convergent experiments, exploiting both actual languages (Musso et al., Reference Musso, Moro, Glauche, Rijntjes, Reichenbach, Büchel and Weiller2003) and invented languages (Tettamanti et al., Reference Tettamanti, Alkadhi, Moro, Perani, Kollias and Weniger2002). The common paradigm consists of contrasting rules based on linear sequences of words vs. hierarchical constituents, which are the ones based on all and only human languages (Rizzi, Reference Rizzi2009), showing a selective inhibition of a network involving Broca’s area for impossible languages only. The target authors address this issue and argue that LLMs have “inductive biases [that] meaningfully align with linguistic structure.” They specifically refer to a study of their own (Kallini et al., Reference Kallini, Papadimitriou, Futrell, Mahowald, Potts, Ku, Martins and Srikumar2024) that purports to show that LLMs learn from English text significantly better than from impossible variants. However, the authors fail to mention other work that has shown that their conclusions are unwarranted. As Bowers (Reference Bowers2025) pointed out, the worst performance of the LLMs in Kallini et al. (Reference Kallini, Papadimitriou, Futrell, Mahowald, Potts, Ku, Martins and Srikumar2024) was with a “language” where the words were shuffled randomly within sentences. As Bowers (Reference Bowers2025) rightly concludes, this has no structure at all, and thus is not a language, impossible or otherwise. The other examples with structured languages resulted in minimal or no differences between LLMs and human learners (see also Mitchell & Bowers, Reference Mitchell and Bowers2020). What differences there were could be explained by (non-linguistic) computational complexity of the “impossible” languages used. As Bowers (Reference Bowers2025) puts it, “What makes a language difficult to learn is not the same for LLMs and humans, because they possess different inductive biases.” More recently, Luo, Ramscar, and Love, (Reference Luo, Ramscar and Love2024) and Ziv et al. (Reference Ziv, Chemmla, Lan and Katzir2025) found that LLMs did not distinguish between normal English and backward-reversed English text, again suggesting that, unlike the human language faculty (Moro, Reference Moro2016) they make no distinction between possible and impossible languages.
The observation that LLMs learn to simulate impossible languages just as well as possible languages renders LLMs uninformative about the cognitive structures children use to acquire language. For one thing, children are incapable of acquiring linguistic patterns based on linear order, as Noam Chomsky has pointed out for decades (e.g., Chomsky, Reference Chomsky1971). By contrast, the whole point about LLMs is that they can readily detect linear regularities in language input. This shows that LLMs and human children process language input in fundamentally different ways.
Given these fundamental differences between LLMs and the human language faculty, we fail to see how the former can inform the latter in any meaningful way. In summary, an LLM may quack like a duck, but isn’t one – and, in its current probabilistic form, it can never be one.
The title of the target article is a little confusing, particularly with regard to what is meant by “language models.” In any science, the starting point for research is the formulation of a model, a theory of the underlying mechanisms that could go towards explaining the particular phenomenon at hand. In linguistics, the Strong Minimalist Thesis (Chomsky, Reference Chomsky, Martin, Michaels and Uriagereka2000) is such a theory, a model for the mechanism of language. It becomes clear from the target article itself that Futrell and Mahowald specifically refer to Large Language Models (LLMs). We disagree with all the arguments that the authors offer to support their claim that LLMs can be useful for our understanding of “linguistic structure, language processing, and learning.” This is because human language is a computational system that works in a fundamentally different way from LLMs (Bolhuis et al., Reference Bolhuis, Crain and Roberts2023, Reference Bolhuis, Crain, Fong and Moro2024; Fong, Reference Fong2025; Moro, Greco, & Cappa, Reference Moro, Greco and Cappa2023). LLMs are probabilistic models that analyze externalized – “flattened” – strings of words. As such, they are not new: already in 1913, Markov (Reference Markov1913/2006) published a probabilistic analysis of vowels and consonants confirming a strong bias in favor of an alternating vowel/consonant pattern in the poetry of Pushkin’s Eugene Onegin. The probabilistic nature of LLMs is in complete contrast to the recursive function by which the human mind generatively forms hierarchical thought structures that may or may not be externalizable (Everaert et al., Reference Everaert, Huybregts, Chomsky, Berwick and Bolhuis2015; Fong, Reference Fong2025; Friederici et al., Reference Friederici, Chomsky, Berwick, Moro and Bolhuis2017). The nature of those structures determines meaning (semantics) (Everaert et al., Reference Everaert, Huybregts, Chomsky, Berwick and Bolhuis2015). LLMs are not generative in this sense, and they do not form structures that determine meaning.
In addition, LLMs “acquire” language in a fundamentally different way from human infants, who can build syntactic structures in their mind even without any relevant input (Bolhuis et al., Reference Bolhuis, Crain and Roberts2023; Crain, Koring, & Thornton, Reference Crain, Koring and Thornton2017; Yang et al., Reference Yang, Crain, Berwick, Chomsky and Bolhuis2017) – the “Poverty of the Stimulus” argument that the target authors discuss. This is in stark contrast to the enormous amount of training plus trillion-parameter models that are absolutely required for LLMs to generate natural output (Fong, Reference Fong2025). The contrast between the two is aptly illustrated by the differences in energy use. Although it is not often made public, we know that the environmental impact and power requirements of the latest language models are quite staggering. For example, it has been reported that xAI in Memphis, TN requires 70MW to run 100,000 GPUs concurrently, a power that the local utility was initially unable to supply. As a result, 18 natural gas generators (2.5MW each) had to be parked outside (Kerr, Reference Kerr2024). Similarly, Google has ordered six or seven small nuclear reactors for its AI datacenters, according to Lawson (Reference Lawson2024). In contrast, it is estimated that the human brain consumes about 20W, not all of which is available to language (Ling, Reference Ling2001).
The manner in which LLMs learn linguistic patterns is also quite unlike the developmental stages children go through in the transition to adult language. At some stages, children’s production and understanding of language systematically differ from that of adults, and include linguistic structures that are not attested in the adult input (Crain, Reference Crain2012). The stages of child language development have no semblance to the way LLMs assimilate linguistic patterns from training regimes. LLMs therefore, shed no light on the cognitive architecture that enables human children to acquire languages.
Unlike human brains, machines based on LLMs are unable to distinguish between possible and impossible languages (Bolhuis et al., Reference Bolhuis, Crain, Fong and Moro2024; Moro, Reference Moro2016; Moro et al., Reference Moro, Greco and Cappa2023). That the human brain can make this distinction is based on convergent experiments, exploiting both actual languages (Musso et al., Reference Musso, Moro, Glauche, Rijntjes, Reichenbach, Büchel and Weiller2003) and invented languages (Tettamanti et al., Reference Tettamanti, Alkadhi, Moro, Perani, Kollias and Weniger2002). The common paradigm consists of contrasting rules based on linear sequences of words vs. hierarchical constituents, which are the ones based on all and only human languages (Rizzi, Reference Rizzi2009), showing a selective inhibition of a network involving Broca’s area for impossible languages only. The target authors address this issue and argue that LLMs have “inductive biases [that] meaningfully align with linguistic structure.” They specifically refer to a study of their own (Kallini et al., Reference Kallini, Papadimitriou, Futrell, Mahowald, Potts, Ku, Martins and Srikumar2024) that purports to show that LLMs learn from English text significantly better than from impossible variants. However, the authors fail to mention other work that has shown that their conclusions are unwarranted. As Bowers (Reference Bowers2025) pointed out, the worst performance of the LLMs in Kallini et al. (Reference Kallini, Papadimitriou, Futrell, Mahowald, Potts, Ku, Martins and Srikumar2024) was with a “language” where the words were shuffled randomly within sentences. As Bowers (Reference Bowers2025) rightly concludes, this has no structure at all, and thus is not a language, impossible or otherwise. The other examples with structured languages resulted in minimal or no differences between LLMs and human learners (see also Mitchell & Bowers, Reference Mitchell and Bowers2020). What differences there were could be explained by (non-linguistic) computational complexity of the “impossible” languages used. As Bowers (Reference Bowers2025) puts it, “What makes a language difficult to learn is not the same for LLMs and humans, because they possess different inductive biases.” More recently, Luo, Ramscar, and Love, (Reference Luo, Ramscar and Love2024) and Ziv et al. (Reference Ziv, Chemmla, Lan and Katzir2025) found that LLMs did not distinguish between normal English and backward-reversed English text, again suggesting that, unlike the human language faculty (Moro, Reference Moro2016) they make no distinction between possible and impossible languages.
The observation that LLMs learn to simulate impossible languages just as well as possible languages renders LLMs uninformative about the cognitive structures children use to acquire language. For one thing, children are incapable of acquiring linguistic patterns based on linear order, as Noam Chomsky has pointed out for decades (e.g., Chomsky, Reference Chomsky1971). By contrast, the whole point about LLMs is that they can readily detect linear regularities in language input. This shows that LLMs and human children process language input in fundamentally different ways.
Given these fundamental differences between LLMs and the human language faculty, we fail to see how the former can inform the latter in any meaningful way. In summary, an LLM may quack like a duck, but isn’t one – and, in its current probabilistic form, it can never be one.
Financial support
None.
Competing interests
None.