The online processing of multiword expressions (MWEs), and phrase frequency effects in particular, have figured prominently in psycholinguistic literature in the past decade (for a review, see Siyanova-Chanturia & van Lancker Sidtis, Reference Siyanova-Chanturia, van Lancker Sidtis, Siyanova-Chanturia and Pellicer-Sanchez2019). A plethora of recent studies have firmly attested to a key role of phrase frequency in language processing (on a par with lexical frequency, e.g., Balota & Chumbley, Reference Balota and Chumbley1984). Despite the different approaches to data collection and analysis, the evidence that has so far accumulated suggests that proficient (adult) language users are highly sensitive to the distributional properties of multiword information, both at the level of comprehension (e.g., Arnon & Snider, Reference Arnon and Snider2010; Siyanova-Chanturia, Conklin, & Schmitt, Reference Siyanova-Chanturia, Conklin and Schmitt2011; Siyanova-Chanturia, Conklin, & van Heuven, Reference Siyanova-Chanturia, Conklin and van Heuven2011; Tremblay & Baayen, Reference Tremblay, Baayen and Wood2010; Tremblay, Derwing, Libben, & Westbury, Reference Tremblay, Derwing, Libben and Westbury2011) and production (e.g., Arnon & Cohen Priva, Reference Arnon and Cohen Priva2013, Reference Arnon and Cohen Priva2014; Bell et al., Reference Bell, Jurafsky, Fosler-Lussier, Girand, Gegory and Gildea2003; Bybee & Scheibman, Reference Bybee and Scheibman1999; Janssen & Barber, Reference Janssen and Barber2012; Siyanova-Chanturia & Janssen, Reference Siyanova-Chanturia and Janssen2018; Tremblay & Tucker, Reference Tremblay and Tucker2011). Overall, MWEs have been found to be processed differently from novel language. While behavioral studies (above) generally show faster processing (e.g., reading and articulation), electrophysiological studies point to easier semantic integration and template matching mechanisms for MWEs relative to novel phrases (e.g., Molinaro & Carreiras, Reference Molinaro and Carreiras2010; Siyanova-Chanturia, Conklin, Caffarra, Kaan, & van Heuven, Reference Siyanova-Chanturia, Conklin, Caffarra, Kaan and van Heuven2017; Vespignani, Canal, Molinaro, Fonda, & Cacciari, Reference Vespignani, Canal, Molinaro, Fonda and Cacciari2010).
While processing studies with adult speakers abound, very little is known about MWE processing in children. This is rather surprising given the important role that has long been attributed to sequences above the word level in first language (L1) learning and use. Studies into L1 acquisition have attested to the interplay between holistic and analytic language processes (e.g., Locke, Reference Locke1997; Peters, Reference Peters1977, Reference Peters1983; Tomasello, Reference Tomasello2003). As Bolinger (Reference Bolinger1975) noted, L1 learning is initially holistic, only later becoming more analytical. Researchers have long documented that young children produce unanalyzed chunks (along with single words), such as Lemme see, I wanna do it, and Gimme that (e.g., Clark, Reference Clark1974; Cruttenden, Reference Cruttenden1981; Lieven, Pine, & Barnes, Reference Lieven, Pine and Barnes1992; Nelson, Reference Nelson1973; Peters Reference Peters1983). What this implies is that children learn linguistic structures of different shapes and sizes and of various degrees of abstraction (e.g., Tomasello, Reference Tomasello2003).
Although researchers largely agree that young children are capable of memorizing and using relatively complex strings of words before they are capable of analyzing their internal structure, the role attributed to chunks in the early (naturalistic) studies has not always been viewed positively. For example, Bates, Bretherton, and Snyder (Reference Bates, Bretherton and Snyder1988) viewed such strings as linguistic “dead-ends.” Similarly, Brown and Hanlon (Reference Brown, Hanlon and Hayes1970) argued that because unanalyzed chunks resist segmentation, they are unlikely to contribute to the child’s linguistic development. As a result, children whose early vocabularies are characterized by memorized chunks were viewed as slow learners unable to analyze and segment adult speech (e.g., Bates et al., Reference Bates, Bretherton and Snyder1988; Bretherton, McNew, Snyder, & Bates, Reference Bretherton, McNew, Snyder and Bates1983). In contrast, other researchers have proposed that chunks in children’s speech play a crucial role in their early linguistic development (e.g., Clark, Reference Clark1974; Peters, Reference Peters1977, Reference Peters1983; Pine & Lieven, Reference Pine and Lieven1993; Tomasello, Reference Tomasello2003; Tomasello & Brooks, Reference Tomasello, Brooks and Barrett1999). For example, Lieven et al. (Reference Lieven, Pine and Barnes1992) found that the use of chunks correlated positively with general productivity (also see Clark, Reference Clark1974; Cruttenden, Reference Cruttenden1981). Similarly, Peters (Reference Peters1977) suggested that children are capable of breaking down multiword strings into constituent components, a process thought to contribute directly to the development of adultlike morphosyntax.
Research that has since followed has overwhelmingly supported the idea that MWEs play a pivotal role in the process of L1 learning. As Tomasello (Reference Tomasello2003) put it, the existence of chunks, or “holophrases,” is “of tremendous theoretical importance for theories of linguistic competence and performance” (p. 306). What the above evidence further alludes to is that children remember utterances they are exposed to frequently and are able to store multiword information along with single words (e.g., Goldberg, Reference Goldberg2006; Tomasello, Reference Tomasello2003).
Despite the important role attributed to sequences above the word level in L1 learning and use, the majority of studies to date have been based on naturalistic observations. Experimental evidence with L1 children is extremely scarce. To the best of our knowledge, only one published study has looked at the role of phrase frequency in online language processing in children. Using a repetition (production) task, Bannard and Matthews (Reference Bannard and Matthews2008) set out to test whether young children store and reuse multiword sequences encountered in their input. These authors examined the accuracy and speed with which 2- and 3-year-old children produced four-word sequences. To this aim, 13 pairs varying in frequency (e.g., a lot of noise, log frequency = 4.66 vs. a lot of juice, log frequency = 0.69) were created using the Max Planck Child Language Corpus. The longitudinal corpus contains the speech produced by a male child between the ages of 2 and 5, as well as his mother’s speech addressed to him. The target stimuli were created based on the latter, given the authors’ interest in the kind of language the child was exposed to. Four-word sequences were chosen because these allowed a wide enough frequency range, and because these (rather than shorter) sequences were sufficiently long to observe the variance in the children’s performance. The phrases within each pair were controlled for the frequency of the final word (e.g., noise vs. juice), the frequency of the final bigram (e.g., of noise vs. of juice), and the length of the final word in syllables. Bannard and Matthews (Reference Bannard and Matthews2008) found that children as young as 3 were sensitive to phrase frequency distributions, with more frequent phrases being articulated more quickly than less frequent phrases. This study further showed that children as young as 2 were more likely to repeat a word sequence correctly if it was higher rather than lower frequency. Thus, the frequency of the target phrasal configurations (as attested in the reference corpus) affected the speed as well as accuracy with which 2- and 3-year-olds produced them, suggesting that young children possess “experience-derived knowledge of specific four-word sequences” (p. 246). The knowledge of multiword sequences, it was argued, was in addition to the children’s knowledge of the individual constituents that make up the sequences. The authors concluded that the children possessed “complementary representations at different levels of granularity” (Bannard & Matthews, Reference Bannard and Matthews2008, p. 246).
Bannard and Matthews (Reference Bannard and Matthews2008) took their results to support the usage-based and exemplar-based approaches to language acquisition, processing, and use, which reject the lexicon-grammar dichotomy and argue for a central role of frequency of exposure in L1 learning (e.g., Abbot-Smith & Tomasello, Reference Abbot-Smith and Tomasello2006; Bod, Reference Bod2006; Bybee, Reference Bybee1998; Goldberg, Reference Goldberg2006; Tomasello, Reference Tomasello2003). A key assumption behind these models is that the basic unit of language acquisition is a construction (e.g., Goldberg, Reference Goldberg2006; Tomasello, Reference Tomasello2003), and that children are able to extract recurrent sequences—varying in length, complexity, and level of abstractness—from the available input, store them, and subsequently use them in their output (e.g., Lieven, Behrens, Speares, & Tomasello, Reference Lieven, Behrens, Speares and Tomasello2003).
The present study
The findings presented in Bannard and Matthews (Reference Bannard and Matthews2008) are important as they attest to children’s sensitivity to the distributional properties of multiword information. However, the evidence is limited to the repetition of MWEs, that is, elicited (controlled) production out of meaningful sentential context (which, admittedly, was the only task possible given the age of the participants). Further, the study’s focus was on very young L1 learners; how older children deal with multiword information online has not been investigated. The primary aim of the present study was, thus, to forge a better understanding of phrase frequency effects in L1 children’s online processing by focusing on language comprehension and employing a naturalistic reading task. For the purpose of this study, and in line with earlier research (e.g., Bannard & Matthews, Reference Bannard and Matthews2008), we adopted the frequency-based approach to the treatment of MWEs. That is, we relied primarily on the frequency of occurrence of MWEs in a representative corpus when identifying and selecting the target items.
In addition, we decided to use eye movements due to their vast applications in reading research (e.g., Rayner, Reference Rayner1998, Reference Rayner2009). First, this method allows for separate analyses to be performed on early, middle, and late stages of reading (for an overview of these measures in the context of vocabulary and MWE research, see Pellicer-Sánchez & Siyanova-Chanturia, Reference Pellicer-Sánchez and Siyanova-Chanturia2018; Roberts & Siyanova-Chanturia, Reference Roberts and Siyanova-Chanturia2013; Siyanova-Chanturia, Reference Siyanova-Chanturia2013). While early measures (e.g., first fixation duration) are sensitive to early processes, such as lexical access and early integration of information, late measures (e.g., dwell time and fixation count) are associated with later processing mechanisms, such as information (re)analysis and discourse integration (e.g., Paterson, Liversedge, & Underwood, Reference Paterson, Liversedge and Underwood1999; Rayner, Sereno, Morris, Schmauder, & Clifton, Reference Rayner, Sereno, Morris, Schmauder and Clifton1989). A combination of both early and late measures provides the researcher with an extremely rich picture of one’s reading behavior. Second, during the course of the experiment, readers do not need to perform a secondary task, such as deciding whether a string of letters is a real word or a nonword (although it is still advisable to provide comprehension questions, see Method section). Third, unlike other experimental paradigms commonly used in reading research (e.g., self-paced reading, rapid serial visual presentation, etc.), the text can be presented over an entire screen. As a result, the eye movement methodology is as close to natural reading as possible in a laboratory setting (e.g., Duyck, van Assche, Drieghe, & Hartsuiker, Reference Duyck, van Assche, Drieghe and Hartsuiker2007), an important consideration given the age of our participants.
Further, in order to extend available evidence to other age groups and L1 backgrounds, we targeted Chinese (L1 Mandarin) primary school pupils, in particular, third and fourth graders (8- and 9-year-olds, respectively), along with adults. Although the 3-year-old children in Bannard and Matthews (Reference Bannard and Matthews2008) were better at repeating sequences than their 2-year-old counterparts, these authors found no significant interaction between children’s age and phrase frequency, suggesting “continuity in frequency effects across development” (p. 247). We wanted to probe this assertion further.
We decided to focus on Chinese, a language markedly different from English. First, unlike alphabetic languages (such as English), Chinese is a logographic language with characters varying in their complexity and number of strokes, a factor known to affect fixation durations in eye movement studies (e.g., Ma & Li, Reference Ma and Li2015). It has been proposed that reading (as well as writing) Chinese characters may require a unique set of skills that are different from alphabetic languages (e.g., Chung & McBride-Chang, Reference Chung and McBride-Chang2011), due to the “visual complexity” of characters and their large number (Liu, Chen, & Chung, Reference Liu, Chen and Chung2015, p. 307). Second, many Chinese characters are homophones. According to Chao (Reference Chao1976), Li, Anderson, Nagy, and Zhang (Reference Li, Anderson, Nagy, Zhang, Li, Gaffney and Packard2002) and Li, Wang, Tong, and McBride (Reference Li, Wang, Tong and McBride2017), among the commonly taught 7,000 Chinese characters, there are only 1,277 syllables with different tones, meaning that “about 5 different characters share the same pronunciation” (Li et al., Reference Li, Wang, Tong and McBride2017, p. 142). According to these authors, this feature makes Chinese scripts rather complex in terms of literacy demands and learning to read. Third, one of the major ways in which Chinese differs from English is word segmentation. According to Packard (Reference Packard2000), a Chinese character can stand alone as a word, can be combined with another character to form a two-character word (which is very common), or can be combined with two or more characters to form a longer multicharacter word (which is less common). This variability may further add to the ambiguity around word boundaries and word segmentation during reading (Liu, Li, Lin, & Li, Reference Liu, Li, Lin and Li2013). In addition, unlike English and other European languages, Chinese does not mark word boundaries with spaces. Although “readers of Chinese are able to perform word-segmentation analysis during parafoveal previewing,” they may do it “less efficiently” than, for example, English readers (Packard, Reference Packard and Chan2016, p. 316).
With respect to MWE processing in Chinese, the evidence is rather limited, with fewer than a handful of published studies to date. Using a grammaticality judgment task, Kong, Zhang, and Zhang (Reference Kong, Zhang and Zhang2016) found that higher frequency discontinuous correlative conjunctions (e.g., 因为…所以… “because … therefore …”; 虽然…也… “although … yet…”) were read faster than lower frequency phrases. More recently, Yi, Lu, and Ma (Reference Yi, Lu and Ma2017) recorded eye movements of L1 and second language (L2) speakers of Chinese as they read two-word adverbial sequences in sentential context. These authors found that both groups of readers were sensitive to phrase frequency and contingency (operationalized as mutual information, a measure that shows how likely the two words co-occur together) of target MWEs. Contrary to earlier research (e.g., Siyanova-Chanturia, Conklin, & van Heuven, Reference Siyanova-Chanturia, Conklin and van Heuven2011), L2 speakers exhibited greater sensitivity to phrase frequency compared to L1 speakers. Finally, Yu et al. (Reference Yu, Cutter, Yan, Bai, Fu, Drieghe and Liversedge2016) investigated parafoveal preview effects in Chinese by using idioms versus control phrases. Although this was not their primary line of enquiry, Yu et al. (Reference Yu, Cutter, Yan, Bai, Fu, Drieghe and Liversedge2016) reported faster reading for idioms than control phrases. It is interesting that there was no indication that idioms benefited from greater parafoveal processing than controls. Overall, albeit scarce, the evidence points to a processing advantage for Chinese MWEs over novel strings of language, akin to what has been reported in the literature on English and other languages.
The main focus of the present study was on phrase frequency effects (or lack thereof) in primary school children. Phrase frequency, however, can be and has been operationalized in a number of different ways. Target phrases have been assigned to various frequency bins (e.g., Sosa & MacFarlane, Reference Sosa and MacFarlane2002), have been looked at as a dichotomy (i.e., high frequency vs. low frequency; e.g., Jiang & Nekrasova, Reference Jiang and Nekrasova2007), or have been treated as a continuum (e.g., Arnon & Snider, Reference Arnon and Snider2010). Some studies have included a continuous as well as a binary (high vs. low) measure of frequency, reporting a distinct pattern of results for the two (e.g., Siyanova-Chanturia, Conklin, & van Heuven, Reference Siyanova-Chanturia, Conklin and van Heuven2011; Siyanova-Chanturia & Janssen, Reference Siyanova-Chanturia and Janssen2018). It has also been proposed that a continuous measure of frequency may be a better predictor of response times compared to employing frequency bins (e.g., Arnon & Snider, Reference Arnon and Snider2010). With this in mind and to further probe this assertion, we decided to include both a continuous and a dichotomous measure of phrase frequency, hoping to obtain a richer picture of phrase frequency effects in MWE processing in children.
Based on the literature reviewed above and the gaps outlined, we sought to answer the following questions:
1. Are Chinese adults sensitive to phrase frequency during reading?
2. Are Chinese third and fourth graders sensitive to phrase frequency during reading?
3. Do reading patterns reveal any processing differences between the effects of phrase frequency conceptualized as a dichotomy versus a continuum?
Method
Participants
Thirty-five normally developing pupils (17 males and 18 females) from two primary schools in Beijing participated in the study. Nineteen of them (9 males and 10 females) were in Grade 3 (age range: 8 years and 3 months to 9 years, mean age = 8 years and 7 months), and 16 of them (8 males and 8 females) were in Grade 4 (age range: 9 years and 4 months to 10 years, mean age = 9 years and 6 months). The Grade 3 primary school students were selected because at this age, children are considered to have mastered enough characters to read reasonably well (Wu et al., Reference Wu, Anderson, Li, Wu, Li, Zhang and Gaffney2009). The fourth graders were selected because at this age, children’s comprehension processes start to approximate those of adult readers (Rayner, Pollatsek, Ashby, & Clifton, Reference Rayner, Pollatsek, Ashby and Clifton2012). In addition, 26 adult participants (11 males and 15 females) were recruited from the student population of the Beijing Language and Culture University (BLCU; age range: 18 years to 30 years old, mean age = 21 years and 5 months). All participants were native speakers of Mandarin and had normal or corrected-to-normal vision. They received a small gift for their participation. Written consent was obtained from the adult participants, and from the children’s parents and their teachers. The study was carried out in line with the ethical procedures of the BLCU.
Materials
The BCC corpus of ChineseFootnote 1 (BLCU Corpus Center, 2016) was used to select experimental items as well as to extract their phrase and lexical frequencies. Forty pairs (80 items in total) of verb–noun combinations varying in phrase frequency were extracted from the corpus. Forty items were high-frequency phrases (e.g., 参加会议 “attend the meeting,” frequency = 2141), and forty were low-frequency phrases (e.g., 参加游戏 “attend the game,” frequency = 62). Thus, each item was assigned to either a high-frequency (collocation) condition or a low-frequency (control) condition. All phrases were transparent, literal and fully compositional. Nouns and verbs in both sequence types consisted of two Chinese characters each, while the entire phrasal configuration was always four characters in length. The verb was always identical in the two conditions (e.g., 参加 “attend”). The nouns in the collocation and control conditions were matched for frequency (e.g., 会议 “meeting” in collocation and 游戏 “game” in control; Mean noun in collocation = 96369.73, Mean noun in control = 108061.83, t = 0.79, p > .10; Median noun in collocation = 83610, Median noun in control = 72933; Mean log frequency noun in collocation = 11.17, Mean log frequency noun in control = 11.20). The stroke number and structure of the two characters in the noun were also matched (Character 1 stroke number: t paired = –0.66, p > .10; Character 2 stroke number: t paired = –0.76, p > .10; Character 1 structure: χ2 = 5.63, p > .10; Character 2 structure: χ2 = 16.28, p = .09). The two types of phrases were, thus, closely matched for verb and noun frequency, phrase length, character structure, and stroke number. However, the collocations and their controls differed significantly in phrase frequency (Mean collocation = 2071.30, Mean control = 16.08, t = –3.77, p < .001; Median collocation = 1005.50, Median control = 4; Mean log frequency collocation = 6.97, Mean log frequency control = 1.81). The constituent words within the target phrases were all high-frequency words (frequency ≥ 1639) according to the BCC corpus, an important consideration given the age of the participants.Footnote 2 The two words in the collocation and control conditions were matched for (forward) association strength (see Siyanova-Chanturia, Conklin, & van Heuven, Reference Siyanova-Chanturia, Conklin and van Heuven2011; and Siyanova-Chanturia et al., Reference Siyanova-Chanturia, Conklin, Caffarra, Kaan and van Heuven2017, for a similar procedure). To this aim, 10 adult native speakers of Chinese, who did not participate in the eye-tracking experiment, took part in the norming procedure. Participants were asked to provide the first word that came to mind after seeing Word 1 of a phrase (i.e., verb, e.g., 参加 ___ “attend___”). The proportion of the nouns (out of the 10 responses obtained) identical to the noun in the target item (e.g., 会议 “meeting” in collocation, or 游戏 “game” in control) was used as the association strength score for the phrase. T test showed no significant differences in the strength of association between Word 1 and Word 2 in collocations versus controls (t = –0.95, p > .10). The characteristics of the experimental items are summarized in Table 1.
Summary of phrase frequency, word frequency, and association strength for the target items
Collocations and their respective controls were embedded in an identical sentence context. The length of the sentences ranged from 12 characters to 21 characters (mean = 15.35 characters), with the target items appearing roughly in the middle of the sentence, at least three Chinese characters from the end of the sentence. An example of a sentence in the collocation and control conditions is provided below (target phrase underlined):
Procedure
Before the reading experiment, the background information regarding each participant (e.g., gender and age) was recorded. All child participants were tested on their Chinese character reading.Footnote 3 Results showed that all child participants were able to read/recognize the top 2,000 most frequently used characters, and that Grade 4 (scores ranged from 81 to 100, mean = 94.38) significantly outperformed Grade 3 (scores ranged from 78 to 97, mean = 89.05) in this test (t = –3.23, p < .01, effect size = 1.10).
The reading experiment was run individually in the Cognition & Neuroscience Lab at the BLCU, using the Eyelink 1000 plus (SR Research Ltd., 2016). A 9-point grid calibration procedure was conducted before the experiment. Participants first completed a practice session, which included six trials. Each trial started with a fixation point that appeared at the beginning of the upcoming sentence. After participants saw the fixation point, a sentence appeared across one line in the middle of the screen. Participants were asked to read as quickly as possible for comprehension. Each trial was followed by a comprehension question (e.g., see Tremblay et al., Reference Tremblay, Derwing, Libben and Westbury2011). An example of a comprehension question is presented above.
Two counter-balanced lists were used with the items randomized (each list included 20 collocation sentences and 20 control sentences). Only one condition of the phrase (either collocation or control) was seen by each participant. After the experiment, the participants (children and adults) were asked to rate the naturalness of the collocation and control sentences on a 10-point Likert scale (请用数字1–10对下列句子的自然度进行评分○。 “Please rate the naturalness of the following sentences on a scale of 1–10, where 1 is unnatural and 10 is natural.” 例如:：杯子懂得珍惜时间 [1, “Cups know how to cherish time”]; 月亮在天上保护着你 [5, “The moon in the sky is protecting you”]; 妈妈正在房间里打扫卫生 [10, “The mother is cleaning the room”]). The experiment took about 30 min from start to finish.
Data analysis and results
Based on the results of the naturalness rating task, we decided to exclude five pairs of sentences from the final data analyses. No significant differences in naturalness judgments were found between the remaining 35 pairs of sentences (total: Mean collocation-sentences = 8.50, Mean control-sentences = 8.30, t = –1.27, p > .10; Grade 3: Mean collocation-sentences = 8.63, Mean control-sentences = 8.46, t = –1.07, p > .10; Grade 4: Mean collocation-sentences = 8.46, Mean control-sentences = 8.24, t = –1.36, p > .10; adults: Mean collocation-sentences = 8.43, Mean control-sentences = 8.22, t = –1.24, p > .10).
Single fixation durations shorter than 80 ms or longer than 1000 ms were discarded (e.g., Gu & Li, Reference Gu and Li2015; Wei, Li, & Pollastek, Reference Wei, Li and Pollatsek2013; Zhou, Ma, Li, & Taft, Reference Zhou, Ma, Li and Taft2017). The data loss accounted for 6.51% of the total data (3.21% for collocation sentences and 3.30% for control sentences). Given that including skipped items in the calculation of means or in any further analyses for a duration measure is problematic for a single-word analysis (e.g., Conklin, Pellicer-Sánchez, & Carrol, Reference Conklin, Pellicer-Sánchez and Carrol2018; also see Vilkaitė, Reference Vilkaitė2016), we discarded trials with a first fixation of 0 ms in the phrase-final word analysis. This exclusion accounted for 7.73% of the entire data (3.79% for the phrase-final word in collocation sentences, and 3.93% for the phrase-final word in control sentences). The participants had no difficulty answering comprehension questions (Grade 3, 93.98% correct; Grade 4, 95.71% correct; adults, 97.58% correct).
A mixed design was employed, treating phrase type as a within-group variable, age group as a between-group variable, and the eye-tracking measures as dependent variables. In line with Carrol and Conklin (Reference Carrol and Conklin2019), Sonbul (Reference Sonbul2014), and Yi et al. (Reference Yi, Lu and Ma2017), four measures were examined: first fixation duration (early), first pass reading time (middle), dwell time, and fixation count (late, see Figure 1). The former three measures were duration measures, which reflected reading times, while the latter measure was a count measure, which provided the number of fixations.
An example of a hypothetical eye-movement record for a collocation-embedded sentence and its control. The black box represents the area of interest (English translation: collocation = “attend the meeting,” control = “attend the game”). First fixation duration = 3, first pass reading time = 3 + 4, dwell time = 3 + 4 + 7 (refers to the sum of fixation durations), fixation count = 3 + 4 + 7 (refers to the sum of all fixations).
In line with previous literature (e.g., Carrol & Conklin, Reference Carrol and Conklin2014, Reference Carrol and Conklin2015, Reference Carrol and Conklin2019; Carrol, Conklin, & Gyllstad, Reference Carrol, Conklin and Gyllstad2016; Conklin & Pellicer-Sánchez, Reference Conklin and Pellicer-Sánchez2016; Underwood, Schmitt, & Galpin, Reference Underwood, Schmitt, Galpin and Schmitt2004; Vilkaitė, Reference Vilkaitė2016; Vilkaitė & Schmitt, Reference Vilkaitė and Schmitt2017), two interest areas were selected for data analysis: the phrase-final word (e.g., 会议 “meeting”) and the whole phrase (e.g., 参加会议 “attend the meeting”). It was important to include the final word as an interest area, as well as the whole phrase, because the final word in MWEs “may be predictable and therefore elicit shorter fixations and more skipping” (Conklin, Pellicer-Sánchez, & Carrol, Reference Conklin, Pellicer-Sánchez and Carrol2018, p. 102). Carrol and Conklin (Reference Carrol and Conklin2014) further recommend including both of these two interest areas, so as to capture “both the macro and micro features of formulaic units” (p. 4).
Descriptive statistics for the two experimental conditions across the four eye-tracking measures in the two interest areas can be found in Table 2. The data were analyzed using linear mixed-effects models in R (version 3.5.1, 2018), package lme4 (version 1.1–21, 2019). The p value for each predictor (variable) was estimated by using the lmerTest package (version 3.1–0, 2019). The mixed-effects models for the three duration measures (i.e., first fixation duration, first pass reading time, and dwell time) were constructed using the lmer function (in the lme4 package). As fixation count is discrete data, it needs to be analyzed differently from duration measures (e.g., Conklin et al., Reference Conklin, Pellicer-Sánchez and Carrol2018). Thus, we constructed a generalized linear model (glmer function in the lme4 package) for this measure, specifying the “Poisson” distribution when fitting the model (e.g., Conklin et al., Reference Conklin, Pellicer-Sánchez and Carrol2018, p. 201; also see Vilkaitė, Reference Vilkaitė2016). All the continuous reading measures and frequency measures were log-transformed. Kappa value was used to check for collinearity among predictors (variables) for each model.
Mean fixation durations (in milliseconds) and mean fixation counts for the collocation (COL)-embedded sentences and their controls (CON) in analyses of the phrase-final word and the whole phrase, with standard deviation (SD) in parentheses
Notes: The mean fixation durations and fixation counts are the original values (not log-transformed). The estimated value of each predictor was rounded and kept to two decimal places. FFD, first fixation duration. FPRT, first pass reading time. DT, dwell time. FC, fixation count.
To address the issue of collinearity between phrase type and phrase frequency (κ = 107.43, corr = 0.86), we built separate models for the two variables for each of the eye-tracking measures in the phrase-final word and whole phrase analysis. Thus, the two variables were not included in the same model.
The categorical variable phrase type included two conditions, collocation and control, which were coded as 1 (collocation) and –1 (control). Age group was also a categorical variable, coded as 3 for Grade 3, 4 for Grade 4, and 5 for adults.
Sixteen separate models were built: 2 Models (one with phrase type and one with phrase frequency) × 4 Eye-Tracking Measures × 2 Interest Areas. To build the original (maximal) models, phrase type (or phrase frequency), age group as well as the interaction between them were first added to the model, serving as primary predictors (fixed effects) for the reading times (or fixation count), regardless of the significance values. A maximal structure of random effects was then added to the model (Barr, Levy, Scheepers, & Tily, Reference Barr, Levy, Scheepers and Tily2013), with random intercepts for participants and items, as well as random slopes for the main predictors (variables) involved.
In the model fitting procedure, we followed Bates, Kliegl, Vasishth, and Baayen (Reference Bates, Kliegl, Vasishth and Baayen2015), removing the predictors stepwise from the full (maximal) model to a final converged one, in which the removal of a given predictor was no longer justified (e.g., Siyanova-Chanturia & Janssen, Reference Siyanova-Chanturia and Janssen2018). The justification for the removal was determined by model comparisons by using the chi-square tests in the anova function (in the lmerTest package). The ranova function (in the lmerTest package) was also checked for the random effect removal and model reduction.
Further comparisons/contrasts between the levels within a categorical variable (e.g., age group or phrase type) and interactions with other variables including calculating effect sizes for each comparison/contrast were performed using emmeans package (version 1.4.2, 2019). Further analyses of a continuous variable (e.g., phrase frequency) and interactions with other variables were conducted using the aov function in the stats package (version 3.6.1, 2019). The effect size for aov was calculated using the etaSquared function in the lsr package (version 0.5, 2019). The interactions were plotted by applying the ggplot2 package (version 3.2.1, 2019).
Analysis of the phrase-final word
Fixed effects and random effects of selected models for the four eye-tracking measures, first fixation duration (FFD), first pass reading time (FPRT), dwell time (DT), and fixation count (FC), are presented in Table 3 (models with phrase type) and Table 4 (models with phrase frequency). Phrase type was not a significant predictor across the early, middle, and late measures (t FFD = 1.18, p > .10; t FPRT = 1.11, p > .10; t DT = 1.43, p > .10; z FC = 1.58, p > .10). Similarly, phrase frequency was not significant across any of the measures (t FFD = 1.45, p > .10; t FPRT = 1.03, p > .10; t DT = 0.70, p > .10; z FC = 0.67, p > .10). Age group was a significant predictor across all the measures in the models with phrase type (t FFD = –6.01, p < .001; t FPRT = –6.16, p < .001; t DT = –7.30, p < .001; z FC = –8.77, p < .001), as well as the models with phrase frequency (t FFD = –3.28, p < .01; t FPRT = –4.17, p < .001; t DT = –5.53, p < .001; z FC = –5.49, p < .001).
Summary of selected models (with phrase type) in the phrase-final word analysis
Notes: The estimated value of each predictor was rounded and kept to two decimal places. Some random effects were discarded (as shown by “—”) due to model fitting, and the analyses of variance in fixed and random effects showed no significant differences between the fitted model and the original model(s).
Summary of selected models (with log-phrase frequency) in the phrase-final word analysis
Notes: The estimated value of each predictor was rounded and kept to two decimal places. Some random effects were discarded (as shown by “—”) due to model fitting, and the analyses of variance in fixed and random effects showed no significant differences between the fitted model and the original model(s).
Post hoc analysis revealed that Grade 4 readers were faster than Grade 3 readers (in models with phrase type: t FFD = 2.83, p = .02, effect size = 0.41, t FPRT = 3.01, p = .01, effect size = 0.49, t DT = 2.61, p = .03, effect size = 0.48, z FC = 2.20, p = .07, effect size = 0.17; in models with phrase frequency: t FFD = 3.02, p = .01, effect size = 0.42, t FPRT = 3.01, p = .01, effect size = 0.49, t DT = 2.70, p = .02, effect size = 0.47, z FC = 2.36, p = .05, effect size = 0.19). Adults were faster readers than Grade 4 readers (in models with phrase type: t FFD = 2.63, p = .03, effect size = 0.36, t FPRT = 2.60, p = .03, effect size = 0.39, t DT = 3.98, p < .001, effect size = 0.67, z FC = 5.86, p < .001, effect size = 0.40; in models with phrase frequency: t FFD = 2.54, p = .04, effect size = 0.37, t FPRT = 2.60, p = .03, effect size = 0.39, t DT = 4.06, p < .001, effect size = 0.67, z FC = 5.49, p < .001, effect size = 0.39).
Crucially, we found a significant interaction between age group and phrase type across the early, middle, and late measures (t FFD = –1.95, p = .05; t FPRT = –1.94, p = .05; t DT = –2.42, p = .02; z FC = –2.05, p = .04). The interaction is plotted in Figure 2. Further comparisons showed that adults, but not third or fourth graders, read the final word in collocations significantly faster than in control phrases across the four measures (adults: t FFD = 2.60, p = .01, effect size = 0.24, t FPRT = 2.60, p = .01, effect size = 0.25, t DT = 3.15, p < .01, effect size = 0.31, z FC = 2.11, p = .03, effect size = 0.15; Grade 3: t FFD = 0.28, p > .10, effect size = 0.03, t FPRT = 0.37, p > .10, effect size = 0.04, t DT = 0.19, p > 0.10, effect size = 0.03, z FC = –0.11, p > .10, effect size < 0.01; Grade 4: t FFD = 1.67, p = .10, effect size = 0.18, t FPRT = 1.85, p = .07, effect size = 0.20, t DT = 1.24, p > .10, effect size = 0.17, z FC = 0.66, p > .10, effect size = 0.05).
The interaction between age group and phrase type for the first fixation duration, first pass reading time, dwell time, and fixation count in the phrase-final word analysis, with 95% confidence intervals.
The interaction between age group and phrase frequency was found significant in the early measure (t FFD = –2.14, p = .04), and marginally significant in the middle and dwell time measure (t FPRT = –1.87, p = .06; t DT = –1.67, p = .09), but was not significant in the fixation count measure (z FC = –1.25, p > .10). The interaction is plotted in Figure 3. Further analysis of the three eye-tracking measures showed that adults read the final word in higher frequency phrases faster than in lower frequency sequences (F FFD = 9.98, p < .01, effect size = 0.13; F FPRT = 9.96, p < .01, effect size = 0.13; F DT = 16.10, p < .001, effect size = 0.20). Crucially, this processing advantage emerged in the early and middle measures in fourth graders (F FFD = 3.85, p = .05, effect size = 0.01; F FPRT = 3.97, p = .05, effect size = 0.01), but not in the late measures (F DT = 1.54, p > .10, effect size < 0.01). No processing advantage for the final word in higher frequency phrases versus lower frequency ones was found in third graders (F FFD = 0.11, p > .10, effect size < 0.01; F FPRT = 0.18, p > .10, effect size < 0.01; F DT = 1.25, p > .10, effect size < 0.01).
The interaction between age group and log-phrase frequency for the first fixation duration, first pass reading time, and dwell time in the phrase-final word analysis.
Analysis of the whole phrase
We further analyzed the reading of the whole phrase (Table 5: models with phrase type; Table 6: models with phrase frequency). Both phrase type and phrase frequency were significant predictors across the dwell time measure, but not other eye-tracking measures (in models with phrase type: t FFD = –0.15, p > .10; t FPRT = 1.59, p > .10; t DT = 3.31, p < .001; z FC = 1.63, p = .10; in models with phrase frequency: t FFD = –0.15, p > .10; t FPRT = 1.47, p > .10; t DT = 2.62, p < .01; z FC = 1.06, p > .10). Further analyses of the dwell time measure showed that collocations were overall processed faster than their controls (t DT = 4.65, p < .001, effect size = 0.46), and that higher frequency phrases were read faster than lower frequency ones (F DT = 45.27, p < .001, effect size = 0.21). Age group was also found significant in the middle and late measures (in models with phrase type: t FFD = –0.68, p > .10; t FPRT = –4.02, p < .001; t DT = –8.28, p < .001; z FC = –9.50, p < .001; in models with phrase frequency: t FFD = –0.41, p > .10; t FPRT = –2.35, p = .02; t DT = –5.50, p < .001; z FC = –6.77, p < .001). Post hoc analyses of the three eye-tracking measures revealed that although Grade 4 readers were not significantly faster than Grade 3 readers (in models with phrase type: t FPRT = 1.85, p > .10, effect size = 0.31, t DT = 2.30, p = .06, effect size = 0.50, z FC = 0.72, p > .10, effect size = 0.05; in models with phrase frequency: t FPRT = 1.85, p > .10, effect size = 0.31, t DT = 2.30, p = .06, effect size = 0.50, z FC = 0.78, p > .10, effect size = 0.05), adults read faster than Grade 4 in late measures (in models with phrase type: t FPRT = 1.81, p > .10, effect size = 0.28, t DT = 5.37, p < .001, effect size = 1.10, z FC = 9.90, p < .001, effect size = 0.69; in models with phrase frequency: t FPRT = 1.81, p > .10, effect size = 0.28, t DT = 5.37, p < .001, effect size = 1.10, z FC = 10.27, p < .001, effect size = 0.70).
Summary of selected models (with phrase type) in the whole-phrase analysis
Notes: The estimated value of each predictor was rounded and kept to two decimal places. Some random effects were discarded (as shown by “—”) due to model fitting, and the analyses of variance in fixed and random effects showed no significant differences between the fitted model and the original model(s).
Summary of selected models (with log-phrase frequency) in the whole-phrase analysis
Notes: The estimated value of each predictor was rounded and kept to two decimal places. Some random effects were discarded (as shown by “—”) due to model fitting, and the analyses of variance in fixed and random effects showed no significant differences between the fitted model and the original model(s).
The interaction between age group and phrase type was found significant in the middle and late measures (t FPRT = –2.22, p = .03; t DT = –5.80, p < .001; z FC = –2.39, p = .02), but not in the early measure (t FFD = –0.12, p > .10). The interaction is plotted in Figure 4. Further comparisons showed that adults read collocations faster than controls (t FPRT = 2.45, p = .02, effect size = 0.20; t DT = 6.58, p < .001, effect size = 0.73; z FC = 3.11, p < .01, effect size = 0.15). Critically, Grade 4 read collocations faster than controls in the late measure (t FPRT = 1.56, p > .10, effect size = 0.15; t DT = 3.27, p < .01, effect size = 0.40; z FC = 0.68, p > .10, effect size = 0.04). No such processing advantage was found in Grade 3 readers (t FPRT = –0.34, p > .10, effect size < 0.01; t DT = 1.12, p > .10, effect size = 0.13; z FC = 0.12, p > .10, effect size < 0.01).
The interaction between age group and phrase type for the first pass reading time, dwell time, and fixation count in the whole phrase analysis, with 95% confidence intervals.
Finally, the interaction between age group and phrase frequency was found significant in middle and late measures (t FPRT = –2.09, p = .04; t DT = –4.92, p < .001), approaching significance in the fixation count measure (z FC = –1.83, p = .07), and not significant in the early measure (t FFD = –0.20, p > .10). The interaction is plotted in Figure 5. Further analysis revealed that adults read higher frequency phrases faster than lower frequency phrases (F FPRT = 9.45, p < .01, effect size = 0.11; F DT = 75.92, p < .001, effect size = 0.79; F FC = 12.84, p < .001, effect size = 0.14). Of importance, Grade 4 readers read higher frequency phrases faster than lower frequency phrases, as evident in the dwell time measure (F FPRT = 2.78, p = .09, effect size = 0.01; F DT = 11.91, p < .001, effect size = 0.21; F FC = 1.60, p > .10, effect size < 0.01). No such processing advantage was found in Grade 3 readers (F FPRT = 0.07, p > .10, effect size < 0.01; F DT = 1.85, p > .10, effect size < 0.01; F FC = 0.49, p > .10, effect size < 0.01).
The interaction between age group and log-phrase frequency for the first pass reading time, dwell time, and fixation count in the whole phrase analysis.
Discussion
The processing advantage for a wide range of MWEs (e.g., collocations, idioms, lexical bundles, etc.) over infrequent control phrases has long been attested in the literature. However, the relevant evidence pertains almost exclusively to MWE processing in adults, in most cases, educated university students. Whether or not other populations and age groups are sensitive to phrase frequency effects during reading has, to date, been largely disregarded. In the present investigation, we sought to address this gap by asking 8- and 9-year-old primary school pupils, as well as a group of adults (L1 Mandarin), to read phrases varying in frequency embedded in sentence context. In particular, we were interested in how phrase type, phrase frequency, and age might influence participants’ reading of the phrase-final word and the whole phrase. The following findings emerged.
We found significant main effects of phrase type and phrase frequency. In particular, we found that, overall, collocations were read faster than control phrases, and, correspondingly, higher frequency phrases were read faster than lower frequency ones. Both the phrase type and phrase frequency effects were observed in the total reading time measure (dwell time). These findings are in line with earlier research involving adults, pointing to an important role of frequency in language acquisition, processing, and use.
Further, age was found to be a significant predictor of (general) reading times across the analyses and eye-tracking measures, with the youngest (Grade 3) readers being the slowest, the oldest (adult) readers being the fastest, and Grade 4 readers being in the middle. The incremental reading pattern as a function of age supports the studies on the development of reading fluency in readers of various ages (e.g., Landerl & Wimmer, Reference Landerl and Wimmer2008).
The analyses of the two interest areas pointed to significant two-way interactions involving age, phrase type, and phrase frequency. First, age was found to interact with phrase type in the analysis of the phrase-final word, such that the noun in collocations was read faster than the noun in control phrases by adults, but not third or fourth graders. Second, age interacted with phrase frequency, revealing faster reading for the final word in higher frequency versus lower frequency phrases in adults, and, critically, in fourth graders. While the effect for the adult readers was robust and was evident across the board, the effect found for Grade 4 was relatively small (p = .05) and was observed in the early and middle, but not late measures. Further, age interacted both with phrase type and phrase frequency in the whole phrase analysis. The interactions were evident across the middle and late measures, but were, in particular, evident in the total reading time (dwell time) measure. As expected, adults read collocations and higher frequency phrases consistently faster than controls and lower frequency sequences, respectively. Grade 4 readers also read collocations and higher frequency phrases reliably faster than controls and lower frequency phrases, respectively. Although phrase type and phrase frequency effects for Grade 4 readers emerged only in the analysis of one late measure, dwell time, the effects were strong (phrase type: p < .01; phrase frequency: p < .001).
The results of the present study are the first in the literature to point to an emerging effect of phrase frequency in primary school children during reading. While adults have consistently been shown to be attuned to phrase frequency in language production and comprehension (e.g., Arnon & Snider, Reference Arnon and Snider2010; Kapatsinski & Radicke, Reference Kapatsinski, Radicke, Corrigan, Moravcsik, Ouali and Wheatley2009; Siyanova-Chanturia, Conling, van Hauven, Reference Siyanova-Chanturia, Conklin and van Heuven2011; Siyanova-Chanturia & Janssen, Reference Siyanova-Chanturia and Janssen2018; Tremblay & Baayen, Reference Tremblay, Baayen and Wood2010; Tremblay et al., Reference Tremblay, Derwing, Libben and Westbury2011), very little evidence exists with regard to children. Bannard and Matthews (Reference Bannard and Matthews2008) demonstrated that children as young as 3 were sensitive to phrase frequency distributions during elicited language production (repetition). Reading, however, is a more complex cognitive process requiring the decoding of symbols, that is, “translating signs and symbols into meanings” (Robeck & Wallace, Reference Robeck and Wallace2018, p. 27). During reading, “literal and higher-level comprehension processes occur as written discourse is decoded” (Robeck & Wallace, Reference Robeck and Wallace2018, p. 24). Reading, thus, encompasses both decoding and comprehension; shifting between the two can be challenging for beginner readers. Reading Chinese characters can be even more challenging, given their numberFootnote 4 and “visual complexity” (Liu et al., Reference Liu, Chen and Chung2015, p. 307). It is thus, perhaps, not surprising that only Grade 4 (relatively skilled), and not Grade 3 (less skilled), readers exhibited emerging sensitivity to phrase frequency and phrase type during reading. It is also clear, however, that further studies are needed, in the domain of both production and comprehension, and with children of various age groups and from different L1 backgrounds.
In Bannard and Matthews’s study (Reference Bannard and Matthews2008), children’s age was not found to interact with phrase frequency, which was taken to show “continuity in frequency effects across development” (p. 247). The findings of our reading study point to a different developmental picture, as age interacted with both phrase type and phrase frequency, across the analyses of the two interest areas and a range of early, middle, and late eye-tracking measures. This underlines the need for a variety of measures and paradigms to be employed in order to tap into the processes associated with the development of phrase frequency effects in language comprehension. Our findings suggest that children need sufficient experience with reading and exposure to written characters to be able to start to exhibit sensitivity to phrase frequency during naturalistic reading, and that the age at which this may happen (at least for L1 Chinese) is around nine. This tenet, however, is speculative and is in need of further exploration involving younger readers, for example first and second graders. (Note that prior to the experiment, the third and fourth graders would have been reading in Chinese for only about 2 and 3 years, respectively).
From a theoretical standpoint, and in line with previous research (e.g., Arnon & Cohen Priva, Reference Arnon and Cohen Priva2013, Reference Arnon and Cohen Priva2014; Bybee & Scheibman, Reference Bybee and Scheibman1999; Siyanova-Chanturia, Conklin, & van Heuven, Reference Siyanova-Chanturia, Conklin and van Heuven2011), we take both adult and child readers’ sensitivity to the distributional properties of MWEs as being problematic for the words-and-rules view of language. This approach views the lexicon (memorized and stored forms) and grammar (a collection of rules) as distinct entities (e.g., Pinker, Reference Pinker1998, Reference Pinker1999; Pinker & Ullman, Reference Pinker and Ullman2002). According to this approach, frequency should play a role in the processing of memorized forms, such as morphologically simple forms and idiosyncratic phrases (e.g., idioms). Compositional phrases, it is argued, are necessarily computed and hence should not be subject to phrase frequency effects. The results of our study are at odds with this view. On the contrary, our findings are compatible with the emergentist accounts of language acquisition, processing, and use. These accounts encompass a variety of approaches, such as connectionist models (e.g., Christiansen & Chater, Reference Christiansen and Chater1999; Elman, Reference Elman1990; Monaghan, Chang, Welbourne, & Brysbaert, Reference Monaghan, Chang, Welbourne and Brysbaert2017; Rumelhart & McClelland, Reference Rumelhart and McClelland1986), usage-based theories (e.g., Bybee, Reference Bybee1998; Goldberg, Reference Goldberg2006; Langacker, Reference Langacker1987; Tomasello, Reference Tomasello2003), and exemplar-based models of language processing (e.g., Abbot-Smith & Tomasello, Reference Abbot-Smith and Tomasello2006; Bod, Reference Bod2006; Pierrehumbert, Reference Pierrehumbert, Bybee and Hopper2001). These models are not uniform and vary in several ways. However, a key tenet that these theories share is an important role of frequency in the processing of any and all linguistic forms (e.g., memorized and stored forms, such as morphologically simple words and idioms, as well as morphologically complex words, multiword phrases, and longer stretches of language).
According to the emergentist accounts, the frequency with which linguistic exemplars varying in size, complexity, and level of abstractness occur is a decisive factor in what language users learn and represent. Consistent with connectionist, usage-based and exemplar-based approaches, we take the phrase frequency effects observed in adults and, to a lesser extent, children to reflect language users’ sensitivity to the distribution of linguistic information at various grain-sizes. We expand the current body of evidence (e.g., Arnon & Cohen Priva, Reference Arnon and Cohen Priva2013, Reference Arnon and Cohen Priva2014; Bannard & Matthews, Reference Bannard and Matthews2008; Janssen & Barber, Reference Janssen and Barber2012; Siyanova-Chanturia, Conklin, & van Heuven, Reference Siyanova-Chanturia, Conklin and van Heuven2011) by showing that by the age of 9, children are already attuned to higher versus lower frequency phrases during naturalistic reading. Because the younger counterparts were not able to reliably differentiate between collocations versus controls, we argue that unlike language production (Bannard & Matthews, Reference Bannard and Matthews2008) and, possibly, aural comprehension, phrase frequency effects may be relatively late to manifest themselves during reading. While 9-year-old children would have had years of experience speaking and hearing the language, they would have far more limited experience reading in their L1.
It is noteworthy that in the present study, phrase frequency was conceptualized and tested as a categorical (phrase type) and a continuous (phrase frequency) variable. It has been argued that a continuous measure of frequency, rather than a binary one (low vs. high), may be a better predictor of response times (e.g., Arnon & Snider, Reference Arnon and Snider2010). However, because the two are distinct in what they represent and what they reflect in processing terms, we decided to look at both. For example, Siyanova-Chanturia, Conklin, and van Heuven (Reference Siyanova-Chanturia, Conklin and van Heuven2011) and Siyanova-Chanturia and Janssen (Reference Siyanova-Chanturia and Janssen2018) employed both measures of frequency and found some noteworthy differences. In Siyanova-Chanturia, Conklin, and van Heuven (Reference Siyanova-Chanturia, Conklin and van Heuven2011), native speakers and proficient second-language speakers read English binomials (time and money) faster than reversed forms (money and time). On the contrary, less proficient learners did not exhibit such an advantage. When phrase frequency was treated as a continuous variable, all participants showed phrase frequency effects. Using the same experimental materials, Siyanova-Chanturia and Janssen (Reference Siyanova-Chanturia and Janssen2018) had native and L2 speakers perform a phrase-elicitation (production) task. Native speakers’ articulatory durations were affected by phrase frequency, but not phrase type. Learners’ durations were not influenced either by phrase frequency or phrase type. Participants in Siyanova-Chanturia, Conklin, and van Heuven (Reference Siyanova-Chanturia, Conklin and van Heuven2011) and Siyanova-Chanturia and Janssen (Reference Siyanova-Chanturia and Janssen2018) were more likely to be affected by phrase frequency than phrase type. The current findings pertaining to adults suggest that these readers were similarly attuned to both measures of frequency, categorical and continuous, irrespective of the target interest area(s). In our study, however, the processing pattern for Grade 4 readers was affected more by the continuous measure of frequency (phrase frequency) than the categorical one (phrase type). First, fourth graders read higher frequency phrases faster than lower frequency ones in the phrase-final word analysis, while no such processing advantage was found for collocations over controls (i.e., phrase type). Second, the magnitude of the continuous phrase frequency effect (p < .001) for these readers in the whole phrase analysis was greater than that of phrase type (p < .01). Our findings, thus, lend support to Arnon and Snider (Reference Arnon and Snider2010), suggesting that the continuous measure of frequency may be a more powerful and accurate predictor of reading behavior than the binary one, with the frequency effect being more readily detectable. This may be, particularly, relevant where participants are not yet fluent or experienced readers (e.g., young L1 readers, or L2 speakers).
The findings of the present investigation also contribute to the current body of knowledge specific to frequency effects in Chinese. Previous research, albeit solely with adults, showed that Chinese readers are sensitive both to word and character frequency (e.g., Rayner, Li, Juhasz, & Yan, Reference Rayner, Li, Juhasz and Yan2005; Yan, Tian, Bai, & Rayner, Reference Yan, Tian, Bai and Rayner2006; Zhang & Peng, Reference Zhang, Peng, Chen and Tzeng1992). More recently, Kong et al. (Reference Kong, Zhang and Zhang2016) and Yi et al. (Reference Yi, Lu and Ma2017) extended these results to phrase frequency effects in language processing. Our findings provide further evidence that Chinese adult readers are attuned to the distribution of linguistic information at various grain-sizes, that is, not just characters and words as has previously been shown (e.g., Yan, et al., Reference Yan, Tian, Bai and Rayner2006; Zhang & Peng, Reference Zhang, Peng, Chen and Tzeng1992) but also sequences above the word level.
In addition, our study extends the current literature by showing that, not unlike adults, primary school children are also attuned to phrase frequency during naturalistic reading. The fact that older and more skilled fourth graders, but not younger and less skilled third graders, read higher frequency sequences faster than lower frequency ones reflects the important role of exposure to language and general experience with reading. It is a well-documented finding that more proficient language users are more likely to exhibit phrase frequency effects than less proficient speakers (e.g., Siyanova-Chanturia, Conklin, & van Heuven, Reference Siyanova-Chanturia, Conklin and van Heuven2011; Siyanova-Chanturia & Janssen, Reference Siyanova-Chanturia and Janssen2018; Vilkaite & Schmitt, Reference Vilkaitė and Schmitt2017). The findings of the present investigation suggest that our Chinese third graders (who were not yet skilled readers) would not have had enough experience with reading language to start to exhibit facilitative processing for collocations over controls, or higher frequency phrases over lower frequency ones. That no processing advantage, even marginal, was observed in any of the analyses performed (two areas of interest; four eye-movement measures), further adds credibility to this finding. In addition, even the data for Grade 4 readers point to incipient phrase frequency effects, as they were largely observed in one late measure. Thus, we can conclude that even these more proficient and skilled (Grade 4) readers would not have had enough experience with written language to exhibit phrase frequency effects across the board, as was the case with the adult readers.
From a more methodological standpoint, our study is a testament to how the use of the eye-tracking methodology can help us forge a fuller understanding of the mechanisms behind MWE online processing. It is interesting to note how the use of a variety of eye-tracking measures, along with different interest areas (phrase-final word and whole phrase), allowed for a detailed picture of different reading patterns to emerge. While adults comfortably read collocations and higher frequency phrases faster than controls and lower frequency phrases, respectively, across the analyses of both interest areas, this processing advantage was largely confined to the whole-phrase analysis for the less fluent and less experienced fourth graders. This again underscores the necessity for a variety of interest areas to be included in MWE research. Remarkably, we found no main effects of either phrase type or phrase frequency in the analysis of the phrase-final word. When the whole phrase was considered, both frequency effects (phrase type and phrase frequency) were highly significant in the late, but never in the early or middle, measures. This lends support to Siyanova-Chanturia, Conklin, and Schmitt (Reference Siyanova-Chanturia, Conklin and Schmitt2011) who argue that late measures may be more sensitive to potential differences between MWEs and novel speech than early and middle measures.
In conclusion, the results of the present reading investigation have reaffirmed phrase frequency effects in adults, and, critically, have pointed to emerging phrase frequency effects in primary school children. The use of the eye-tracking methodology has further allowed us to tap into the mechanisms associated with phrasal processing in children and adults, and the differences between phrase frequency conceptualized as a dichotomy versus a continuum. While the finding of incipient phrase frequency effects in children is a novel and important one, future research should replicate and expand on this finding in a number of ways. First, it is desirable to focus on children of a wider age range (e.g., 8-year-olds to early teens), in order to paint a more detailed picture of the development of frequency effects as a function of the ever-changing exposure to the target structures and greater experience with reading, in general. Second, reading studies should endeavor to incorporate a range of language backgrounds (e.g., alphabetic, syllabic, and logographic), as languages are likely to differ in how reading development happens in childhood (e.g., Chinese primary school children are first exposed to pinyin, before being taught to read in simplified Chinese characters; e.g., Chen, Reference Chen and Chan2016), and a variety of target sequences (e.g., different phrasal combinations, such as V+N, Adj+N, etc., have been shown to carry different learning, and, possibly, processing burden; e.g., Peters, Reference Peters2016; Wolter & Yamashita, Reference Wolter and Yamashita2014). Third and finally, given the scarcity of studies looking at phrase frequency effects in children, it is important for various modalities to be explored, targeting both production and comprehension. While adults, having generally experienced huge amounts of exposure with the target language, have been shown to be attuned to phrase frequency in comprehension (i.e., reading and listening; e.g., Arnon & Snider, Reference Arnon and Snider2010; Hernández, Costa, & Arnon, Reference Hernández, Costa and Arnon2016; Siyanova-Chanturia, Conklin, & van Heuven, Reference Siyanova-Chanturia, Conklin and van Heuven2011), as well as production (i.e., repetition/speaking; e.g., Bell et al., Reference Bell, Jurafsky, Fosler-Lussier, Girand, Gegory and Gildea2003; Bybee & Scheibman, Reference Bybee and Scheibman1999; Janssen & Barber, Reference Janssen and Barber2012; Siyanova-Chanturia & Janssen, Reference Siyanova-Chanturia and Janssen2018; Tremblay & Tucker, Reference Tremblay and Tucker2011), children’s behavior is likely to differ depending on the modality and the varied experience they have had using the language (e.g., a 9-year-old would have had years of experience listening to and speaking in the L1, but only 2 to 3 years engaging in such a complex cognitive activity as reading). Finally, while the MWEs used in the present study were extracted from an adult reference corpus, where possible, future studies should endeavor to use corpora of child speech and writing (as was done in Bannard & Matthews, Reference Bannard and Matthews2008).
In sum, although the results of the present study require further interrogation and replication, we hope to have contributed to the existing body of knowledge pertinent to phrase frequency effects and, in particular, to have paved the way for future studies into MWE processing in children.
Acknowledgments
This research was supported by the Fundamental Research Fund for the Central Universities and the Research Fund of Beijing Language and Culture University (No. 15YCX152) to the first author, and the Major Project of National Social Science Foundation of China (No.17ZDA305) to the second author. We would like to thank the students from the Third Experimental Primary School in Haidian District and the Primary School Affiliated to the Beijing Petroleum Institute for their participation in the study.
