1 Introduction
Many languages distinguish between identical and non-identical segments with respect to some phonotactic pattern. For example, in Bolivian Aymara (Aymaran) pairs of identical ejectives may co-occur in a root, as in [t'ant'a] ‘bread’, but pairs of non-identical ejectives may not: *[t'ank'a]. This pattern is dubbed the ‘identity effect’ by MacEachern (Reference MacEachern1999). The classes of identical and non-identical segments have traditionally been analysed with suprasegmental, representational structures, either double linking in autosegmental phonology (Goldsmith Reference Goldsmith1976, McCarthy Reference McCarthy1986, Reference McCarthy1988) or reduplicative correspondence (Buckley Reference Buckley1990, Hudson Reference Hudson and Goldsmith1995, Rose Reference Rose1997, Gafos Reference Gafos1998). The sets of identical and non-identical segments are thus represented differently from the featurally defined natural classes that are also commonly active in phonology, like the set of labial consonants (picked out by the feature [labial]) or the set of stop consonants (picked out by the features [−continuant, −sonorant]). The identical/non-identical distinction falls out naturally given certain representational assumptions, but it is difficult to capture in models of inductive learning that assume strictly feature-based representations, as in the UCLA phonotactic learner (Hayes & Wilson Reference Hayes and Wilson2008).
This paper explores the predictions of the UCLA phonotactic learner, an inductive model with no explicit representation of identity, and compares it to a modification of the model where identity is represented as copying (Colavin et al. Reference Colavin, Levy and Rose2010). In the model with no representation of identity, henceforth the baseline model, the identity effect must be encoded as the cumulative effect of specific constraints on each non-identical pair of segments. Under this analysis, however, the identity effect is formally identical to any arbitrary distinction between segment combinations, and is not predicted to generalise to novel forms; cf. Marcus et al. (Reference Marcus, Vijayan, Bandi Rao and Vishton1999), who identify a similar failing in connectionist models, and argue that variables must be included in cognitive representations. A model in which identity is represented, henceforth the copying model, allows for the identity effect to be learned as a general restriction on all pairs of non-identical segments, and thus predicts both that the identity effect is more general than other patterns and that it should extend to novel forms. Two artificial grammar experiments test the predictions of these two models, and demonstrate that participants' performance is better accounted for with the copying model. The results of Experiment 1 show that participants learn a pattern based on the distinction between identical and non-identical consonant pairs better than a pattern based on an arbitrary distinction between consonant pairs. Experiment 2 shows that participants generalise a distinction between identical and non-identical consonant pairs to novel pairs of identical and non-identical consonants. Both experiments support the analysis of the identity effect as a broad generalisation over identical and non-identical segments, evidencing the need for an explicit representation of identity in the phonological grammar.
The paper is organised as follows. §2 presents the typological pattern known as the identity effect in more detail and discusses different analyses of the pattern. In §3, the predictions of two inductive phonotactic models are compared, the baseline model proposed in Hayes & Wilson (Reference Hayes and Wilson2008) and the model proposed in Colavin et al. (Reference Colavin, Levy and Rose2010), in which identity is represented as segmental copying. Experiment 1 is presented in §4, comparing learning of the identity effect to a formally identical, but arbitrary, pattern, and Experiment 2 is discussed in §5, testing whether the identical–non-identical distinction generalises to novel forms. §6 concludes.
2 The identity effect
2.1 The pattern
In many languages, identical segments are exempt from phonotactic restrictions that hold of non-identical segments. This is dubbed the ‘identity effect’ by MacEachern (Reference MacEachern1999). Consider the data from Bolivian Aymara in (1), taken from de Lucca's (Reference Lucca1987) dictionary and discussed in MacEachern (Reference MacEachern1999) and Gallagher (Reference Gallagher2010a, Reference Gallagherb). Disyllabic roots in Bolivian Aymara may contain a single ejective (1a), but may not contain two ejectives (1b) unless they are identical (1c).
(1)
In other languages, like the varieties of Quechua spoken in Bolivia and the Southern Peruvian highlands, both non-identical and identical pairs of ejectives are absent from the language (e.g. *[k'…p'], *[k'…k']). Thus a phonotactic restriction on the co-occurrence of a class of sounds may apply uniformly to all segment pairs in a language, or it may target only non-identical pairs.
The identity effect is widely attested in languages with restrictions on laryngeally marked consonants. MacEachern finds that pairs of identical ejectives, aspirates or implosives are attested despite restrictions on non-identical pairs in Tz'utujil (Mayan), Hausa (Afro-Asiatic), Peruvian Aymara (Aymaran) and Gojri (Indo-Aryan). This same pattern is also found for ejectives in other Mayan languages, e.g. Chol (Gallagher & Coon Reference Gallagher and Coon2009) and Yucatec Mayan (Straight Reference Straight1976) and for implosives in Muna (Austronesian) (van den Berg & Sidu Reference Berg and Sidu1996, Coetzee & Pater Reference Coetzee and Pater2008).
Restrictions on consonant co-occurrence may also apply equally to identical and non-identical segments, as mentioned above for ejectives in Quechua. This type of pattern is also found for ejectives in Shuswap (Salish) (MacEachern Reference MacEachern1999) and Yapese (Austronesian) (Jensen Reference Jensen1977), and for pairs of aspirates in Quechua, Ofo (Siouan), Sanskrit (Indo-Aryan) and Souletin Basque (isolate) (MacEachern Reference MacEachern1999).
Languages with restrictions on major place of articulation may also show the identity effect, whereby pairs of non-identical homorganic consonants may be underattested or unattested, while pairs of identical consonants are attested. The pattern is clearly illustrated in the co-occurrence of labial consonants in Muna: the attestation of a pair of labials generally decreases with the similarity of the two consonants, but identical consonants occur more often than expected by chance, despite being maximally similar (Coetzee & Pater Reference Coetzee and Pater2008). The examples in (2) show pairs of non-identical and identical labial consonants and their observed/expected (O/E) ratios (taken from Coetzee & Pater Reference Coetzee and Pater2008); a similar effect is found for coronals and dorsals. An O/E around 1 indicates that a pair of consonants occurs as often as expected by chance; below 1 indicates underattestation and above 1 overattestation (Pierrehumbert Reference Pierrehumbert1993, Frisch et al. Reference Frisch, Pierrehumbert and Broe2004).
(2)
A similar pattern is seen in the restrictions on homorganic consonants in Semitic (McCarthy Reference McCarthy1986, Berent & Shimron Reference Berent and Shimron1997, Frisch & Zawaydeh Reference Frisch and Zawaydeh2001, Frisch et al. Reference Frisch, Pierrehumbert and Broe2004), though in Semitic languages identical pairs of consonants are restricted to certain positions within the root, and are often analysed as deriving from a single consonant that is either linked to multiple prosodic positions (McCarthy Reference McCarthy1986, Reference McCarthy1988) or reduplicated (Gafos Reference Gafos1998). Ngbaka (Niger-Congo; Thomas Reference Thomas1963, Mester Reference Mester1986) also shows this type of pattern, where homorganic, highly similar pairs of consonants are absent but identical pairs are widely attested, as do Javanese (Austronesian) and Bolivian Aymara (Graff & Jäger Reference Graff and Jäger2009).
2.2 Analysing the identity effect
Multiple proposals have been made for distinguishing between identical and non-identical segments in phonological patterns. The classic autosegmental account of the identity effect appeals to the idea of double linking. Under this line of analysis, identical segments are a single featural representation linked to two prosodic positions, and thus while on the surface there are two phonetically distinct segments, the phonology operates as if there is just one segment. This doubly linked representation allows identical segment pairs to escape violation of standardly formulated Obligatory Contour Principle (OCP) constraints (Leben Reference Leben1973, Goldsmith Reference Goldsmith1976, McCarthy Reference McCarthy1986, Reference McCarthy1988, Coetzee Reference Coetzee and Parker2009a). An OCP constraint takes the form *[αF][αF], disallowing multiple instances of the same feature specification on the same autosegmental tier. For example, a restriction on two ejectives in a root results from a constraint on multiple instances of [+constricted glottis], the feature that distinguishes ejectives from other stops: *[+cg][+cg]. Pairs of identical segments can escape violation of an OCP constraint if a single root node is doubly linked to two consonantal positions, because there is only one [+constricted glottis] autosegment, as shown in (3). In (3a), there are two distinct root nodes and two instances of [+constricted glottis], which violates *[+cg][+cg]. In (3b), there is only a single root node and no sequence of [+constricted glottis] specifications, and thus no OCP violation.
(3)
The autosegmental account of the identity effect relies on a covert distinction between pairs of surface segments that are represented as distinct segments and those that are represented as a single segment. While the class of all identical segments is not easily definable in featural terms, double linking allows the grammar to reference identical segments as a class: identical segments are those that share a single root node.
Other analyses of the identity effect also assume that the identical or non-identical status of a pair of segments is something that constraints in Optimality Theory (Prince & Smolensky Reference Prince and Smolensky1993) can reference. MacEachern (Reference MacEachern1999) analyses the identity effect as the interaction between an OCP constraint and a constraint requiring complete identity between consonants of a root, BeIdentical. Coetzee & Pater (Reference Coetzee and Pater2008) assume that OCP constraints generally apply only to non-identical segments; in languages where identical segments are disallowed, they are ruled out by a specific constraint against identical segments. Both of these proposals assume that the identity or non-identity of segments is something that constraints can refer to, just like any other feature value that may be shared or unshared between a pair of segments.
3 Constraint induction and the representation of identity
Any account of the identity effect as such relies on some representational distinction between identical and non-identical consonants, either in the phonological representation itself or in the structure of grammatical generalisations. In the baseline model of inductive phonotactic learning proposed in Hayes & Wilson (Reference Hayes and Wilson2008), which assumes a very basic structure for phonotactic generalisations, no such representational distinction is available. This section compares the predictions of the baseline model, with no explicit representation of identity, to the predictions of the copying model, where identity is represented (Colavin et al. Reference Colavin, Levy and Rose2010). The results of the two artificial grammar experiments in §4 and §5 support the predictions of a model that refers directly to identity, and thus provide an argument that an accurate model of learning must allow for an explicit distinction between identical and non-identical segments. The predictions of the baseline model are laid out schematically in §3.1, and contrasted with the copying model in §3.2. The models are compared concretely with learning simulations in §3.3.
3.1 The baseline model and predictions for identity
The principle behind the UCLA phonotactic learner (Hayes & Wilson Reference Hayes and Wilson2008) as a model of phonotactics is to begin with a maximally simple theory of representations and constraints and see what range of phonological patterns can be learned with this baseline model. Evidence for enriching either representations or the structure of constraints comes from generalisations that cannot be stated or learned in the baseline model.
The UCLA phonotactic learner, the baseline model, starts with a feature set to distinguish the segments of a language and a formula for constructing constraints on feature combinations and sequences, and arrives at a grammar of weighted constraints, weighted via an algorithm based on the principle of Maximum Entropy (maxent; for background on maxent in general see Jaynes Reference Jaynes and Rosenkrantz1983, Manning & Schütze Reference Manning and Schütze1999 and Klein & Manning Reference Klein and Manning2003, and for applications to phonological grammar Goldwater & Johnson Reference Goldwater, Johnson, Spenador, Eriksson and Dahl2003). The grammar assigns a probability distribution over the possible and impossible structures in a language, according to the formula in (4a). (4a) says that the probability of a form x, P(x), is equivalent to the maxent value, defined as e raised to the negation of the score assigned by the grammar, h(x), divided by Z, the sum of the total maxent values of all possible forms Ω. The score for a given form, h(x), is defined in (4b); it is the sum of the product of the weights w of each constraint C that the form violates and the number of times the form violates that constraint. The total maxent values of all possible forms, Z, is defined in (4c).
(4)
Given a feature set that uniquely defines each segment, the learner constructs all possible natural classes, and then constructs all possible constraints from these natural classes. Constraints are negative statements that rule out natural classes, either in a single matrix penalising a type of segment (e.g. *[+cont, −son, lab], penalising labial fricatives), or in a sequence of feature matrices, penalising sequences of segments (e.g. *[−cont, −son][ −cont, −son], penalising adjacent sequences of stops).Footnote 1
To arrive at a grammar, the learner selects a constraint from the set of possible constraints, and assigns the constraint a weight by testing it against the attested forms in the learning set. The goal of the weighting algorithm is to maximise the likelihood of attested forms and minimise the likelihood of unattested forms; thus a high weight is assigned to constraints that penalise unattested forms, and a low or zero weight is assigned to constraints that penalise some or only attested forms. The model first selects the most accurate constraints to add to the grammar, and then, within this set, selects the more general constraints. The accuracy of a constraint is defined roughly as the observed/expected ratio of violations on that constraint; it is the number of times the constraint is violated in the learning data divided by the number of violations that are expected given the current grammar (see Hayes & Wilson Reference Hayes and Wilson2008: §4.2.1 for further discussion). The generality of a constraint is a function first of the number of feature matrices referred to in the constraint, and second of the number of features referred to in a given feature matrix. Shorter constraints are preferred over longer constraints (e.g. *[+voice, lab] is preferred over *[+voice][+voice]), and among constraints of the same length, constraints that refer to fewer natural classes are preferred (e.g. *[+voice] is preferred over *[+voice, lab]) (see Hayes & Wilson Reference Hayes and Wilson2008: §4.2.2 for further discussion).
Patterns that distinguish between identical and non-identical segments are an interesting test case for this model, because the distinction between identical and non-identical segments cannot be stated with standard natural classes. Generalisations over (non-)identical entities require constraints to include variables, as discussed in Marcus et al. (Reference Marcus, Vijayan, Bandi Rao and Vishton1999) and Berent et al. (Reference Berent, Wilson, Marcus and Bemis2012). It is possible, however, to analyse the identity effect without referencing identity directly, as the cumulative effect of specific constraints on each non-identical combination. Stating the pattern in this way makes different predictions from a model where generalisations can reference identity directly; these differences are fleshed out in the remainder of this section and in §3.2, with a toy example.
A constraint schema that refers only to distinctive feature values does not allow a co-occurrence restriction on the class of non-identical segments to be stated as such. However, the identity-effect pattern can be described with a set of constraints, as the cumulative effect of multiple constraints on each individual pair of non-identical segments. To illustrate, consider a language with just three ejectives [p' t' k'], which exhibits the identity effect, as in (5a): pairs of identical ejectives are attested, but pairs of non-identical ejectives are absent. One way that this pattern could be learned is with the six constraints in (5b), which rule out each of the six ungrammatical combinations of ejectives. The constraints assume three privative place features corresponding to the three major articulators: the lips [labial], the tongue tip/blade [coronal] and the tongue dorsum [dorsal] (Sagey Reference Sagey1986, McCarthy Reference McCarthy1988).Footnote 2, Footnote 3
(5)
A general constraint against pairs of ejectives, *[+cg][+cg], is not compatible with the pattern in (5a), because [+constricted glottis] sequences occur on the surface. Since identical segments don't form a natural class which is definable with distinctive features, the learner has no way of noticing that the attested combinations of [+constricted glottis] segments form a systematic class, and that all other pairs of [+constricted glottis] … [+constricted glottis] segments are absent. In the baseline model, the six constraints in (5b) cannot be condensed into one or more general constraints.
The piecemeal account of the identity effect in (5b) makes two predictions, stated here and expanded on in the remainder of this section. First, since the identity effect is formally equivalent to an arbitrary distinction between individual segment pairs, the baseline model predicts that the identity effect should be learned just as well as an arbitrary pattern, all else being equal. Second, speakers of a language with the identity effect should not extend the distinction between identical and non-identical pairs to novel segment pairs.
The first prediction is illustrated by comparing the hypothetical language on the left in (6a) below to the identity-effect pattern on the right (as in (5a)). These patterns are parallel in that three pairs of ejectives are attested and six are absent. The constraints in (6b) show that the two patterns are formally identical in a theory with no way of representing identity: both require six constraints, each of which consists of two two-feature matrices.
(6)
The constraints that define the identity effect have no generality or simplicity advantage over the constraints that define an arbitrary pattern in (6). The formal parallelism between the arbitrary and identity-effect patterns predicts that the difference in acceptability between the attested and unattested forms in the two systems should be equally strong.Footnote 5
The experiment presented in §4 tests this first prediction, explicitly comparing individuals' ability to learn the identity-effect pattern and an arbitrary pattern in an artificial grammar learning paradigm. The finding is that the identity-effect pattern is indeed learned better, suggesting that the correct model of phonotactics and phonotactic learning bestows some advantage to the identical/non-identical distinction.
The second prediction of a piecemeal analysis of the identity effect in the baseline model is that a distinction between identical and non-identical segments should not extend to any novel segment pairs. To illustrate, consider a language, similar to that in (5a), with three ejectives [p' t' k'] and the identity effect, but in which pairs of identical labial ejectives are absent. The pattern would be as in (7).
(7)
Given the pattern in (7), constraints against individual combinations of ejectives, including pairs of labial ejectives, are learned, as shown in (8). All pairs of ejectives involving a labial ejective can be ruled out with two constraints; the remaining absent combinations are ruled out by further constraints on those individual pairs.
(8)
If speakers of a language with the grammar in (8) are asked to judge the acceptability of nonce words with two ejectives, they are predicted not to distinguish between the unattested pair of identical labial ejectives and the unattested pairs of non-identical ejectives. Without constraints that refer explicitly to identical or non-identical classes of segments, no generalisation can be made for nonce pairs of identical and non-identical segments. A nonce word with [p'…p'] will not be treated as belonging to the broader class of identical ejective pairs, which are generally attested, but instead will be grouped with the other unattested non-identical ejective pairs. In fact, as will be seen in the simulations in §3.3 below, pairs of labial ejectives are predicted to be judged to be more ill-formed than pairs of non-identical ejectives, because they are penalised both by more constraints and by more general constraints.
Many studies have found, through a variety of tasks, that speakers generalise broad patterns in their lexicon to nonce words, such that certain nonce forms emerge as more acceptable than others (Frisch & Zawaydeh Reference Frisch and Zawaydeh2001, Moreton Reference Moreton2002, Rose & King Reference Rose and King2007, Albright Reference Albright2009); cf. the well-known distinction between absent, but possible, blick and absent, but impossible, bnick in English (Halle Reference Halle1962, Chomsky & Halle Reference Chomsky and Halle1968: 380). Some evidence that generalisations formed over identical segments extend to nonce words comes from a study by Berent et al. (Reference Berent, Marcus, Shimron and Gafos2002). Berent et al. investigated Hebrew speakers' representation of a restriction on identical consonants by asking for well-formedness judgements on nonce forms containing identical pairs of consonants not native to Hebrew. Native Hebrew verbs exhibit a pattern common to many Semitic languages where identical consonants are attested at the right edge of a base form but not the left edge, e.g. [simem] ‘drug (past 3sg masc)’ is an attested form, with the pattern C1C2C2, but C1C1C2 forms such as *[sisem] are unattested. To test whether Hebrew speakers learn a generalisation over all identical consonants, as opposed to restrictions on individual pairs of identical consonants, Berent et al. constructed nonce words with identical pairs of the non-native consonants [ʧ], [ʤ] and [θ] in different positions. If Hebrew speakers' grammar references identity explicitly, then the generalisation that identical consonant pairs are well-formed at the left edge but not the right edge should extend to the novel segments. If generalisations based on the broad distinction between identical and non-identical consonants are unavailable to the learner, then identical pairs of these novel segments should be judged equally well-formed at the right edge and at the left edge. Hebrew speakers' judgements support the identity-based generalisation: forms like [kiθeθ] were given better well-formedness ratings than forms like [θiθek]. The artificial grammar experiment in §5 also finds that a distinction between identical and non-identical segments generalises to novel pairs of identical and non-identical segments, supporting the claim that identical and non-identical segments are classes that the grammar references directly.
3.2 The copying model and predictions for identity
In the learning simulations in §3.3 below, the predictions of the baseline model outlined above are tested and compared with the predictions of a model that explicitly represents identity. This copying model follows Colavin et al. (Reference Colavin, Levy and Rose2010), who show that a representation of identity in the learning data allows for a better model of the patterning of identical consonants in Amharic. They found that the copying model with identity represented as reduplication is a better fit to Amharic speakers' well-formedness judgements of nonce roots than the baseline model.
In the copying model, pairs of identical consonants are represented as a single consonant followed by a placeholder X, e.g. the root sequence [k'…k'] is represented as [k'…X]. The copying model is otherwise identical to the baseline model (i.e. the constraint-induction and weighting algorithms are the same). The placeholder X is unspecified for all the features that distinguish segments in the language, but is specified for an additional, suprasegmental feature, which I call [ident], which is unspecified for all other consonants. This suprasegmental feature [ident] is different from other distinctive features, in that it refers to a relation between segments in a string, as opposed to a property of an individual segment. It could be thought of as representing double linking of a root node, as in an autosegmental representation. As with double linking, this method of representing identical consonants results in only a single phonological feature matrix for identical segments. The representation of identical and non-identical ejectives in the two models is exemplified in Table I.
Representation of identical consonant pairs in the baseline and copying models.

As can be seen in Table I, the representation of non-identical ejective pairs does not differ between the two models. In both models, a sequence of non-identical segments is represented as a sequence of two fully specified feature matrices. Identical segments, however, differ in their representation between the two models. In the baseline model, an identical pair of segments is represented, like non-identical pairs, as a sequence of two fully specified feature matrices, while in the copying model there is only one fully specified feature matrix.
With identity represented as in the copying model, our toy identity-effect language can be learned with a single constraint that rules out sequences of ejectives, *[+cg][+cg]. The arbitrary pattern still cannot be learned as a broad generalisation, and requires multiple constraints, as in the baseline model. How the identity-effect and arbitrary restriction patterns could be learned in the copying model is shown in (9).
(9)
As can be seen in (9b), for the arbitrary restriction in the copying model, a single constraint, *[+cg][ident], penalises all pairs of identical ejectives. The other three absent pairs of ejectives, however, do not form a class distinct from the attested ejective pairs, and must be ruled out with three additional constraints on those individual ejective pairs, as in the baseline model. For the identity effect, in the copying model a single constraint, *[+cg][+cg], rules out all six unattested pairs of ejectives. This constraint does not penalise pairs of identical ejectives, because they are not represented as sequences of two [+constricted glottis] segments. In the copying model, then, the arbitrary and identity-effect patterns are not formally equivalent. Rather, the identity effect can be learned with a single, general constraint, while the arbitrary pattern requires multiple, more specific constraints. As will be shown in the simulations in the next section, more general constraints receive higher weights, and thus unattested sequences that fall into a broad class are penalised more than unattested sequences that must be ruled out by more narrow constraints. Because the copying model allows a single generalisation to be made over all non-identical segment pairs, it allows for a formal distinction between the identity effect and the arbitrary pattern. The simulations in §3.3 below show that the difference in acceptability between attested and unattested pairs in the identity-effect pattern is larger than in the arbitrary pattern in the copying model, but not the baseline model.
The copying model also differs from the baseline model in the predictions about an identity-effect system with a gap for one identical segment pair, as in (7) above, where [t'…t'] and [k'…k'] are attested, but non-identical pairs and [p'…p'] are unattested. The constraints needed to capture this pattern in the baseline model (repeated from (8)) and the copying model are presented in (10). In the baseline model, the absence of [p'…p'] allows for a broader generalisation, i.e. that labial ejectives cannot occur with any other ejective, captured by the two constraints *[lab, +cg][+cg] and *[+cg][lab, +cg]; the other absent combinations are again ruled out by specific constraints on those combinations. In the copying model, a single constraint cannot rule out identical and non-identical pairs of ejectives, since identical pairs are not represented as segmental sequences. Instead, all unattested non-identical ejective pairs can be ruled out with the single constraint *[+cg][+cg], and an additional, specific constraint, *[+cg, lab][ident], is needed to rule out the gap.
(10)
The crucial difference between the two models is that in the baseline model, restrictions on pairs of identical labials and non-identical pairs with a single labial can be penalised with a single constraint (e.g. *[lab, +cg][+cg]), while in the copying model separate constraints are needed for identical and non-identical pairs. In the baseline model, grouping identical and non-identical pairs of unattested ejectives means that the [p'…p'] gap violates a more general constraint than the unattested non-identical ejectives [t'…k'] and [k'…t'] (*[lab, +cg][+cg] refers to only three features; *[cor, +cg][dors, +cg] and *[dors, +cg][cor, +cg] each refer to four features). In the copying model, however, the identical pair is penalised by a more specific constraint than the non-identical pairs. As will be shown in the simulations to follow, the preference for more general constraints means that the baseline model predicts that pairs of identical labial ejectives will be more dispreferred than pairs of non-identical ejectives, while the copying model predicts the opposite.
The following section presents learning simulations that demonstrate the different predictions of the baseline model and the copying model with respect to (i) the distinction between the identity-effect pattern and an arbitrary pattern, and (ii) the extension of the identity pattern to an unattested gap.
3.3 Learning simulations: modelling the identity effect
A series of learning simulations show the predictions outlined schematically above for the baseline and copying models. The data for the simulations were based on a list of lexical roots from Chol, a Mayan language exhibiting the identity effect on ejectives (Warkentin & Brend Reference Warkentin and Brend1974, Gallagher & Coon Reference Gallagher and Coon2009). The consonantal inventory of Chol is given in (11) (the language has six vowels: [a e o i ɨ u]).
(11)
Ejectives occur only in roots in Chol, which are predominantly CVC, and are restricted from co-occurring in pairs unless completely identical. A list of all 843 roots extracted from Aulie & Aulie (Reference Aulie and Aulie1978) contains 13 roots with two identical ejectives (12a), but none with two non-identical ejectives (12b).
(12)
The learning simulations were conducted with the UCLA phonotactic learner, the inductive model proposed and tested in Hayes & Wilson (Reference Hayes and Wilson2008).Footnote 6 Six different feature simulations were run, varying both the structure of the learning data and the representations (i.e. the baseline or copying model). The learning data were either the unmodified list of Chol roots, showing the identity effect, or were modified either to show an arbitrary pattern or to exclude one of the attested pairs of identical ejectives.Footnote 7 In the arbitrary pattern, each pair of identical ejectives in the root list was changed to a different combination of non-identical ejectives. The result is a pattern where five of the 25 possible combinations of the five ejectives are attested, and 20 are unattested, as in the identity pattern. The arbitrary identity patterns here are thus parallel to those sketched schematically in §3.1; the learning data is identical in every way, except that the five attested pairs of ejectives are either all identical, or not. The second modification was to remove the root with identical labial ejectives from the learning data, so there was a gap in the identity-effect pattern: all attested pairs of ejectives are identical, but both non-identical pairs and one identical pair are unattested. The three patterns are shown in Table II, illustrating just the attested pairs of ejectives in each set of learning data; pairs of ejectives not listed are entirely absent from the learning set. The other roots (those not containing two ejectives) in the learning data were the same for all three data sets.
Attested ejective pairs in three sets of learning data given as input to the simulations, and the number of roots with each pair (out of a total of 843).

Simulations on each of these data structures were run twice, once without a representation of identity (the baseline model) and once with identity represented with a placeholder (the copying model). Additionally, only the consonantal root pairs were given to the model; the vowels were removed. This step was taken only for expediency, as the learner is capable of making generalisations over non-adjacent sequences, via n-grams or tier projection (Hayes & Wilson Reference Hayes and Wilson2008: §6). The feature set for Chol consonants given to the model is shown in Table III.Footnote 8 All models were run to learn 200 constraints, though the same basic patterns emerge with fewer constraints.
Distinctive feature chart for Chol consonants, given to the model as input to the learning simulations. Blank cells indicate that a segment is underspecified for the given feature.

The learner assigns a score to each form in the testing data, which for all simulations was the full set of attested forms in the learning data as well as all ejective pairs. The score for a given form is computed by summing the weights of the constraint violations, similar to other weighted constraint models like Harmonic Grammar (Pater et al. Reference Pater, Bhatt and Potts2007, Coetzee & Pater Reference Coetzee and Pater2008, Pater Reference Pater2009, McCarthy & Pater to appear). Constraint weights and violations are positive, and thus scores have a lower bound of 0 and no upper bound. Higher scores indicate greater dispreference; a form with a score of 0 violates no constraints and is grammatically perfect. To assess each model, the scores of attested and unattested pairs of ejectives were compared. The learner is non-deterministic, meaning that it gives slightly different results on each run with the same data and settings. To get a measure of the variability between runs of the same model, each model was run five times; the tables below report the average across all five runs.
3.3.1 Prediction 1: comparing the identity and arbitrary patterns
The baseline and copying models make different predictions about the arbitrary and identity-effect patterns. In the baseline model, the difference between attested and unattested pairs of ejectives is roughly equivalent for both the arbitrary and identity patterns, while for the copying model the difference is bigger for the identity pattern than the arbitrary pattern. Table IV shows the average scores assigned by the baseline model to attested and unattested ejective pairs in the identity pattern and the arbitrary pattern. For both patterns, attested forms have lower scores than unattested forms. The difference between attested and unattested forms is slightly bigger for the arbitrary pattern (2·99) than for the identity pattern (2·29).
Scores for attested and unattested ejective pairs in the identity and arbitrary patterns, as assessed by the baseline model. Scores are averaged across five runs. One standard deviation is given in parentheses.

Table V shows the average scores for attested and unattested ejective pairs in the identity and arbitrary patterns for the copying model. Like the baseline model, the copying model assigns higher scores to unattested forms than to attested forms for both patterns. Unlike the baseline model, in the copying model the difference between attested and unattested forms is twice as large for the identity pattern (5·08) as for the arbitrary pattern (2·46).
Scores for attested and unattested ejective pairs in the identity and arbitrary patterns, as assessed by the copying model. Scores are averaged across five runs. One standard deviation is given in parentheses.

The baseline models of the identity and arbitrary patterns are illustrated in Table VI, which show the ten highest-weighted constraints that penalise some combination of ejectives. Some of these constraints rule out only combinations of ejectives and look like the constraints sketched in the previous subsections, like *[+cg, lab][+cg, cor]. Other constraints rule out combinations of ejectives as well as combinations of non-ejectives, like *[−ant][+ant]. The highest-weighted constraints in both models are constraints against disagreeing anteriority values, as pairs of stridents that disagree in anteriority are categorically absent in Chol. What is of interest in these models is that for both the identity (a) and the arbitrary (b) patterns, the unattested combinations of ejectives are ruled out by a variety of constraints on some subset of the unattested pairs.
Ten highest-weighted constraints penalising some pair of ejectives in the baseline model: (a) identity pattern; (b) arbitrary pattern.
The copying models for the identity and arbitrary patterns are shown in Table VII, again showing the ten highest-weighted constraints that penalise some combination of ejectives. For the identity pattern, the copying model learns a high-weighted, general constraint that rules out pairs of non-identical ejectives. The constraint *[+cg][+cg] represents this generalisation, which can be learned in the copying model because pairs of identical ejectives are not represented as sequences, and therefore do not constitute exceptions to this constraint in the training data. Additional, lower-weighted constraints further penalise subsets of the unattested, non-identical ejective pairs, as in the baseline model. This redundancy is an inherent part of the UCLA phonotactic learner, which assigns some weight to all constraints that allow for a tighter fit to the learning data. The copying model of the identity pattern also learns low weights for constraints against pairs of labial ejectives [p'…p'] and pairs of alveolar stop ejectives [tʲ'…tʲ'], which, despite being attested, are very infrequent in the learning data. In the copying model of the arbitrary pattern in Table VIIb, the unattested ejective combinations are not penalised by any single constraint. Rather, they are ruled out by constraints on subsets of the unattested combinations, or individual combinations, as in the baseline model.
Ten highest-weighted constraints penalising some pair of ejectives in the copying model: (a) identity pattern; (b) arbitrary pattern.
The simulations reported in this subsection illustrate that the identity-effect pattern is formally equivalent to an arbitrary pattern, unless identity is represented explicitly. The baseline model learns the identity and arbitrary patterns equally well, whereas the copying model learns a stronger distinction between attested and unattested pairs for the identity pattern.
3.3.2 Prediction 2: generalisation of the identity pattern
The second set of simulations compared the baseline and copying models on the learning data with a gap for identical labial ejectives. Table VIII shows the results of both models. Here, the scores are shown for attested identical ejectives, the pair of identical labial ejectives that is unattested in the learning data and the unattested non-identical ejectives. In both models, unattested non-identical ejectives are given higher scores than pairs of attested identical ejectives, though the difference is bigger for the copying model than the baseline model (as found for the simulations in the previous section). Crucially, the models differ with respect to the unattested pair of two labial ejectives. In both models, the unattested identical labial ejectives have a higher score than the attested pairs of identical ejectives. In the baseline model, however, this pair is more ill-formed – has a higher score – than the other unattested non-identical ejectives, while in the copying model the identical labial ejective pair is less ill-formed – has a lower score – than the non-identical ejectives. That is, in the copying model the grammaticality of identical ejectives in the learning data is extended to an unattested identical pair, while in the baseline model it is not.
Scores for attested ejective pairs and unattested identical and non-identical ejective pairs, as assessed by the baseline model and the copying model. Scores are averaged across five runs. One standard deviation is given in parentheses.

The constraints that the two models learn are illustrated in Table IX, which shows the ten highest-weighted constraints that penalise some combination of ejectives. Additionally, all constraints that penalise labial ejective pairs are shown (below the dashed line). The main difference between the two models is that, in the baseline model (a), the absence of identical pairs of labial ejectives allows the model to learn a high weight for a general constraint against all combinations of a labial ejective followed by some other ejective, *[+cg, lab][+cg]. In the copying model (b), this general constraint is not learned, because identical ejectives are not represented as sequences of ejectives, and thus pairs of identical segments don't fall within the scope of broader generalisations that hold of non-identical segment pairs. Instead, in the copying model pairs of labial ejectives are penalised by a more specific, and lower-weighted, constraint specifically against identical labial ejectives *[+cg, lab][ident]. While both models learn several lower-weighted constraints that penalise labial ejectives, in the baseline model these constraints are more general and higher-weighted than in the copying model.
Ten highest-weighted constraints penalising some pair of ejectives for the gap pattern in (a) the baseline model; (b) the copying model. Lower weighted constraints penalising labial ejectives are below the dashed line.
The simulations reported in this subsection illustrate that the identity-effect pattern is extended to novel, unattested ejective pairs in the copying model but not the baseline model.
3.4 Summary
The section has shown that the predictions of the baseline model, which lacks an explicit representation of identity, differ from those of the copying model, which represents identity. In the baseline model, the distinction between attested and unattested ejectives is learned equally well for an identity-effect pattern and an arbitrary pattern, while in the copying model the identity-effect pattern is learned better (the difference between attested and unattested ejective pairs is greater). Furthermore, in the copying model the distinction between identical and non-identical ejectives is extended to a novel pair of identical ejectives, while in the baseline model it is not. In sum, a model in which identity is represented allows for a greater distinction between identical and non-identical segments to be learned, for the distinction to be learned as a broad, systematic generalisation, and for generalisation of the identity effect to unattested segment pairs.
The source of the different predictions of the baseline and copying models is in the generality of the constraints they can learn. Because of both the accuracy and generality heuristics in the constraint-weighting algorithm, a pattern that can be stated with a single constraint will be learned with a higher weight than one that can only be stated with several constraints. A constraint against all non-identical ejectives is preferred on accuracy, because there is more data to support it than a constraint such as just, say, *k'…p', and it is more general because it refers to fewer features. This feature of the learning algorithm is desirable, as it has been found that formal properties like scope and simplicity influence learning in artificial grammar experiments (Moreton Reference Moreton2008, Reference Moreton2012, Pater & Moreton Reference Pater and Moreton2012). The experiments in the next section show that an identity-based pattern is indeed learned better than an arbitrary pattern, and thus warrants a simpler statement, as in the copying model.
4 Experiment 1: learning the identity effect in an artificial grammar paradigm
An artificial grammar learning experiment was designed to test how well a pattern based on a distinction between identical and non-identical consonants is learned relative to a pattern based on an arbitrary distinction among pairs of consonants. Participants were taught a simple language game in which they were trained on an alternation between voiced and voiceless stops. In one condition, all stops underwent the alternation except for those that co-occurred with an identical stop (i.e. stimuli with [b…b, d…d, g…g] pairs patterned differently from stimuli with [b…d, b…g, d…b, d…g, g…b, g…d] pairs). In a second condition, an arbitrary distinction was made between consonant pairs, such that stimuli with three arbitrarily chosen pairs of consonants did not exhibit an alternation, while stimuli with the remaining six pairs of consonants did (i.e. stimuli with [b…d, d…g, g…b] pairs patterned differently from stimuli with [b…b, b…g, d…b, d…d, g…d, g…g] pairs).
If generalisations are learned at the segmental level, over individual combinations of segments, then the two conditions are formally equivalent. In each case, stimuli with six pairs of consonants exhibit an alternation, while three pairs of consonants do not. If identity is a representational primitive, however, and learners can make generalisations that refer to identity, then the pattern based on identity can be stated more simply than the arbitrary pattern.
4.1 Method
4.1.1 Participants
Participants were recruited via Mechanical Turk, Amazon's crowd-sourcing site,Footnote 9 and were paid $0·60 for completing the experiment, which took about ten minutes. Participants were told that they needed to be native speakers of English to complete the experiment, and were asked in a short demographic survey at the end of the experiment what their native language was. In addition, participants were restricted to those with a 95% approval rating on previous Mechanical Turk tasks, and an IP address within the United States.
Participants' data were excluded from analysis if (i) they stated at the end of the experiment that they were not native speakers of English (5 participants), (ii) they gave no alternating responses (13 participants) or (iii) more than 50% of their responses were erroneous (8 participants; see §4.3 below for what classifies a response as erroneous). Once participants were removed, responses from 102 participants remained in each of the identity and segmental conditions and 104 participants in the control condition.
4.1.2 Stimuli
The stimuli for the experiment were C1V1C2V2 nonce words, where V1 and V2 were all non-identical pairings of the vowels [a e i u], and C1 and C2 were identical and non-identical combinations of [b d g] in C1 and [b d g p t k] in C2. In addition, filler items were made with the same vowel patterns and all combinations of [ʧ ʃ] in C1 and [b d g] in C2. Stimuli were thus items like [badu], [dike], [giga], [ʧebu], etc. There was a total of 288 stimuli following this template: 216 critical items and 72 fillers.
Stimuli were made from recordings of a native Hebrew speaker, who was naive as to the purpose of the experiment, reading each stimulus item. A Hebrew speaker was chosen because the language has a canonical five-vowel inventory with no vowel reduction in unstressed positions, and a contrast between fully voiced and voiceless unaspirated stops.Footnote 10 The speaker was instructed to read the stimulus items as if they were Hebrew nonce words, with stress on the initial syllable. The words were read off a print-out, and each one was repeated twice. The first and last item on each page were discarded, to avoid stimuli with prosodic effects associated with the beginning/end of a list. The second repetition of each word was used for the experimental stimuli, except for a small number of cases where the final vowel was either devoiced or very quiet, in which case the initial repetition was used. The stimuli were not modified in any way.
There were two conditions, exhibiting one of two patterns. In the identity condition, identical and non-identical pairs of consonants patterned differently: a prompt with identical voiced stops was paired with an identical response (e.g. prompt [babu], response [babu]), while a prompt with non-identical voiced stops was paired with a response with the second stop devoiced (e.g. prompt [badu], response [batu]; prompt [bagu], response [baku]). In the segmental condition, prompts with labial … coronal, coronal … dorsal and dorsal … labial pairs of voiced stops were paired with an identical response (e.g. prompt [badu], response [badu]), while prompts with all other combinations of voiced stops were paired with responses with the second stop devoiced (e.g. prompt [bagu], response [baku]). The segmental condition shows a pattern similar to the patterns referred to as ‘arbitrary’ in the previous section. The two patterns are schematised in Table X, using stimuli with the [a…u] vowel pattern. Fillers were only present in testing; there were no fillers in the training trials.
Stimuli for the identity and segmental experimental conditions.

In addition to the identity and segmental conditions, a third condition, the control condition, was run. The goal of the control condition is to assess bias in participants that may account for learning differences between the identity and segmental conditions (e.g. does the English lexicon bias participants from giving responses with the [b…b] consonant pair?). In the control condition, participants were trained on 50% alternating pairs and 50% non-alternating pairs, which showed no consistent pattern. A prompt stimulus with any consonant pair could appear in training with either an alternating or a non-alternating response, and thus no generalisation could be made about when alternation occurred. For each prompt, either an alternating or a non-alternating response was chosen at random for each participant. An illustration of what training stimuli in the control condition could look like is shown in Table XI. This table shows six prompts, and how responses could be randomly assigned to two participants. For both participants, half of the responses are alternating and half are non-alternating, but the alternating/non-alternating prompts are not necessarily the same across participants (though they may be, accidentally, as for [bage] and [dedu] in Table XI), or consistent for a given consonant pair (though they may be accidentally, as for the two [d…d] prompts for participant n+1 in Table XI).
Illustration of possible prompt-response pair selection for two hypothetical participants in the control condition.

The testing prompts were drawn evenly from each of the three sets of prompts that are compared in the identity and segmental conditions; seven stimuli were drawn from the set of non-alternating prompts in the identity condition ([b…b, d…d, g…g]), seven from the set of non-alternating prompts in the segmental condition ([b…d, d…g, g…b]) and seven from the set of prompts that are alternating in both conditions ([b…g, d…b, g…d]).
4.1.3 Equipment
The experiment was run using Experigen, a program for running online experiments (Becker & Levine Reference Becker and Levine2010). Participants were directed to the experiment, hosted on the author's university webspace, from Mechanical Turk.
4.1.4 Procedure
The procedure employed is similar to that in Wilson (Reference Wilson2006). Participants were taught a language game, in which they were presented with a prompt and had to provide a response. In training, subjects were presented with two stimulus items, the prompt and the response, in the frame ‘I say “x”’, ‘You say “y”’. In testing, subjects were presented with a prompt and were asked to provide a response.
The experiment consisted of a training and a testing phase. In the critical training conditions, the training phase was made up of 36 prompt–response pairs, 18 drawn each from the alternating and non-alternating sets for the relevant condition. The set of 36 training pairs was repeated twice, in random order, for a total of 72 training trials. In a training trial, the participant was presented with the text ‘I say “x”’, with the stimulus displayed orthographically, followed by a button that the participant clicked to listen to the prompt stimulus. Once the prompt stimulus was played, a second line of text, ‘You say “y”’, appeared, along with a button to listen to the response stimulus. After the response stimulus played, a ‘continue’ button appeared at the bottom of the page, which the participant clicked to move on to the next trial. Participants thus had to listen to both the prompt and the response stimulus before moving on. Participants were instructed to repeat the response stimulus to help them learn the pattern, but as the experiment was run online and subjects were not recorded, it is not known what proportion of participants actually did repeat the response stimulus. A screenshot for the training phase is given in Fig. 1.
Screenshot of a training trial.
The testing phase consisted of 26 items, ten prompts each from the alternating and non-alternating sets, and six fillers. In testing, subjects were presented with the prompt stimulus in the same format as in training, the text ‘I say “x”’ followed by a button to play the stimulus. Once the prompt had been played, the text ‘You say’ appeared followed by a response box, where participants typed in their response. A screenshot for the testing phase is given in Fig. 2. The open response format was chosen instead of a forced choice design, in the hope that it would make the experiment more engaging. As will be mentioned in §4.3, this response format did result in needing to discard some anomalous responses, but overall participants used the orthography properly and entered either a response identical to the prompt, or one with the second stop devoiced (e.g. responses to the prompt [badu] were overwhelmingly either badu or batu).
Screenshot of a testing trial.
Items from training were never repeated in testing, so while all testing items contained consonant combinations seen in training, the particular item had not been seen before (e.g. if [bagu], [biga] and [buga] appeared in training as stimuli with the consonant pair [b…g], [bega] might appear in testing). Additionally, training and testing items were selected randomly from the set of all stimuli for each participant, so neither the set of training items nor the set of testing items were the same across participants.
4.2 Predictions
This experiment tests the first distinction between the baseline and copying models, outlined in §3 above. The baseline model predicts that participants should learn the patterns in the identity and segmental conditions equally well, while the copying model predicts that the participants should learn the pattern in the identity condition better. Both models predict that both the identity and segmental condition patterns should be learnable, as both models assigned a higher score to unattested segment pairs than to attested segment pairs in the simulations.
4.3 Results and analysis
For the identity and segmental conditions, responses to each trial were coded for whether they alternated or not, and for whether the prompt triggered an alternating response in training or not. Table XII shows how responses were coded for each condition, using stimuli with the [a…u] vowel pattern as illustration. Alternating responses were coded as ‘1’ and non-alternating responses as ‘0’.
Examples of alternating and non-alternating responses for the identity and segmental patterns for each consonant combination, by prompt type.
Some responses were removed from the analysis because the response was not classifiable as ‘alternating’ or ‘non-alternating’. Responses were removed either because the participant gave no response (pressing the enter key in the testing phase moved on to the next trial, regardless of whether there was anything entered in the response box), or because the response differed from the prompt in place of articulation (e.g. prompt [badu], response baku). Responses were not excluded if one or both vowels did not match the prompt (e.g. bida instead of bide), or if vowels were spelled in English orthography instead of in the orthography used in the experiment (e.g. bidoo instead of bidu). 858 individual responses (11% of the data) were excluded (261 from the identity condition, 257 from the segmental condition and 340 from the control condition). Finally, responses to the fillers were also not analysed.
The comparison between the identity and segmental conditions is shown graphically in Fig. 3. For both conditions, participants gave more alternating responses to alternating prompts than to non-alternating prompts. The difference between alternating and non-alternating prompts is bigger in the identity condition than the segmental condition, however. In the identity condition, participants gave alternating responses to alternating prompts more often than in the segmental condition, and gave non-alternating responses to non-alternating prompts more often than in the segmental condition.
Proportion of alternating responses given to alternating and non-alternating prompts, by condition. Error bars indicate the standard error measure.
A Mixed Logit Model was fit using the lmer() function from the lme4 package (Bates & Maechler Reference Bates and Maechler2010) for the R software. The dependent variable was whether the response alternated or not. The predictors in the model were condition (identityvs. segmental) and prompt type (alternating or not), and the interaction between condition and prompt type. Random intercepts were included for participant and prompt, and a random slope for condition by prompt stimulus. Random slopes were not included for participant, since participants were nested within conditions; in contrast, each prompt stimulus appeared in both conditions. Significance of factors was assessed using model comparison. Removing the interaction factor resulted in a significant difference from the full model (p<0·001), showing that the full model, given in Table XIII, is a better fit to the data than a simpler model without the interaction.Footnote 11 There are significant main effects of condition and prompt type, as well as a significant interaction.
Results of a Mixed Logit Model testing for main effects of condition (baseline identity) and prompt type (baseline non-alternating) and an interaction between condition and prompt type on alternation rate in responses.

The main effect of condition results from the greater proportion of alternating responses in the segmental condition than in the identity condition (34% vs. 32%). The main effect of prompt type indicates that participants in both conditions were affected by training, giving more alternating responses to alternating prompts (51% in the identity condition and 43% in the segmental condition) than to non-alternating prompts (13% in the identity condition and 26% in the segmental condition). Finally, the interaction between condition and prompt type results from the larger difference between prompt types in the identity condition than in the segmental condition.
In the control condition, participants gave an alternating response at about the same rate regardless of prompt type: 34% for stimuli drawn from the set of non-alternating prompts in the identity condition, 35% for stimuli drawn from the set of non-alternating prompts in the segmental condition and 33% for stimuli drawn from the set of prompts that alternate in both conditions. Two Mixed Logit Models were fit to explicitly compare the control condition with the identity and segmental conditions. One model predicted rate of alternation in responses by condition, comparing the control condition with the alternating prompts in the identity and segmental conditions. The second model compared the control condition with the non-alternating prompts in the identity and segmental conditions. Two analyses are necessary, because prompts in the control condition cannot be coded as alternating or non-alternating, since this was randomised by subject and stimulus item; thus there is no consistent coding schema across the three conditions. For both models, random intercepts were included for participant and prompt, and a random slope for condition by prompt stimulus. The control condition was set as the baseline for the condition factor, and a significant difference was found for both the segmental and identity conditions, for both alternating (Table XIVa) and non-alternating (b) prompts.
Results of a Mixed Logit Model comparing rate of alternation in the control condition to rate of alternation to (a) alternating and (b) nonalternating prompts in the identity and segmental conditions.

In both the identity and segmental conditions, alternating responses to non-alternating prompts were lower than in the control condition, and alternating responses to alternating prompts were higher than in the control condition, showing that the results of the identity and segmental conditions are unambiguously due to training.
4.4 Discussion
The results of Experiment 1 show that participants learn both the identity and segmental pattern, but that they learn the identity pattern better. The better learning on the identity pattern suggests that the representational distinction between identical and non-identical segments is available to learners. While both the segmental and identity patterns can be learned as generalisations over individual pairs of segments, only the identity pattern is compatible with a broader generalisation.
The results of the experiment are consistent with the predictions of the copying model. The simulations in §3.3 showed that the copying model is able to learn general constraints on all non-identical segments, and that these constraints are more highly weighted than more specific constraints on individual segment pairs. The generality heuristic in the UCLA phonotactic learner prioritises more general constraints, and thus distinctions between attested and unattested (or frequent vs. infrequent) structures that fall under more general constraints are learned better.
The experiments in this paper do not explicitly test whether participants are learning generalisations that refer to whole segment identity, or to homorganicity. The identity pattern could also be described and learned as a dependency between consonants with the same place of articulation: the second stop is voiceless unless it is homorganic with the first stop. While future work should tease apart this confound, it does not interfere with the main argument in this paper. Both whole segment identity and homorganicity require explicit reference to matching, either with variables over all features (or at the root node) or over some particular features (or at the place node).
The results also show that participants are biased against giving an alternating response. Across all three training conditions, participants gave about one-third alternating responses, despite the training data consisting of 50% alternating responses. A similar effect was found in the artificial grammar learning experiments in Wilson (Reference Wilson2006) and Coetzee (Reference Coetzee2009b). Coetzee hypothesises that learners are biased against alternation, both in artificial grammar tasks and real language learning, and will only freely generalise an alternation with very strong evidence from learning data. While interesting, this bias against alternation does not bear on the main issue of the paper, which is the distinction between identical and non-identical segments, and will not be discussed further.
5 Experiment 2: generalising the identity effect to novel segment pairs
Experiment 2 tests whether a distinction between identical and non-identical segment pairs extends to novel identical and non-identical pairs. In Experiment 1, the prompts in the training and testing stimuli consisted of the same combinations of consonants. In Experiment 2, one pair of non-identical consonants and one pair of identical consonants are omitted from the training stimuli, which otherwise show the identity effect. The testing phase then compares how well participants learn the identical/non-identical distinction for stimuli with consonant combinations they saw in training, and whether they extend this distinction to new items.
5.1 Method
5.1.1 Participants
Participants were recruited via Mechanical Turk, and were paid $0·60 for completing the experiment, which took about ten minutes. Responses from 44 participants were excluded, 24 because they gave zero alternating responses and 20 because 50% or more of their responses were unusable. Once participants were removed, responses from 193 participants remained for analysis, 97 from the critical condition and 96 from the control condition.
5.1.2 Stimuli
The stimuli were the same as in Experiment 1. Participants were trained on an identity-effect pattern, as in the identity condition in Experiment 1, except that one identical pair of segments and one non-identical pair were not included in training. In testing, prompts either contained pairs of consonants attested in the training data (old) or novel consonant pairs (new). The pattern is schematised in Table XV, using stimuli with the [a…u] vowel pattern. As in Experiment 1, fillers were only included in testing; there were no fillers in training.
Sample of stimuli for Experiment 2.

In addition to the critical training condition schematised in Table XV, a control condition was also run. In the control condition, prompts were randomly paired with alternating or non-alternating responses, as in the control condition for Experiment 1. In the control condition for Experiment 2, prompts with [g…g] and [d…g] consonant pairs were also omitted from training, but included in testing. The rate of alternating responses in the control condition provides a baseline for comparing the rate of alternating responses on alternating and non-alternating new and old prompt types in the critical condition.
5.1.3 Equipment
The equipment was the same as for Experiment 1.
5.1.4 Procedure
The structure of the experiment was the same as in Experiment 1. In the critical condition, there were 24 training pairs showing the pattern in Table XIII above, 12 each drawn from the alternating and non-alternating sets. The 24 training pairs were repeated twice, in random order, for a total of 48 training trials. In testing, there were eight prompt stimuli each from the alternating–old, alternating–new, non-alternating–old and non-alternating–new categories, and six fillers, for a total of 38 testing trials.
In the control condition, participants were also trained on 50% alternating and 50% non-alternating pairs, drawn from the same set of training pairs in Table XIII, but showing no consistent pattern. The structure of the training phase of the control condition was the same as for Experiment 1. The testing phase of the control condition was the same as the critical training condition.
As in Experiment 1, stimulus items were randomly selected for each participant from the full set of items, and were not repeated from training to testing.
5.2 Predictions
The results of Experiment 1 show that participants learn the identity-effect pattern, and thus participants in Experiment 2 are predicted to give more alternating responses to old prompts with non-identical consonant pairs than to old prompts with identical consonant pairs. The key question for this experiment is whether the proportion of alternating responses differs between the new non-identical consonant pair and the new identical consonant pair. If participants learn a broad generalisation about identical and non-identical consonant pairs, then they should give fewer alternating responses to prompts with identical [g…g] than to those with non-identical [d…g].
This experiment is in parallel with the simulations in §3.3.2, testing how the baseline and copying models extend an identity-based pattern to novel segments. The baseline model predicts that the identity distinction should not generalise. Rather, participants should only make generalisations based on the behaviour of individual segments or segment pairs. Given the learning data in the critical condition, participants could notice that there are no responses with [g] in C2, i.e. the only prompts with [g] in C2 are [b…g] prompts, which are paired with an alternating [b…k] response. This observation would lead to high rates of alternating responses to both [g…g] and [d…g] prompts in testing. Participants could also notice the rates of alternation of prompts with initial [g] or [d] in training. Prompts with initial [g] are all alternating ([g…b] and [g…d]), and thus again the prediction is made that participants should give an alternating response to [g…g] prompts. One set of prompts with initial [d] is alternating in training ([d…b]) and one set is not ([d…d]), so the prediction would be that participants should give half alternating and half non-alternating responses to [d…g] prompts in testing. The copying model predicts that participants should learn not just the distribution of individual segments or segment combinations, but also generalisations based on identity. If the copying model is right, participants should be able to generalise the distinction between identical and non-identical segments in training, and give more alternating responses to prompts with non-identical [d…g] than to those with identical [g…g].
5.3 Results and analysis
For each condition, responses were coded for whether they alternated or not, for whether the prompt was ‘old’ (the consonant pair was present in training) or ‘new’ (the consonant pair was not present in training), and for whether the consonants were identical. Table XVI shows how responses were classified, using stimuli with the [a…u] vowel pattern to illustrate.
Examples of alternating and non-alternating responses for new and old stimuli, by consonant combination.

As in Experiment 1, some responses were excluded from analysis because they could not be classified according to the coding scheme for the reasons described above for Experiment 1. In total, 746 individual responses (12% of the data) were excluded (378 from the critical condition and 368 from the control condition). As in Experiment 1, responses to the fillers were not analysed.
The results are shown graphically in Fig. 4. For both old and new stimuli, the rate of alternation conforms to the pattern in training in the critical condition but not the control condition. Participants gave more alternating responses to stimuli with non-identical consonants than to those with identical consonants in the critical condition but not in the control condition. Moreover, participants show this pattern for stimuli with old consonant pairs they saw in training, and also extend the pattern to stimuli with new consonant pairs.
Proportion of alternating responses to old and new stimuli in the critical and control conditions, for stimuli with identical consonants (which alternated in critical training) and those with non-identical consonants (which did not alternate in critical training). Errors bars indicate the standard error measure.
A Mixed Logit Model was fit, predicting rate of alternation from three binary factors. The predictors compared the control and critical conditions (control vs. critical training), stimuli with consonant pairs that appeared in training and stimuli with pairs that did not (old vs. new) and stimuli with identical and non-identical consonants (ident vs. non-ident). All two-way interactions between these factors were included, as well as the three-way interaction. Random intercepts were included for participant and prompt stimulus. Additionally, random slopes for consonant pair and prompt type by participant and a random slope for training by prompt stimulus were also included. Neither the three-way interaction between factors nor the interaction between consonant pair and prompt type was significant (as assessed by model comparison). The final model is given in Table XVII.Footnote 12
Results of Mixed Logit Model testing for main effects of training (baseline critical condition) and consonant pair (baseline new) and an interaction between training and consonant pair on conforming responses.

The main effect of training is found because participants gave more alternating responses in the critical condition (34%) than in the control condition (28%). Participants also gave more alternating responses to prompts with non-identical consonants (38%) than identical consonants (25%), in conformance with the pattern in the critical condition. The main effect of old vs. new consonant pair reflects the greater proportion of alternating responses to stimuli with old consonant pairs (34%) than new consonant pairs (29%). The key result is the significant interaction between training and ident vs. non-ident, which results from the greater effect of prompt type (identical or non-identical consonants) on responses in the critical condition than in the control condition. Participants gave more alternating responses to stimuli with pairs of old and new non-identical consonants than to pairs of old and new identical consonants in the critical condition (46% for non-ident vs. 22% for ident), but showed no such effect in the control condition (28% for non-ident vs. 29% for ident). Finally, the significant interaction between training and old vs. new arises because participants in the critical condition gave alternating responses at similar rates to stimuli with both old and new consonant pairs (32% for old vs. 36% for new), while participants in the control condition gave alternating responses much more often to stimuli with old consonant pairs than to those with new consonant pairs (35% for old vs. 21% for new).
5.4 Discussion
Participants learn a pattern that distinguishes between identical and non-identical consonant pairs, and extend this pattern to novel segment pairs. The extension of the identity-effect pattern to new stimuli is only possible if participants have learned a broad generalisation about identical and non-identical pairs, as opposed to learning a narrow generalisation about each individual segment pair. These results support the hypothesis that a distinction between identical and non-identical segments is learned as such, with direct reference to identity, as predicted by the copying model.
In addition to extending the identity-based pattern to novel stimuli in the critical condition, a difference between old and new stimuli was also found for the control condition. The interaction between condition and old vs. new found that participants in the control condition gave far fewer alternating responses to stimuli with new consonant pairs than to those with old consonant pairs. This effect is likely a side-effect of the bias against alternation, as discussed for Experiment 1. While participants in the control conditions are exposed to 50% alternating and 50% non-alternating stimuli pairs in training, they only give alternating response around 33% of the time in testing. For stimuli with new consonant pairs, there is no evidence from training that those pairs should or could alternate, and so the bias against alternation appears even more strongly.
6 Conclusion
This paper has presented results from two artificial grammar learning experiments that provide support for the explicit representation of identity in phonological generalisations. The experiments show that a pattern based on the distinction between identical and non-identical consonant pairs is easier to learn than an arbitrary pattern, and that an identity-based pattern generalises to novel consonant combinations. Both of these results suggest that learners make a single generalisation over identical/non-identical segments, as opposed to tracking only the patterning of individual segmental or featural pairs.
The copying model is successful at modelling the experimental results and the typology of phonological patterns, in that it predicts both that the identity pattern should be learned better than an arbitrary pattern, and that it should extend to novel segment pairs. The success of the copying model rests on a particular representational assumption: in the input to the learner, identical segments have only a single feature matrix. In this way, the model is similar to autosegmental accounts of the identity effect (McCarthy Reference McCarthy1986, Reference McCarthy1988), which assume that the only representational possibility for identical segments (or features) is a single set of features linked to multiple prosodic positions. In the copying model, the unique representation of identical segments restricts the ability of constraints to apply to both identical and non-identical segment pairs, and in turn allows distinct constraints on identical and non-identical segments to be learned. Whether this particular assumption of the copying model is a realistic model of how identity-based patterns are learned is a substantial question for future research. The questions for a model is (i) whether the distinction between identical segments is in the representation of the learning data or in the generalisations that are learned over the data and (ii) whether identity in either representations or constraints is a bias that learners come with, or is learned from the data.
While the copying model assumes that the identity relation is in the input data, Berent et al. (Reference Berent, Wilson, Marcus and Bemis2012) pursue the idea that it is the generalisations over the learning data that reference identity. They propose an expansion to the constraint-induction algorithm in the UCLA phonotactic learner to include constraints that refer to variables. In this model, there is nothing special about the representation of identical segments in the input data – they are represented as sequences of two feature matrices, just like any other pair of segments. Constraints, however, may penalise either simple sequences of feature matrices, e.g. *[+cg][+cg] penalises a sequence of [+constricted glottis] segments, regardless of other features of the segments, or variable-based relationships between feature matrices, e.g. *[+cg]i[+cg]i penalises a sequence of [+constricted glottis] segments only if they are identical. To learn an identity-effect pattern, this type of model would need to consider constraints with both variable-matching relationships and variable-mismatching relationships, i.e. the constraint necessary for the identity effect is *[+cg]i[+cg]j. It remains to be tested whether a model that induces variable-based constraints can make the same predictions as the copying model, but some speculations can be offered. It seems likely that such a model would, like the copying model, predict that an identity-based pattern is learned better than an arbitrary pattern, since the identity pattern can be stated with a single, general constraint *[+cg]i[+cg]j. What is less clear is whether a model with variable-based constraints can generalise an identity-effect pattern to novel identical segments. In the simulations in §3, it was found that the baseline model predicted an unattested identical ejective pair ([p'…p']) to be even worse than the unattested non-identical ejective pairs. This prediction was made because the unattested ejective pair could be penalised by constraints that ruled out non-identical pairs; the relevant high-weighted constraint was *[+cg, lab][+cg]. This constraint would also be available in a model with variable-based constraints, and it may thus lead such a model to predict that the identity pattern would not extend to novel segments. It is left to future work to verify and explore the predictions of this type of model.
Whether the identity relation in either representations or constraints is induced from the data or part of a prior bias has implications for languages that don't exhibit identity-based patterns. In addition to languages with the identity effect, many languages have co-occurrence restrictions that apply equally to identical and non-identical segments, like Quechua, which disallows all combinations of identical or non-identical ejectives in a root. In the copying model, this restriction would necessarily be learned as two separate generalisations, one, *[+cg][ident], over identical pairs of ejectives and the other, *[+cg][+cg], over non-identical pairs. If there is no bias towards identity, and identity is only included in constraints or representations when explicitly supported by the data, then a language like Quechua could be learned with just a single constraint on all pairs of ejectives, *[+cg][+cg]. Ongoing experimental work by the author is investigating whether speakers of languages like Quechua show a latent distinction between identical and non-identical segments. If true, this would be a case of a cross-linguistic tendency showing up at the level of an individual speaker, as has been found in acceptability-rating tasks for unattested onsets in English (Scholes Reference Scholes1966, Treiman et al. Reference Treiman, Kessler, Knewasser, Tincoff, Bowman, Broe and Pierrehumbert2000, Albright Reference Albright2009), as well as in a range of production and perception tasks (Broselow & Finer Reference Broselow and Finer1991, Broselow et al. Reference Broselow, Chen and Wang1998, Moreton Reference Moreton2002, Hansen Reference Hansen2004, Davidson Reference Davidson2006, Berent et al. Reference Berent, Steriade, Lennertz and Vaknin2007).
A bias in favour of identity may be analytic, in Moreton's (Reference Moreton2008) terms, in that the formal structure of an identity-based generalisation is preferred. The preference for more general constraints that favour the identity pattern over the arbitrary pattern, discussed in §3, is a kind of analytic bias, but it may also be that learners have a bias in favour of identity-based generalisations. This would predict that learners prefer generalisations that reference identity or other simple algebraic relations over otherwise equivalent generalisations that are stated over simple featural strings. Support for a bias in favour of identity is presented in Endress et al. (Reference Endress, Dehaene-Lambertz and Mehler2007), who find that a tonal pattern based on identity is learned better than a systematic tonal pattern that does not contain an identity relation. Bias may also be substantive. Previous experiments in artificial grammar paradigms have found that phonetically grounded patterns are learned better than phonetically unnatural patterns (Wilson Reference Wilson2006, Carpenter Reference Carpenter2010, Finley Reference Finley2011), and it may be that a preference for identical segments is phonetically grounded, though this remains to be shown experimentally.
This paper has outlined two specific properties that a model of learning must have: it must allow an identity-based generalisation to be learned more strongly than an arbitrary generalisation, and it must allow an identity-based pattern to generalise to novel items. While it is clear that identity can be represented explicitly by learners, and that languages can exploit the identical/non-identical distinction in grammatical patterns, it is not yet clear precisely how identity is represented in the grammar, or how the learning of identity-based patterns should be modelled.












