Regardless of theoretical assumptions, at some point morphemes must be linked to phonological forms. But the question of how distinct these lexically stored phonological forms can be from the forms that actually surface has been of interest to phonologists since Kenstowicz & Kisseberth (Reference Kenstowicz and Kisseberth1977).
A strong hypothesis would claim that for each morpheme there is a single surface form that serves as the underlying representation (UR). If this were true, the surface form of the morpheme in all contexts would be entirely predictable from one surface form. However, this is much too strong; some morphemes have alternants that are not predictable in this way. Consider [ˈfotəˌgræf] photograph ~ [fəˈtɑgrəˌfi] photography, among other forms in English; the vowel-place features when stressed are totally unpredictable from the reduced unstressed form (Schane Reference Schane, Bruck, Fox and La Galy1974). Similar patterns are found in Palauan (Flora Reference Flora1974, Schane Reference Schane, Bruck, Fox and La Galy1974) and elsewhere. However, both of these patterns can be modelled as long as lexically stored forms are allowed to contain material from multiple surface forms, i.e. /fotɑgræf/. This extension from the strong hypothesis has been widely accepted, leading some to draw a line between concrete and abstract URs, as in (1) (definitions adapted from Kenstowicz & Kisseberth Reference Kenstowicz and Kisseberth1979, Baković Reference Baković2009 and Bowers Reference Bowers2015).
-
(1)

Some have argued (e.g. Kiparsky Reference Kiparsky and Fujimura1968, Albright Reference Albright2002, Allen & Becker Reference Allen and Becker2015) that languages should not make use of abstract URs, citing the difficulties they present for the learner. Each morpheme has a limited number of possible concrete URs, correlated to the number and length of surface alternants. If URs do not need to be concrete, the search space of possible URs grows substantially. However, this space is searchable if the set of URs is structured: given output-drivenness, Tesar (Reference Tesar2014) shows that those URs with minimal faithfulness violations can be examined first. In some cases, like the Klamath case explored in this paper, the number of faithfulness violations is not enough to distinguish between an unbounded number of potential URs, which each differ from the surface form by an equal number of violations.
The choice of UR here can be based on feature economy, first introduced in de Groot (Reference Groot1931: 121): ‘there is a tendency to employ certain accompanying phoneme properties more than once’ [translation from Clements Reference Clements2003]. Under this theory, the best UR is the one that makes crucial use of a feature that is contrastive more often in the grammar of the language than other URs. If a feature is contrastive except where the abstract alternation is seen, that same feature can be used to contrast alternating forms with non-alternating ones.
Feature-economic notions have a long pedigree in phonological analysis (see especially Hockett Reference Hockett1955 and Martinet Reference Martinet and Malmberg1968, and Clements Reference Clements2003: §1.5 for a historical overview). However, since optimality-theoretic and other related constraint-based grammars tend to have no restrictions on the input and no morpheme-structure constraints, there is no explicit place for feature economy in the grammar. Yet grammar is not the only way to account for language universals and tendencies – recent work has begun to show the power of learnability to restrict typology, through emergent properties (e.g. Alderete Reference Alderete2008, Heinz Reference Heinz2010, Pater & Staubs Reference Pater and Staubs2013, Stanton Reference Stanton2016).Footnote 1
This paper claims that the preference for employing features used elsewhere in the grammar for abstract URs emerges naturally out of a learner like that typically used in the MaxEnt learning literature (e.g. Goldwater & Johnson Reference Goldwater, Johnson, Spenader, Eriksson and Dahl2003, Jäger & Rosenbach Reference Jäger and Rosenbach2006, Wilson Reference Wilson2006, Jäger Reference Jäger, Zaenen, Simpson, King, Grimshaw, Maling and Manning2007, Hayes & Wilson Reference Hayes and Wilson2008). Without any explicit mechanisms built in to drive learning of abstract URs, this emergent bias prefers URs that minimise gaps in the lexical distribution of segments without any direct pressure to do so. While the question of where the line should be drawn between a single UR and allomorphy is largely undecided, this paper shows that abstract URs can be learnable, allowing for a larger class of alternations to be explained with single URs.
§1 introduces the case study of abstract alternations in Klamath explored in this paper, and shows analytically that a concrete UR will fail, and thus that an abstract UR may be useful. The MaxLex learning model is presented in §2, and in §3 I show the results of phonotactic learning and the weighting conditions which are necessary regardless of the selected UR. In §4 the simulation results show that a MaxLex learner learns abstract URs, in particular the most restrictedly abstract UR. §5 offers explanations as to why the learner prefers certain types of abstract URs to others. Finally, in §6, I conclude, and consider further questions.
1 Abstractness in Klamath
In this section, I will sketch out data from a vowel alternation in Klamath (Penutian; Southern Oregon) that motivates the learning of some abstract URs. All Klamath data comes from Barker (Reference Barker1963, Reference Barker1964) (see O'Hara Reference O'Hara2015 for more details of this analysis). Klamath has four surface vowels, [i e a u], with contrastive length for each vowel (Barker Reference Barker1963, Reference Barker1964).
To show the need for abstract URs in Klamath, four types of verb stems will be analysed, with three types of suffixes: /-a/ (indicative), /-tkʰ/ ‘having been verb-ed’ and /-tʰa/ (a combination of the indicative and a /-tʰ-/ locative affix meaning ‘on’).Footnote 2
-
(2)

Unlike the other types of stems presented in (2), which can be concretely represented as /wen/, /sl?eq?/ and /stupwi/ respectively, the [i]~[Ø] alternation exemplified in (3) cannot be modelled with concrete URs.
-
(3)

Two potential concrete URs are available for a morpheme like [ʔeːwa] ~ [ʔeːwitkʰ] in (3): /ʔeːw/, with [i]-epenthesis, and /ʔeːwi/, with /i/-deletion. However, neither of these analyses is possible, given the rest of the language's phonology. In particular, the [i]~[Ø] alternation is restricted to non-initial syllables of verbs, whereas the [a]-epenthesis process in (4) appears across the language (Barker Reference Barker1964). There seems to be no phonotactic reason for some stems to show [i]-epenthesis and others [a]-epenthesis, as the phonological environments for both are very similar. Therefore, if /ʔeːw/ were the UR, /ʔeːw-tkʰ/ would surface as [ʔeːwatkʰ] rather than [ʔeːwitkʰ].
-
(4)

Additional evidence against an [i]-epenthesis account comes from a glottalisation alternation present in many of these stems. In Klamath, prevocalic glottal stops coalesce with preceding stops to create glottalised consonants in many contexts, whereas coda glottal stops delete. In many verbs showing the [i]~[Ø] alternation, glottalisation appears on the consonant only when [i] does not. If [i] was epenthesised here, it could appear after the glottal stop and maximise faithfulness to the underlying form, giving [ntew?itkʰ] rather than [ntewitkʰ]. Forms with [a]-epenthesis (like [tsaːk?atkʰ] in (4)) show that when [a] epenthesises, glottalisation is not lost. Only if the vowel exists underlyingly (/nteweʔ/) can this pattern be modelled, as in (5).
-
(5)

Evidence against the /ʔeːwi/ UR comes from the many verb stems that show non-alternating [i] within this same paradigm, as in (6). When /i/-final stems appear with the /-a/ suffix, deletion of the /a/ occurs to resolve hiatus. If /ʔeːwi/ were the UR, /ʔeːwi-a/ would incorrectly surface as [ʔeːwi]. Therefore, neither of these concrete URs can model the alternation.
-
(6)

The [i]~[Ø] alternation cannot be represented concretely, so a learner might attempt to represent it abstractly. Importantly for Klamath, [e] appears in all positions (nouns, initial syllables, etc.), except where this alternation is found. Since /e/ never appears in this context, but appears elsewhere, it is a particularly good potential UR, whereas a segment like /ɪ/, which never surfaces in Klamath, seems less good. This is because /e/ is more restrictedly abstract than /ɪ/, as defined in (7). Since [ɪ] never surfaces, its distribution is the empty set, and so any segment that surfaces anywhere appears in a superset of its positions. Thus [e] has a wider distribution than [ɪ]. Crucially here, a contrast between /e/ and /i/ (or of the feature [±high]) is used in other positions in Klamath, while a contrast between /ɪ/ and /i/ (involving the feature [±ATR]) is used nowhere else.
-
(7)

Importantly, /ɪ/ and [±ATR] are stand-ins for any means of marking the UR as exceptional that makes use of a feature that is never contrastive on the surface. If /e/ is preferred to /ɪ/ by the learner, it would also be preferred to /ĩ/, /y/ or the diacritic representation /i1/. An indexed constraint account (Itô & Mester Reference Itô, Mester and Tsujimura1999, Pater Reference Pater2000, Coetzee & Pater Reference Coetzee, Pater, Goldsmith, Riggle and Yu2011, Gouskova & Becker Reference Gouskova and Becker2013, among others), for example, would require marking relevant morphemes with some exceptional feature used nowhere else in the grammar.
In the following sections we will see that restrictedly abstract URs emerge as a naturally preferred for the learner in cases like Klamath. This emergent property shows the learner replicating the analyst's intuitions.
2 MaxLex
The MaxEnt learner of grammars and lexicons (MaxLex) discussed in this paper makes use of several theoretical assumptions common in previous learners. MaxLex uses a MaxEnt Harmonic Grammar as its model of constraint interaction. Following previous literature (Hayes Reference Hayes, Kager, Pater and Zonneveld2004, Jarosz Reference Jarosz2006, Jesney & Tessier Reference Jesney and Tessier2011, Tesar Reference Tesar2014), the learner has two stages, first a phonotactic stage, where the learner is unaware of morphological components of words, and simply tries to find a mapping from surface forms to themselves, and then a morphologically aware stage, where the learner attempts to learn alternations and (in our case) the underlying representations of morphemes. MaxLex differs from many other MaxEnt learners of underlying forms, which use UR constraints (Eisenstat Reference Eisenstat2009, Pater et al. Reference Pater, Staubs, Jesney and Smith2012, Staubs & Pater Reference Staubs, Pater, McCarthy and Pater2016), in that it learns a probability distribution across a set of possible URs, just as Jarosz's (Reference Jarosz2006) Maximum Likelihood learner of lexicons and grammars does in an OT framework.
The learning algorithm implements a batch learner that minimises an objective function. An objective function is a function that organises the search space of possible grammars by quantifying the relative success of a grammar at modelling the data. This objective function is built of two parts. First, the negative log likelihood of the learning data surfacing as observed is established. This factor quantifies how well the grammar models the learning data; a grammar that has a 100% probability of producing the learning data would be assigned a zero for this factor, and the lower the probability of producing the data, the higher this factor becomes. Second, a L2 Gaussian prior prevents the constraint weights growing indefinitely, as well as modelling an initial bias of higher weights for markedness constraints than faithfulness constraints (in both OT (Smolensky Reference Smolensky1996) and HG (Jesney & Tessier Reference Jesney and Tessier2011)). Here the L2 prior is simply a factor of the distance of any constraint from its starting point, resulting in the learner preferring the grammar where constraint weights are closer to their initial weights, given two grammars that model the learning data equally well. This factor serves to replicate the ease of learning of the grammar; a grammar that requires more change in constraint weights would require more data for an online learner (like a child).
The objective function in (8), used during the first stage of the learner, does not differ from the typical objective function used in the MaxEnt literature. That is because at this point the learner is not morphologically aware, so no UR probabilities need to be included.Footnote 3
-
(8)

The objective function required once morphological awareness has kicked in and started the second stage, which is shown in (9), defines the negative log likelihood of observed data in a different way. The learner now tries to find the value of the constraint weights (w) and the probability distribution of URs (π) that maximise the likelihood of the observed data. The critical changes here are that, instead of just looking at the surface forms of the data, oi, the learner is now aware of a set of n morphemes which together build the word; {μi1 … μin}. The Harmony and Candidate functions are now evaluated over concatenated strings of possible URs for morphemes, (ui1 … uin). Since at this stage the learner must find the likelihood of the data given any possible UR, it sums up the likelihood of the output form given some UR (uij) for a morpheme (μij), and multiplies this by the probability that uij is the underlying form for μij (p(uij|μij)). For this Klamath data, each word is only composed of two morphemes, so only μi1 and μi2 are important for the simulations in this paper. The objective function for the morphologically aware stage is thus primarily the same as (8), except the likelihood of each input–output mapping is multiplied by the probability of each UR used in the input.
-
(9)

I ran a series of simulations (available in the online supplementary materials) on different training data, in order to test the learner's ability to acquire the Klamath pattern. Recall from (2) that there are four types of stems, which alternate differently with three types of suffixes. I collected a set of 50 verb stems that appear with both /-a/ and /-tkʰ/. These are the most common verb suffixes in Klamath; so a large overlap of stems was possible. Exposed to data with just these two suffixes, the learner categorically preferred the restrictedly abstract UR /ʔeːwe/ to the concrete and less restrictedly abstract URs for abstract alternating stems like [ʔeːwa] ~ [ʔeːwitkʰ], learning the surface data with a probability of 0.89 overall, and greater than 0.999 for any given form.
In order to handle hiatus resolution with the indicative /-a/ suffix, a set of stem-faithfulness constraints (Beckman Reference Beckman1998) was necessary. For the purpose of understanding the fundamental emergent principle that leads to this preference for more restrictedly abstract URs, these additional constraints complicate the picture, not mechanically or mathematically, but explanatorily. Since the stem-faithfulness constraints share some of the burden of the general faithfulness constraints, their weights would need to be considered in all tableaux and calculations below. Instead, for the rest of the paper, I train the learner on the basis of forms with the /-tkʰ/ suffix and suffixes that act like /-tʰa/ phonotactically, as in (2), allowing the simulation to be run without constraints addressing hiatus resolution.
Unfortunately, no single suffix that behaves like /-tʰa/ has a large enough distribution for a large set of verb stems to be selected with all three suffixes or even just with /-tkʰ/; though most verb stems pattern with one suffix of this type. For the purposes of the simulation, all of these suffixes would behave uniformly for all relevant constraints, so I collapsed all of these suffixes into one /-Ca/ suffix.Footnote 4 In the following sections, I present the results of this simulation in more detail.
3 Stage 1: phonotactic learning of Klamath
At stage 1, the learner is presented with Klamath data, as illustrated in (10). One set of forms, (10a), shows the troublesome alternation that is the focus of this inquiry. The other two are necessary to show the learner that the concrete URs cannot serve as the UR for the alternation; (10b) shows this for /i/-final stems, and (10c) for consonant-final stems.
-
(10)

The Candidate function takes the input, and returns all permutations of the output with any violations of the faithfulness constraints involved in the simulation. The only restriction is that epenthesis is limited to occurring between consonants at morpheme boundaries, so as to prevent infinite epenthesis and allow us to get by with just one cluster constraint. This restricts Gen to consider only candidates that differ with respect to the constraints currently being considered. The simulation then evaluates the harmony of each input–output candidate by automatically incurring violations of the constraints in question, and multiplies the violations by the weight of the constraint.
The simulations uses Sequential Least Squares Programming (Kraft Reference Kraft1988), an optimisation algorithm implemented in SciPy, in order to find the constraint weights (and at stage 2 the lexical probabilities) that lead to the minimal objective function.
The constraints used in the simulations are shown in Table I, with the initial weights of each constraint all set uniformly at 50, as well as the weights output by the learner after convergence at this stage. Markedness or faithfulness is also indicated, in order to show the bias of each constraint: 100 for markedness constraints, and 0 for faithfulness constraints.
Constraint weights learned by phonotactic grammar.
Most constraints act as expected; a few are worth drawing attention to. For the purposes of this paper, positions in regard to positional faithfulness constraints are defined on the input. In order to model positional asymmetries in deletion patterns we must include Max(V)σ1. The constraint Phonotac is a cover constraint, used to represent overall Klamath phonotactics; it assigns a violation to word-final clusters of [Ctkʰ] (unless C is [n]).
3.1 Necessary weightings in HG for Klamath
There are two types of weighting conditions involved in modelling the [i]~[Ø] alternation: those that describe the phonotactics and therefore must be true regardless of the choice of UR, and those that describe the function between inputs and outputs, allowing some UR to surface with the alternation. The weightings learned on the first non-morphologically aware level represent most of the non-UR specific weightings.
The relevant properties that hold for the phonotactics of Klamath are given in (11).
-
(11)

First, for [e] to not surface in non-initial syllables, at least one of Ident[high] or Max(V) must be weighted below *Mid, in order to drive some repair of non-initial [e] vowels. In fact, using the weights learned at the phonotactic stage (as in Table I), it is true for both constraints, as shown in (12). Since [nu.puːsi.Ca] and [nu.puːs.Ca] are so close in weighting, in MaxEnt they each have around half the output probability. Crucially, the weight of [nu.pu.se.Ca], with [e] appearing unlicensed in a non-privileged position, approaches zero, so this candidate almost never surfaces, and is marked with ì.
-
(12)

[e] surfaces faithfully in initial syllables. Since [e] is not raised in initial syllables, the sum of the weights of Ident[high] and Ident[high]σ1 must be more than the weight of *Mid. To prevent it from deleting, Max(V) and Max(V)σ1 must collectively outweigh *Mid. Both of these weighting conditions are shown to be learned in (13).
-
(13)

[ɪ] never surfaces anywhere, even in privileged positions, because the faithfulness constraints that would prevent it from becoming [+ATR], i.e. Ident[ATR] and its positional counterpart, are weighted at 0, whereas the markedness constraint is weighted at 100, as in (14).
-
(14)

Finally, note that Phonotac must outweigh Dep(V), as in (15), to ensure that epenthesis is used to break up [Ctk] clusters.
-
(15)

The weightings found by the learner model the phonotactics of Klamath effectively. The weighting conditions explored in this section, and summarised in (16), are necessary for any grammar that has the phonotactics of Klamath, regardless of underlying forms.
-
(16)

4 Stage 2: learning underlying representations
In the next stage, the learner becomes morphologically aware, and tries to learn a probability distribution across underlying forms. There are three types of URs that are relevant for our simulations: the concrete URs /ʔeːw/ and /ʔeːwi/, the analytically preferred restrictedly abstract UR /ʔeːwe/ and the never surfacing very abstract UR /ʔeːwɪ/. Simulations were run with the two sets of URs in (17).Footnote 5
-
(17)

4.1 Concrete URs
If the set of possible URs is restricted to those concrete forms that surface somewhere, the learner fails to settle on any UR for alternating stems. Instead, as shown in Table II, it assigns equal probability to both concrete URs.
Constraint weights learned at the second stage, with only concrete URs.
The tableaux in (18) and (19) show the grammar with the constraint weightings and UR probabilities learned in Table II. The selected URs are shown in the leftmost column, together with the probability of that input being chosen. Then the harmony for each candidate is calculated for each input. The probability shown is that of each input–output candidate being chosen globally. The probability shown here is the product of the probability of the UR (p(UR)) and the probability of the output given that UR (p(output|UR)).
-
(18)

(18a.i), [ʔeːwiCa], is near categorically chosen as the output, given /ʔeːwi-Ca/ as the input, as its harmony score is 45.63 better than its competitor [ʔeːwCa], but the probability of the grammar selecting /ʔeːwi-Ca/ → [ʔeːwiCa] is only 0.5, because the UR probability is 0.5. If /ʔeːw-Ca/ is chosen as the input, then (18b.i), [ʔeːwCa], has the greatest probability. Therefore, the choice of surface form is completely dependent on the choice of UR, with both [ʔewCa] and [ʔeːwiCa] receiving near 0.5 probability. This is an incorrect result, as the learner has never seen [ʔeːwiCa], only [ʔeːwCa].
-
(19)

A similar result is seen in (19). The grammar outputs (19b.ii), /ʔeːw-tkʰ/ → [ʔeːwatkʰ], 50% of the time, even though that form is never seen. The correct surface form, (19a.i), is chosen only half the time. Note here that the two tableaux are contradictory; in order to select (a.i), [ʔeːwitkʰ], more probability must be assigned to /ʔeːwi/, but that UR selects the incorrect output form, [ʔeːwiCa], in (18).
If the learner fails to converge on a grammar that accurately models the data, as here, it should be able to open up its search space to allow abstract URs.
4.2 Full set of URs
After opening the search space to allow abstract URs, the MaxLex learner is able to model the surface data. It settles on the forms in which /e/ has a probability close to 1, with the constraint weights shown in Table III.
Constraint weights learned at the second stage, with all URs.
As the learner has near categorically learned an abstract UR, it is able to model the data with similar categoricity. The simulation above obtained over 0.9 probability for all surface forms.
The critical change in constraint weighting learned during this stage is the difference between Ident[high] and Max(V). As shown above, the weighting learned by the phonotactic grammar has non-initial /e/’s undecided between deleting or raising, with a near 0.5 probability for each option (when Phonotac doesn't interfere). Now Ident[high] outweighs Max(V) by a margin of 5.20. Thus, /e/ deletes over 98% of the time when the phonotactics allow, as in (20).
-
(20)

However, it raises to [i] over 99% of the time when deletion is phonotactically illicit, as in (21).Footnote 6
-
(21)

Note that these tableaux only show the results for the two most probable URs; since most of the probability is assigned to /ʔeːwe/, the probability of any of the other URs being chosen is near-negligible.
These results confirm that the restrictedly abstract UR is preferred to the otherwise abstract URs, and that abstract URs are learnable by this model. An alternative would be that the learner settles on /ɪ/ as the UR, but as long as /e/ is an option, the learner prefers it.
5 Discussion
The simulation data shows that restrictedly abstract URs are preferred to never surfacing URs. Several factors in the learner lead to this result. To understand those factors, we must understand the distinct constraint weighting conditions that cause each type of UR to model the [i]~[Ø] alternation. In this section the properties underlying the results will first be explored, and their further implications will then be discussed.
5.1 Why are restrictedly abstract URs preferred?
Since all of the abstract segments considered delete when this is phonotactically licit, Max(V) must be weighted below whatever markedness constraint militates against the abstract segment, as shown in (22a). In order to prevent the segment from raising or strengthening to [i], Ident[high] or Ident[ATR] must outweigh Max(V). Finally as shown in (20) and (21), if the Ident constraint is also weighted below the markedness constraint in (22b), and is outweighed by Max(V) and Phonotac together, as in (22c), [i] will be found when the phonotactics prevent deletion, rather than the faithful [e] or [ɪ].
-
(22)

The obvious difference between /e/ and /ɪ/ is that a high weighting of Ident[high] is required to model the basic phonotactics of the language in (16b) above (Ident[high] and Ident[high]σ1 together outweigh *Mid), whereas a high weighting of Ident[ATR] is not. However, it is not obvious that the weighting condition in (16b) should have any effect on the weight of the general faithfulness constraint – the grammar could have the same predictions just by assigning a lot of weight to the specific faithfulness constraint, and none to the general one. However, two forces act to prevent the specific faithfulness constraint from receiving all the weight. One, the optimisation function, looks at the gradient of the objective function for each possible set of constraint weights; the gradient of the likelihood function for some constraint is equal to the observed violations of that constraint minus the expected violations. Since, for any violation of the specific constraint there is also a violation of the general constraint, if there are more observed violations of the specific constraint than expected violations (or vice versa) there must also be at least as many more observed violations of the general constraint for that same data. This makes it very difficult for the learner to raise the weight of the specific constraint while lowering the weight of the general constraint.Footnote 7
Secondly, the L2 Gaussian prior has a preference for spreading the weight among constraints (and preferring a general constraint used multiple times). Recall that this prior is used to prefer grammars where the constraint weights have moved least from their initial weights (high for markedness, zero for faithfulness). Since the prior for faithfulness constraints is proportional to the sum of the squares of the constraint weights when ci = 0, as in (8), in order to minimise the prior, the learner tries to share the weight between the constraints while also obtaining a weighting condition like that in (16b). Imagine that the sum of the constraints had to reach 80 in order to categorically show [e] surfacing in initial syllables: if all the weight is assigned to one of the constraints, the prior will be proportional to 802 = 6400. However, if the weight is shared between the constraints, the prior will be proportional to 402 + 402 = 3200. In the natural language data from Klamath, this effect is increased, since in order to correctly capture the phonotactic generalisations about [e], three different weighting conditions of this sort must be learned, the one in (16b) and the two in (23).
-
(23)

If each of these sums must reach a value of 80, the weights that minimise the prior are 60 for the general constraint, Ident[high], and 20 for each of the specific constraints. This property is generalisable, given a typologically predicted positional privilege pattern – disjunctive licensing as in Klamath, conjunctive licensing where a segment appears only as long in the initial syllable of nouns, or any combination of the two – the prior will prefer to assign more weight to the general constraint if the segment surfaces faithfully in more positions.
The important result is that the learner selects the UR that is more restrictedly abstract. /ʔeːwe/ is more restrictedly abstract than /ʔeːwɪ/ in Klamath, because while both have segments (/e/ and /ɪ/ respectively) that do not appear in any surface exponent of the morpheme, /e/ is able to surface in more positions than /ɪ/. Thus the alternation can fill a gap in the lexical distribution of /e/, whereas it would be the only motivation for /ɪ/ appearing in URs.
The prior allows the learner to select the grammar and lexicon that prefer more restrictedly abstract forms. The grammar with /ʔeːwe/ and the one with /ʔeːwɪ/ as the UR for [ʔeːwCa] ~ [ʔeːwitkʰ] perform equally well with respect to the likelihood of the output data. Since both grammars can be described in HG (O'Hara Reference O'Hara2015), the probability of the output data given the grammar and lexicon become near categorical regardless of which UR is chosen, and therefore both negative log likelihoods approach zero. Thus the only difference between these two grammar–lexicon pairs is the value which the prior assigns: basically the sum of the weights of the faithfulness constraints squared. In both grammars, since [e] surfaces everywhere but in non-initial syllables, the weighting condition in (16b) must be respected. Ident[high] must therefore have some non-zero positive value in both grammars.
The learner must check the value of the prior for both the grammar that uses /e/ and the one that uses /ɪ/. The phonotactic learner in Table I assigns a weight of 40.13 to Ident[high], to account for the distribution of [e] in the training data. On the other hand, since Ident[ATR] is never respected in the surface data, the constraint can be set to zero. In order to make a particular /e/ or /ɪ/ repair to [i] in contexts where it cannot delete, the respective faithfulness constraint must outweigh Max(V), as shown in (24) (as seen in the simulation results above in (20)).
-
(24)

Assume without loss of generality that Max(V) is constant at 45.69 in both grammars – it must have a relatively high weight, in order to prevent privileged [e] from deleting (as well as to prevent any other vowels from deleting in a larger constraint set). Now we can find the constraint weights that minimise the prior while also satisfying both the (simplified) universal weighting conditions in (25), necessary to show the proper surface distributions of [e] and [ɪ], and one of the weighting conditions in (24), to allow an abstract UR to serve for the alternation. In order to find that the UR (/e/ or /ɪ/) deletes categorically, the relevant Ident constraint will be assumed to be at least 50.
-
(25)

The grammar necessary for /e/ to serve as the UR must weight Ident[high] at 50.00, and can keep Ident[ATR] at 0. For these three constraints, the prior is proportional to 02 + 45.692 + 50.002 = 4587.58. On the other hand, if /ɪ/ were to serve as the UR, Ident[ATR] must reach 50.00, while the lowest Ident[high] can be is 45.31. Thus the prior would be proportional to 45.312 + 40.112 + 45.692 = 5749.38. Since the minimum weight of Ident[high] is greater than that of Ident[ATR], the global minimum must put all of its weight into /ʔeːwe/. This example can be fully generalised to any set of weighting conditions where Ident[high] must be higher than Ident[ATR] to satisfy phonotactics, including the weights learned in Table I.
5.2 Further implications
Further generalising these results shows that learners tend towards other analytically pleasing results. When given the choice of a variety of abstract underlying representations, a learner will choose to make use of the feature used contrastively in more positions (i.e. with a higher-weighted faithfulness constraint associated with it).
Importantly, this is not a categorical contrast between restrictedly abstract and never surfacing URs; rather, it allows for ordering of URs in terms of how restrictedly abstract they are. If we have a language where [e] appears in all syllables of nouns and initial syllables of words of all categories, and [ɪ] only appears in initial syllables of nouns, /e/ would be a more restrictedly abstract UR for an [i]~[Ø] alternation in non-initial syllables of verbs than /ɪ/, causing it to be learned as the UR for this alternation.
By picking the UR that is most restrictedly abstract, the learner fills the gap in the lexical distribution that it can best fill. This prediction is analytically preferable, but cannot be easily enforced through any grammatical means in a constraint-based grammar with richness of the base. However, this shows that the choice of analytically satisfying URs is an emergent property of learning, driven by mechanisms already inherent in the learner.
However, most faithfulness constraints affect more than one segment in a language. Since the choice of abstract UR is based on the relative weight of each relevant faithfulness constraint, this effect can be seen not just with segments, but also with features. For example, imagine a language with an inventory like Klamath's [i e a u] with no surface restrictions, and a [u]~[Ø] alternation which appears in all positions. Though /o/ never surfaces, it would still be the learner's likely choice of abstract UR for the alternation over something like /ʊ/, simply because Ident[high] needs to have a relatively high weight in order to protect /e/ from raising to [i]. Thus another emergent bias is found that replicates an analytical preference: learners prefer to minimise the number of contrastive features in their language when learning their lexicon, resulting in a more symmetric inventory of underlying segments than predicted by chance.
6 Conclusion
This paper has argued that the learnability argument against abstract URs is not sufficient to rule them out as possible URs. The same properties that an analyst might look for when picking an abstract UR for an alternation – feature economy, symmetry, minimising lexical gaps – are in fact emergent biases in a MaxEnt learning framework. If a more restrictedly abstract UR is available, the learner will choose it. Thus the set of possible URs for a morpheme can include the surface exponents themselves, amalgams of the surface exponents (concrete URs) and abstract URs.
But what happens when a learner has no preferred abstract UR? Many Slavic languages show exceptional ‘yer’ vowels that delete when phonotactically possible (Jarosz Reference Jarosz2005, Gouskova & Becker Reference Gouskova and Becker2013). However, unlike Klamath, there does not exist a vowel that appears on the surface in the language that also has a distributional gap in the position where the alternation occurs. If there are no distributional reasons to pick one UR over the others – in Slavic languages, only never surfacing URs are available (of which there will usually be many) – the learner should have no reason to prefer /ɪ/ to /ĩ/ or anything else. I suggest that other last-resort strategies belong here. If the learner is having this difficulty, it could learn that multiple underlying forms exist for the stem (Pater et al. Reference Pater, Staubs, Jesney and Smith2012), or it could clone constraints in order to lexically index an exception (Pater Reference Pater, Brugos, Clark-Cotton and Ha2005). This is not to make any claims about how exceptionality is handled, but to show that the data in Klamath is firmly different from data involving true lexical exceptionality.
If a goal of phonological learning is to have a single underlying form for each morpheme, but that goal is not always met, it is important to know how high a priority having a single underlying form is, and in what cases learners turn to last-resort strategies for exceptionality. If these strategies are considered only after the learning of alternations that can be explained with restrictedly abstract URs (like /e/ in Klamath), it suggests that patterns like Klamath may be more stable than some of these other types of exceptionality, because noise or unlucky learning data distributions could lead to learners biasing one of the many never surfacing forms slightly above some other form. Differences between learners leads to different individuals learning different hidden structures for the same data, which may make some different predictions on very low-frequency items, on the treatment of loanwords or on gradient well-formedness judgements.