No CrossRef data available.
Published online by Cambridge University Press: 06 March 2006
In a communication network, one might attempt to route calls from an origin to a destination through n paths that will be tried one by one, each having a success probability pi ∈ (0,1), i = 1,2,…,n. The order of trying is controlled by a routing table. The number of attempts made is defined as the cost of the routing table. Move-forward self-organizing rules are applied to the routing table and comparisons of expected equilibrium costs are performed when p2 = p3 = … = pn. Stationary distributions for a subset of f-swap rules are obtained for general pi's.
In a communication network, one might attempt to route calls from an origin to a destination. Suppose that there are n paths that can be tried one by one, each having a success probability pi ∈ (0,1), i = 1,2,…,n. Note that the pi's do not necessarily sum to one. The order of trying is controlled by a routing table represented by π, a permutation of {1,2,…,n}. Each time there is a need of connection from the origin to the destination, the path π(1) is attempted first. If path π(i) (i = 1,2,…,n − 1) is attempted and fails, path π(i + 1) is attempted next. This process continues until one of the paths succeeds or all of the paths fail. We say that the call is completed or blocked, respectively. Whether a path succeeds or fails is assumed to be independent of the other paths and other calls. The number of attempts made is defined as the cost of this communication problem. Topkis [12] suggested that self-organizing rules can be applied to reorganize the routing table each time a call is completed. Specifically, he considered the following move-to-front rule that moves the successful path to the front of the routing table so that it will be tried first for the next call. Topkis [12] showed that under the move-to-front self-organization rule, the ordering in the routing table will reach an equilibrium. He showed that the stationary distribution for a routing table π under the move-to-front rule is given by

where qi ≡ 1 − pi for i = 1,2,…,n. The expected cost is then given by

when cost(π) is the expected number of attempts for a call to be connected under the routing table π.
Self-organizing rules are most commonly used under an information retrieval setting when the items under search are linearly ordered. Here, we consider n records R1,R2,…,Rn in a linear list. The configuration of these records can be represented by a permutation π ≡ (π(1),π(2),…,π(n)) of the set {1,2,…,n}. From time to time, there are successive independent demands for them. Each time there is a request for a certain record, we start at the front (first position) of the list and compare the records in the list one by one until we find a record Rπ(i), which is in the ith position, being the exact record requested. The time spent or the number of comparisons required to find the requested record is the search cost of this problem. We assume that the record Ri has probability pi of being requested. Unlike the communication problem, the pi's sum up to unity. The move-to-front rule moves the requested record to the first position in the linear list. The stationary distribution and the expected equilibrium cost under the move-to-front rule is well known in the self-organizing literature.
There are many self-organizing rules for a linear list other than the move-to-front rule. There is the famous transposition rule, considered by Hendricks [3,4] and Rivest [9], which moves the requested record to one position before its original position without changing the relative positions of the other records. A move-forward rule (Kan and Ross [5], Phelps and Thomas [8]) moves the requested record, which is in position i, to position li, with l1 = 1, li < i for i = 2,3,…,n, and li ≤ li+1 for i = 1,2,…,n − 1, and does not change the relative ordering of all other records. Examples for move-forward rules include the famous move-to-front rule and transposition rule, the family of move-up-k rules, SWITCH(k) rules, and POS(k) rules (Rivest [9], Tenenbaum and Nemes [11], Chong and Lam [1]). Rules that do not necessarily move things up, like the f-swap rules, are also considered in the literature (Lam and Cowan [7]). Note that each self-organizing rule under the information retrieval setting can also be applied to the communication setting.
One interesting problem is to compute the stationary distributions for various self-organizing rules. Under the information retrieval setting, stationary distributions are obtained for a large range of self-organizing rules, like the SWITCH(k) rules, POS(k) rules, and the f-swap rules; see Tenenbaum and Nemes [11], Chong and Lam [1], and Lam and Cowan [7] for references.
Another problem is to compare the cost of two self-organizing rules. It is well known that for an information retrieval problem, the transposition rule outperforms the move-to-front rule, which, in turn, outperforms the random rule that simply arranges the record randomly. Among the family of move-forward rules, Lam [6] obtained some cost comparison results under the condition that p2 = p3 = … = pn.
As we have pointed out earlier, the same self-organizing rule can be applied in the information retrieval and the communication settings. However, the stationary distribution under these settings are different. This is because the transition probabilities for the underlying Markov chain are not exactly the same. For example, when we consider three records under the move-to-front rule, the transition probability from the state (231) to (123) equals p1 and the transition probability from (123) to itself is also p1. However, under the communication setting, the former transition probability equals (1 − p2)(1 − p3)p1 and the latter equals p1 + (1 − p1)(1 − p2)(1 − p3). Because the communication problem has more complicated transition probabilities, its stationary distributions might not have an analytic solution even though its counterpart has one.
The expected cost of a self-organizing rule at equilibrium is given by [sum ]π P(π)cost(π), where P(π) is the stationary distribution and cost(π) is the cost of a given configuration π. Like P(π), which might be different under the two settings, cost(π) is also different. Under the information retrieval setting,

. However, under the communication setting,

Because of the above-mentioned differences, it comes as no surprise that the communication problem has less theoretical results than the record problem. The first step in narrowing this gap can be found in Ross [10], where the stationary distribution for the transposition rule under the communication setting can be given analytically and it is proved that the connection cost for the transposition rule is not more than that for the move-to-front rule when all but one of the pi's are the same. Chong and Lam [2] found the stationary distributions for the family of POS(k) rules and showed that for the case of three paths, the transposition rule is never worse than the move-to-front rule.
This article attempts to narrow the gap between the theoretical results for self-organizing rules under the information retrieval or communication setting. In Section 2 we consider a family of self-organizing rules called the f-swap rules under the communication settings. When the f-swap rules satisfy some mild conditions, we are able to derive the stationary distribution for general p = (p1,p2,…,pn). In Section 3 we consider the family of move-up rules under the communication setting. When two move-up rules are ordered according to a particular manner, we are able to compare their expected cost when the probabilities satisfy p2 = p3 = … = pn. In Section 4 the expected cost of a given move-forward rule is shown to be monotone in p1.
Consider the following family of f-swap rules: If the successful attempt of a path is in position j, j = 1,2,…,n, then this path exchanges its position with the path in position f (j), where f is a given mapping from the set {1,2,…,n} into itself. The mapping f can be represented by a directed graph with every vertex having out-degree unity. Throughout this section we will assume that the graph has exactly one directed cycle. Under this assumption, we will generalize the result about the stationary distributions in Lam and Cowan [7].
Let R be all the vertices in the unique directed cycle of the graph. Define

For a position j ∈ A ∪ B, let g(j) be the generation number of j (i.e., the smallest number of mappings applied such that f ○ f ○ … ○ f (j) ∈ R). For j ∈ R, let g(j) = 0. Furthermore, let

for j ∈ A ∪ B and w(j) = 0 for j ∈ R.
For convenience we will let qj = 1 − pj, aj = pj /qj and

which represents the routing table immediately preceding the routing table π when a call is completed through the path in position k. We will also make use of the conventions that for any function F,

The following lemma is needed for finding the stationary distributions.
Lemma 1:

Proof: When k = n, the left-hand side of Eq. (1) is

which equals the right-hand side of Eq. (1). Now suppose that Eq. (1) is true when k = K + 1. Then when k = K, by assumption of induction
Hence, Eq. (1) is true when k = 1,2,…,n. █
Theorem 1: Under the swap-forward rule with
(a) R = {z}, where z = 1,2,…,n or
(b) R = {z,z + 1}, where z = 1,2,…,n − 1,
the stationary probability of state π is proportional to

Especially when z = 1 and f (k) = k − 1 for k ≥ 2, the swap-forward rule becomes the transposition rule and the stationary probability of state π is proportional to

(see Chong and Lam [2]).
Proof: First note that g(f (k)) = g(k) − 1 for k ∈ A ∪ B and

Let

(a) Suppose R = {z}. Let t(σ,π) denote the transition probability from state σ to state π. Then

or, equivalently,
Since πz = π, we have
where the last equality is due to Lemma 1. Hence,

.
(b) Suppose R = {z,z + 1} (i.e., f (z) = z + 1 and f (z + 1) = z). Let u(σ,π) denote the transition probability from state σ to state π. Then
or, equivalently,
Since now c(πz) = c(π), we have
where the last equality is due to Lemma 1 and the second equality is from

Hence, [sum ]j∈A∪B u(πj,π)c(πj) + u(πz,π)c(πz) + u(π,π)c(π) = c(π). █
Example 1: Suppose n = 3, f (1) = 3, f (2) = 1, and f (3) = 1. Then the transition probability from σ to (1,2,3) is

Note that g(1) = g(3) = w(1) = w(3) = 0 and g(2) = w(2) = 1. Hence, c(π) = 1/aπ(2), where c(π) is defined in the proof of Theorem 1, and
Therefore, Theorem 1 cannot be generalized to the case when R = {y,z} with |y − z| > 1.
Example 2: Suppose n = 3, f (1) = 2, f (2) = 3, and f (3) = 1. Then the transition probability from σ to (1,2,3) is

Now g(i) = w(i) = 0 for i = 1,2,3 and c(π) = 1 for all permutations π. Obviously,

Therefore, Theorem 1 cannot be generalized to the case when |R| > 2.
In this section we compare the move-forward rules applied to a communication problem with the assumption that p2 = p3 = … = pn. For a move-forward rule characterized by l1,l2,…,ln, let

which uniquely characterizes a move-forward rule (Lam [6]).
Given that p1 = p, p2 = p3 = … = pn = r, 0 < p < 1, 0 < r < 1. Let q = 1 − p and s = 1 − r. Similar to Lam [6], the arrangement of the paths can be denoted by state i, i = 1,2,…,n, where i is the position of the unique path with success probability p. Let pij be the one-step transition probability from state i to state j. Then
for i = 2,3,…,n.
Let the equilibrium probability vector be (h(1),h(2),…,h(n)), H(0) be 0, and H(j) be

for j = 1,2,…,n. Then the H(j)'s satisfy

or, equivalently,

Lemma 2:
(a) If p ≥ r, then h(1) ≥ h(2) ≥ … ≥ h(n).
(b) If p ≤ r, then h(1) ≤ h(2) ≤ … ≤ h(n).
(c) If p ≥ r, then h(j + k(j))/h(j) ≤ qr/ps for j = 1,2,…,n − 1.
(d) If p ≤ r, then h(j + k(j))/h(j) ≥ qr/ps for j = 1,2,…,n − 1.
Proof: Suppose p ≥ r.
From the (n − 1)st equation of Eq. (4), we have h(n − 1)qrsn−2 = h(n)psn−1. Hence, h(n) ≤ h(n − 1).
Now suppose

and we need to prove h(j) ≥ h(j + 1). If k(j) = 1, the jth equation of Eq. (4) is h(j)qrsj−1 = h(j + 1)psj and h(j) ≥ h(j + 1) follows. If k(j) ≥ 2, from the (j + 1)st equation of Eq. (4) we get

By the induction assumption, we have
Adding

to both sides of the sum of the above k(j) inequalities, we have
Combining with Eq. (5), we obtain

Additionally, the jth equation of Eq. (4) is

Combining Eqs. (6) and (7), we get h(j) ≥ h(j + 1), which completes the proof of part (a).
The proof of part (b) is similar to the proof of part (a).
For the proof of part (c), we make use of Eq. (7) and part (a) to obtain

Thus, h(j)qr ≥ h(j + 1)ps.
The proof of part (d) is similar to the proof of part (c). █
For state i, the expected cost, which is the expected number of paths to attempt before a call is completed or blocked, is

Thus, the expected cost corresponding to the equilibrium probability vector (h(1),h(2),…, h(n)) is

For the probability vectors b = (b(1),b(2),…,b(n)) and b′ = (b′(1),b′(2),…,b′(n)), define b [pr ] b′ if and only if

Lemma 3:
(a) If p ≥ r, then b [pr ] b′ implies that the expected cost of b is not more than that for b′.
(b) If p ≤ r, then b [pr ] b′ implies that the expected cost of b is not less than that for b′.
Proof: By Abel's partial summation formula,

Therefore,

. The conclusions can then be derived from the above expression for C. █
For a transition probability matrix (pmj, m,j = 1,2,…,n), let

Lemma 4: For every move-forward rule, Pm,i ≥ Pm+1,i, m = 1,2,…,n − 1, i = 1,2,…,n.
Proof: In fact,
Corollary: For every move-forward rule, b [pr ] b′ implies bP [pr ] b′P.
Proof:
where the second equality comes from the Abel's partial summation formula and the inequality is due to b [pr ] b′ and Lemma 4. █
Theorem 2: Suppose that we have two move-forward rules characterized by {l1,l2,…,ln} and {l1′,l2′,…,ln′}, respectively, and li ≤ li′ for all i = 1,2,…,n. Denote their equilibrium probability vectors by h and h′, respectively, and the corresponding expected costs by C and C′. Then the following hold:
(a) p ≥ r implies h′ [pr ] h.
(b) p ≤ r implies h [pr ] h′.
(c) C′ ≤ C.
Proof: Note that li ≤ li′ for all i = 1,2,…,n is equivalent to k′(j) ≤ k(j) for all j = 1,2,…,n − 1 (Lam [6]), where the k(j)'s and k′(j)'s are defined by Eq. (2).
For the proof of part (a), suppose p ≥ r. First we will prove that h′ [pr ] h′P, where P is the transition probability matrix according to the move-forward rule with k(1),k(2),…,k(n − 1). The sum of the first i entries of h′P is given by
where H′(i) is the sum of the first i entries of h′. Note that H′(i) satisfies the ith equation of Eq. (3): that is,

Thus, D(i) ≤ H′(i), is equivalent to

Since p ≥ r, this is true by parts (c) and (a) of Lemma 2. Thus, h′ [pr ] h′P is proved. Then by the corollary to Lemma 4, h′ [pr ] h′P [pr ] h′P2 [pr ] h′P3 [pr ] … and so h′ [pr ] h.
The proof of part (b) is similar to that of part (a).
For the proof of part (c), C′ ≤ C comes immediately from parts (a) and (b) and Lemma 3. █
In this section, we consider only one move-forward rule and assume that there are two sets of success probabilities, p1 = p, p2 = p3 = … = pn = r and p1 = p′, p2 = p3 = … = pn = r′, where 0 < p < 1, 0 < r < 1, 0 < p′ < 1, and 0 < r′ < 1. Let P and P′ be the corresponding transition matrices and let h and h′ be the corresponding equilibrium probability vectors. Let also q = 1 − p, s = 1 − r, q′ = 1 − p′, and s′ = 1 − r′.
Lemma 5: If p ≥ p′ and r = r′, then h [pr ] h′.
Proof: Let

for m,i = 1,2,…,n, where the pmj's and pmj′'s are the one-step transition probabilities for the two sets of success probabilities, respectively. For any probability vectors b and b′ such that b [pr ] b′, we have bP′ [pr ] b′P′ by the corollary to Lemma 4. On the other hand, for every i = 1,2,…,n,

because Pm,i ≥ Pm,i′ for m,i = 1,2,…,n (refer to the expression for Pm,i in the proof of Lemma 4). Therefore, bP [pr ] bP′. Hence, h = hP [pr ] hP′ [pr ] h(P′)2 [pr ] h(P′)3 [pr ] … and so h [pr ] h′. █
Denote the expected costs corresponding to h and h′ by C and C′, respectively.
Theorem 3: If p ≥ p′ ≥ r = r′ or p ≥ r = r′ ≥ p′, then C ≤ C′.
Proof: Suppose that p ≥ p′ ≥ r = r′. Let

Then

. Now by Abel's partial summation formula and Lemma 5,
For the case p ≥ r = r′ ≥ p′,
When r = r′ ≥ p ≥ p′, C might be greater or smaller than C′. As an example, consider cases when n = 4 and r = 0.9. For the move-to-front rule, the expected equilibrium costs are 1.11957414, 1.11957444, and 1.11957383 for p = 0.814, 0.815, and 0.816, respectively. For the POS(2) rule, the expected equilibrium costs are 1.11899514, 1.11899612, and 1.11899606 for p = 0.821, 0.822, and 0.823, respectively. For the transposition rule, the expected equilibrium costs are 1.11853856, 1.11853924, and 1.11853865 for p = 0.828, 0.829, and 0.83, respectively.
The authors would like to acknowledge the support provided by the Hong Kong University Grants Council (grant No. RGC 2011/98H).