No CrossRef data available.
Published online by Cambridge University Press: 01 July 2004
In a system with one queue and several service stations, it is a natural principle to route a customer to the idle station with the distributionwise shortest service time. For the case with exponentially distributed service times, we use a coupling to give strong support to that principle. We also treat another topic. A modified version of our methods brings support to the design principle: It is better with few but quick servers.
Let

be stochastic models of two queuing systems. Suppose that they may be constructed on the same probability space in such a way that

when the initial conditions of

are identical; here, Yt and Yt′ are the number of customers at time t ≥ 0 in

respectively. If (1) holds, we are able to make an interesting comparison between

; we will use it for the following routing problem.
Consider the standard M/M/k system: Poisson arrival process, one queue, and k service stations with independent and identically distributed (i.i.d.) exponentially distributed service times that are also independent of the arrival process. Now, retain all of these conditions except the sameness of the service-time distributions; we assume that the service times of station i are exp(δi)-distributed, where δ1 ≥ ··· ≥ δk and the δi's are not all equal. The problem is as follows: If a customer arrives and there are two or more idle stations, to which of these should she be routed? A natural policy is the following:

For convenience, we use the term “route” also for the trivial case when a customer arrives and there is exactly one station idle or when at least one customer waits and one station becomes idle. We abbreviate (2) to the HSR (highest service rate) policy.
In Section 2, we will prove that if the HSR is used for

and some other policy is used for

, then (1) holds. Actually, that turns out to be the case for an arbitrary arrival process that is independent of the service times.
Note that if g is a bounded, nondecreasing, and nonnegative function and α is a constant > 0, then (1) implies

In fact, any reasonable cost criterion based only on the number of customers decides in favor of the HSR policy.
Considerable attention has been paid to comparisons between queuing systems (cf. Asmussen [1, Sect. XI.1], Stoyan [5, Chaps.5 and 6], and Wolff [7, Chap.11] for accounts). The importance of couplings (i.e., constructions of random elements on the same probability space) has been apparent for a long time; for a recent example, see Lindvall [3].
When it comes to routing problems, interesting uses of couplings turn up in Sparaggis, Towsley, and Cassandras [4] and Winkler [6].
In Section 3, we modify our setup in order to study systems with different numbers of stations. It turns out that if there are more but slower (to be made precise) stations in

than in

, then

is superior to

in the sense that (1) holds if the maximal capacities of the systems are the same.
Recall the setup presented in (1) and (2). To begin with, assume that the arrival process is deterministic, with arrivals at time points sj,j ≥ 1, such that

Set s0 = 0. We will prove that the HSR policy implies (1) by induction, using the following idea: Suppose we have been able to construct

on [0,sj] in such a way that (1) holds for t ∈ [0,sj] and the states of

at t = sj are feasible, in a sense to be made precise later, then we will be able to extend that to the interval [0,sj+1] , for j = 1,2,…
It is due time for the details. Because the service times are exponentially distributed, the states of

are completely described by the number of customers and the configurations of busy stations. Let

and for b = (b1,…,bk) ∈ B,

That a system is in state (i,b) ∈ E will mean that there are i customers in it, with the configuration of busy stations given by b; bj = 1 indicates that station j is busy.
For the partial ordering on E that will be defined now, let D(b) ≠ [empty ] to start. We define [prcue ] on E as follows: For i ≥ 1,

exactly when the following hold:
(i) i ≤ i′
(ii) There exists a strictly increasing mapping φ(b,b′,·) : D(b) → {1,…,k} such that φ(b,b′,j) ≥ j for all j ∈ D(b), and φ(b,b′,D(b)) ⊆ D(b′).
To complete the definition, let (0,(0,…,0)) [prcue ] (i′,b′) for all (i′,b′) ∈ E.
The meaning of (6(ii)) is that we can match each busy station in

with one busy station in

with a smaller or equal service rate.
We will use Xt = (Yt,Bt), t ≥ 0, to denote queuing process when the HSR policy is used and use Xt′ = (Yt′,Bt′), t ≥ 0, to denote the competing process with some other routing policy; the meanings of Bt and Bt′, t ≥ 0, are the obvious ones. We will produce a coupling such that Xt [prcue ] Xt′ for all t ≥ 0, under the assumption that the initial distributions are the same.
We follow the convention about right-continuity of paths of the type of processes we are dealing with here. That means that we will produce (Xt,Xt′), t ≥ 0, as a time-homogeneous jump Markov process on each of the intervals [sj,sj+1), j = 0,1,…, and then pay special attention to the jump at sj+1. We are now able to be precise about what the proof idea requires:

(i) produce a coupling such that (Xt,Xt′), t ≥ 0, is a jump Markov process on [0,T) satisfying Xt [prcue ] Xt′ for all t ∈ [0,T) if X0 [prcue ] X0′
(ii) see to it that XT [prcue ] XT′.
We used the word “feasible” in the presentation of the proof idea; now (7(ii)) makes that precise. We will apply (7) to the intervals [sj,sj+1], j = 0,1,…, successively, with X0 = X0′ for the application to the interval [0,s1] . That yields

if X0 = X0′, which is actually stronger than (1).
For (7(i)), recall the properties of the mappings φ(b,b′,·) in (6(ii)) and that the stations have intensities δ1,…,δk satisfying δ1 ≥ ··· ≥ δk.
Let ej = (0,…,1,…0) be the jth unit vector. For convenience, we will occasionally abbreviate φ(b,b′,j) to j′.
We will produce (Xt,Xt′), t ≥ 0, in terms of transition intensities. Fix two elements in E such that (i,b) [prcue ] (i′,b′), to be thought of as states of X0 and X0′, respectively. We sort out the presentation of the intensities into three cases.
Case 1: i > k. From ((i,b),(i′,b′)), we make a jump

Case 2: i ≤ k,i′ ≤ k. From ((i,b),(i′,b′)), we make jumps

for j ∈ D(b) and

for j ∈ D(b′)[setmn ]φ(D(b)) if that set is not equal to [empty ], which implies i < i′.
Case 3: i ≤ k,i′ > k. From ((i,b),(i′,b′)), we make jumps

for j ∈ D(b) and

Clearly, all possible jumps go to states ∈ E × E with the inequality [prcue ] preserved.
We turn to (7(ii)). It is obvious how the HSR policy works. However, we have not defined what is meant by a routing policy in general: It is a rule that decides about an arrival customer, given the state of the system at the arrival. If there is at most one station idle, the rule is the trivial one; there is no choice. The rule could mean a randomization over idle stations; we omit the formalism involving a Markov kernel on E × E and think of

using a policy deviating from the HSR policy.
Now, let (i,b) and (i′,b′) be the states of XT− and XT−′, respectively, and let (i + 1,b*) and (i′ + 1,b*′) denote the states at XT and XT′. We have to find a function φ(b*,b*′,·) satisfying (6(ii)).
If i′ ≥ k, the arriving customer to

at time T finds all stations busy. That means that we may let

Therefore, suppose that i′ < k. Clearly, due to the HSR policy,

where

We observe that {1,…,m − 1} ⊆ D(b).
Suppose that the policy for

routes the customer arriving at time T to station [ell ]. To start, suppose that [ell ] < m. Let

Since φ(b,b′,·) is strictly increasing on D(b) and {1,…,m − 1} ⊆ D(b), L is either empty or a set {1,…,r} ⊆ {1,…,m − 1} for some r ≥ 1.
If L = [empty ], let

If L ≠ [empty ], let
A similar proof applies to the case [ell ] ≥ m; let r be the integer ∈ {0,…,k − 1} such that L = {1,…,r} ∩ D(b) (= [empty ] if r = 0) and note that special attention has to be paid to the case r ≥ m.
That completes the proof of (8), for an arrival process satisfying (4). However, the condition in (4) excluding multiple arrivals was made to avoid some trite arguments; with multiple arrivals, we extend (7) to cover the case: T = 0 and (7(i)) dropped. No obstacles appear.
For a random point process ξ of arrivals, let S = (Si)1∞ be its points of occurrence in increasing order. If ξ is independent of the service times involved, then (8) is seen to hold for the random arrival case, after a conditioning on S.
That completes the proof of the optimality of the HSR policy; we refrain from a statement in terms of a theorem.
Remarks:
1. Our analysis works just as well when there are infinitely many stations. In fact, it becomes easier: We may use B as the state space, and the distinction among Cases 1–3 is unnecessary. The same comment applies to loss systems (i.e., when no waiting is allowed).
2. If the arrival process is stationary and with sufficiently low intensity (the expected number of arrivals per time unit), then (Yt)0∞ and (Yt′)0∞ can be stationary too and (1) can be used to justify the HSR policy when performing measures under stationarity are used.
3. It is natural to believe that (1) holds when ρ1 ≥ ··· ≥ ρk, where ρi is the failure rate function for the distribution of the service times at station i. However, even an effort under the extra condition that the ρi functions are all increasing, using some of the ideas in Lindvall [3] in order to keep track of the attained service times, was in vain.
4. For this remark, suppose that the HSR policy is used for both

and that the arrivals appear according to a time-homogeneous Poisson process (which renders Xt,t ≥ 0, a Markov process). It is clear from the proof of (8) that if

is idle at time 0, then Xt [prcue ] Xt′ for all t ≥ 0, regardless of the initial configuration of

. That is the condition of Lindvall [2, Sect. IV.3, Thm. (9.3)] and we can conclude from that theorem that Xt is stochastically increasing in t if

is idle at time 0; the same monotonicity for Yt follows.
In Lindvall [3, Sect.6], it was proved that if we compare two M/M/· systems, with k and k′ stations and service rates δ and δ′, respectively, where k < k′ and kδ = k′δ′, then (1) holds if Y0 ≤ Y0′, for a certain natural and simple coupling. That speaks in favor of the design principle: Use few but quick stations.
We will now generalize that result to the case where the service rates δ1,…,δk and δ1′,…,δk′′ of the stations in

, respectively, satisfy

and the arrival process is arbitrary but independent of the service times, as in Section 2. It is assumed that the HSR policy is used for both

, but it suffices that

uses that policy. We will be as brief as possible, concentrating on the necessary modification of the setup in Section 2 and a new coupling problem that has to be solved.
Some new notation is needed. Let

we let C(b′) and D(b′) have their obvious meanings for b′ ∈ B′. For the matching in (6(ii)), the mapping φ(b,b′,·) now has {1,…,k′} as its range. That means that (6(i)) and (6(ii)) no longer define a partial ordering on E, but rather a relation on E × E′; that is, however, sufficient for our purposes. We use

to denote that relation.
We will produce (Xt,Xt′),t ≥ 0, such that

when

. Clearly, that implies (1).
We will pay no attention to the analog of (7(ii)), since the proof of that is virtually the same as for the routing problem. For the analog of (7(i)), let (i,b) ∈ E and (i′,b′) ∈ E′ be such that

; we will produce couplings such that “inequality” is preserved when services are finished. Note that i ≤ i′.
Case 1°: i ≤ k. Use the obvious variants of Cases 2 and 3 in Section 2.
For the case i > k, we need couplings that are more subtle than those above. To that end, let

Further, let

Here, [ell ](I) denotes the length of an interval I.
Case 2°: i > k,i′ = k′. Let φ(b,b′,j) = j for j = 1,…,k. From ((i,b),(i′,b′)), we make jumps

for j = 1,…,k,

for j = k + 1,…,k′.
To understand the last intensity, consider γmn as the intensity for service finished both at station m in

and station n in

. We have

due to the condition

. Because there is a customer waiting in

, it does not become visible which station in

finishes service at the same time as station j in

.
We used ej′ to denote the jth k′-dimensional unit vector.
Case 3°: i > k,i′ > k′. This case is easy, after understanding Case 2°.
Case 4°: i > k,i′ < k′. Let n1′,…,nm′ be the elements of D(b′) enumerated in increasing order and let

Now use an obvious variant of Case 2°.
For Cases 1°–4°, we find that the relation

is preserved after jumps; hence (11) is proved.