Dynamic Programming for Estimating Acceptance Probability of Credit Card Products

Lai Soon Lee^1,2*, Ya Mei Tee¹, Hsin Vonn Seow³

¹Department of Mathematics, Faculty of Science, Universiti Putra Malaysia, Serdang, Malaysia.
²Laboratory of Computational Statistics and Operations Research, Institute for Mathematical Research, Universiti Putra Malaysia, Serdang, Malaysia.
³Nottingham University Business School, The University of Nottingham Malaysia Campus, Semenyih, Malaysia.

DOI: 10.4236/jcc.2017.514006                

Abstract

Banks have many variants of a product which they can offer to their customers. For example, a credit card can have different interest rates. So determining which variants of a product to offer to the new customers and having some indication on acceptance probability will aid with the profit optimisation for the banks. In this paper, the authors look at a model for maximisation of the profit looking at the past information via implementation of the dynamic programming model with elements of Bayesian updating. Numerical results are presented of multiple variants of a credit card product with the model providing the best offer for the maximum profit and acceptance probability. The product chosen is a credit card with different interest rates.

Keywords

Credit Card, Credit Scoring, Dynamic Programming, Profitability

1. Introduction

Traditionally, credit card issuers charged a “fixed interest rate” on their credit cards for all their customers. According to [1] , since 1991 however, some credit card firms have switched to “variable interest rate” as a result to the credit card lending market becoming more competitive [1] . As reported by [2] , profitability of credit card lenders consequently suffered a substantial loss due to this competition.

Hence it is becoming increasing important to be able to secure the acceptance of an offer in order to have profit. So, the lenders have to be able to “persuade” the customer to accept their offer. When a good customer is willing to accept an offer, he or she will generate profit to an organisation. One way of doing so is to “customise” the offer to the customer. The lenders could use information about the customer’s preferences so as a guide to make a decision on what type of offer the customer may be interested in. This information is already available from initial collection for credit scoring purposes. By looking at which type of product accepted by different customers, the lenders can “learn” about the preferences of their customers. Hence, the decision on what offer to make can be modeled.

There are a number of researchers who have researched acceptance probability for financial products to maximise profitability; for example [3] [4] [5] .

In this paper, the authors extended an acceptance model based on the work done by [4] . The lender’s decision problem has been modeled as a Markov Decision Process under uncertainty. The objective of this model is the maximisation of profit using a dynamic programming [6] model with Bayesian updating to incorporate the usage of past customer information to optimise acceptance probability. The problem is discussed in the next section. Then the optimal solutions for variants of products are described. Finally, the numerical results are tabled and the conclusions are drawn in the last section.

2. The Problem

Banks have many variants of a personal financial product which they can offer to their customers. The attractiveness of the variants to the customer can be ordered in such a way that the likelihood of accepting that variant by the customer is monotonically decreasing while the lender’s profitability of the variant is monotonically increasing. For example, a credit card with different interest rates likes 5%, 10% and so on. The decision on which offer to make to the next applicant is based on the given knowledge of the previous offers and whether the offer accepted by previous customers. The objective of modeling the acceptance probability is to maximise the profit to the bank.

In the model here, the authors follow the example of [4] and model the problem as a credit card product with different variant of interest rates. It is assumed that the customers are from homogenous population and the probability of any customer choosing variant t is $p_t$ where $t=1,2,\cdots ,m$ and $p_1\ge p_2\ge \cdots \ge p_m$ . The profit to the lender of t variant chosen by customers is $P_t$ where $P_1\le P_2\le \cdots \le P_m$ and $P_t\ge 0$ . Thus, the bank’s maximum profit is determined by $\text{max}\left\{p_t{P}_t\right\}$ . However, one does not know the probability of $p_t$ , so we defined $p_t$ as with the condition of $p_1\ge p_2\ge \cdots \ge p_m$ . Here assume Offer 1 is a credit card with 5% interest rate annually, Offer 2 is a credit card with 10% interest rate annually, Offer 3 is a credit card with 15% interest rate annually and Offer 4 is a credit card with 20% interest rate annually. Also, assume the number of potential customers has a geometric distribution with parameter β with the last customer is 1 − β.

At the beginning, two variants of the credit cards are considered in the model. There are a few assumptions made in this model. First, assume that if a customer rejected variant t, meaning that he/she would also reject all worse variants u, where $u>t$ . Similarly, if a customer accepted variant t, he/she would accepted all better variants v, where $v<t$ . With so $u>t>v$ . To illustrate, let u = 20% interest rate on a credit card, t = 10% and v = 5%. If one rejects an offer of 10% interest rate (t), then one is also likely to reject a credit card of 15% interest rate (u). And if one accepts the offer of 10% interest rate, one is likely to accept a “better offer” of 5% (v) interest rate. We ensure this by defining a set of conditional probabilities where $p_1$ is the probability of accepting Offer 1 and $q_1$ is the Bernoulli random variable.

$q_1=p_1$ ;

$q_2$ = Probability (customer would accept Offer 2/customer would accept Offer 1).

Since $q_1=p_1$ ,

hence $p_2=q_2{p}_1=q_2\left(q_1\right)$ .

This condition ensures that $p_1\ge p_2$ .

For three variants of interest rates for the credit card, the conditional probability is as follows:

Since $p_2=q_2{q}_1$ ,

hence $p_3=q_3{p}_2=q_3\left(q_2{q}_1\right)$ and this ensures that $p_1\ge p_2\ge p_3$ .

And so for the four variants of interest rates for the credit card, the conditional probability is as follows:

Since $p_3=q_3{q}_2{q}_1$ ,

hence $p_4=q_4{p}_3=q_4\left(q_3{q}_2{q}_1\right)$ and this ensures that $p_1\ge p_2\ge p_3\ge p_4$ .

For many variants of interest rates for the credit card, the conditional probability is defined as:

$p_m=q_m{p}_{m-1}={\displaystyle {\prod }_{u=1}^m{q}_u}$ ,

where $p_m$ = Probability of accepting offer m,

$q_m$ = Probability (customer would accept Offer m/customer would accept Offer $m-1$ ).

This condition ensures that $p_1\ge p_2\ge p_3\ge \cdots \ge p_m$ .

Given that $q_t$ are all Bernoulli random variables so in a Bayesian setting, one could describe the bank’s knowledge of the information as a Beta distribution. The prior for $q_t$ is by $B\left(r_t,n_t-r_t\right)$ whose probability density function is

$q_t^{r_t-1}{\left(1-q_t\right)}^{n_t-r_t-1}$ and expectation is $\frac{r_t}{n_t}$ where $r_t$ = the number of customers

that have accepted the offer t and $n_t$ = the number of customers who were extended offer t. At any point, the bank’s belief about the acceptance probabilities $p_1\ge p_2\ge p_3\ge \cdots \ge p_m$ is given by the parameters $\left(r_1,n_1,r_2,n_2,\cdots ,r_m,n_m\right)$ . Let the expected maximum total future profit to the bank as $V\left(r_1,n_1,r_2,n_2,\cdots ,r_m,n_m\right)$ given that the current belief is $\left(r_1,n_1,r_2,n_2,\cdots ,r_m,n_m\right)$ .

$r_1,n_1$ are the parameters of the Beta distribution describing one’s belief of $p_1$ . So if Offer 1 is accepted, the parameters will get updated to $r_1+1$ , $n_1+1$ . If it is rejected, they get updated to $r_1$ , $n_1+1$ . Thus, one could reinterpret these as:

$r_1$ = number of customer who already accepted Offer 1 (Offer 5% in this model); and

$n_1$ = number of customer who have been offered Offer 1 (Offer 5%).

Hence $r_2,n_2$ are the parameters of the Beta distribution describing one’s belief of $p_2$ . Note the assumption that the offer of Offer 1 will have to be accepted first before Offer 2 can be considered. If Offer 2 is accepted, the parameters get updated to $r_2+1$ , $n_2+1$ . So when it is rejected, they get updated to $r_2$ , $n_2+1$ . Thus,

$r_2$ = number of customer who already accepted Offer 2 (Offer 10% in this model); and

$n_2$ = number of customer who have been offered Offer 2 (Offer 10%).

Note that $r_3,n_3$ are the parameters of the Beta distribution describing one’s belief of $p_3$ . If Offer 3 is accepted, the parameters get updated to $r_3+1$ , $n_3+1$ . When Offer 3 is rejected, and the customer is assumed to would have accepted Offer 1 but could reject Offer 2; or accepted Offer 1 and Offer 2. Hence they get updated to $r_3$ , $n_3+1$ and the $r_1,n_1$ and $r_2,n_2$ is updated depending on the conditions of Offer 1 and Offer 2. Thus,

$r_3$ = number of customer who already accepted Offer 3 (Offer 15% in this model); and

$n_3$ = number of customer who have been offered Offer 3 (Offer 15%).

$r_4,n_4$ are the parameters of the Beta distribution describing one’s belief of $p_4$ . If Offer 4 is accepted, the parameters get updated to $r_4+1$ , $n_4+1$ . If it is rejected, then there are three possibilities:

1) The customer would have accepted Offer 1 but rejected Offer 2 and Offer 3;

2) The customer would have accepted Offer 1 and Offer 2 but rejected Offer 3;

3) The customer would have accepted Offer 1, Offer 2 and Offer 3. Thus,

$r_4$ = number of customer who already accepted Offer 4 (Offer 20% in this model); and

$n_4$ = number of customer who have been offered Offer 4 (Offer 20%).

In the above four cases, $n_t\ge r_t$ for $t=1,2,3,4$ .

By including the information obtained from the past acceptance and rejection of each variants of the product, the model becomes a “learning” model to support making decisions on which product to offer to the next customer.

With such a belief distribution, the expected probability of Offer 1 being

accepted is $\frac{r_1}{n_1}$ , Offer 2 is $\frac{r_1}{n_1}\frac{r_2}{n_2}$ , Offer 3 is $\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}$ and Offer 4 is $\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}\frac{r_4}{n_4}$ . For k offers, this is defined as ${\displaystyle {\prod }_{u=1}^k\frac{r_u}{n_u}}$ .

Let $V\left(r_1,n_1,r_2,n_2\right)$ = expected maximum future profit from the next customer. Consider a two variant case, given that one has to choose which of the two variants of the product to offer to the next customer, function $V\left(r_1,n_1,r_2,n_2\right)$ has to satisfy the optimal equation (see [7] ):

$\begin{array}{l}V\left(r_1,n_1,r_2,n_2\right)\\ =\text{max}\{\begin{array}{l}\frac{r_1}{n_1}{P}_1+\beta \{\frac{r_1}{n_1}V\left(r_1+1,n_1+1,r_2,n_2\right)\\ +\left(1-\frac{r_1}{n_1}\right)V\left(r_1,n_1+1,r_2,n_2\right)\};\\ \frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2+\beta \{\frac{r_1}{n_1}\frac{r_2}{n_2}V\left(r_1+1,n_1+1,r_2+1,n_2+1\right)\\ +\frac{r_1}{n_1}\left(1-\frac{r_2}{n_2}\right)V\left(r_1+1,n_1+1,r_2,n_2+1\right)\\ +\left(1-\frac{r_1}{n_1}\right)V\left(r_1,n_1+1,r_2,n_2\right)\}.\end{array}\end{array}$ (1)

For the 3 variants of the credit card product, function $V\left(r_1,n_1,r_2,n_2,r_3,n_3\right)$ satisfies the optimal equation of:

$\begin{array}{l}V\left(r_1,n_1,r_2,n_2,r_3,n_3\right)\\ =\max \{\begin{array}{l}\frac{r_1}{n_1}{P}_1+\beta \{\frac{r_1}{n_1}V\left(r_1+1,n_1+1,r_2,n_2,r_3,n_3\right)\\ +\left(1-\frac{r_1}{n_1}\right)V\left(r_1,n_1+1,r_2,n_2,r{}_3,n_3\right)\};\\ \frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2+\beta \{\frac{r_1}{n_1}\frac{r_2}{n_2}V\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3,n_3\right)\\ +\frac{r_1}{n_1}\left(1-\frac{r_2}{n_2}\right)V\left(r_1+1,n_1+1,r_2,n_2+1,r_3,n_3\right)\\ +\left(1-\frac{r_1}{n_1}\right)V\left(r_1,n_1+1,r_2,n_2,r_3,n_3\right)\};\\ \frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3+\beta \{\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}V\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3+1,n_3+1\right)\\ +\frac{r_1}{n_1}\frac{r_2}{n_2}\left(1-\frac{r_3}{n_3}\right)V\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3,n_3+1\right)\\ +\frac{r_1}{n_1}\left(1-\frac{r_2}{n_2}\right)V\left(r_1+1,n_1+1,r_2,n_2+1,r_3,n_3\right)\\ +\left(1-\frac{r_1}{n_1}\right)V\left(r_1,n_1+1,r_2,n_2,r_3,n_3\right)\}.\end{array}\end{array}$ (2)

For the 4 variants of the credit card product, function $V\left(r_1,n_1,r_2,n_2,r_3,n_3,r_4,n_4\right)$ satisfies the optimal equation of:

(3)

For m variants of products, function $V\left(r_1,n_1,r_2,n_2,\cdots ,r_m,n_m\right)$ satisfies the optimal equation:

$\begin{array}{l}V\left(r_1,n_1,r_2,n_2,\cdots ,r_m,n_m\right)\\ =\underset{k:1\le k\le m}{\text{max}}\{{\displaystyle \underset{\text{u}=\text{1}}{\overset{\text{k}}{\prod }}\left(\frac{r_u}{n_u}\right)P_k+\beta {\displaystyle \underset{u=1}{\overset{k}{\prod }}\left(\frac{r_u}{n_u}\right)V\left(r_1+1,n_1+1,\cdots ,r_u+1,n_u+1\right)}}\\ +{\displaystyle \underset{l=1}{\overset{k}{\sum }}\left({\displaystyle \underset{u=1}{\overset{k}{\prod }}\left(\frac{r_{u-1}}{n_{u-1}}\right)\left(1-\frac{r_l}{n_l}\right)}V\left(r_1+1,n_1+1,\cdots ,r_l,n_l+1\right)\right)}\}.\end{array}$ (4)

The first term in each offer is the probability that a customer will accept the variant offered multiplied by the profit to the bank. The remaining terms depends on the chance β that there will be another customer. In the β equation, the first term corresponds to the current offer being accepted. The remaining terms correspond to the offer being refused and it looks at the different ways it can happen. For example, the term $V\left(r_1+1,n_1+1,r_2,n_2+1\right)$ corresponds to the refusal of the Offer 2. While $V\left(r_1,n_1+1,r_2,n_2\right)$ means one believes Offer 1 has been refused thus there is no updating of Offer 2. The term $V\left(r_1+1,n_1+1,\cdots ,r_l,n_l+1\right)$ corresponds to the refusal of the l-th offer.

3. Optimal Solution for Many Variants of the Product

Consider a variation of the problem in (1) where the lender has a cost of

$\beta \left(1-\frac{r{}_1}{n_1}\right)V\left(r_1,n_1+1,r_2,n_2\right)$ if an offer is made to a customer where the state is

$\left(r_1,n_1,r_2,n_2\right)$ irrespectively of which offer is made. Since the cost is independent of the offer made, it cannot affect the optimal action. Let $\tilde{V}\left(r_1,n_1,r_2,n_2\right)$ be the optimal expected profit for the modified problem. Then, we know the optimal policy when solving for $\tilde{V}\left(r_1,n_1,r_2,n_2\right)$ is the same as for $V\left(r_1,n_1,r_2,n_2\right)$ , with

$\tilde{V}\left(r_1,n_1,r_2,n_2\right)=\frac{r_1}{n_1}\beta \max \{\begin{array}{l}{B}_1+\tilde{V}\left(r_1+1,n_1+1,r_2,n_2\right);\\ \frac{r_2}{n_2}{B}_2+\frac{r_2}{n_2}\tilde{V}\left(r_1+1,n_1+1,r_2+1,n_2+1\right)\\ +\left(1-\frac{r_2}{n_2}\right)\tilde{V}\left(r_1+1,n_1+1,r_2,n_2+1\right).\end{array}$ (5)

where $B_i=\frac{P_i}{\beta }$ , $P_i\ge 0$ , and $i=1,2$ .

For the 3 variants case, the optimal expected profit is defined as:

$\begin{array}{l}\tilde{V}\left(r_1,n_1,r_2,n_2,r_3,n_3\right)\\ =\frac{r_1}{n_1}\beta \max \{\begin{array}{l}{B}_1+\tilde{V}\left(r_1+1,n_1+1,r_2,n_2,r_3,n_3\right);\\ \frac{r_2}{n_2}{B}_2+\frac{r_2}{n_2}\tilde{V}\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3,n_3\right)\\ +\left(1-\frac{r_2}{n_2}\right)\tilde{V}\left(r_1+1,n_1+1,r_2,n_2+1,r_3,n_3\right);\\ \frac{r_2}{n_2}\frac{r_3}{n_3}{B}_3+\frac{r_2}{n_2}\frac{r_3}{n_3}\tilde{V}\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3+1,n_3+1\right)\\ +\left(1-\frac{r_3}{n_3}\right)\tilde{V}\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3,n_3+1\right)\\ +\left(1-\frac{r_2}{n_2}\right)\tilde{V}\left(r_1+1,n_1+1,r_2,n_2+1,r_3,n_3\right);\end{array}\end{array}$ (6)

where $B_i=\frac{P_i}{\beta }$ , $i=1,2,3$ .

For the 4 variants case, the optimal expected profit is defined as:

$\begin{array}{l}V\left(r_1,n_1,r_2,n_2,r{}_3,n_3,r_4,n_4\right)\\ =\frac{r_1}{n_1}\beta \max \{\begin{array}{l}{B}_1+\tilde{V}\left(r_1+1,n_1+1,r_2,n_2,r_3,n_3,r_4,n_4\right);\\ \frac{r_2}{n_2}{B}_2+\frac{r_2}{n_2}\tilde{V}\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3,n_3,r_4,n_4\right)\\ +\left(1-\frac{r_2}{n_2}\right)\tilde{V}\left(r_1+1,n_1+1,r_2,n_2+1,r_3,n_3,r_4,n_4\right);\\ \frac{r_2}{n_2}\frac{r_3}{n_3}{B}_3+\frac{r_2}{n_2}\frac{r_3}{n_3}\tilde{V}\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3+1,n_3+1,r_4,n_4\right)\\ +\left(1-\frac{r_3}{n_3}\right)\tilde{V}\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3,n_3+1,r_4,n_4\right)\\ +\left(1-\frac{r_2}{n_2}\right)\tilde{V}\left(r_1+1,n_1+1,r_2,n_2+1,r_3,n_3,r_4,n_4\right);\\ \frac{r_2}{n_2}\frac{r_3}{n_3}\frac{r_4}{n_4}{B}_4\\ +\frac{r_2}{n_2}\frac{r_3}{n_3}\frac{r_4}{n_4}\tilde{V}\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3+1,n_3+1,r_4+1,n_4+1\right)\\ +\left(1-\frac{r_4}{n_4}\right)\tilde{V}\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3+1,n_3+1,r_4,n_4+1\right)\\ +\left(1-\frac{r_3}{n_3}\right)\tilde{V}\left(r_1+1,n_1+1,r_2+1,n_2+1,r_3,n_3+1,r_4,n_4\right)\\ +\left(1-\frac{r_2}{n_2}\right)\tilde{V}\left(r_1+1,n_1+1,r_2,n_2+1,r_3,n_3,r_4,n_4\right);\end{array}\end{array}$ (7)

where $B_i=\frac{P_i}{\beta }$ , $i=1,2,3,4$ .

Recall that Equation (4) is the optimal equation for m variants of the product which is the extension of Equations (1)-(3) in the 2, 3 and 4-variants cases

respectively. We subtract a cost of $\beta \left(1-\frac{r{}_1}{n_1}\right)\tilde{V}\left(r_1,n_1+1,r_2,n_2,\cdots ,r_m,n_m\right)$ from all

the actions in state of $\left(r_1,n_1,\cdots ,r_m,n_m\right)$ of Equations (5)-(7). We know that this cannot affect the decisions made but allows us to simplify Equations (5), (6) and (7) to a general equation of:

$\begin{array}{l}\tilde{V}\left(r_1,n_1,\cdots ,r_m,n_m\right)\\ =\beta \underset{k:\le 1\le k\le m}{\max }\{{\displaystyle \underset{j=1}{\overset{k}{\prod }}\frac{r_j}{n_j}{B}_k+{\displaystyle \underset{j=1}{\overset{k}{\prod }}\frac{r_j}{n_j}\tilde{V}\left(r_1+1,n_1+1,\cdots ,r_k,n_k,r_{k+1},n_{k+1}\right)}}\\ +{\displaystyle \underset{l=2}{\overset{k}{\sum }}\left({\displaystyle \underset{j=1}{\overset{k}{\prod }}\left(\frac{r_{j-1}}{n_{j-1}}\right)\left(1-\frac{r_l}{n_l}\right)\tilde{V}\left(r_1+1,n_1+1,\dots ,r_l,n_l+1,\cdots ,r_m,n_m\right)}\right)}\}.\end{array}$ (8)

The proof of the theorem can be referred in Seow and Thomas [6] .

If we have 2 variants,

1) $r_2\le r_1^{*}\left(r_2,n_2\right)$ , one chooses Offer 1.

2) $r_2>r_1^{*}\left(r_2,n_2\right)$ , one chooses Offer 2.

If we have 3 variants,

1) $r_3\le r_2{}^{*}\le r_1^{*}\left(r_2,n_2,r_3,n_3\right)$ , one chooses Offer 1.

2) $r_3\le r_2^{*}\left(r_3,n_3\right)$ , one chooses Offer 2.

3) $r_3>r_2^{*}\left(r_3,n_3\right)$ , one chooses Offer 3.

If we have 4 variants,

1) $r_4\le r_3^{*}\le r_2{}^{*}\le r_1^{*}\left(r_2,n_2,r_3,n_3,r_4,n_4\right)$ , one chooses Offer 1.

2) $r_4\le r_3{}^{*}\le r_2^{*}\left(r_3,n_3,r_4,n_4\right)$ , one chooses Offer 2.

3) $r_4\le r_3^{*}\left(r_4,n_4\right)$ , one chooses Offer 3.

4) $r_4>r_3^{*}\left(r_4,n_4\right)$ , one chooses Offer 4.

So, if we have m variants, from the theorem as in [4] it is found that:

At any state $\left(r_1,n_1,\cdots ,r_m,n_m\right)$ , there exists functions $r_i^{*}\left(r_{i+1},n_{i+1},\cdots ,r_m,n_m\right),\text{}i=2,3,\cdots ,m$ so that:

1) One chooses Offer 1 to all future customers if $r_2\le r_1^{*}\left(r_2,n_2,\cdots ,r_m,n_m\right)$ ;

2) One chooses Offer 2 to all future customers if $r_3\le r_2^{*}\left(r_3,n_3,\cdots ,r_m,n_m\right)$ ;

3) One chooses Offer t to all future customers if $r_{t+1}\le r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_m,n_m\right)$ ; and

4) One chooses Offer t + 1 to all future customers if $r_{t+1}>r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_m,n_m\right)$ .

We have proved that there is exists at most one $r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_m,n_m\right),t=1,2,3,\cdots ,m$ in the following Lemma 1.

Lemma 1:

At any state $\left(r_1,n_1,\cdots ,r_m,n_m\right)$ , there is exists at most one $r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_m,n_m\right),t=1,2,3,\cdots ,m$ for the choice of t variants of all future customers.

Proof

To prove the Lemma above, we need to consider two cases.

Case 1 where there is exactly one switch:

1) Let P(m) be the statement that one chooses Offer t to all future customers if $r_{t+1}\le r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_m,n_m\right)$ and one chooses Offer $t+1$ to all future customers if $r_{t+1}>r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_m,n_m\right)$ .

2) Let P(1) which is base offer be the default. Hence for m = 1, one chooses Offer 1.

3) For m = 2, assume P(2) is correct, that is:

a) $r_2\le r_1^{*}\left(r_2,n_2\right)$ , one chooses Offer 1.

b) $r_2>r_1^{*}\left(r_2,n_2\right)$ , one chooses Offer 2.

Note that there is one $r_1^{*}\left(r_2,n_2\right)$ .

For the following statements, $r_2^{**},r_3^{**},r_4^{**},\cdots$ is used to differentiate $r_2^{*},r_3^{*},r_4^{*},\cdots$ since $r_2^{**},r_3^{**},r_4^{**},\cdots$ are not the point to switch the offer.

4) Suppose P(K) is true, for m = K, where P(K) is the statement that one chooses Offer t to all future customers if $r_{t+1}\le r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_K,n_K\right)$ ; and one chooses Offer t + 1 to all future customers if $r_{t+1}>r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_K,n_K\right)$ . P(K) also means that:

a) One chooses Offer 1 if $r_2\le r_1^{*}\left(r_2,n_2\right)$ .

b) One chooses Offer 1 if $r_3\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3\right)$ and one chooses Offer 2 if $r_3\le r_2^{*}\left(r_3,n_3\right)$ .

c) One chooses Offer 1 if $r_4\le r_3^{**}\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3,r_4,n_4\right)$ ; one chooses Offer 2 if $r_4\le r_3^{**}\le r_2^{*}\left(r_3,n_3,r_4,n_4\right)$ ; and one chooses Offer 3 if $r_4\le r_3^{*}\left(r_4,n_4\right)$ .

d) One chooses Offer 1 if $r_t\le \cdots \le r_4^{**}\le r_3^{**}\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3,r_4,n_4,\cdots ,r_K,n_K\right)$ ; one chooses Offer 2 if $r_t\le \cdots \le r_4^{**}\le r_3^{**}\le r_2^{*}\left(r_3,n_3,r_4,n_4,\cdots ,r_K,n_K\right)$ ; one chooses Offer 3 if $r_t\le \cdots \le r_4^{**}\le r_3^{*}\left(r_4,n_4,\cdots ,r_K,n_K\right)$ ; one chooses Offer 4 if $r_t\le \cdots \le r_6^{**}\le r_5^{**}\le r_4^{*}\left(r_5,n_5,r_6,n_6,\cdots ,r_K,n_K\right)$ ; and so on, then one chooses Offer t if $r_{t+1}\le r_t^{*}\left(r_K,n_K\right)$ .

e) One chooses Offer $t+1$ if $r_{t+1}>r_t^{*}\left(r_K,n_K\right)$ and there is one $r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_K,n_K\right)$ or switch of offers.

5) It can be shown that $P\left(K+1\right)$ is true where $P\left(K+1\right)$ is the statement that one chooses Offer t to all future customers if $r_{t+1}\le r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_{K+1},n_{K+1}\right)$ , otherwise one chooses Offer $t+1$ to all future customers if $r_{t+1}>r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_{K+1},n_{K+1}\right)$ . $P\left(K+1\right)$ also means that:

a) One chooses Offer 1 if $r_2\le r_1^{*}\left(r_2,n_2\right)$ .

b) One chooses Offer 1 if $r_3\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3\right)$ and one chooses Offer 2 if $r_3\le r_2^{*}\left(r_3,n_3\right)$ .

c) One chooses Offer 1 if $r_4\le r_3^{**}\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3,r_4,n_4\right)$ ; one chooses Offer 2 if $r_4\le r_3^{**}\le r_2^{*}\left(r_3,n_3,r_4,n_4\right)$ ; and one chooses Offer 3 if $r_4\le r_3^{*}\left(r_4,n_4\right)$ .

d) One chooses Offer 1 if $r_{t+1}\le \cdots \le r_4^{**}\le r_3^{**}\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3,r_4,n_4,\cdots ,r_{K+1},n_{K+1}\right)$ ; one chooses Offer 2 if $r_{t+1}\le \cdots \le r_4^{**}\le r_3^{**}\le r_2^{*}\left(r_3,n_3,r_4,n_4,\cdots ,r_{K+1},n_{K+1}\right)$ ; one chooses Offer 3 if $r_{t+1}\le \cdots \le r_4^{**}\le r_3^{*}\left(r_4,n_4,\cdots ,r_{K+1},n_{K+1}\right)$ ; one chooses Offer 4 if $r_{t+1}\le \cdots \le r_6^{**}\le r_5^{**}\le r_4^{*}\left(r_5,n_5,r_6,n_6,\cdots ,r_{K+1},n_{K+1}\right)$ ; and so on, then one chooses Offer t if $r_{t+1}\le r_t^{*}\left(r_{K+1},n_{K+1}\right)$ .

e) One chooses Offer $t+1$ if $r_{t+1}>r_t^{*}\left(r_{K+1},n_{K+1}\right)$ .

Since P(K) is true, that is:

1) One chooses Offer 1 if $r_2\le r_1^{*}\left(r_2,n_2\right)$ .

2) One chooses Offer 1 if $r_3\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3\right)$ and one chooses Offer 2 if $r_3\le r_2^{*}\left(r_3,n_3\right)$ .

3) One chooses Offer 1 if $r_4\le r_3^{**}\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3,r_4,n_4\right)$ ; one chooses Offer 2 if $r_4\le r_3^{**}\le r_2^{*}\left(r_3,n_3,r_4,n_4\right)$ ; and one chooses Offer 3 if $r_4\le r_3^{*}\left(r_4,n_4\right)$ .

4) One chooses Offer 1 if $r_t\le \cdots \le r_4^{**}\le r_3^{**}\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3,r_4,n_4,\cdots ,r_K,n_K\right)$ ; one chooses Offer 2 if $r_t\le \cdots \le r_4^{**}\le r_3^{**}\le r_2^{*}\left(r_3,n_3,r_4,n_4,\cdots ,r_K,n_K\right)$ ; one chooses Offer 3 if $r_t\le \cdots \le r_4^{**}\le r_3^{*}\left(r_4,n_4,\cdots ,r_K,n_K\right)$ ; one chooses Offer 4 if $r_t\le \cdots \le r_6^{**}\le r_5^{**}\le r_4^{*}\left(r_5,n_5,r_6,n_6,\cdots ,r_K,n_K\right)$ ; and so on, then one chooses Offer t if $r_t\le r_{t-1}^{*}\left(r_K,n_K\right)$

The introduction of an additional option of choice; the term $r_{t+1}\le r_t^{*}\left(r_{K+1},n_{K+1}\right)$ in (5, d); can also be expressed as $r_{t+1}\le r_t^{*}\left(r_K,n_K,r_{K+1},n_{K+1}\right)$ . Since $r_{t+1}\le r_t^{*}\left(r_K,n_K,r_{K+1},n_{K+1}\right)$ has an additional option choice of $\left(r_{K+1},n_{K+1}\right)$ , then the next choice is one chooses variant t to all future customers if $r_{t+1}\le r_t^{*}\left(r_{K+1},n_{K+1}\right)$ before it comes to the last condition of choice which is where one chooses variant t + 1 if $r_{t+1}>r_t^{*}\left(r_{K+1},n_{K+1}\right)$ . Hence, P(K + 1) is also true, that is:

1) One chooses Offer 1 if $r_2\le r_1^{*}\left(r_2,n_2\right)$ .

2) One chooses Offer 1 if $r_3\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3\right)$ and one chooses Offer 2 if $r_3\le r_2^{*}\left(r_3,n_3\right)$ .

3) One chooses Offer 1 if $r_4\le r_3^{**}\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3,r_4,n_4\right)$ ; one chooses Offer 2 if $r_4\le r_3^{**}\le r_2^{*}\left(r_3,n_3,r_4,n_4\right)$ ; and one chooses Offer 3 if $r_4\le r_3^{*}(r_{4,}{n}_4)$ .

4) One chooses Offer 1 if $r_{t+1}\le \cdots \le r_4^{**}\le r_3^{**}\le r_2^{**}\le r_1^{*}\left(r_2,n_2,r_3,n_3,r_4,n_4,\cdots ,r_{K+1},n_{K+1}\right)$ ; one chooses Offer 2 if $r_{t+1}\le \cdots \le r_4^{**}\le r_3^{**}\le r_2^{*}\left(r_3,n_3,r_4,n_4,\cdots ,r_{K+1},n_{K+1}\right)$ ; one chooses Offer 3 if $r_{t+1}\le \cdots \le r_4^{**}\le r_3^{*}\left(r_4,n_4,\cdots ,r_{K+1},n_{K+1}\right)$ ; one chooses Offer 4 if $r_{t+1}\le \cdots \le r_6^{**}\le r_5^{**}\le r_4^{*}\left(r_5,n_5,r_6,n_6,\cdots ,r_{K+1},n_{K+1}\right)$ ; and so on, then one chooses Offer t if $r_{t+1}\le r_t^{*}\left(r_{K+1},n_{K+1}\right)$ .

5) One chooses Offer $t+1$ if $r_{t+1}>r_t^{*}\left(r_{K+1},n_{K+1}\right)$ and there is one $r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_{K+1},n_{K+1}\right)$ .

Case 2 where there is no change in the decision of offer.

If there is no change in the decision of the offer, from above proof of case 1 means that there is only one variant at any state and $r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_m,n_m\right),t=1,2,3,\cdots ,$ $m$ does not exist trivially.

4. Empirical Results and Analysis

In this section, the data needed to get information for learning the switch of offers has been generated using the dynamic programming model. This is based on expected profit generated (in ₤). Some results generated by the model are shown in the following tables. We first defined β = 0.5 for 2 and 3 variants in the model. Then defined β = 0.999 for 4 variants. We have subtracted the “fee” from the model, hence the values shown are not the full profits. Please note the choice of β = 0.5 and 0.999 was based on the purpose to illustrate the profit generated at 50% discounting factor and almost 100% discounting factor.

4.1. Two Variants Case

If there are 2 variant of products (5% and 10% interest rates), then variant 5%

will be chosen if $\frac{r_1}{n_1}{P}_1>\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2$ and otherwise, variant 10% will be chosen if $\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2>\frac{r_1}{n_1}{P}_1$ .

Table 1 and Table 2 present some of the results generated by the model. The bold in the row is the point when the switch of offers occurs. We choose $r_1=3$ and $n_1=10$ to represent a case where one’s belief of the acceptance of variant

5% is $p_1=\frac{3}{10}$ .

Table 1. Part of results generated by the acceptance model when P₁ = 10.000, P₂ = 25.000, β = 0.5, m = 45, p = 10.

Table 2. Part of results generated by the acceptance model when P₁ = 10.000, P₂ = 25.000, β = 0.5, m = 45, p = 10.

Table 3 and Table 4 present a case where one’s belief of the acceptance of

variant 5% with the ratio of $p_1=\frac{1}{2}$ and some of the belief points at which the

offer decision changes.

Table 5 and Table 6 present a case where one’s belief of the acceptance of

variant 5% with the ratio of $p_1=\frac{5}{6}$ and some of the belief points at which the

offer decision changes.

Table 7 and Table 8 show an example where there is no any point of the switch of offers occurs. That is $r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_m,n_m\right)$ does not exists in any state. We choose $r_2=1$ and $n_2=5$ to represent a case where one’s belief of the

acceptance of variant 10% is $p_2=\frac{1}{5}$ .

Table 3. Changing of offers when r₁ = 1, n₁ = 2, P₁ = 10.000, P₂ = 25.000, β = 0.5, m = 45, p = 10.

Table 4. Changing of offers when r₁ = 8, n₁ = 16, P₁ = 10.000, P₂ = 25.000, β = 0.5, m = 45, p = 10.

Table 5. Changing of offers when r₁ = 5, n₁ = 6, P₁ = 10.000, P₂ = 25.000, β = 0.5, m = 45, p = 10.

Table 6. Changing of offers when r₁ = 15, n₁ = 18, P₁ = 10.000, P₂ = 25.000, β = 0.5, m = 45, p = 10.

Table 7. Offer 5% to all future customers when P₁ = 20.000, P₂ = 50.000, β = 0.999, m = 45, p = 10.

Table 8. Offer 10% to all future customers when P₁ = 20.000, P₂ = 50.000, β = 0.999, m = 45, p = 10.

4.2. Three Variants Case

If there are 3 variant of products (5%, 10% and 15% interest rates), then variant

5% will be chosen if $\frac{r_1}{n_1}{P}_1>\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2$ and $\frac{r_1}{n_1}{P}_1>\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3$ . Variant 10% will be chosen if $\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2>\frac{r_1}{n_1}{P}_1$ and $\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2>\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3$ . Otherwise, variant 15% will be chosen if $\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3>\frac{r_1}{n_1}{P}_1$ and $\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3>\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2$ .

Table 9 and Table 10 presented some of the results generated by the model for three variant of products. The bold in the row is the point when the switch of offers occurs. We choose $r_1=3$ and $n_1=16$ to represent a case where one’s

belief of the acceptance of variant 5% and variant 10% are $p_1=p_2=\frac{3}{8}$ . The

changes of offer shown are from variant 5% to variant 15%.

Table 11 presents some of the results generated by the model for three variants of the product. The bold row is the point when the switch of offers occurs. We choose $r_1=1,n_1=1$ and $r_3=3,n_3=6$ to represent a case where one’s belief

of the acceptance of variant 5% and 15% are $p_1=1$ and $p_3=\frac{1}{2}$ respectively.

The changes of offer are from variant 5% to variant 10%.

Table 9. Part of results generated by the acceptance model when P₁ = 10.000, P₂ = 25.000, P₃ = 35.000, β = 0.5, m = 6, p = 6.

Table 10. Part of results generated by the acceptance model when P₁ = 10.000, P₂ = 25.000, P₃ = 35.000, β = 0.5, m = 6, p = 6.

Table 11. Part of results generated by the acceptance model when P₁ = 10.000, P₂ = 25.000, P₃ = 35.000, β = 0.5, m = 6, p = 6.

Table 12 presents some of the results generated by the model for three variants of the product. The bold row is the point when the switch of offers occurs. We choose $r_1=4,n_1=11$ and $r_2=3,n_2=7$ to represent a case where one’s

belief of the acceptance of variant 5% and 10% are $p_1=\frac{4}{11}$ and $p_2=\frac{3}{7}$

respectively.

Table 13 and Table 14 present a case where one’s belief of the acceptance of

variant 5% with the ratio of $p_1=p_2=\frac{4}{5}$ and acceptance of variant 10% with

the ratio of $p_1=p_2=\frac{3}{8}$ respectively for some of the belief points at which the

offer decision changes.

Tables 15-17, presented here show that there is no any point of the switch of offers occurs. That is $r^{*}\left(n\right)$ does not exists in any state of $\left(r_1,n_1,\cdots ,r_m,n_m\right)$ . In Table 15, we choose $r_2=5,n_2=13$ and $r_3=4,n_3=14$ to represent a case

where one’s belief of the acceptance of variant 10% is $p_2=\frac{5}{13}$ and acceptance

of variant 15% is $p_3=\frac{2}{7}$ . In Table 16, we choose $r_2=6,n_2=15$ and

$r_3=3,n_3=12$ to represent a case where one’s belief of the acceptance of variant

10% is $p_2=\frac{2}{5}$ and acceptance of variant 15% is $p_3=\frac{1}{4}$ . In Table 17, we

choose $r_2=6,n_2=11$ and $r_3=3,n_3=4$ to represent a case where one’s belief

Table 12. Part of results generated by the acceptance model when P₁ = 10.000, P₂ = 25.000, P₃ = 35.000, β = 0.5, m = 6, p = 6.

Table 13. Changing of offers when r₅ = 4, n₅ = 5, r₁₀ = 4, n₁₀ = 5, P₁ = 10.000, P₂ = 25.000, P₃ = 35.000, β = 0.5, m = 6, p = 6.

Table 14. Changing of offers when r₅ = 6, n₅ = 16, r₁₀ = 6, n₁₀ = 16, P₁ = 10.000, P₂ = 25.000, P₃ = 35.000, β = 0.5, m = 6, p = 6.

Table 15. Offer 5% to all future customers when P₁ = 10.000, P₂ = 25.000, P₃ = 35.000, β = 0.5, m = 6, p = 6.

Table 16. Offer 10% to all future customers when P₁ = 10.000, P₂ = 25.000, P₃ = 35.000, β = 0.5, m = 6, p = 6.

Table 17. Offer 15% to all future customers when P₁ = 10.000, P₂ = 25.000, P₃ = 35.000, β = 0.5, m = 6, p = 6.

of the acceptance of variant 10% is $p_2=\frac{6}{11}$ and acceptance of variant 15% is $p_3=\frac{3}{4}$ .

Table 18 shows that as r₁ increases but the rate $\frac{r_1}{n_1}$ and $\frac{r_2}{n_2}$ are fixed, the

crucial value where one changes offers, $r_1^{*}\left(r_2,n_2\right)$ , is monotonically non increasing. We also give results for the effect of more information (increment of

Table 18. Effect of more information on the switch of offers.

r₂) in the table. The $r_1^{*}\left(r_2,n_2\right)$ for n₂ varying from 1 to 16. Note that the hyphen (−) in the table means that there is no changes of the offer occurs where Offer 5% is the only offer.

4.3. Four Variants Case

If there are 4 variants of products, then variant 5% will be chosen if

$\frac{r_1}{n_1}{P}_1>\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2$ , $\frac{r_1}{n_1}{P}_1>\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3$ , and $\frac{r_1}{n_1}{P}_1>\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}\frac{r_4}{n_4}{P}_4$ . Variant 10% will be chosen if $\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2>\frac{r_1}{n_1}{P}_1$ , $\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2>\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3$ , and

$\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2>\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}\frac{r_4}{n_4}{P}_4$ . Variant 15% will be chosen if $\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3>\frac{r_1}{n_1}{P}_1$ , $\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3>\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2$ , and $\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3>\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}\frac{r_4}{n_4}{P}_4$ . Otherwise, variant 20% will be chosen if $\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}\frac{r_4}{n_4}{P}_4>\frac{r_1}{n_1}{P}_1$ , $\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}\frac{r_4}{n_4}{P}_4>\frac{r_1}{n_1}\frac{r_2}{n_2}{P}_2$ , and $\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}\frac{r_4}{n_4}{P}_4>\frac{r_1}{n_1}\frac{r_2}{n_2}\frac{r_3}{n_3}{P}_3$ .

Table 19 presents some of the results generated by the model for four variants of the product. The bold row is the point when the switch of offers occurs. We choose $r_1=2,n_1=2$ , $r_3=1,n_3=7$ , and $r_4=1,n_4=7$ to represent a case where one’s belief of the acceptance of variant 5%, 15% and 20% are $p_1=1$ and $p_3=p_4=0$ respectively. The changes of offer are from variant 5% to variant 10%.

Table 20 presents some of the results generated by the model for four variants of the products. The bold row is the point when the switch of offers occurs. We choose $r_1=4,n_1=6$ , $r_2=2,n_2=6$ and $r_4=2,n_4=3$ to represent a case where

one’s belief of the acceptance of variant 5%, 10% and 20% are $p_1=p_4=\frac{2}{3}$ and $p_2=\frac{1}{3}$ respectively. The changes of offer shown is from variant 5% to variant

15%.

Table 21 presents some of the results generated by the model for four variants of the products. The bold row is the point when the switch of offers occurs. We

Table 19. Part of results generated by the acceptance model when P₁ = 20.000, P₂ = 50.000, P₃ = 80.000, P₄ = 100.000, β = 0.999, m = 3, p = 2.

Table 20. Part of results generated by the acceptance model when P₁ = 20.000, P₂ = 50.000, P₃ = 80.000, P₄ = 100.000, β = 0.999, m = 3, p = 2.

Table 21. Part of results generated by the acceptance model when P₁ = 20.000, P₂ = 50.000, P₃ = 80.000, P₄ = 100.000, β = 0.999, m = 3, p = 2.

choose $r_1=5,n_1=6$ , $r_3=6,n_3=7$ , and $r_4=6,n_4=7$ to represent a case where

one’s belief of the acceptance of variant 5%, 10% and 20% are $p_1=\frac{5}{6}$ and $p_3=p_4=\frac{6}{7}$ respectively. The changes of offer shown is from variant 5% to

variant 20%.

Tables 22-24 shown that the changes of offer is from variant 10% to variant 15%, variant 10% to variant 20% and variant 15% to variant 20% respectively.

Tables 25-28 presented here show no point for the switch of offers. That is $r_t^{*}\left(r_{t+1},n_{t+1},\cdots ,r_m,n_m\right)$ does not exist in any state of $\left(r_1,n_1,\cdots ,r_m,n_m\right)$ .

Table 22. Part of results generated by the acceptance model when. P₁ = 20.000, P₂ = 50.000, P₃ = 80.000, P₄ = 100.000, β = 0.999, m = 3, p = 2.

Table 23. Part of results generated by the acceptance model when P₁ = 20.000, P₂ = 50.000, P₃ = 80.000, P₄ = 100.000, β = 0.999, m = 3, p = 2.

Table 24. Part of results generated by the acceptance model when P₁ = 20.000, P₂ = 50.000, P₃ = 80.000, P₄ = 100.000, β = 0.999, m = 3, p = 2.

Table 25. Offer 5% to all future customers when P₁ = 20.000, P₂ = 50.000, P₃ = 80.000, P₄ = 100.000, β = 0.999, m = 3, p = 2.

Table 26. Offer 10% to all future customers when P₁ = 20.000, P₂ = 50.000, P₃ = 80.000, P₄ = 100.000, β = 0.999, m = 3, p = 2.

Table 27. Offer 15% to all future customers when P₁ = 20.000, P₂ = 50.000, P₃ = 80.000, P₄ = 100.000, β = 0.999, m = 3, p = 2.

Table 28. Offer 20% to all future customers when P₁ = 20.000, P₂ = 50.000, P₃ = 80.000, P₄ = 100.000, β = 0.999, m = 3, p = 2.

5. Conclusion

From the results, we can clearly see that there is at most one point of switch offers. No matter how many variants of the product offered, the switching offer will not more than one. Based on this observation, the model can tell the best offer to extend to the next customer in an efficient manner and maximise the profit earned. Hence the model is able to identify the best offer for variants of credit cards. Further research would be to test this on different financial products like mortgages.

Acknowledgements

This research is supported by the Research University Grant Scheme (RUGS) 05-02-12-1869RU.

Disclosure Policy

The authors declare that there is no conflict of interest regarding the publication of this paper.

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Stango, V. (2000) Competition and Pricing in the Credit Card Market. The Review of Economics and Statistics, 82, 499-508. https://doi.org/10.1162/003465300558858
[2]	Grodzicki, D. (2012) The Evolution of Competition in the Credit Card Market. Working paper. Stanford University, Palo Alto, CA.
[3]	Keeney, R.L. and Oliver, R.M. (2005) Designing Win-Win Financial Loan Products for Consumers and Business. Journal of the Operational Research Society, 56, 1030-1040. https://doi.org/10.1057/palgrave.jors.2601992
[4]	Seow, H.-V. and Thomas, L.C. (2006) Using Adaptive Learning in Credit Scoring to Estimate Take-Up Probability Distribution. European Journal of Operational Research, 173, 880-892. https://doi.org/10.1016/j.ejor.2005.06.058
[5]	Ma, P., Crook, J. and Ansell, J. (2010) Modelling Take-Up and Profitability. Journal of the Operational Research Society, 61, 430-442. https://doi.org/10.1057/jors.2009.33
[6]	Bellman, R. (1957) Dynamic Programming. Princeton University Press, Princeton, NJ.
[7]	Puterman, M.L. (1994) Markov Decision Process: Discrete Stochastic Dynamic Programming. John Wiley & Sons, Inc., Hoboken, NJ.