The Determinants of Student Satisfaction Acquired by University Education: The Case of the Hellenic Open University ()
1. Introduction
In the happiness/well-being literature, life satisfaction is the combined effect of distinct life areas, called domains. Such domains are income, health, education, having children, housing, job satisfaction, etc. [1] [2] . Total satisfaction may or may not vary overtime, as an individual ages. Some researchers suggest that total satisfaction is a U shaped curve, others claim the opposite i.e. that it is an inverted U shaped curve, while some others find it remains relatively constant [3] . The same trichotomy of views applies for satisfaction arising in each domain, as well as on the relative importance of each domain [4] . Total life satisfaction, however, can be explained as a product of domain satisfactions (e.g. as a weighted average of domain satisfactions) although the relationship between domain satisfactions and total satisfaction may not be a straightforward one [5] . This debate in the literature, resulted in several research papers that examine how domain satisfactions shape overall life satisfaction in a point in time or during lifetime. For example, Loewe et al. [6] have shown that a person’s life satisfaction can be predicted by four main domains (finances, family life, work, and health) while Easterlin and Sawangfa [7] have shown that the life-time satisfaction pattern can be predicted as the net effect of these four domains.
Another subset of literature focuses on the factors that may affect a domain satisfaction. The most notable example is the voluminous literature on job satisfaction1. It is plausible that received education may be also viewed as a domain of total life satisfaction and be analysed in a similar way.2 The examination of student satisfaction could be useful for several reasons. First, it may provide information about overall life satisfaction and thus help in formulating economic policies that aim to improve the welfare of a country. Secondly, it may conclude a set of guidelines, as a rule of thumb, to those designing national educational policies, and third, by identifying the variables affecting student satisfaction3, it could lead universities to a better customization of their services so that they will increase student retention rates, achieve higher future enrollments, and thus secure the viability of their operations.
2. Study Design
2.1. Variables and Data
Along the lines of previous studies on job satisfaction we assume that student satisfaction depends upon a number of variables. Thus, we model student satisfaction as a production function, where student satisfaction is the output and determining factors are the inputs:
where Xi are variables depending upon the personal characteristics of students i.e. age, sex, marital status, motivation for study, effort, income, etc. and Yi are variables determined by the university, i.e. books, tutors, academic coordinators, university administrative services, and the Programme website4. For our purposes we use survey data collected through questionnaires, during the academic year 2014-15. Students were asked to self-report two facets of their satisfaction. These were 1) satisfaction acquired by the level of knowledge provided during university years and 2) satisfaction obtained by the prospects for career development after graduation. We believe that the first one, “Level of knowledge” may be the most important of the two measures of satisfaction but the inclusion of the other measure is intended to investigate differences in these measures.
The relevant inputs (variables), for which we collected data, can be grouped in five categories: personal; family; resources; effort; motivation, as shown in Table 1.
The questionnaire we used in this study is “homemade”. Although there is significant experience with students’ evaluations of teaching (SET) and students’ evaluations of educational quality (SEEQ) [13] , our own interest is not in students’ evaluations but in student satisfaction. It is very likely that evaluation and satisfaction are related but our focus is exclusively on satisfaction and thus we created a questionnaire specific for that purpose.
Respondents were 470 students of the BA in Business Administration Programme at the Hellenic Open University. The questionnaire was administered during the 4th and 5th student meetings (March and May) in Athens and Thessaloniki. Of the 470 students, 113 attended Year 1 (they had completed less than 3 modules), 245 students attended Year 2 (had completed 3 - 5 modules), 56 students attended Year 3 (had completed 6 - 8 modules), and 52 students attended Year 4 (had completed 9 or more modules).
2.2. Method
As in similar studies of satisfaction, we use ordinal logit regression. This regression model is useful when the dependent variable consists of several discreet outcomes that can be ordered. In our case, the outcomes are ordered from 1 (very much dissatisfied) to 7 (very much satisfied). This model allows us to estimate the probability that a given outcome may occur:
where m is the number of categories,
is a cutoff point (used to differentiate the boundaries between the m categories),
is an array of independent variables, and
is the array of estimated coefficients.
The raw coefficients of the ordinal logit model are not readily interpretable. A raw coefficient (e.g. of age) shows the change in the log odds ratio induced by a change by 1 unit of the independent variable. The (log) odds ratio is defined as
Table 1. Variables used in the study.
the (log of) probability of an outcome (given the explanatory variables) divided by the probability that the outcome does not occur. For example, the logit coefficient shows the effect of an age change of one year as follows.
where m is one of the ordered categories used.
In our study that we have seven ordered categories, the coefficient of age shows the change (incurred by an increase in age by 1 year) in the log odds of an outcome being less than or equal to 7, 6, 5,…,1; i.e. being in a lower category. For example, a change of one year in age would alter a student’s log odds of being in a lower category by an amount equal to the estimated coefficient for age, βage. We can simplify this expression my removing the logarithm: The odds of being in a lower category equals
.6
Even though the raw coefficients are not intuitively interpretable, the ordinal logit model allows us to compute estimated probabilities of all seven satisfaction outcomes based on any combination of values of the independent variables. From those we can compute the expected satisfaction score of an individual with specific characteristics, using the formula
, as will be shown below. For a detailed analysis of ordinal logit regression, see Long and Freese [14] .
3. Data Analysis
3.1. Descriptive Statistics
Table 2 provides the descriptive statistics of our sample (columns 2 - 6) and of the subsample used for the regression (columns 7 - 10).
There are some significant mean differences among males and females in our sample (n = 470). Females are older; mean age of females is 36.4 years, while mean age of males is 35.2 years (p < 0.01). This might be due to pregnancy, giving birth etc. that delay females in their studies. Females report larger annual net individual income (?9,847 vs ?4,498 of males, p < 0.05), and larger household income (?0,425 vs ?6,448 for males, p < 0.01). This is a puzzling finding as the literature usually suggests that the opposite holds. Females also have more work experience (15.3 years vs 13.4 yrs for males, p < 0.01), probably because of the obligatory military service (12 - 24 months) for men.
3.2. Regression Results
Table 3 presents the ordinal logit regression results. Coefficients show the change in the log of the odds ratio induced by a change by 1 unit in an explanatory variable.
We first focus our analysis on Model 1, i.e. the one in which the dependent variable is satisfaction from the level of knowledge provided during university years. In Table 2, it is shown that university resources such as books, tutors and website are critical in shaping reported satisfaction.7
Table 4 presents the maximum score that can be attained in student satisfaction from the level of knowledge attained if the university improves its books, tutors, and website so that students assess them with the maximum score (i.e. 7). Calculations have been made based on the regression results, and keeping the other variables at their sample mean value. It is impressive that the probability of very satisfied students (categories 6 and 7 combined) can rise from 14.74% to 51.29%, and the probability for satisfied students (categories 5, 6, and 7) can rise from 77.31% to 95.41%).
We may analyse further how much these university resources may affect the satisfaction score from the level of knowledge attained. In Table 5 we provide the predicted satisfaction score for different combinations of scores of these three resources (1 is the maximum). From this table it can be seen that moving from the lowest (“Very negative”) to the highest (“Very positive”) scores of the resources is associated with an increase of 3.18 satisfaction points.
Finally, the ordinal logit model predicts that if the university could focus on improving only one of the three university resources, then this would be associated with an increase in satisfaction by 0.16 (website), by 0.23 (tutors), and by 0.24 (books) points, respectively, above their current mean. These predictions are shown in Table 6, where two out of three variables are kept in their sample mean, and the third is set to “Excellent”. It seems that improving the books or tutor support would have a similar effect on student satisfaction, while a strategy focused on improving exclusively the website would have the least impact.
Gender is a significant factor affecting satisfaction. In both models, females report higher satisfaction (see Table 3). Based on our regression results of model 1, if we keep all other values at their sample mean (i.e. ceteris paribus), the
***means that p value ≤ 0.010; **means that 0.010 < p ≤ 0.050; * means that 0.050 < p ≤ 0.100.
Table 4. Predicted student satisfaction if variables that can be changed by the university get a maximum score by students.
Table 5. Estimated increase in student satisfaction associated with increases in the scores reported on university-controlled variables.
Table 6. Predicted satisfaction in case the university got the best assessment in one only university-controlled variable.
calculated satisfaction score will be 5.01 for females and 4.76 for males. In Table 7 we provide the differences in predicted probabilities of males vs females to report each satisfaction level. It can be seen that, women are less likely to report lower satisfaction scores and also more likely to report higher satisfaction scores.
Our regression results show that satisfaction increases for respondents having young children up to 13 years of age.8 Based on our regression results, it can be calculated that for a student with one child below 7 and one child between 7 and 13, the estimated satisfaction score is 5.10 for males and 5.35 for females, ceteris paribus (all other variables at the sample means).
Another interesting aspect of satisfaction is the effort that is put into the education process. Our regression results (Model 1) suggest that satisfaction from obtained knowledge increases for those who put more effort (i.e. those who study more hours per week), although the actual effect on satisfaction scores is arguably small. Table 8 provides the predicted satisfaction score associated with various levels of effort, ceteris paribus (i.e. all other variables at their sample means).
That might be due to the fact that Hellenic Open University students are usually on full-time employment which makes their education a part-time effort. They often face additional limitations by family obligations and, therefore, the effort that they can make is rather limited as their available time for studies is limited by these obligations.
Interestingly, but not quite unexpectedly, satisfaction decreases for those reporting as their primary motivator for undertaking university study an expected
Table 7. Gender effect on probabilities of reporting each satisfaction level.
Table 8. Satisfaction associated with student effort.
income increase. This might indicate that viewing education as an investment reduces the consumption value (pleasure) that education may provide to the individuals [15] [16] . The other primary motivators included in the regression were related to status, getting education, and skill acquisition; they were all insignificant. Female students primarily motivated by a future income increase, have an estimated satisfaction score of 4.74 vs 5.04 for those having another primary motivator, a difference of 0.30 satisfaction points. The figures for male students are both lower: 4.45 vs 4.79 (and the difference is larger, 0.34 satisfaction points).
It is also interesting to see the effect of age on (estimated) satisfaction levels. Satisfaction from the level of knowledge declines with age, but the rate of decrease is haltered after 40 years of age, as shown in Figure 1.
It is interesting to see how the probability of reporting top and lowest satisfaction changes with age. In Figure 2 it can be seen that the probability of reporting absolute satisfaction declines until about age 37 and from that age the probability of reporting absolute dissatisfaction starts to increase.
In Figure 3, we plot the cumulative probabilities of choosing a specific satisfaction level. The lowest line shows the probability of responding “very much dissatisfied”. The line on top of it shows the combined probability of responding “very much dissatisfied” and “very dissatisfied”, and so on. The flat line on top of all shows the probability (equal to 1) of responding either of the 7 categories. It is evident that older students are generally less satisfied with the level of knowledge provided by the university.
This effect of age is unrelated to work experience, as the latter has been included in the regressors. Satisfaction indeed decreases with work experience, although the effect is much smaller than the effect of age. The effect of age (from
Figure 1. Plot of calculated satisfaction from level of knowledge against age.
Figure 2. Probability of satisfaction from knowledge against age.
Figure 3. Cumulative probabilities of choosing a specific satisfaction level against age.
26 to 50 years) spans about 5.5 satisfaction points, while the effect of work experience (from 1 year to 30 years) hardly spans one satisfaction point. The average student with 1 year of work experience is expected to report a satisfaction level of 5.26 points, while the same student with 30 years of work experience is expected to report a level of 4.33 points.
The majority (59%) of students have no more than 100 books at their homes. Those with 11 - 100 books report lower satisfaction than those having 0 - 9 books. Having more than 100 is not significant in satisfaction. Table 9 provides the predicted satisfaction level according to book ownership.
Table 9. Books owned by students their percentages and predicted satisfaction levels.
As noted above, three out of four motivating factors (i.e., getting education, increasing one’s status, acquiring skills) are nonsignificant in shaping satisfaction. Other nonsignificant demographic factors are marital status and household income. Lyceum final grade is also irrelevant; the educational background of students does not alter their probability of reporting high satisfaction.
Students who report that the cost of studies has lowered the pace of their studies report lower satisfaction, compared to those who report that the cost does not affect the pace or study. The average student of this category has an estimated satisfaction score of 4.75, vs 4.99 for one that her/his pace of study has been unaffected by the cost, a difference of 0.24 satisfaction points. However, students reporting that the cost of studies has made them rush to graduate sooner, have similar probability of being satisfied with those that are not affected by the cost.
Interestingly, the use of external support (e.g. private tutoring) is nonsignificant in shaping student satisfaction from the level of knowledge offered at the BA course. Students who use external support are equally likely to be as satisfied as students who study on their own.9
In model 2 we used the same regressors on the reported satisfaction from career prospects. The results are similar regarding our focus: i.e. university provided materials: students who find the books, website, and tutors helpful still give more positive responses, but here the statistical significance is lower (10%). Interestingly, the use of external support (e.g. private tutoring), affects negatively (10% significance) student satisfaction from career prospects.
The results are similar to Regression 1 regarding gender and age, and children up to 6 years of age. Here though, having older children of 7 - 12 years does not affect satisfaction. Two other notable differences are that work experience and effort (weekly hours of study) are not significant in shaping satisfaction from career prospects. The number of books at home, household income, the way the cost of studies affects pace of study, and the lyceum final grade are also insignificant.
Regarding motivators for study, here the only one that is significant (at the 10% level) is the acquisition of skills; and not the acquisition of education. Students for whom the primary motivator is skill acquisition are more satisfied from their career prospects.10
To conclude, resources offered by the university (hence modifiable by the university) are significant in shaping student satisfaction. External support is either insignificant or negatively affecting student satisfaction. Table 10 summarizes and compares the two models.
At this point it is interesting to compare some representative types of students, to get an idea of how, for example, age or gender would affect the satisfaction responses. Table 11 provides the predicted probability of responses of some representative student profiles and the corresponding calculated satisfaction score for the knowledge level offered at the BA course.
4. Concluding Remarks and Policy Implications
Based on the regression results, and the predicted value of satisfaction across several scenaria, it can be seen that the most significant factors in shaping student satisfaction are the resources that are offered to students by the university (books, tutors, and website). Household income is irrelevant to satisfaction. External support acquired by students through private tutors is insignificant in explaining satisfaction from obtained knowledge, but―interestingly―is associated with reduced satisfaction regarding the prospects of career development after graduation.
Regarding personal and family characteristics, female students, younger students, and students with young children in the household seem to report higher
Table 11. Predicted probability of representative student profiles and the calculated satisfaction score for the knowledge level.
satisfaction. Marital status is irrelevant. Students with more work experience and more books at home report lower satisfaction from knowledge gained.
The motivation to get education and the motivation to get more skills are insignificant in shaping satisfaction from knowledge obtained, but are associated with increased satisfaction from broadening the prospects of career development. The motivation to increase one’s income negatively affects one’s satisfaction from knowledge obtained, and is irrelevant to satisfaction from broadening one’s career prospects. The motivation to increase one’s status is insignificant to satisfaction. The final grade from high school (called Lyceum in Greece) at age 18 is insignificant, too. Finally, the effort (in terms of weekly hours of study) one puts into study is positively associated with satisfaction from obtained knowledge.
Our findings are empowering to universities, since factors that are within university control (books, tutors, and website) seem to be the most important in shaping student satisfaction. They are also empowering to students, since a student’s previous academic record may be unimportant in shaping his/her satisfaction. This could be an indication that all students have equal opportunity to get satisfaction from the knowledge obtained through their studies, regardless of their academic background. Finally, it is very important that external support of studies (e.g. through private tutors paid by students) is irrelevant to the satisfaction from obtained knowledge, but, importantly, affects negatively student satisfaction which is related to the enhancement of career prospects. It might be the case that either the price of external tutoring is too high and/or the career enhancement is negative for those who use external support.
Acknowledgements
This research has been co-financed by the European Union (European Social Fund―ESF) and Greek national funds through the Operational Program ‘‘Education and Lifelong Learning’’ of the National Strategic Reference Framework (NSRF)―Funding Program: ‘‘Hellenic Open University’’.
NOTES
1Similar methods can be used to examine even more peculiar issues; see e.g., Matthews et al. [8] who explore the relationship between specific domains of satisfaction and disordered eating.
2In most of the total life satisfaction studies, education has traditionally been viewed as a domain of life satisfaction. However, education can be seen both as a domain (satisfaction from acquired educational level) or as a process or experience (satisfaction during the process of being educated). Accordingly, the satisfaction of students during their tertiary educational experience could also be seen as one of the main satisfactions shaping their overall life satisfaction. In their four-group taxonomy Veenhoven [9] , and also Stanca and Veenhoven [10] distinguish four types of satisfaction, namely pleasure, domains satisfaction, peak-experience, and life satisfaction. Clearly student satisfaction falls in the domains satisfaction group.
3Student satisfaction depends on both individual characteristics and university or course characteristics [11] [12] .
4Some inputs are fixed (e.g. maths background), some are not; some inputs can be changed by the University, some cannot.
5Respondents could indicate more than one reason as primary.
6In the ordered logit model we may calculate the odds of a student being in a specific category (e.g. to reply a satisfaction score of 4) by
, where
is the estimated cutpoint 4. Each estimated cutpoint is used to differentiate a category from the higher ones. For example, cutpoint 1 differentiates category 1 from categories 2 and above; cutpoint 2 differentiates categories 1 and 2 from categories 3 and above; and cutpoint 6 differentiates categories 1 up to 6 from category 7.
7The sign is negative because 1 shows the most positive effect and 5 the most negative effect.
8We tried the same model with the inclusion of the number of children older than 12. It was insignificant so we dropped it from the final equation.
9It is interesting, nonetheless, that this factor is significant in (negatively) affecting student satisfaction from career prospects (Model 2).
10More results on Model 2 are available upon request.