Abstract
In this study, the variables that affect the International Outlook of Universities are examined. The international outlook was treated as a dependent variable. Teaching, research, citation and industry income, GCI, critical thinking in teaching, freedom of the press, judicial independence, HDI, GNI, Gini coefficient, gender inequality index, unemployment youth, and share of seats in parliament (% held by women) were treated as independent variables. Fourteen indicators measured by three different organizations which are UNDP, WEF, and THE were selected. The data used in the research were from 57 countries and 1,133 universities. Therefore, for data analysis, a two-level hierarchical linear model was conducted. The differentiation in the international outlook scores of universities by country was found to be significant. The empirical outcomes of this study will make important contributions to both top-level decision-makers and students who will select a university to study.
Keywords
Introduction
Knowledge is power says F. Bacon, who contributed to the conception of the age with his ideas on methodology and knowledge. Knowledge here is scientific knowledge. Scientific knowledge is mostly produced in universities—institutions of higher education. In the strictest sense of the word, higher education stands for higher teaching and learning activities in terms of the level and quality of such activities. In this sense, institutions of higher education are the leading organizations of producing, communicating (teaching), and sharing (spreading) high-quality and high-level scientific knowledge. The institutions of higher education which produce technology with systematic knowledge, in particular, have built an outlook with their reputation in the international domain. This international outlook gave rise to the concept of internationalized university, creating both competition and cooperation among universities. International outlook, combined with the concept of globalization, has provided universities with prestige, economic and political power. When the global circulation of information and technologies produced by the institutes of higher education is considered particularly in terms of their relation to political power, one can see that Foucault’s idea that knowledge rests on solid ground. Therefore, even if the concept of international outlook has a positive meaning in the context of the institutions of higher education, it also has negative connotations. The most striking one among those negative connotations is that internationalized universities where high-level and high-quality knowledge is produced degrade multiculturalism, contrary to popular belief. Another negative connotation is that internationalized universities serve the rulers who aim to shape society.
It is largely inevitable for many young people to aspire to an education in a high-quality higher education institution for a lot of reasons. For example, the global circulation of knowledge has increased the options of higher education bodies that individuals can choose. It has become a subject of study and discussion to define the criteria for a high-quality higher education institution. At this point, it has become reasonable to sort universities by objective criteria without any subjectivity. Education systems have been created to rank universities worldwide by different criteria (The Times Higher Education University Rankings-THE, CHE Ranking, Academic Ranking of World Universities-ARWU). The ranking systems are “used in many national systems to provide data supporting student choice making and in some nations guide allocations of public funds and also simply to feed public appetites for data on institutional status” (Marginson & van der Wende, 2007, p. 319). However, Taylor and Braddock (2007, p. 245) offer “how an ideal international university ranking system might look, concluding with some comments on the uses of ranking systems.” Amsler and Bolsmann (2012, p. 283) in their article “conclude by arguing that, rather than regarding world university rankings as a means to establish criteria of educational value, the practice may be understood as an exclusionary one that furthers the alignment of higher education with neoliberal rationalities at both national and global levels.”
Innovative knowledge produced at a macro level in universities, and social, cultural, and economic outputs based on such knowledge drag countries to an inevitable competition of welfare. This global competition changes and increases the demands of individuals before society. In this sense, higher education institutions represent the momentum of both social matters such as gender inequality, freedom of the press, judicial independence and human development and economic mobility such as inequality of income distribution, unemployment, and gross national income per capita. Governments also try to maintain their reputation in the international domain by funding (subsidizing) higher education bodies. The desire of individuals to receive higher education at micro-level determines the development policies of countries at a macro level.
The attractiveness of the production of knowledge started locally by universities has made the international outlook of universities significant at a global level. For this reason, how the international outlook performance indicator for higher education bodies is defined and how the performance indicators of countries in the fields of economy, human development, and education affect the international outlook scores of universities are important parameters.
International Outlook of Universities
A 21st-century individual is a part of a multicultural world. In this respect, carrying out internationally inclusive higher education activities with students and scholars from different cultures gave rise to the concept of international outlook of universities.
Rating more than 1,300 universities to provide organizations with data on the world’s most effective universities, the London-based higher education rating organization Times Higher Education (THE) defines the international outlook performance as follows: First of all, “the performance indicators are grouped into five areas: “the ability of a university to attract undergraduates, postgraduates and faculty from all over the planet is key to its success on the world stage. The international outlook indicator has been composed of three subcomponents: staff, students and research. Proportion of international students is 2.5%, international staff 2.5% and international collaboration 2.5%” (THE, 2019).
International Views of Countries
Sociocultural and socioeconomic indicators of the country of a university are among the factors that affect the international outlook of universities. For this reason, outlooks of countries, as well as universities in areas such as education, health, law, economy, and human development, are considered important. The OECD’s Programme for International Student Assessment (PISA), which measures 15-year-olds’ academic performance across dozens of countries is an example of an influential global performance indicator (Aytug et al., 2018). Organizations such as the World Economic Forum (WEF), World Justice Project (WJP), United Nations Development Program (UNDP), Organization for Economic Cooperation and Development (OECD), World Health Organization (WHO), and International Monetary Fund (IMF) provide countries with strategically significant data, allow decision-makers to make comparisons and help them set new objectives at the micro and macro level. Therefore, relevant organizations keep sociocultural and socioeconomic indicators for countries up to date. Also, measurement methods for indicators are being discussed in the literature.
A Brief Theoretical Background of Global Rankings
The university rankings first appeared in the 1870s to notify academics, practitioners, professionals, and government officials of higher education (Dearden et al., 2019). ARWU (2019) is the first world-known university ranking and starting from 2003 and funded by the Chinese government (Hazelkorn & Gibson, 2017). Another well-known world ranking is THE. It was published between 2004 and 2009 in association with Quacquarelli Symonds—QS (Pavel, 2015). AWRU, THE, QS, HEEACT (Higher Education Evaluation & Accreditation Council of Taiwan), CWTS (Centre for Science and Technology Studies), webometrics ranking by Spanish National Research Council have developed many benchmarks and rankings which are based on these benchmarkers. Although these rankings are not the sole criteria for the quality and reputation of a university, they may offer valuable quantitive date in regional and global rankings. Furthermore, the internationalization of higher education is vigorously encouraged by most governments around the World (Han & Zhong, 2015). As Marginson and van der Wende (2007, p. 309) emphasized that the global ranking indicators immediately secured great prominence in higher education, policy, and public arenas and have already had discernable effects in institutional and policy behaviors.
It seems that such new styles of objectifying academic excellence change local academic hierarchies and internal dynamics in universities (Ishikawa, 2009). However, the main purpose of the ranking of a university is not to be recognized as an international institution. It can be used as “the integration of international, intercultural or global dimensions into the aims, functions, and presentation of education” as a development tool (Knight, 2015, p. 108). Because the claim that international ranks accurately captures higher educational excellence is often seen as overstated, as the commensurate measurement in ranking tables is often narrow or even misleading (Allen, 2017). There is considerable criticism of university rankings. Simon Marginson’s analysis showed that there is no perfect ranking, and each of the best-known global rankings has its advantages and shortcomings (Boyadjieva, 2017).
Aim of the Study
The focus of this study is not to discuss the indicators that the said organizations share with the public. In this study, the variables that affect the International Outlook of Universities are examined. However, this study treats a part of the data shared publicly by such organizations as independent variables and analyzes the international outlook scores of universities at a two-stage level. Therefore, the fundamental question of the present study was as follows:
Is the international outlook variable (as an outcome variable) predicted by
One should keep in mind that predictor variables across a university or a country, which affect the international outlook of a university, are likely to be subject to different outcomes and interpretations in the long run. The empirical outcomes of this study will make important contributions to both top-level decision-makers and students who will select a university to study.
Method
A different and separate methodology regarding the indicators handled in the study has not been considered. Most ranking agencies’ websites have presented information on their methodology. Researchers can access to these methods on the agencies’ websites. All sequencing methodologies and indicators in this study are based on the data input from a number of external sources.
Sampling and Instruments
No measurement tool was used in the study. The data used in the study were obtained from the databases on the official websites of the relevant organizations (THE, 2019; WEF, 2018; UNDP, 2017). Descriptive information about the examples and data are available in Table 1.
Descriptive Information About Sampling and Data.
Fourteen indicators measured by three different organizations were selected. The first four of these indicators are measurements of the qualities of the universities. The remaining 10 indicators are related to the socio-cultural and economic qualities of countries. The data used in the research were collected from 57 countries and 1,133 universities. The number of universities by country is given in Table 2. The countries that were included in the sample set were represented by a minimum two and maximum 172 universities.
Number of Universities by Countries.
Data Analysis
Since many indicators display a strong correlation with economic development, the aim is to evaluate the most important indicators to represent the global ranking. The international outlook was discussed as a dependent variable. Teaching, research, citation and industry income, GCI, critical thinking in teaching, freedom of the press, judicial independence, HDI, GNI, Gini coefficient, gender inequality index, unemployment youth, and share of seats in parliament (% held by women) were treated as independent variables. A multi-level structure employed in the study with measurements of 14 indicators was found with no missing at the first level and 57 universities at the second level. Therefore, for data analysis two-level hierarchical linear model was conducted.
Hierarchical Linear Modeling (HLM)
HLM is applied to nested structured data. When data are nested, observations or units or cases cannot be sampled independently of the others. In the event that this situation is overlooked, statistical analysis can bring about the detection of differences that do not really exist, resulting in inflation of the type 1 error rate (Williams, 2003). The utilization of classical methodologies with most monitoring data yields biased predictions of the relations among factors or variables (Willms, 1999). HLM is utilized to examine the impacts of predictor factors on various levels on one dependent variable on level 1. As shown in Figure 1, universities are nested within countries.

Hierarchical data structure.
As found in Figure I, A two-level model in Hierarchical Linear Modeling comprises two sub-models at university level and country level. In level-1, international outlook scores are predicted as a function of the university’s teaching, research, citation, and industry income. In level-2, international outlook scores are predicted as a function of the country’s socio-economic and socio-cultural indicators (e.g., the global competitiveness index, Gini coefficient, human development index). Hence, data were tested with a completely conditional model (intersection and slopes as result model) used by HLM.
On the level-1 (university level) analysis is like that of Ordinary Least Squares regression-OLS (Raudenbush & Bryk, 2002). Dependent or outcome variable is international outlook scores measured at the university level, in this research. In level-1, independent variables or predictors are teaching, research, citation, and industry income scores. The university level could be defined as:
where Yij represents the international Outlook score of i. university in j. country,
B1j, B2j, B3j, and B4j the intercepts predicted at level-1 are utilized as a result variable (international outlook scores) in the level-2 equation.
Findings
According to the random influence one-way ANOVA modeling, intraclass correlation coefficient is 0.73 [U0/(U0 + R) = 344.86/(344.86 + 124.48)]. A 0.73% of the variance in the international outlook scores are at the country level due to the difference between countries. On the other hand, 27% of the variance in international outlook scores is at the university level due to the difference between universities. It is thought that variance could be clarified utilizing university and country-level predictor variables. For this reason, predictor variables at the university and country-level were added. Table 3 shows the result of HLM analyses.
Outcome of level-1 and 2 models in HLM.
p < .05.
Overall, the mean international outlook scores for universities across counties were significantly different from zero (G00 = 52.017, p < .05). A remarkable impact of the GCI scores on average international outlook scores for universities was observed (G01 = −1.592, p < .05). It was observed that teaching and citation scores measured for the universities had a positive and significant effect on the differentiation of the international outlook scores by country (G10 = 0.351 and G30 = 0.176, p < .05). However, research and industry income scores measured for the universities were not found to have a significant effect on the differentiation of international outlook scores (p > .05). The variables “critical thinking in teaching” and “judicial independence” had a significant effect on the teaching scores of the universities (p < .05).
Only the variable “critical thinking in teaching” had a significant effect on the research scores of the universities (p < .05). Only the variable “judicial independence” had a significant effect on the citation scores of the universities (p < .05).
None of the second-degree predictor variables had a significant effect on the industry income scores of the universities (p > .05). The Variance components for the variance in the international outlook scores of the universities are indicated in Table 4.
The Variance Components for in the International Outlook Scores of the Universities.
The universities showed a significant variance in their international outlook scores based on their countries (χ2 = 2603.78, p < .05). When first-degree and second-degree predictor variables were added to the model, the amount of variance for the international outlook scores of universities declined. Thus, 38% [(124.488−76.961)/124.488] of the variance in the international outlook scores of the universities were explained by country-related predictors and 62% by university-related predictors. In addition, the reliability estimate for the average international outlook score was found to be as high as 0.91.
Discussion and Conclusion
Economists and politicians have long been involved in the evaluation of the global ranking of countries as global rankings indicators are popular in many markets, such as places to live (e.g., Money), restaurants (e.g., numerous city magazines), hotels (e.g., travel + leisure), and cooking products (Dearden et al., 2019). The following discussion can be considered to be complementary. The differentiation in the international outlook scores of universities by country was found to be significant. Therefore, the possibilities of the countries regarding international students, international staff, and international collaboration are decisive in their international outlook. The global competitiveness indicator was found to have a negative yet remarkable effect on the international outlook scores of universities by country. This is an interesting outcome. While global competitiveness increases, the international outlook of the universities declines. Jabnoun (2009) found that “the number of top-ranked universities per country increased with gross domestic product (GDP) and lack of corruption, but decreased with decreased press freedom.”
It was observed that international outlook scores of the universities by country were affected significantly by the learning environment quality of the universities. Also, a national education system that promotes creative and critical thinking and that is independent of the effects of the judicial system, government, individuals, and companies significantly affected the teaching quality of the universities. According to the report “New vision for education unlocking the potential of technology, critical thinking is the ability to identify, analyze and evaluate situations, ideas and information in order to formulate responses to problems” (WEF, 2015). In this sense, a national education system that supports critical thinking skills makes a positive contribution to the quality of research activities of the universities in that country.
Citations made through universities were found to be a predictor of the international outlook of the universities. It was also observed that independence of the national judicial system from the effects of the government, individuals, or companies was a significant predictor. A similar conclusion was made by Baykal (2017), who found a positive, medium-level, and significant relation among the international outlook, citations, and research of a country. Citations are a measure of the references made to a study and its authors. An independent judicial system is decisive for securing and supervision the ideas in potential violations of the rights (e.g., plagiarism) of the authors of a study. In this sense, an independent judicial system is required to ensure that citations are made without plagiarism and that seeking justice in case of plagiarism is based on impartial and independent legal grounds. Therefore, this correlation between the citations and the independence of the judicial system is a significant one.
The research consists of volume, income, and reputation was not found to have a significant effect on the international outlook scores of the universities. Also, industry income (knowledge transfer) was no significant effect on the international outlook scores of the universities. Pietrucha (2018, p. 1138) has shown in his/her study that
“the position of universities from a country in the ranking is determined by the following variables: economic potential of the country, research and development expenditure, long-term political stability (freedom from war, occupation, coups and major changes in the political system) and some institutional variables, including government effectiveness and regulatory quality.”
In the present study, the indicators of freedom of the press, HDI, GNI, Gini coefficient, gender inequality index, unemployment youth, and share of seats in parliament (% held by women) observed for countries were not found to have a huge effect on the international outlook scores of the universities. In other words, it is fair to say that the content of the international outlook scores, one of the criteria for ranking universities, is independent of these indicators. One can say that the indicators of freedom of the press, HDI, GNI, Gini coefficient, gender inequality index, unemployment youth, and share of seats in parliament (% held by women) were predominantly considered socioeconomic problems of the countries rather than factors that affect the international outlook rankings of the universities worldwide.
It is necessary to systematically study and understand the international strategies used by other universities worldwide for the sustainable international growth of any university (Han & Zhong, 2015). As Tilak (2016, p. 137) emphasized “world-class universities cannot be built overnight and the concept of the world-class university cannot be unique; each country has to define the nature and scope of a world-class university that it develops that helps national development and simultaneously addresses global issues, and at the same time, it may have to be comparable with others.”
Eventually, as this study points out the multitude of increasingly prominent indices and national rankings, the sophistication of their measurement, and the overlap between the data they contain, indicated that it was useful to see if the critical details contained in these various metrics can be extracted.
