A Decision-Making Model Based on TOPSIS,WASPAS,and MULTIMOORA Methods for University Location Selection Problem

Abstract

With the growing population increase and following young population’s desire to study at the university, political authorities are supporting university and higher education investments, especially in the last 10 years. This situation has increased the number of universities considerably. Because a university will provide socioeconomic dynamism to both the development of the country and the region, choosing the right university location has become a significant problem nowadays. In line with this, this study is focused on supporting the new university location decision in a wide region in Turkey where currently the number of universities in the region is relatively low despite the high population density in the area. Alternative cities to be utilized in the study are determined particularly taking the demographic structure into consideration and various multicriteria decision-making (MCDM) techniques are applied. Technique for Order Preference by Similarity to Ideal Solution (TOPSIS), Weighted Aggregated Sum Product Assessment (WASPAS), and Multi-Objective Optimization on the Basis of Ratio Analysis (MOORA) are applied to a real case study. Related criteria and alternative locations are specified by consulting seven experts. Within the study, both the results of these methods are presented, and also sensitivity analyses are conducted to observe how sensitive the results are to the changes in the criteria weights. The results obtained are purposed to aid decision makers in this field.

Keywords

decision analysis multicriteria decision-making location selection TOPSIS WASPAS MULTIMOORA

Introduction

Universities are considered fundamental institutions that have major roles in the social, cultural, economic, scientific, and technological progress of a country. A university can basically be defined as a “higher education institution based on scientific information production and constitutes of faculty or another unit which operates in various disciplines” (Bozkurt et al., 1998). While determining the right location for establishing a university, emphasis must be put on the notion of “facility location” because a university is a facility. Facility location has a significant place in planning and has a direct impact on factors which effect planning (Turner, 1987). Thus, particularly since the 1950s and 1960s, planning action has become an important factor in the university concept (Muthesius, 2001). Accordingly, university campus plans are directly linked with modern urban planning and cannot be considered independent from urban plans (Christiaanse, 2006). While taking into consideration the points related to campus/university location selection, and reflecting on these selection issues, it is necessary to admit that the background reasons and results of location selections are not only physical.

Location place decisions can arise from many reasons. The important point is that decision makers should not only choose a location which will perform well but also take into consideration the flexibility to comply sufficiently with the changes in the future. Hence, choosing the facility location place inappropriately will bring along various negativities, particularly increases in costs. Due to these reasons, we can conclude that the selection of the most appropriate location for a facility is of critical importance. More precisely, the sociocultural structure of the city that a university is established in has influence on location selection decisions; therefore, assessing campus/university planning in a broader perspective is vital (Ding & Zeng, 2015). Ensuring the required instructor, management group, and students to a university depends on to the development of the city in many perspectives such as social, cultural, transportation, and economical. In this context, a city where its municipal functions are advanced can serve better to the university and educate the students by catching more qualified instructor and students’ attention. Because the relationships between university and its location place (city) are bilateral, this point makes the social, economic, and cultural infrastructure of the city crucial. In addition to these, by setting up a university in a city, there will be a considerable number of contributions to that city. These contributions can be summarized as follows: Universities create employment within their environments and thus become an economical resource; affect surrounding regions as sociocultural and economically; accelerate the sustainable economic growth; make a major contribution to the human capital inventory; and increase the research and development (R&D) application infrastructure and opportunities.

These points are the motive that makes this study a valuable contribution in determining the most appropriate location for a new university. When literature is analyzed, it is observed that the most discussed topics on university planning in our country are the distribution of the universities domestically and the inner-city location selection (Arap, 2010; Arslan & Yildiz, 2015; Kuyrukcu & Alkan, 2020; Maltas Erol & Ozer, 2018). In general, the city in which university will be established is determined without any standard and almost every county endeavors to attract the new universities to be established to their region with economic, social, and cultural pickup expectations. As well, from the point of country progress, administrators frequently encounter the location selection decision-making problems, which is extremely important.

Decision-making is defined as choosing an activity or a set of activities between possible options, and in the decision-making environment, many problems can be solved simultaneously being transformed into numerical expressions (Athawale et al., 2012). Besides, in the decision-making process, individual preferences can be stated by means of lingual expressions which reflect indefinite values. For this reason, it is generally hard for certainty including mathematical models to deal with such decision-making situations. When considered from this point of view, it is observed that multicriteria decision-making (MCDM) methods are effective in the location selection problems as addressed in this study (Wu et al., 2019). The reasons behind this are that there are many subjective criteria in the evaluation of location place suitability and the weights of these criteria can usually be expressed with lingual terms (Balcik & Beamon, 2008; Keshavarz Ghorabaee et al., 2017b). Suitable location selection can involve various alternatives, several goals (cost minimization, travel distance minimization, service maximization, etc.), and conflicting criteria. In this study, focusing on these points, the present problem is adopted as an MCDM problem and solved utilizing multiple techniques. Although MCDM methods are used for facility location problems in literature, there is still an opportunity to improve the problem addressed in this study. Accordingly, Technique for Order Preference by Similarity to Ideal Solution (TOPSIS), Weighted Aggregated Sum Product Assessment (WASPAS), and Multi-Objective Optimization on the Basis of Ratio Analysis (MOORA) are utilized, and the obtained results are presented by a real case study. Through conducting sensitivity analysis, we aimed to see how sensitive are the results of our approach to the changes in the criteria weights.

In literature, various other MCDM methods such as Evaluation Based on Distance from Average Solution (EDAS; Keshavarz Ghorabaee et al., 2015, 2016, 2017a, 2018), Combinative Distance-based Assessment (CODAS; Simic et al., 2021), Additive Ratio Assessment (ARAS; Karagoz et al., 2021), and measurement of alternatives and ranking according to compromise solution (MARCOS; Pamucar, Iordache, et al., 2020) exist. However, there are multiple advantages of adopted MCDM methods within this study. TOPSIS method is simple, intuitive, and has a comprehensible concept. The logic in this method represents the rationale of human choice, and its computation is easy with good computational efficiency. It reveals a scalar value that accounts for both the best and worst alternatives’ ability, and the method can measure the relative performance for each alternative in a simple mathematical form (Hung & Chen, 2009). WASPAS method is mathematically simple but also it has capability to gain correct results compared with weighted sum model (WSM) and weighted product model (WPM). The method is a combination of these two techniques and enables reaching the highest accuracy of estimation. These characteristics make the technique an effective decision-making tool. Once the decision criteria are determined, experts are consulted to evaluate the alternatives based on the decision criteria (Gokasar et al., 2021, in press; Mishra et al., 2019; Rani et al., 2020). Compared with other MCDM methods, MOORA method has a very less computational time, high simplicity with minimum mathematical calculations, and a good stability. Method takes into consideration various objectives with their own units. Combining the results from different approaches such as MOORA-Reference Point or MOORA-Significance Coefficient, the method forms a guaranty for a solution as nonsubjective as possible (Brauers & Zavadskas, 2012).

Consequently, the remainder of this article is organized as follows. In section “Literature Review,” a literature review of the topic is presented, including adopted methods as well as location selection problems with MCDM methods. Section “Materials and Methods” contains the material utilized in the study and detailed information about the employed MCDM methods. The case study and its results are given in section “Case Study and Results” along with tables indicating supporting results and sensitivity analyses. Final remarks, discussions, and some suggestions for future studies are also specified in section “Results and Discussion.”

Literature Review

Decision problems differ in the methods used and the solutions needed. In cases which have many conflicting criteria/positions, applying an MCDM process to arrive at a solution is appropriate. MCDM is a procedure of specifying the best solution according to the criteria generated. A traditional MCDM problem usually contains alternatives, criteria, and criteria weights. In this study, three MCDM methods were utilized and are summarized below respectively.

The first method, TOPSIS, does not include complex algorithms and mathematical models. In literature, due to reasons such as ease of use, interpreting results readily, and ease of understanding, it is applied extensively. Fields in which this technique is performed include supplier selection (Boran et al., 2009; Kumar et al., 2018; Shahroudi & Tonekaboni, 2012), education (Arslan & Yildiz, 2015; Ding & Zeng, 2015; Kuyrukcu & Alkan, 2020), personnel selection (Akin, 2016; Kelemenis & Askounis, 2010; Matin et al., 2011), corridor selection (Dogan et al., 2020), finance (Amile et al., 2013; Ozen et al., 2015), location selection (Demirel et al., 2016), reliability, availability, and maintainability (RAM) parameter analysis (Panchal et al., 2019), bridge maintenance prioritization (Gokasar et al., 2021), and business and marketing management (Aydogan, 2011; Shyur, 2006; Ye, 2010).

The WASPAS method has been applied in many decision-making problems and environments. Some areas in which this technique is performed include supplier selection (Jayant et al., 2019; Mishra et al., 2019; Singh & Modgil, 2020; Urosevic et al., 2017), airport ground access mode selection (Pamucar, Deveci, et al., 2020), ranking accuracy (Baykasoglu & Golcuk, 2019), personnel selection (Karabašević et al., 2016), fuel technology selection (Rani & Mishra, 2020), physician selection (Rani et al., 2020), resource allocation (Shaaban et al., 2019), production quality (Prajapati et al., 2019), strategy selection (Emovon et al., 2018), qualitative risk analysis (Badalpur & Nurbakhsh, 2019), measurements (El-Santawy & Mohamed, 2019), software selection (Tus & Adalı, 2019), and indoor environment (Zavadskas et al., 2016).

The MOORA and its extension MULTIMOORA method is popularly utilized in practice due to its simple application procedure, pertinence to various conditions, and advances through empirical observation. Examples of fields in which this method can be applied include process parameter selection (Majumder et al., 2019), occupational health and safety risk analysis (Dabbagh & Yousefi, 2019), performance measurements and selection (Hanifatulqolbi et al., 2019; Kuvat & Demir, 2020; Yilmaz, 2019), alternative selection (Brauers & Zavadskas, 2006; Karuppanna & Sekar, 2016; Pathapalli et al., 2020; Pérez-Domínguez et al., 2018; Sahida et al., 2019), material selection (Nori et al., 2018; Patnaik et al., 2020), and supplier selection (Jayant et al., 2019).

Furthermore, to gain a better understanding of the subject, related literature based on MCDM-oriented location selection studies was also reviewed. Table 1 below summarizes location selection papers utilizing various MCDM methods highlighting case study area, number of main and subcriteria, uncertainty, and applied techniques.

Table 1.

Summary of MCDM-Based Location Selection Studies.

Author(s)	Year	Case study	Main criteria	Subcriteria	Alternatives	Uncertainty	Types of uncertainty	MCDM methods
Chen and Qu	2006	Logistics center location	6	15	3	Yes	Triangular fuzzy numbers	AHP
Onut et al.	2010	Shopping center location	8	—	6	Yes	Triangular fuzzy numbers	AHP and TOPSIS
Ertugrul	2011	Textile company location	5	—	3	Yes	Trapezoidal fuzzy numbers	TOPSIS
Kuo and Liang	2011	International distribution center location	3	10	6	Yes	Triangular fuzzy numbers	AHP, ANP, TOPSIS, DEMATEL
Mousavi et al.	2013	Manufacturing company location	5	—	3	No	—	AHP, PROMETHEE
Chakraborty et al.	2013	Distribution center location	6	—	4	No	—	GRA, MOORA, ELECTRE, OCRA
Belbag et al.	2013	Potential airport location	9	34	5	Yes	Fuzzy numbers	TOPSIS, ELECTRE
Zak and Węgliński	2014	Distribution center location	9	—	10	No	—	ELECTRE
Mangalan et al.	2016	Warehouse location	5	—	4	No	—	TOPSIS, MOORA
Zečević et al.	2017	Intermodal Transport Terminal Location	6	26	5	Yes	Triangular fuzzy numbers	ANP, VIKOR
C. N. Wang et al.	2018	Solar power plant location	5	15	46	Yes	Triangular fuzzy numbers	AHP, TOPSIS, DEA
Deveci et al.	2018	Car sharing station location	5	9	4	Yes	Interval Type 2 fuzzy sets	WASPAS, TOPSIS
Wu et al.	2019	Offshore wind-PV-seawater pumped storage power plant location	4	19	8	Yes	Triangular intuitionistic fuzzy numbers	TODIM
Mihajlović et al.	2019	Logistics distribution fruit center location	7	—	9	No	—	AHP, WASPAS
Guler and Yomralioglu	2020	Electric vehicle fast charging station location	3	10	10	Yes	Triangular fuzzy numbers	AHP, TOPSIS
Ortega et al.	2020	Park and rice facility location	6	19	15	Yes	Triangular fuzzy numbers	AHP
Sahin	2020	Offshore location	6	32	25	Yes	Triangular fuzzy numbers	AHP, VIKOR, TOPSIS, ELECTRE, PROMETHEE, WSM
Seker and Aydin	2020	Hydrogen production facility location	5	12	4	Yes	Interval-valued Pythagorean fuzzy sets	TOPSIS
Kaya et al.	2020	Electric vehicles charging stations location	5	19	95	No	—	AHP, VIKOR, PROMETHEE
Karasan et al.	2020	Electric vehicles charging stations location	4	21	9	Yes	Interval-valued intuitionistic fuzzy sets	DEMATEL, AHP, TOPSIS
Ulutas et al.	2020	Logistics center location	11	—	12	Yes	Fuzzy numbers	CoCoSo, SWARA
Ghorui et al.	2020	Shopping mall site location	7	17	7	Yes	Triangular fuzzy numbers	AHP, TOPSIS
Supciller and Bayramoglu	2020	Wind farm location	4	18	5	No	—	SWARA, I-GRA, G-EDAS
Deveci et al. 2020	2020	Offshore wind farm site selection	3	24	5	Yes	Interval Type 2 fuzzy sets	TOPSIS, CODAS

Note. MCDM = multicriteria decision-making; AHP = Analytic Hierarchy Process; TOPSIS = Technique for Order Preference by Similarity to Ideal Solution; ANP = Analytic Network Process; DEMATEL = Decision-Making Trial and Evaluation Laboratory; WASPAS = Weighted Aggregated Sum Product Assessment; WSM = weighted sum model; SWARA = Step-Wise Weight Assessment Ratio Analysis; CODAS = Combinative Distance-based Assessment; PROMETHEE = Preference Ranking Organization Method for Enrichment Evaluation; GRA = grey relational analysis; OCRA = operational competitiveness rating analysis; DEA = Data Envelopment Analysis; CoCoSo = Combined Compromise Solution; MOORA = Multi-Objective Optimization on the Basis of Ratio Analysis; ELECTRE = ÉLimination et Choix Traduisant la REalité; VIKOR = VIse KriterijumsaOptimiz acija I Kompromisno Resenje; IGRA = Interval Grey Relational Analysis; G-EDAS = Grey Evaluation Based on Distance from Average Sloution; TODIM = an acronym in Portuguese of interactive and multiple attribute decision making.

Through the literature review, it was seen that only three papers handled education-related problems. Kuyrukcu and Alkan (2020) employed Analytic Hierarchy Process (AHP) and TOPSIS for the location selection of universities; Arslan and Yildiz (2015) adopted fuzzy TOPSIS for the selection of education facilities. Ding and Zeng (2015) evaluated the performance of 68 Chinese universities.

To this end, our contributions compared with existing literature can be summarized as follows:

Despite the work described above, insufficient attention has been paid to education facility location problems in the MCDM perspective in literature. Therefore, this article aims to bridge this gap and provide a resource for similar problems.

Three MCDM methods were applied in this study to increase the effectiveness of results.

Sensitivity analysis for three adopted method is conducted to observe the changes in the alternative rankings.

We consulted various experts in our study who are city planner, civil engineer, geological engineer, municipal official, transportation engineer, environmental engineer, and constable to obtain accurate data about criteria.

Materials and Methods

Material

Table 2 below presents some demographic factors in the two geographical regions of Turkey (Mediterranean and Central Anatolian) including the name of provinces, metropolitan municipalities, geographical regions, number of universities, total population, and number of students attending secondary school and high school. It is seen from Table 2 that there are six metropolitan municipalities in these two geographical regions which have a population of more than 1,500,000 people: Adana, Antalya, Hatay, Mersin, Ankara, and Konya. The reason of excluding Ankara (the capital of Turkey) in this study is that although the capital has a population of more than 5 million people, it has 23 universities (total of public university and foundation university). Hatay province is not included to the study as well because the city is not available to develop geographically, its infrastructure conditions are weak, and more than 400,000 people of the city’s 1.5 million population is consisted of Syrian refugees (Göç İdaresi Genel Müdürlüğü, n.d.). Another metropolitan municipality Mersin is not included to the study due to similar refugee reason with Hatay. The Syrian refugee population in Mersin is more than 200,000 people, and this number corresponds to approximately 12% of the province’s population (Göç İdaresi Genel Müdürlüğü, n.d.). In the light of this information, between the provinces given in Table 2, Adana, Antalya, Mersin, and Konya are included to the case study in this article to determine the best location for a new university.

Table 2.

Some Demographic Factors for Two Geographical Regions in Turkey.

Province	Metropolitan municipality	Geographical region	Number of university	Total population	Students attending secondary school	Students attending high school
Adana	✓	Mediterranean region	2	2,237,940	174,472	158,814
Antalya	✓		5	2,511,700	158,195	167,311
Burdur	-		1	270,796	13,557	15,422
Hatay	✓		2	1,628,894	150,391	127,697
Isparta	-		2	444,914	24,210	27,294
Kahramanmaras	✓		2	1,154,102	102,095	93,189
Mersin	✓		4	1,840,425	133,856	129,393
Osmaniye	-		1	538,759	45,839	42,334
Aksaray	-	Central Anatolia region	1	416,367	29,324	27,773
Ankara	✓		23	5,639,076	346,345	371,499
Cankiri	-		1	195,789	9,371	10,222
Eskisehir	✓		3	887,475	45,711	51,711
Karaman	-		1	253,279	16,160	18,511
Kayseri	✓		4	1,407,409	105,197	107,645
Kirikkale	-		1	283,017	16,179	18,235
Kirsehir	-		1	242,938	13,455	14,734
Konya	✓		5	2,232,374	158,810	161,777
Nevsehir	-		2	303,010	18,928	19,266
Nigde	-		1	362,861	25,063	24,206
Sivas	-		2	638,956	39,165	44,990
Yozgat	-		1	421,200	26,023	27,439

The locations of these cities are shown in Figure 1 below. In Figure 1, the location of geographical regions in Turkey map is given in the upper right-hand corner of the Figure. In the main part, the provinces are demonstrated in these regions and the population of these provinces is indicated by the population density.

Figure 1.

Location of candidate cities for university location selection problem.

In line with the related literature research (Suben (1980), Arap (2010), Aikebaier (2013), Arslan and Yildiz (2015), Maltas Erol and Ozer (2018), Kuyrukcu and Alkan (2020)) and expert opinions, five criteria were utilized to determine the most appropriate location for a new university. The detailed information about the experts is given in Table 3 below.

Table 3.

Detailed Information About the Experts in This Study.

Expert no.	Expertise	Experience (year)	Title	State of education
1	City planner	17	Chief	Bachelor
2	Civil engineer	22	Manager	Master
3	Geological engineer	12	Expert engineer	Bachelor
4	Municipal official	14	Chief	Bachelor
5	Transportation engineer	16	Expert engineer	Master
6	Environmental engineer	22	Expert engineer	Master
7	Constable	8	Commissar	Bachelor

All considered criteria are measured by all evaluators, who consist of experts detailed above with different viewpoints and the criteria are defined as follows:

$C_{1}$ : Demographic structure including the population size as well as the distribution of the population and migration. These data are the population living in the borders of related province and consist of various aspects of population.

$C_{2}$ : Investment costs including facility organization costs and planning costs ($); in other words, total costs associated with the implementation of the project.

$C_{3}$ : The rate of illiterate person (%). While literacy is defined by “the ability to identify, understand, interpret, create, communicate and compute, using printed and written (and visual) materials associated with varying contexts” by United Nations Educational, Scientific and Cultural Organization (n.d.) (https://en.unesco.org/), illiteracy corresponds to the lack of this ability in the population.

$C_{4}$ : Number of graduates including the number of people in high school level education in the related area and potential number of students who can start university.

$C_{5}$ : Yearly income including the yearly income per person in the related area. This is the number when the gross national product of a country is divided by the population of that country.

Data related to criteria and alternatives are presented in Table 4.

Table 4.

Data Related to Alternative Cities (Turkish Statistical Institute, 2020).

Alternatives	Population $(C_{1})$ (person)	Investment costs $(C_{2})$ (×100,000) ($)	The rate of illiterate person $(C_{3})$ (%)	Number of graduates $(C_{4})$ (person)	Yearly income per person $(C_{5})$ ($)
Mersin $(A_{1})$	1,814,468	9	2.7	321,767	18,285
Adana $(A_{2})$	2,220,125	6	4.3	410,691	15,521
Antalya $(A_{3})$	2,426,356	4	1.5	471,787	15,231
Konya $(A_{4})$	2,205,609	4	2.7	345,159	11,637

In line with this information, TOPSIS, WASPAS, and MOORA methods were applied and the results were compared. Detailed stages of these methods are presented below, respectively.

Research Methodology

TOPSIS

As one of the most utilized MCDM methods, the TOPSIS technique was developed by Hwang and Yoon (1981). The technique depends on two essential points, positive ideal solution (PIS) and negative ideal solution (NIS); it evaluates alternatives in accordance with specific criteria and then compares them according to an ideal solution between maximum and minimum values of criteria (Yurdakul & Ic, 2003). In other words, the ideal solution is the alternative which is the closest distance to the PIS and at the same time at the outermost distance to the NIS (Cheng et al., 2002; Hwang & Yoon, 1981).

In this method, the best solution is expressed as the ideal or PIS and is one which minimizes cost criteria or maximizes benefit criteria. However, the nonideal or NIS minimizes benefit criteria or maximizes cost criteria. All decision alternatives can be ranked comparing distances (Y. M. Wang & Elhag, 2006).

The application procedure of the TOPSIS method is summed up in the following (Hwang & Yoon, 1981).

After determining decision alternatives and evaluation criteria, a decision matrix comprising of $n$ criteria $(C = c_{1}, c_{2}, c_{3}, \dots, c_{n})$ and $m$ decision alternative $(A = a_{1}, a_{2}, a_{3}, \dots, a_{m})$ (Hwang & Yoon, 1981) is generated.

Stage 1: Decision matrix is created. The decision matrix $(X)$ is generated by decision makers at the beginning of the process. In this matrix, columns state criteria and rows state alternatives. $x_{i j}$ denotes the real value or present performance of $i$ alternative as to $j$ criteria. This matrix is formulized with Equation 1 and stated below:

X_{i j} = [\begin{matrix} \begin{matrix} \begin{matrix} x_{11} \\ x_{21} \end{matrix} & \begin{matrix} x_{12} \\ x_{22} \end{matrix} \end{matrix} & \begin{matrix} \dots \\ \dots \end{matrix} & \begin{matrix} x_{1 n} \\ x_{22} \end{matrix} \\ ⋮ ⋮ & ⋮ & ⋮ \\ \begin{matrix} \begin{matrix} x_{i 1} \\ \begin{matrix} ⋮ \\ x_{m 1} \end{matrix} \end{matrix} & \begin{matrix} x_{i 2} \\ \begin{matrix} ⋮ \\ x_{m 2} \end{matrix} \end{matrix} \end{matrix} & \begin{matrix} \dots \\ \begin{matrix} ⋮ \\ \dots \end{matrix} \end{matrix} & \begin{matrix} x_{i n} \\ \begin{matrix} ⋮ \\ x_{m n} \end{matrix} \end{matrix} \end{matrix}] .

(1)

Stage 2. Normalized decision matrix is formed. After generating a decision matrix, the normalized decision matrix is constituted utilizing Equations 2 and 3 below. If any member of the decision matrix is zero, the value of that member in the standard decision matrix is zero as well.

r_{i j} = \frac{x_{i j}}{\sqrt{\sum_{c = 1}^{m} x_{c j}^{2}}} \forall_{i} = 1, \dots, m; \forall_{j} = 1, \dots, n; \forall x_{i j} \neq 0,

(2)

\forall x_{i j} = 0; r_{i j} = 0; \forall_{i} = 1, \dots, m; \forall_{j} = 1, \dots, n .

(3)

After normalization, the normalized decision matrix is given in Equation 4 in the following:

R_{i j} = [\begin{array}{l} \begin{matrix} \begin{array}{l} r_{11} \\ r_{21} \end{array} & \begin{array}{l} r_{12} \\ r_{22} \end{array} & \begin{array}{l} \dots \\ \dots \end{array} & \begin{array}{l} r_{1 n} \\ r_{22} \end{array} \\ ⋮ & ⋮ & ⋮ & ⋮ \\ r_{i 1} & r_{i 2} & \dots & r_{i n} \\ ⋮ & ⋮ & ⋮ & ⋮ \end{matrix} \\ r_{m 1} r_{m 2} \dots r_{m n} \end{array}] .

(4)

Stage 3. Weighted normalized decision matrix is constituted. This is realized by multiplying predetermined criteria weights $(w_{j})$ (the sum of the evaluation criteria’s weight values should be equal to 1) with the members of R matrix, which is shown in Equation 5 below. With this process, a weighted normalized decision matrix is obtained.

V_{i j} = [\begin{matrix} w_{1} r_{11} & w_{1} r_{12} & \dots & w_{1} r_{1 n} \\ w_{2} r_{21} & w_{2} r_{22} & \dots & w_{2} r_{22} \\ ⋮ & ⋮ & ⋮ & ⋮ \\ w_{i} r_{i 1} & w_{i} r_{i 2} & \dots & w_{i} r_{i n} \\ ⋮ & ⋮ & ⋮ & ⋮ \\ w_{n} r_{m 1} & w_{n} r_{m 2} & \dots & w_{n} r_{m n} \end{matrix}] .

(5)

Stage 4. PIS $(A^{*})$ and NIS $(A^{-})$ sets are constituted. These values are obtained from $V_{i j}$ matrix. If the evaluation criteria are benefit-oriented, PIS $(A^{*})$ is composed of the best values of $V_{i j}$ and NIS $(A^{-})$ is composed of the worst values of $V_{i j}$ . On the contrary, if the evaluation criteria are cost-oriented, then, PIS $(A^{*})$ is composed of the lowest values of $V_{i j}$ and NIS $(A^{-})$ is composed of the best values of $V_{i j}$ . These ideal solutions are calculated by the equations given in Equations 6 and 7 in the following. In both formulas, $J$ and $J^{'}$ demonstrate benefit and cost value, respectively.

\begin{matrix} A^{*} = {(\max_{i} v_{i j} | i \in J), (\min_{i} v_{i j} | i \in J^{'}) i = 1, \dots, m} \\ A^{*} = {v_{1}^{*}, v_{2}^{*}, \dots, v_{j}^{*}, \dots, v_{n}^{*}}, \end{matrix}

(6)

\begin{array}{l} A^{-} = {(\min_{i} v_{i j} | i \in J), (\max_{i} v_{i j} | i \in J^{'}) i = 1, \dots, m} \\ A^{-} = {v_{1}^{-}, v_{2}^{-}, \dots, v_{j}^{-}, \dots, v_{n}^{-}}, \end{array}

(7)

where:

J = {j = 1, \dots, n | c r i t e r i a a r e b e n e f i t - o r i e n t e d};

\begin{array}{l} J^{'} = {j = 1, \dots, n | c r i t e r i a a r e c o s t - o r i e n t e d} a n d \\ J \cap^{} J^{'} = \emptyset \land J \cup^{} J^{'} = {1, \dots, n} \end{array}

Stage 5. Separation measures are calculated. In the TOPSIS method, for each alternative $(A_{i})$ , there are two separation measures called positive ideal separation $(S_{i}^{*})$ and negative ideal separation $(S_{i}^{-})$ . The distance of the jth alternative to the PIS $(S_{i}^{*})$ and NIS $(S_{i}^{-})$ is calculated by following Equations 8 and 9, respectively. In these calculations, the Euclidean distance approach is utilized.

S_{i}^{*} = \sqrt{\sum_{j = 1}^{n} {(v_{i j} - v_{j}^{*})}^{2}} \forall_{i} = 1, \dots, m,

(8)

S_{i}^{-} = \sqrt{\sum_{j = 1}^{n} {(v_{i j} - v_{j}^{-})}^{2}} \forall_{i} = 1, \dots, m .

(9)

Stage 6. Relative closeness to the ideal solution is calculated. Utilizing $S_{i}^{*}$ and $S_{i}^{-}$ , relative closeness to the PIS of each alternative is calculated by Equation 10 below. The alternative which is closest to the PIS is determined as the most appropriate decision alternative.

C_{i}^{*} = \frac{S_{i}^{-}}{S_{i}^{-} + S_{i}^{*}} 0 \leq C_{i}^{*} \leq \forall_{i} = 1, \dots, m .

(10)

Here, $C_{i}^{*}$ is a value in the 0 ≤ C_*i ≤ 1 interval and $C_{i}^{*} = 1$ means that $i$ decision alternative is on the PIS point, while $C_{i}^{*} = 0$ means that $i$ decision alternative is on the NIS point.

WASPAS

The WASPAS method is based on the WSM and WPM (Zolfani et al., 2013). It was developed by Zavadskas in 2012 and presents the performance values of alternatives according to criteria utilizing criteria weights in the solution of MCDM problems. In consequence of the solution, alternatives are arranged from the best to the worst. Furthermore, the method attempts to reach a high level of consistency in the estimation by optimizing weighted integrated function (Lashgari et al., 2014; Zavadskas et al., 2012).

In this method, there is no particular technique for determining criteria weight. For this purpose, methods such as the Analytic Network Process (ANP), AHP, Decision-Making Trial and Evaluation Laboratory (DEMATEL), Entropy, Measuring Attractiveness by a Categorical Based Evaluation Technique (MACHBETH), and Step-Wise Weight Assessment Ratio Analysis (SWARA) can be utilized (Zolfani et al., 2013). In this study, a 1 to 9 scale to determine criteria weight was applied. In this scale, 9 represents the best, whereas 1 represents the worst. In the following, we briefly summarize the stages and procedure of the method.

In the WASPAS method, the problem to be solved is designed in an $m x n$ dimensional matrix form in which columns express criteria and rows express decision alternatives. In the decision matrix which is defined as the initial matrix, $m$ states alternatives $(A_{i}, i = 1, 2, \dots, m)$ and $n$ states criteria $(C_{j}, j = 1, 2, \dots, n)$ (Zavadskas et al., 2012).

Stage 1: Decision matrix is constituted. In this first stage, the decision matrix $(X)$ which demonstrates the performance of alternatives in respect to criteria is generated. This matrix is the same as the aforementioned Equation 1. In the decision matrix, $x_{i j}$ represents the performance of $i$ alternative as to $j$ criteria.

Stage 2: Decision matrix is normalized. The decision matrix is normalized taking into consideration the benefit or cost directions of the criteria. Linear normalization is utilized for the normalization process. In cases where criteria are cost-oriented, Equation 11 is utilized, and in cases where criteria are benefit-oriented, Equation 12 is applied.

x_{i j}^{*} = \frac{m i n_{i} x_{i j}}{x_{i j}},

(11)

x_{i j}^{*} = \frac{x_{i j}}{m a x_{i} x_{i j}} .

(12)

Stage 3: Relative performances of alternatives are calculated according to the WSM method. This is determined by adding the weighted alternative values of each criterion. This is formulized with Equation 13 below. In this Equation, $w_{j}$ demonstrates criteria weights.

P_{i}^{(1)} = \sum_{j = 1}^{n} x_{i j}^{*} w_{j} .

(13)

Stage 4: Relative performances of alternatives are calculated according to the WPM method. This is obtained by multiplying the alternative value of each criterion with the same indexed criteria weight’s power. This is formulized with Equation 14 below.

P_{i}^{(2)} = \prod_{j = 1}^{n} {(x_{i j}^{*})}^{w_{j}} .

(14)

Stage 5: Final performance of alternatives is calculated. Final performance of alternatives $(P_{i})$ , which demonstrates the positions of alternatives in a general ranking, is calculated by adding the relative performances obtained by Equations 13 and 14. This is presented with Equation 15 below:

P_{i} = 0.5 P_{i}^{(1)} + 0.5 P_{i}^{(2)} .

(15)

Equation 16 in the following can be utilized to increase the ranking efficiency and accuracy of the decision-making process. α is a parameter which can take values between 0 and 1.

P_{i} = α P_{i}^{(1)} + (1 - α) P_{i}^{(2)} .

(16)

When α = 1, the WASPAS method turns into the WSM method, and when α = 0, it turns into the WPM method. α value can be determined freely by the user.

Stage 6: Alternatives are ranked. $P_{i}$ values are ranked from highest to lowest to determine the final rankings of alternatives. In this ranking, the first alternative is best, whereas the last alternative is worst.

Multi-Objective Optimization on the Basis of Ratio Analysis (MOORA) and MULTIMOORA

Multi-Objective Optimization on the Basis of Ratio Analysis (MOORA) was developed by Brauers and Zavadskas in 2006 and is a commonly used, relatively new method for the solution of MCDM problems. It depends on the scoring of different foresights (Pérez-Domínguez et al., 2018). This method is used to make proper decisions in the solution process of various and complex problems. Results obtained through use of this method present measurable results for each decision alternative. Thus, the MOORA method is an effective tool to rank and select decision alternatives (Brauers & Zavadskas, 2006; Dey et al., 2012; Gadakh, 2011).

The MOORA method is a multiobjective optimization method and depends on proportional analysis. Different versions of MOORA, such as MOORA-Ratio, MOORA-Significance Coefficient, MOORA-Reference Point, MOORA-Full Multiplication, and MULTIMOORA have been developed.

However, there are some conditions required to obtain proper results in the application process of this method: All affected factors and all relationships between alternatives and criteria should be taken into account, the decision maker should be objective and use updated data, and the final evaluation should be made by applying different MOORA approaches (Mandal & Sarkar, 2012). The steps of this method are summed up in the following.

In MOORA, decision alternatives are formulized in the same way as stated previously in the TOPSIS and WASPAS methods ( $n$ criteria $(C = c_{1}, c_{2}, c_{3}, \dots, c_{n})$ and $m$ decision alternative $(A = a_{1}, a_{2}, a_{3}, \dots, a_{m})$ ).

Step 1. Initial decision matrix is generated. The decision matrix in this stage is the same as the aforementioned Equation 1. Likewise, $x_{i j}$ represents the performance of i alternative as to j criteria.

Step 2. Decision matrix is normalized. The normalization process in this stage is the same with the TOPSIS method. Thus, Equations 2 and 3 are utilized in this stage. Here, it is significant to mention that normalization is executed without taking into account the criteria’s direction (maximization/minimization).

Step 3. MOORA-Ratio approach. This approach is applied by calculating the performance of decision alternatives. This is obtained via following Equation 17.

y_{i}^{*} = \sum_{j = 1}^{g} x_{i j}^{*} - \sum_{j = g + 1}^{g} x_{i j}^{*} .

(17)

Here, $g, (n - g)$ , and $y_{i}^{*}$ represent the number of criteria to be maximized, the number of criteria to be minimized, and the normalized value of the $i th$ alternative with respect to all criteria, respectively. $y_{i}^{*}$ values are ranked from highest to lowest and the alternative on the first rank is determined to be the best alternative.

Step 4. MOORA-Significance Coefficient approach. In this approach, normalized data which are obtained from the MOORA-Ratio approach are multiplied with a ratio called the significance coefficient $(s c_{j})$ to assign more or less significance to some criteria (Mandal & Sarkar, 2012). Performance values of alternatives are calculated by Equation 18 below.

y_{i}^{*} = \sum_{j = 1}^{g} s c_{j} x_{i j}^{*} - \sum_{j = g + 1}^{g} s c_{j} x_{i j}^{*} .

(18)

As stated previously, here, $y_{i}^{*}$ values are ranked from highest to lowest and the alternative on the first rank is determined to be the best alternative.

Step 5. MOORA-Reference Point approach. In this approach, normalized data acquired from the MOORA-Ratio approach are taken into account. In case of maximization, the best value of decision alternatives for each alternative and in case of minimization, the worst value of decision alternatives for each alternative are determined as reference points $(r_{i})$ . Equation 19 in the following calculates the distance of alternatives to the reference point for each criterion.

d_{i j} = | r_{j} - x_{i j}^{*} | .

(19)

Then the highest value of each alternative is calculated by Equation 20 below; alternatives are ranked from highest to lowest, and the alternative in the first rank is determined to be the best alternative.

P_{i} = \min_{i} (\underset{j}{m a x} d_{i j}) .

(20)

Step 6. MOORA-Full Multiplication approach. In this approach, to obtain the score of each alternative, maximization-oriented data which are specified at the beginning of the process are multiplied and divided to the multiplication of minimization-oriented data. This calculation is given with Equation 21 in the following. $A_{i}$ and $B_{i}$ values are computed by Equations 22 and 23 below, respectively.

U_{i} = \frac{A_{i}}{B_{i}},

(21)

A_{i} = \prod_{g = 1}^{j} x_{g j} i = 1, 2, \dots, m,

(22)

B_{i} = \prod_{k = j + 1}^{n} x_{k i} .

(22)

In Equations 22 and 23, while $m$ represents the number of alternatives, $j$ represents the number of maximization-oriented criteria. Thus, $n - j$ corresponds to the number of minimization-oriented criteria. $U_{i}$ denotes the score of alternatives, and after ranking the $U_{i}$ values from highest to lowest, the alternative in the first rank is determined to be the best alternative.

Step 7. MULTIMOORA. This approach was first suggested by Brauers and Zavadskas in 2010 and consists of the MOORA-Ratio, MOORA-Reference Point, and MOORA-Full Multiplication approaches (Brauers & Zavadskas, 2012). It is not an independent method. It depends on evaluating the rankings of the aforementioned MOORA methods according to the ordinal dominance theory and thus creates a final evaluation. The fundamental aim of this approach is to determine the preferred alternatives and support decision makers. In this study, the results of MULTI-Ratio, MULTI-Significance Coefficient, MULTI-Reference Point, and MULTI-Full Multiplication approaches are transformed into a final ranking by means of ordinal dominance theory.

There are four different situations to determine the score of decision alternatives according to related theory for MULTIMOORA. These are dominance, transitiveness, equability, and circular reasoning. Dominance is the effect of an alternative on other alternatives and can be revealed as absolute dominance or general dominance. Absolute dominance is the situation of an alternative or solution being dominant to other alternatives or solutions and stated as (1-1-1). For general dominance, in case of a > b > c > d, if the decision alternative is in the same rank at two of the three approaches, dominance is expressed as follows:

(d-a-a) is dominant to (c-b-b),

(a-d-a) is dominant to (b-c-b),

(a-a-d) is dominant to (b-b-c).

In transitiveness, if a is dominant to b and b is dominant to c, then a is dominant to c. For equability, if the two decision alternatives have the same result, this situation is called absolute equability. However, if there is equability in two of the three situations, then it is called partial equability.

Case Study and Results

Application of TOPSIS Method and Results

First of all, as a result of evaluations by decision makers, a decision matrix was formed (Equation 1), in which each value in this matrix represents the real value of related criteria. This matrix is presented in Table 5 and the orientations of criteria are included. Then, all alternative scores were normalized using Equations (2) and (3) and the acquired values are given in Table 6.

Table 5.

Decision Matrix.

	$C_{1}$	$C_{2}$	$C_{3}$	$C_{4}$	$C_{5}$
	Maximum	Minimum	Minimum	Maximum	Maximum
$A_{1}$	1,814.468	9	2.7	321.767	18.285
$A_{2}$	2,220.125	6	4.3	410.691	15.521
$A_{3}$	2,426.356	4	1.5	471.787	15.231
$A_{4}$	2,205.609	4	2.7	345.159	11.637

Table 6.

Normalized Values of Decision Matrix.

	$C_{1}$	$C_{2}$	$C_{3}$	$C_{4}$	$C_{5}$
$A_{1}$	0.4166	0.7373	0.4543	0.4107	0.5956
$A_{2}$	0.5097	0.4915	0.7235	0.5242	0.5055
$A_{3}$	0.5570	0.3277	0.2524	0.6021	0.4961
$A_{4}$	0.5064	0.3277	0.4543	0.4405	0.3790

In the proceeding step, the decision makers weighted each criterion based on a 1 to 9 scale, in which 1 represents the worst and 9 represents the best. According to their evaluations, each criterion’s score was divided by the total score and the related criteria weights were obtained. These weights are presented in Table 7.

Table 7.

Criteria Weights.

Criteria	Criteria weight
$C_{1}$	0.13
$C_{2}$	0.33
$C_{3}$	0.27
$C_{4}$	0.07
$C_{5}$	0.20
Total	1.0

Then, by multiplying criteria weights with normalization values as given in Equation 5, a weighted normalized decision matrix was generated, which is presented in Table 8.

Table 8.

Weighted Normalized Values of Decision Matrix.

	$C_{1}$	$C_{2}$	$C_{3}$	$C_{4}$	$C_{5}$
$A_{1}$	0.0555	0.2458	0.1211	0.0274	0.1191
$A_{2}$	0.0680	0.1638	0.1929	0.0349	0.1011
$A_{3}$	0.0743	0.1092	0.0673	0.0401	0.0992
$A_{4}$	0.0675	0.1092	0.1211	0.0294	0.0758

Subsequently, after generating values $A^{*}$ and $A^{-}$ by using Equations 6 and 7, the distance to PIS $(S^{*})$ and the distance to NIS $(S^{-})$ were calculated for each alternative via Equations 8 and 9. According to these values, relative closeness to the ideal solution $(C_{İ})$ was obtained by Equation 10 and the corresponding results are presented in Table 9. Furthermore, Table 9 includes the ranking of alternatives according to the results.

Table 9.

$S^{*},$ $S^{-},$ and $C$ İ Values for Each Alternative.

	$S^{*}$	$S^{-}$	$C$ İ	Ranking
$A_{1}$	0.0192	0.0070	0.3772	4
$A_{2}$	0.0085	0.0076	0.4850	3
$A_{3}$	0.0033	0.0355	0.7665	2
$A_{4}$	0.0020	0.0239	0.7742	1

As seen from Table 9, the ranking of alternative cities is $A_{4}$ > $A_{3}$ > $A_{2}$ > $A_{1}$ . This means that the best location to establish a new university using the TOPSIS method is $A_{4}$ which corresponds to Konya.

Application of WASPAS Method and Results

The WASPAS decision matrix used the same process as the decision matrix of the TOPSIS method and has previously been shown in Table 5. However, for the WASPAS method normalization process, Equations 11 and 12 were utilized and the normalized decision matrix is presented in Table 10 below.

Table 10.

WASPAS Normalized Decision Matrix.

	$C_{1}$	$C_{2}$	$C_{3}$	$C_{4}$	$C_{5}$
$A_{1}$	0.7478	0.4444	0.5556	0.6820	1.0000
$A_{2}$	0.9150	0.6667	0.3488	0.8705	0.8488
$A_{3}$	1.0000	1.0000	1.0000	1.0000	0.8330
$A_{4}$	0.9090	1.0000	0.5556	0.7316	0.6364

Note. WASPAS = Weighted Aggregated Sum Product Assessment.

Relative performance of alternatives according to WPM and WSM is calculated by Equations 13 and 14. Final performance of alternatives was obtained via Equation 16 for three different $α$ values, and all these values are presented in Table 11.

Table 11.

WSM and WPM and Final Rankings of Alternatives for the WASPAS Method.

	WSM	WPM	$α = 0$		$α = 0.5$		$α = 1$
	WSM	WPM	WASPAS score	Rank	WASPAS score	Rank	WASPAS score	Rank
$A_{1}$	0.6400	0.6100	0.6100	4	0.6266	4	0.6400	4
$A_{2}$	0.6650	0.6300	0.6300	3	0.6450	3	0.6650	3
$A_{3}$	0.9666	0.9600	0.9600	1	0.9654	1	0.9666	1
$A_{4}$	0.7787	0.7600	0.7600	2	0.7670	2	0.7787	2

Note. WSM = weighted sum model; WPM = weighted product model; WASPAS = Weighted Aggregated Sum Product Assessment.

As indicated in Table 11, the ranking of alternative cities is $A_{3}$ > $A_{4}$ > $A_{2}$ > $A_{1}$ . This refers to the fact that the most appropriate location to establish a new university by using the WASPAS method is $A_{3}$ which stands for Antalya.

Application of MULTIMOORA Method and Results

As in the TOPSIS and WASPAS methods, for MULTIMOORA method, a decision matrix was formed by Equation 1, and it utilizes the same values as given in Table 5. Normalization of the decision matrix was the same as the TOPSIS method as well, and the normalized decision matrix has previously been given in Table 6.

The aforementioned four MOORA approaches (MOORA-Ratio, MOORA-Significance Coefficient, MOORA-Reference Point, and MOORA-Full Multiplication) were applied, and the scores of each alternative for each approach are given in Table 12 below.

Table 12.

Alternative Scores for Four MULTIMOORA Approach.

	Ratio	Significance Coefficient	Reference Point	Full Multiplication
$A_{1}$	0.2300	−0.1649	0.4096	1.0675E+16
$A_{2}$	0.3200	−0.1528	0.4152	1.4152E+16
$A_{3}$	1.0800	0.0370	0.2491	1.7435E+16
$A_{4}$	0.5400	−0.577	0.2165	8.8591E+16

Note. MOORA = Multi-Objective Optimization on the Basis of Ratio Analysis.

The dominance comparisons and final MULTIMOORA rankings are presented in Table 13.

Table 13.

Dominance Comparisons of MULTIMOORA Method.

	Ratio system	Significance Coefficient	Reference Point	Full Multiplication	MULTIMOORA
$A_{1}$	4	3	3	4	4
$A_{2}$	3	2	4	3	3
$A_{3}$	2	1	2	2	2
$A_{4}$	1	4	1	1	1

Note. MOORA = Multi-Objective Optimization on the Basis of Ratio Analysis.

For the MULTIMOORA method, the ranking of alternatives is $A_{4}$ > $A_{3}$ > $A_{2}$ > $A_{1}$ . Thus, the alternative which is in the first rank $A_{4}$ (namely Konya) is the best alternative to establish the new university.

Table 14 (as can be seen below) was obtained through comparison of the ranking results of the three methods applied in this study (TOPSIS, WASPAS, and MULTIMOORA).

Table 14.

Comparison of TOPSIS, WASPAS, and MULTIMOORA Rankings.

	TOPSIS	WASPAS	MULTIMOORA
$A_{1}$	4	4	4
$A_{2}$	3	3	3
$A_{3}$	2	1	2
$A_{4}$	1	2	1

Note. TOPSIS = Technique for Order Preference by Similarity to Ideal Solution; WASPAS = Weighted Aggregated Sum Product Assessment; MOORA = Multi-Objective Optimization on the Basis of Ratio Analysis.

It can be seen from Table 14 that while TOPSIS and MULTIMOORA resulted in the same rankings (Konya, Antalya, Adana, and Mersin), the rank of the first and second alternative is changed in the WASPAS method (Antalya, Konya, Adana, and Mersin).

Sensitivity Analyses

In this subsection, we performed sensitivity analyses to verify our results structuring 10 different scenarios based on changes in the criteria weights. These analyses are expected to be beneficial to map each alternative’s performance with respect to each criterion. Figure 2 below demonstrates the changes of alternative university location rankings according to different scenarios for TOPSIS, WASPAS, and MULTIMOORA methods. Because in MULTIMOORA method, between the four approaches (MOORA-Ratio, MOORA-Significance Coefficient, MOORA-Reference Point, and MOORA-Full Multiplication), criteria weights are applied only in Significance Coefficient approach, sensitivity analyses are conducted for MOORA-Significance Coefficient approach.

Figure 2.

Sensitivity analyses of the results for TOPSIS, WASPAS, and MULTIMOORA methods.

In Figure 2; the colors blue, orange, green, and yellow represent the alternatives Mersin, Adana, Antalya, and Konya, respectively. In these analyses, the ranking of the alternatives is calculated for each scenario.

Obtained results depict that assigning different weights to criteria causes changes in alternatives’ rankings, which present sensitivity of methods to the changes of criteria weights. Furthermore, results show that the proposed methods establish robust and reliable results and it is effective to handle with MCDM problems. In Figure 3 below, sensitivity analyses depicted at Figure 2 are presented based on criteria for each MCDM method. While the x-axis stands for the criteria weights, the y-axis stands for the scores of alternatives.

Figure 3.

Results of sensitivity analyses based on each criteria for the utilized MCDM method.

As seen from Figures 2 and 3, it is observed that $A_{3}$ (Antalya) is superior to the three other alternatives in all sensitivity analyses for all scenarios and utilized MCDM methods. In all analyses, $A_{3}$ has its biggest score in Scenario 7 which $C_{1}$ (population) has the highest criteria weight.

In TOPSIS method sensitivity analyses, while $A_{4}$ is in the second rank in six of the 10 scenarios (Scenarios 1, 2, 3, 4, 5, and 7), it is ranked as the worst alternative in Scenario 6 by the biggest weight of $C_{4}$ (number of graduates). In Scenarios 8 and 10, $A_{4}$ ’s second rank is replaced by $A_{2}$ , as well. In WASPAS method, the situation of $A_{4}$ is the same as that in TOPSIS; however, in WASPAS for Scenario 8, $A_{4}$ is ranked as the worst alternative by the biggest weight of $C_{5}$ (yearly income per person) and its second rank is replaced by $A_{1}$ . In MOORA-Significance Coefficient approach, while $A_{4}$ is in the second rank in five of the 10 scenarios (Scenarios 1, 2, 3, 4, and 7), it is ranked as the worst alternative in Scenario 6 by the biggest weight of $C_{4}$ (number of graduates) and Scenario 10 by the biggest weight of $C_{2}$ (investment costs).

Results and Discussion

This article compared the application of three different MCDM methods with the selection of a new university location problem. The results obtained suggest that Konya is the best location for the new university establishment. However, in TOPSIS method, the score of Konya and Antalya (0.7665 and 0.7742, respectively) is close and Antalya is in the first rank. This situation is caused by the different stages of utilized methods. Also, sensitivity analyses demonstrated the changes in the rankings due to the various criteria weights. Compared with the literature, although there are studies which applied several MCDM methods for location selection decisions (Table 1), it is observed that studies where MCDM is used for location selection of educational facilities have been very rare (Arslan & Yildiz, 2015; Ding & Zeng, 2015; Kuyrukcu & Alkan, 2020). In their study, location selection problem was not the focus, and Ding and Zeng (2015) integrated TOPSIS with information entropy weight (IEW) to examine the overall performance of 68 Chinese universities. Arslan and Yildiz (2015) aimed to determine the location selection of a sport high school between four alternatives in Duzce, Turkey, and utilized fuzzy TOPSIS technique for this aim. Kuyrukcu and Alkan (2020) applied AHP for determining criteria weights and employed TOPSIS to obtain the ranking of alternative five cities for university location problem in Turkey. Thereby, it can be concluded that a study that used three different MCDM methods together for the selection of the education facility, as in this study, was not observed in the literature.

Due to various reasons such as the most important stage of education investments is location selection, as in many sectors, apart from its economic meaning, the choice of location of the educational facility will also deeply affect the social life in the region where it will be established; the place of establishment of the university, which is an educational facility, should also be carefully selected. Therefore, the content of this study was enriched by using the TOPSIS, WASPAS, and MULTIMOORA methods together to solve the problem of choosing the location of establishment of a university. Furthermore, the results are validated performing sensitivity analyses.

As a result of this study, it has become clear that decision-making problems encountered in the education sector, as in other sectors, can be solved and interpreted using MCDM methods. However, our study includes limitations, as well. First, the article integrated a limited number of criteria (5) and we suggest and aim to use more criteria, subcriteria in further studies. Second, the article focused on evaluating four alternatives. For further studies, the case study area can be expended to various regions of country. Other suggestions for later studies include utilizing artificial intelligence, intuitionistic sets, fuzzy logic, Type 2 fuzzy sets, or hybrid methods as new approaches. Also, increasing the number of experts can enrich the research.

Footnotes

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research and/or authorship of this article.

Ethics

Ethical permission was not needed.

Consent

Consent was not needed.

ORCID iD

Pınar Miç

References

Aikebaier

(2013). Çin’deki üniversite kentlerinin gelişme şekli ve modeli [Development Form and Model of Chinese Univesity Cities] [Master’s thesis]. Mimar Sinan University of Fine Arts.

Akin

N. G.

(2016). Multi-criteria approach to personnel selection: Fuzzy TOPSIS applications. Journal of Business Research-Turk, 8(2), 224–224. https://doi.org/10.20491/isarder.2016.177

Amile

Sedaghat

Poorhossein

(2013). Performance evaluation of banks using Fuzzy AHP and TOPSIS, case study: State-owned banks, partially private and private banks in Iran. Caspian Journal of Applied Sciences Research, 2(3), 128–138.

Arap

(2010). Turkey meets its new universities: New universities in Turkey and the rationale behind the their foundation. Ankara University SBF Journal, 65(1), 1–29. https://doi.org/10.1501/SBFder_0000002156

Arslan

H. M.

Yildiz

M. S.

(2015). Application of fuzzy TOPSIS method on location selection of educational facilities: A location analysis in Düzce. Journal of International Social Research, 8(36), 763–773.

Athawale

V. M.

Chatterjee

Chakraborty

(2012). Decision making for facility location selection using PROMETHEE II method. International Journal of Industrial and Systems Engineering, 11(1–2), 16–30. https://doi.org/10.1504/IJISE.2012.046652

Aydogan

E. K.

(2011). Performance measurement model for Turkish aviation firms using the rough-AHP and TOPSIS methods under fuzzy environment. Expert Systems With Applications, 38(4), 3992–3998. https://doi.org/10.1016/j.eswa.2010.09.060

Badalpur

Nurbakhsh

(2019). An application of WASPAS method in risk qualitative analysis: A case study of a road construction project in Iran. International Journal of Construction Management, 21(9), 1–10. https://doi.org/10.1080/15623599.2019.1595354

Balcik

Beamon

B. M.

(2008). Facility location in humanitarian relief. International Journal of Logistics, 11(2), 101–121. https://doi.org/10.1080/13675560701561789

10.

Baykasoglu

Golcuk

(2019). Revisiting ranking accuracy within WASPAS method. Kybernetes, 49(3), 885–895. https://doi.org/10.1108/K-01-2019-0052

11.

Belbag

Deveci

Uludag

A. S.

(2013). Comparison of two fuzzy multi criteria decision methods for potential airport location selection. International Conference on Operations Research and Enterprise Systems, 2, 270–276.

12.

Boran

F. E.

Genç

Kurt

Akay

(2009). A multi-criteria intuitionistic fuzzy group decision making for supplier selection with TOPSIS method. Expert Systems With Applications, 36(8), 11363–11368. https://doi.org/10.1016/j.eswa.2009.03.039

13.

Bozkurt

Turgay

Seriye

(1998). Kamu Yonetimi Sozlugu [Public Administration Dictionary] (2nd ed.). Turkey and Middle East Public Administration Institution.

14.

Brauers

W. K. M.

Zavadskas

E. K.

(2006). The MOORA method and its application to privatization in a transition economy. Control and Cybernetics, 35, 445–469.

15.

Brauers

W. K. M.

Zavadskas

E. K.

(2012). Robustness of MULTIMOORA: A method for multi-objective optimization. Informatica, 23(1), 1–25. https://doi.org/10.15388/informatica.2012.346

16.

Chakraborty

Ray

Dan

P. K.

(2013). Multi criteria decision making methods for location selection of distribution centers. International Journal of Industrial Engineering Computations, 4(4), 491–504. https://doi.org/10.5267/j.ijiec.2013.06.006

17.

Chen

(2006). Evaluating the selection of logistics centre location using fuzzy MCDM model based on entropy weight. In Proceedings of the 6th World Congress on Intelligent Control and Automation (WCICA) (pp. 7128–7132). https://doi.org/10.1109/WCICA.2006.1714468

18.

Cheng

Chan

C. W.

Huang

G. H.

(2002). Using multiple criteria decision analysis for supporting decisions of solid waste management. Journal of Environmental Science and Health, Part A, 37(6), 975–990. https://doi.org/10.1081/ESE-120004517

19.

Christiaanse

(2006). Campus to city: Urban design for universities. In Hoeger

Christiaanse

(Eds.), Campus and the city: Urban design for the knowledge society (3rd ed., pp. 80–82). Prentice Hall.

20.

Dabbagh

Yousefi

(2019). A hybrid decision-making approach based on FCM and MOORA for occupational health and safety risk analysis. Journal of Safety Research, 71, 111–123. https://doi.org/10.1016/j.jsr.2019.09.021

21.

Demirel

N. C.

Deveci

Eser

(2016, August). Comparative analysis of fuzzy multi-criteria decision making for location selection of textile plant in Turkey. In Proceedings of International Academic Conferences (No. 4006524). International Institute of Social and Economic Sciences. https://econpapers.repec.org/paper/sekiacpro/4006524.htm

22.

Deveci

Canıtez

Gokasar

(2018). WASPAS and TOPSIS based interval type-2 fuzzy MCDM method for a selection of a car sharing station. Sustainable Cities and Society, 41, 777–791. https://doi.org/10.1016/j.scs.2018.05.034

23.

Deveci

Ozcan

John

(2020, February 7–8). Offshore wind farm site selection based on multi-criteria fuzzy systems: A case study of Turkey [Conference session]. 2019 IEEE Texas Power and Energy Conference, College Station, TX, United States.

24.

Dey

Bairagi

Sarkar

Sanyal

(2012). A MOORA based fuzzy multi-criteria decision making approach for supply chain strategy selection. International Journal of Industrial Engineering Computations, 3(4), 649–662. https://doi.org/10.5267/j.ijiec.2012.03.001

25.

Ding

Zeng

(2015). Evaluation of Chinese higher education by TOPSIS and IEW—The case of 68 universities belonging to the Ministry of Education in China. China Economic Review, 36, 341–358. https://doi.org/10.1016/j.chieco.2015.05.007

26.

Dogan

Deveci

Canıtez

Kahraman

(2020). A corridor selection for locating autonomous vehicles using an interval-valued intuitionistic fuzzy AHP and TOPSIS method. Soft Computing, 24, 8937–8953. https://doi.org/10.1007/s00500-019-04421-5

27.

El-Santawy

M. F.

Mohamed

(2019). A new approach for solving rough interval MCDM problems based on BWM and WASPAS methods. International Journal of Advanced Trends in Computer Science and Engineering, 8(6), 3615–3620. https://doi.org/10.30534/ijatcse/2019/144862019

28.

Emovon

Norman

R. A.

Murphy

A. J.

Okwu

M. O.

(2018). Application of WASPAS in enhancing reliability centred maintenance for ship system maintenance. Journal of Engineering and Technology, 9(1), 1–16.

29.

Ertugrul

(2011). Fuzzy group decision making for the selection of facility location. Group Decision and Negotiation, 20(6), 725–740. https://doi.org/10.1007/s10726-010-9219-1

30.

Gadakh

(2011). Application of MOORA method for parametric optimization of milling process. International Journal of Applied Engineering Research, 1(4), 743–758.

31.

Ghorui

Ghosh

Algehyne

E. A.

Mondal

S. P.

Saha

A. K.

(2020). AHP-TOPSIS inspired shopping mall site selection problem with fuzzy data. Mathematics, 8(8), 1380. https://doi.org/10.3390/math8081380

32.

Göç İdaresi Genel Müdürlüğü. (n.d.). https://www.goc.gov.tr/

33.

Gokasar

Deveci

Kalan

(2021, in press). CO2 emission based prioritization of bridge maintenance projects using neutrosophic fuzzy sets based decision making approach. Research in Transportation Economics. Advance online publication. https://doi.org/10.1016/j.retrec.2021.101029

34.

Guler

Yomralioglu

(2020). Suitable location selection for the electric vehicle fast charging station with AHP and fuzzy AHP methods using GIS. Annals of GIS, 26(2), 169–189. https://doi.org/10.1080/19475683.2020.1737226

35.

Hanifatulqolbi

Ismail

I. E.

Hammad

Al-Hooti

M. H.

(2019). Decision support system for considering the best teacher performance using MOORA method. Journal of Physics: Conference Series, 1193(1), 012018. https://doi.org/10.1088/1742-6596/1193/1/012018

36.

Hung

C. C.

Chen

L. H.

(2009). A fuzzy TOPSIS decision making model with entropy weight under intuitionistic fuzzy environment. Proceedings of the International Multiconference of Engineers and Computer Scientists, 1, 13–16.

37.

Hwang

C. L.

Yoon

(1981). Multiple attribute decision making: Methods and applications a state of the art survey (1st ed., Vol. 186, pp. XI–269). Springer. https://doi.org/10.1007/978-3-642-48318-9

38.

Jayant

Chandan

A. K.

Singh

(2019). Sustainable supplier selection for battery manufacturing industry: A MOORA and WASPAS based approach. Journal of Physics: Conference Series, 1240(1), 012015.

39.

Karabašević

Stanujkić

Urošević

Maksimović

(2016). An approach to personnel selection based on SWARA and WASPAS methods. Bizinfo (Blace) Journal of Economics, Management and Informatics, 7(1), 1–11. https://doi.org/10.5937/bizinfo1601001K

40.

Karagoz

Deveci

Simic

Aydin

(2021). Interval type-2 Fuzzy ARAS method for recycling facility location problems. Applied Soft Computing, 102, 107107. https://doi.org/10.1016/j.asoc.2021.107107

41.

Karasan

Kaya

Erdogan

(2020). Location selection of electric vehicles charging stations by using a fuzzy MCDM method: A case study in Turkey. Neural Computing and Applications, 32(9), 4553–4574. https://doi.org/10.1007/s00521-018-3752-2

42.

Karuppanna

P. N.

Sekar

(2016). Optimal alternative selection using MOORA in industrial sector—A review. International Journal of Fuzzy Logic Systems, 6(2), 1–21.

43.

Kaya

Tortum

Alemdar

K. D.

Codur

M. Y.

(2020). Site selection for EVCS in İstanbul by GIS and multi-criteria decision-making. Transportation Research Part D: Transport and Environment, 80, 1–16. https://doi.org/10.1016/j.trd.2020.102271

44.

Kelemenis

Askounis

(2010). A new TOPSIS-based multi-criteria approach to personnel selection. Expert Systems With Applications, 37(7), 4999–5008. https://doi.org/10.1016/j.eswa.2009.12.013

45.

Keshavarz Ghorabaee

Amiri

Zavadskas

E. K.

Turskis

Antucheviciene

. (2017a). A new multi-criteria model based on interval type-2 fuzzy sets and EDAS method for supplier evaluation and order allocation with environmental considerations. Computers & Industrial Engineering, 112, 156–174. https://doi.org/10.1016/j.cie.2017.08.017

46.

Keshavarz Ghorabaee

Amiri

Zavadskas

E. K.

Turskis

Antucheviciene

. (2017b). Stochastic EDAS method for multi-criteria decision-making with normally distributed data. Journal of Intelligent & Fuzzy Systems, 33(3), 1627–1638. https://doi.org/10.3233/JIFS-17184

47.

Keshavarz Ghorabaee

Amiri

Zavadskas

E. K.

Turskis

Antucheviciene

. (2018). A dynamic fuzzy approach based on the EDAS method for multi-criteria subcontractor evaluation. Information, 9(3), 68. https://doi.org/10.3390/info9030068

48.

Keshavarz Ghorabaee

Zavadskas

E. K.

Amiri

Turskis

. (2016). Extended EDAS method for fuzzy multi-criteria decision-making: An application to supplier selection. International Journal of Computers Communications & Control, 11(3), 358–371. https://doi.org/10.15837/ijccc.2016.3.2557

49.

Keshavarz Ghorabaee

Zavadskas

E. K.

Olfat

Turskis

. (2015). Multi-criteria inventory classification using a new method of evaluation based on distance from average solution (EDAS). Informatica, 26(3), 435–451.

50.

Kumar

Barman

A. G.

(2018). Supplier selection using fuzzy TOPSIS multi criteria model for a small scale steel manufacturing unit. Procedia Computer Science, 133, 905–912. https://doi.org/10.1016/j.procs.2018.07.097

51.

Kuo

M. S.

Liang

G. S.

(2011). A novel hybrid decision-making model for selecting locations in a fuzzy environment. Mathematical and Computer Modelling, 54(1–2), 88–104. https://doi.org/10.1016/j.mcm.2011.01.038

52.

Kuvat

Demir

(2020). Use of AHP and MOORA for cattle breeding: Karesi district of Balıkesir province application. Mugla Journal of Science and Technology, 6(1), 8–17. https://doi.org/10.22531/muglajsci.616054

53.

Kuyrukcu

Alkan

(2020). Evaluation of the location selection of universities by using AHP and TOPSIS methods. The Journal of International Social Research, 13(69), 625–638. https://doi.org/10.17719/jisr.2020.3983

54.

Lashgari

Antuchevičienė

Delavari

Kheirkhah

(2014). Using QSPM and WASPAS methods for determining outsourcing strategies. Journal of Business Economics and Management, 15(4), 729–743. https://doi.org/10.3846/16111699.2014.908789

55.

Majumder

Mishra

S. K.

Sahu

A. R.

Bavche

A. L.

Valekar

Padaseti

B. K.

(2019). Application of MOORA to optimize WEDM process parameters: A multi-criteria decision making approach. In International Conference on Reliability, Risk Maintenance and Engineering Management (pp. 73–78). Springer. https://doi.org/10.1007/978-981-13-8507-0_12

56.

Maltas Erol

Ozer

Y. E

. (2018). Contribution of site selection of universities in Anatoliato urban development: Case study of Karaman. Cankırı Karatekin University Journal of Economics and Administrative Sciences, 8(1), 83–112.

57.

Mandal

U. K.

Sarkar

(2012). Selection of best intelligent manufacturing system (IMS) under fuzzy MOORA conflicting MCDM environment. International Journal of Emerging Technology and Advanced Engineering, 2(9), 301–310.

58.

Mangalan

A. V.

Kuriakose

Mohamed

Ray

(2016). Optimal location of warehouse using weighted MOORA approach. In 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT) (pp. 662–665). IEEE. https://doi.org/10.1109/ICEEOT.2016.7754764

59.

Matin

H. Z.

Fathi

M. R.

Zarchi

M. K.

Azizollahi

(2011). The application of fuzzy TOPSIS approach to personnel selection for Padir company, Iran. Journal of Management Research, 3(2), 1–14. https://doi.org/10.5296/jmr.v3i2.663

60.

Mihajlović

Rajković

Petrović

Ćirić

(2019). The selection of the logistics distribution center location based on MCDM methodology in southern and eastern region in Serbia. Operational Research in Engineering Sciences: Theory and Applications, 2(2), 72–85. https://doi.org/10.31181/oresta190247m

61.

Mishra

A. R.

Rani

Pardasani

K. R.

Mardani

(2019). A novel hesitant fuzzy WASPAS method for assessment of green supplier problem based on exponential information measures. Journal of Cleaner Production, 238, 117901. https://doi.org/10.1016/j.jclepro.2019.117901

62.

Mousavi

S. M.

Tavakkoli-Moghaddam

Heydar

Ebrahimnejad

(2013). Multi-criteria decision making for plant location selection: An integrated Delphi–AHP–PROMETHEE methodology. Arabian Journal for Science and Engineering, 38(5), 1255–1268. https://doi.org/10.1007/s13369-012-0361-8

63.

Muthesius

(2001). The Postwar University: Utopianist campus and college. Paul Mellon Centre; Illustrated Edition.

64.

Nori

N. S. A.

Saifuddin

Ratna

(2018). Cam shaft material selection using Multi-Objective Optimization on the Basis of Ratio Analysis-(MOORA) method. International Journal of Mechanical and Production Engineering Research and Development, 8(3), 1023–1028.

65.

Onut

Efendigil

Kara

S. S.

(2010). A combined fuzzy MCDM approach for selecting shopping center site: An example from Istanbul, Turkey. Expert Systems With Applications, 37(3), 1973–1980. https://doi.org/10.1016/j.eswa.2009.06.080

66.

Ortega

Tóth

Moslem

Péter

Duleba

(2020). An integrated approach of analytic hierarchy process and triangular fuzzy sets for analyzing the park-and-ride facility location problem. Symmetry, 12(8), 1–19. https://doi.org/10.3390/SYM12081225

67.

Ozen

Yesildag

Soba

(2015). TOPSIS performance evaluation measures and relation between financial ratios and stock returns. Journal of Economics, Finance and Accounting, 2(4), 482–500. https://doi.org/10.17261/pressacademia.2015414363

68.

Pamucar

Deveci

Canıtez

Lukovac

(2020). Selecting an airport ground access mode using novel fuzzy LBWA-WASPAS-H decision making model. Engineering Applications of Artificial Intelligence, 93, 103703. https://doi.org/10.1016/j.engappai.2020.103703

69.

Pamucar

Iordache

Deveci

Schitea

Iordache

(2020). A new hybrid fuzzy multi-criteria decision methodology model for prioritizing the alternatives of the hydrogen bus development: A case study from Romania. International Journal of Hydrogen Energy, 46(57), 29616–29637. https://doi.org/10.1016/j.ijhydene.2020.10.172

70.

Panchal

Singh

A. K.

Chatterjee

Zavadskas

E. K.

Keshavarz-Ghorabaee

(2019). A new fuzzy methodology-based structured framework for RAM and risk analysis. Applied Soft Computing, 74, 242–254. https://doi.org/10.1016/j.asoc.2018.10.033

71.

Pathapalli

V. R.

Basam

V. R.

Gudimetta

S. K.

Koppula

M. R.

(2020). Optimization of machining parameters using WASPAS and MOORA. World Journal of Engineering, 17(2), 237–246. https://doi.org/10.1108/WJE-07-2019-0202

72.

Patnaik

P. K.

Swain

P. T. R.

Mishra

S. K.

Purohit

Biswas

(2020). Composite material selection for structural applications based on AHP-MOORA approach. Materials Today: Proceedings, 33, 5659–5663. https://doi.org/10.1016/j.matpr.2020.04.063

73.

Pérez-Domínguez

Sánchez Mojica

K. Y.

Ovalles Pabón

L. C.

Cordero Díaz

M. C.

(2018). Application of the MOORA method for the evaluation of the industrial maintenance system. Journal of Physics: Conference Series, 1126(1), 012018.

74.

Prajapati

Kant

Shankar

(2019). Prioritizing the solutions of reverse logistics implementation to mitigate its barriers: A hybrid modified SWARA and WASPAS approach. Journal of Cleaner Production, 240, 118219. https://doi.org/10.1016/j.jclepro.2019.118219

75.

Rani

Mishra

A. R.

(2020). Multi-criteria weighted aggregated sum product assessment framework for fuel technology selection using q-rung orthopair fuzzy sets. Sustainable Production and Consumption, 24, 90–104. https://doi.org/10.1016/j.spc.2020.06.015

76.

Rani

Mishra

A. R.

Pardasani

K. R.

(2020). A novel WASPAS approach for multi-criteria physician selection problem with intuitionistic fuzzy type-2 sets. Soft Computing, 24(3), 2355–2367. https://doi.org/10.1007/s00500-019-04065-5

77.

Sahida

A. P.

Surarso

Gernowo

(2019). The combination of the MOORA method and the Copeland Score method as a Group Decision Support System (GDSS) Vendor Selection. In 2019 International Seminar on Research of Information Technology and Intelligent Systems (pp. 340–345). IEEE. https://doi.org/10.1109/ISRITI48646.2019.9034579

78.

Sahin

(2020). Hybrid multicriteria group decision-making method for offshore location selection under fuzzy environment. Arabian Journal for Science and Engineering, 45, 6887–6909. https://doi.org/10.1007/s13369-020-04534-2

79.

Seker

Aydin

(2020). Hydrogen production facility location selection for Black Sea using entropy based TOPSIS under IVPF environment. International Journal of Hydrogen Energy, 45(32), 15855–15868. https://doi.org/10.1016/j.ijhydene.2019.12.183

80.

Shaaban

Nojavan

Mohammaditabar

(2019). A fuzzy hybrid approach for ranking and allocation of flare gas recovery methods: A case study of refineries in Iran. Kybernetes, 49(4), 1103–1126. https://doi.org/10.1108/K-10-2018-0534

81.

Shahroudi

Tonekaboni

S. M. S.

(2012). Application of TOPSIS method to supplier selection in Iran auto supply chain. Journal of Global Strategic Management, 6(2), 123–131. https://doi.org/10.20460/JGSM.2012615779

82.

Shyur

H. J.

(2006). COTS evaluation using modified TOPSIS and ANP. Applied Mathematics and Computation, 177(1), 251–259. https://doi.org/10.1016/j.amc.2005.11.006

83.

Simic

Karagoz

Deveci

Aydin

(2021). Picture fuzzy extension of the CODAS method for multi-criteria vehicle shredding facility location. Expert Systems With Applications, 175, 114644. https://doi.org/10.1016/j.eswa.2021.114644

84.

Singh

R. K.

Modgil

(2020). Supplier selection using SWARA and WASPAS—A case study of Indian cement industry. Measuring Business Excellence, 24(2), 243–265. https://doi.org/10.1108/MBE-07-2018-0041

85.

Suben

(1980). Türkiye’de Yüksek Öğrenim Kurumlarının Dağılımı ve Planlarının Karşılaştırılması [Distribution of Higher Education Institutions in Turkey and Comparison of Their Plans] [Bachelor thesis]. Istanbul Technical University.

86.

Supciller

A. A.

Bayramoglu

(2020). Wind farm location selection with interval grey numbers based I-GRA and grey EDAS methods. Journal of the Faculty of Engineering and Architecture of Gazi University, 35(4), 1847–1860. https://doi.org/10.17341/gazimmfd.609518

87.

Turkish Statistical Institute. (2020). http://www.tuik.gov.tr

88.

Turner

P. V.

(1987). Campus: An American planning tradition. MIT Press.

89.

Tus

Adalı

E. A.

(2019). The new combination with CRITIC and WASPAS methods for the time and attendance software selection problem. OPSEARCH, 56(2), 528–538. https://doi.org/10.1007/s12597-019-00371-6

90.

Ulutas

Karakus

C. B.

Topal

(2020). Location selection for logistics center with fuzzy SWARA and CoCoSo methods. Journal of Intelligent & Fuzzy Systems, 38(4), 4693–4709. https://doi.org/10.3233/jifs-191400

91.

United Nations Educational, Scientific and Cultural Organization. (n.d.). https://en.unesco.org/

92.

Urosevic

Karabasevic

Stanujkic

Maksimovic

(2017). An approach to personnel selection in the tourism industry based on the SWARA and the WASPAS methods. Economic Computation and Economic Cybernetics Studies & Research, 51(1), 75–88.

93.

Wang

C. N.

Nguyen

V. T.

Thai

H. T. N.

Duong

D. H.

(2018). Multi-criteria decision making (MCDM) approaches for solar power plant location selection in Viet Nam. Energies, 11(6), 1504. https://doi.org/10.3390/en11061504

94.

Wang

Y. M.

Elhag

T. M. S.

(2006). Fuzzy TOPSIS method based on alpha level sets with an application to bridge risk assessment. Expert Systems With Applications, 31(2), 309–319. https://doi.org/10.1016/j.eswa.2005.09.040

95.

Zhang

Yan

(2019). Optimal location selection for offshore wind-PV-seawater pumped storage power plant using a hybrid MCDM approach: A two-stage framework. Energy Conversion and Management, 199, 1–18. https://doi.org/10.1016/j.enconman.2019.112066

96.

(2010). An extended TOPSIS method with interval-valued intuitionistic fuzzy numbers for virtual enterprise partner selection. Expert Systems With Applications, 37(10), 7050–7055. https://doi.org/10.1016/j.eswa.2010.03.013

97.

Yilmaz

(2019). Performance analysis of foreign deposit banks in Turkey: A multi-MOORA method. Social Sciences Research Journal, 8(3), 54–66.

98.

Yurdakul

Y. T.

(2003). An illustrative study aimed to measure and rank performance of Turkish automotive companies using TOPSIS. Journal of the Faculty of Engineering and Architecture of Gazi University, 18(1), 1–18.

99.

Zak

Węgliński

(2014). The selection of the logistics center location based on MCDM/A methodology. Transportation Research Procedia, 3, 555–564. https://doi.org/10.1016/j.trpro.2014.10.034

100.

Zavadskas

E. K.

Kalibatas

Kalibatiene

(2016). A multi-attribute assessment using WASPAS for choosing an optimal indoor environment. Archives of Civil and Mechanical Engineering, 16, 76–85. https://doi.org/10.1016/j.acme.2015.10.002

101.

Zavadskas

E. K.

Turskis

Antucheviciene

Zakarevicius

(2012). Optimization of weighted aggregated sum product assessment. Elektronika Ir Elektrotechnika, 122(6), 3–6. https://doi.org/10.5755/j01.eee.122.6.1810

102.

Zečević

Tadić

Krstić

(2017). Intermodal transport terminal location selection using a novel hybrid MCDM model. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 25(6), 853–876. https://doi.org/10.1142/S021848851750036

103.

Zolfani

S. H.

Aghdaie

M. H.

Derakhti

Zavadskas

E. K. V.

Varzandeh

M. H. M.

(2013). Decision making on business issues with foresight perspective; an application of new hybrid MCDM model in shopping mall locating. Expert Systems With Applications, 40(17), 7111–7121. https://doi.org/10.1016/j.eswa.2013.06.040