Multi-criteria decision-making (MCDM) can be formally implemented by various methods. This study compares suitability of four selected MCDM methods, namely WPM, TOPSIS, VIKOR, and PROMETHEE, for future applications in agent-based computational economic (ACE) models of larger scale (i.e., over 10 000 agents in one geographical region). These four MCDM methods were selected according to their appropriateness for computational processing in ACE applications. Tests of the selected methods were conducted on four hardware configurations. For each method, 100 tests were performed, which represented one testing iteration. With four testing iterations conducted on each hardware setting and separated testing of all configurations with the-server parameter de/activated, altogether, 12800 data points were collected and consequently analyzed. An illustrational decision-making scenario was used which allows the mutual comparison of all of the selected decision making methods. Our test results suggest that although all methods are convenient and can be used in practice, the VIKOR method accomplished the tests with the best results and thus can be recommended as the most suitable for simulations of large-scale agent-based models.

Faculty of Informatics and Management University of Hradec Králové Rokitanského 62 Hradec Králové Czech Republic

See more in PubMed

Bureš V, Tučník P. Complex Agent-based Models: Application of a Constructivism in the Economic Research. E&M Economics and Management. 2014;17(3):17 10.15240/tul/001/2014-3-012 DOI

Saeed K. Jay Forrester's operational approach to economics. System Dynamics Review. 2014;30(4):233–61. 10.1002/sdr.1525 DOI

Kantamneni A, Brown LE, Parker G, Weaver WW. Survey of multi-agent systems for microgrid control. Engineering Applications of Artificial Intelligence. 2015;45:192–203. 10.1016/j.engappai.2015.07.005 DOI

Weinberg GM. An introduction to general systems thinking / Gerald M. Weinberg Silver anniversary ed. New York: Dorset House; 2001. xxi, 279 p. p.

Yu X, Xu Z. Graph-based multi-agent decision making. International Journal of Approximate Reasoning. 2012;53(4):502–12. 10.1016/j.ijar.2011.12.002 DOI

Nguyen VGN, Huynh HX, Drogoul A. Modelling Multi-Criteria Decision Making Ability of Agents in Agent-Based Rice Pest Risk Assessment Model. In: Huang R, Ghorbani AA, Pasi G, Yamaguchi T, Yen NY, Jin B, editors. Active Media Technology: 8th International Conference, AMT 2012, Macau, China, December 4–7, 2012 Proceedings. Berlin, Heidelberg: Springer Berlin Heidelberg; 2012. p. 134–44.

Triantaphyllou E. Multi-criteria decision making methods. Multi-criteria Decision Making Methods: A Comparative Study: Springer; 2000. p. 5–21.

Peng Y, Kou G, Wang G, Shi Y. FAMCDM: A fusion approach of MCDM methods to rank multiclass classification algorithms. Omega. 2011;39(6):677–89. 10.1016/j.omega.2011.01.009 DOI

Cordasco G, De Chiara R, Mancuso A, Mazzeo D, Scarano V, Spagnuolo C. A Framework for Distributing Agent-Based Simulations. In: Alexander M, D’Ambra P, Belloum A, Bosilca G, Cannataro M, Danelutto M, et al., editors. Euro-Par 2011: Parallel Processing Workshops: CCPI, CGWS, HeteroPar, HiBB, HPCVirt, HPPC, HPSS, MDGS, ProPer, Resilience, UCHPC, VHPC, Bordeaux, France, August 29 –September 2, 2011, Revised Selected Papers, Part I. Berlin, Heidelberg: Springer Berlin Heidelberg; 2012. p. 460–70.

Kiran M, Richmond P, Holcombe M, Chin LS, Worth D, Greenough C, editors. FLAME: simulating large populations of agents on parallel hardware architectures. Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1-Volume 1; 2010: International Foundation for Autonomous Agents and Multiagent Systems.

Voss A, You J-Y, Yen E, Chen H-Y, Lin S, Turner A, et al., editors. Scalable social simulation: investigating population-scale phenomena using commodity computing. e-Science (e-Science), 2010 IEEE Sixth International Conference on; 2010: IEEE.

Nikolai C, Madey G. Tools of the trade: A survey of various agent based modeling platforms. Journal of Artificial Societies and Social Simulation. 2009;12(2):2.

Hmida FB, Seguy A, Dupas R. MultiAgent Systems for Production Planning and Control in Supply Chains. In: Omatu S, De Paz Santana FJ, González RS, Molina MJ, Bernardos MA, Rodríguez CJM, editors. Distributed Computing and Artificial Intelligence: 9th International Conference. Berlin, Heidelberg: Springer Berlin Heidelberg; 2012. p. 205–12.

Wang S, Wan J, Zhang D, Li D, Zhang C. Towards smart factory for Industry 4.0: A self-organized multi-agent system with big data based feedback and coordination. Computer Networks. 10.1016/j.comnet.2015.12.017 DOI

Kagermann H, Helbig J, Hellinger A, Wahlster W. Recommendations for Implementing the Strategic Initiative INDUSTRIE 4.0: Securing the Future of German Manufacturing Industry; Final Report of the Industrie 4.0 Working Group: Forschungsunion; 2013.

Klügl F. “Engineering” Agent-Based Simulation Models? In: Müller JP, Cossentino M, editors. Agent-Oriented Software Engineering XIII: 13th International Workshop, AOSE 2012, Valencia, Spain, June 4, 2012, Revised Selected Papers. Berlin, Heidelberg: Springer Berlin Heidelberg; 2013. p. 179–96.

Kumari S, Singh A, Mishra N, Garza-Reyes JA. A multi-agent architecture for outsourcing SMEs manufacturing supply chain. Robotics and Computer-Integrated Manufacturing. 2015;36:36–44. 10.1016/j.rcim.2014.12.009 DOI

Premm M, Kirn S. A Multiagent Systems Perspective on Industry 4.0 Supply Networks. In: Müller PJ, Ketter W, Kaminka G, Wagner G, Bulling N, editors. Multiagent System Technologies: 13th German Conference, MATES 2015, Cottbus, Germany, September 28–30, 2015, Revised Selected Papers. Cham: Springer International Publishing; 2015. p. 101–18.

Tesfatsion L. Agent-based computational economics: Growing economies from the bottom up. Artificial life. 2002;8(1):55–82. 10.1162/106454602753694765 PubMed DOI

Ishizaka A, Nemery P. Multi-criteria decision analysis: methods and software: John Wiley & Sons; 2013.

Georges A, Buytaert D, Eeckhout L, editors. Statistically rigorous java performance evaluation. Proceedings of the 22nd annual ACM SIGPLAN conference on Object-oriented programming systems and applications; 2007; Montreal, Quebec, Canada: ACM.

Mulliner E, Malys N, Maliene V. Comparative analysis of MCDM methods for the assessment of sustainable housing affordability. Omega. 2016;59, Part B:146–56. 10.1016/j.omega.2015.05.013 DOI

Zopounidis C, Galariotis E, Doumpos M, Sarri S, Andriosopoulos K. Multiple criteria decision aiding for finance: An updated bibliographic survey. European Journal of Operational Research. 2015;247(2):339–48. 10.1016/j.ejor.2015.05.032 DOI

Sabaei D, Erkoyuncu J, Roy R. A Review of Multi-criteria Decision Making Methods for Enhanced Maintenance Delivery. Procedia CIRP. 2015;37:30–5. 10.1016/j.procir.2015.08.086 DOI

Scott JA, Ho W, Dey PK. A review of multi-criteria decision-making methods for bioenergy systems. Energy. 2012;42(1):146–56. 10.1016/j.energy.2012.03.074 DOI

Celik E, Gul M, Aydin N, Gumus AT, Guneri AF. A comprehensive review of multi criteria decision making approaches based on interval type-2 fuzzy sets. Knowledge-Based Systems. 2015;85:329–41. 10.1016/j.knosys.2015.06.004 DOI

Alicia HdD, Mónica MGM, Jorge JAM. Application of Multi-Criteria Decision Methods (MCDM) for the development of functional food products in Venezuela. Procedia Food Science. 2011;1:1560–7. 10.1016/j.profoo.2011.09.231 DOI

Pekkaya M. Career Preference of University Students: An Application of MCDM Methods. Procedia Economics and Finance. 2015;23:249–55. 10.1016/S2212-5671(15)00486-4 DOI

Thor J, Ding S-H, Kamaruddin S. Comparison of multi criteria decision making methods from the maintenance alternative selection perspective. The International Journal of Engineering and Science. 2013;2(6):27–34.

Peniwati K. Criteria for evaluating group decision-making methods. Mathematical and Computer Modelling. 2007;46(7–8):935–47. 10.1016/j.mcm.2007.03.005 DOI

Tan PS, Lee SSG, Goh AES. Multi-criteria decision techniques for context-aware B2B collaboration in supply chains. Decision Support Systems. 2012;52(4):779–89. 10.1016/j.dss.2011.11.013 DOI

Rezaei J. A Systematic Review of Multi-criteria Decision-making Applications in Reverse Logistics. Transportation Research Procedia. 2015;10:766–76. 10.1016/j.trpro.2015.09.030 DOI

Chiu W-Y, Tzeng G-H, Li H-L. A new hybrid MCDM model combining DANP with VIKOR to improve e-store business. Knowledge-Based Systems. 2013;37:48–61. 10.1016/j.knosys.2012.06.017 DOI

Wang Y-L, Tzeng G-H. Brand marketing for creating brand value based on a MCDM model combining DEMATEL with ANP and VIKOR methods. Expert Systems with Applications. 2012;39(5):5600–15. 10.1016/j.eswa.2011.11.057 DOI

Liu C-H, Tzeng G-H, Lee M-H. Improving tourism policy implementation–The use of hybrid MCDM models. Tourism Management. 2012;33(2):413–26. 10.1016/j.tourman.2011.05.002 DOI

Lee W-S, Tu W-S. Combined MCDM techniques for exploring company value based on Modigliani–Miller theorem. Expert Systems with Applications. 2011;38(7):8037–44. 10.1016/j.eswa.2010.12.138 DOI

Behzadian M, Khanmohammadi Otaghsara S, Yazdani M, Ignatius J. A state-of the-art survey of TOPSIS applications. Expert Systems with Applications. 2012;39(17):13051–69. 10.1016/j.eswa.2012.05.056 DOI

Johnson DDP, Blumstein DT, Fowler JH, Haselton MG. The evolution of error: error management, cognitive constraints, and adaptive decision-making biases. Trends in Ecology & Evolution. 2013;28(8):474–81. 10.1016/j.tree.2013.05.014 PubMed DOI

Fishburn PC. Letter to the editor—additive utilities with incomplete product sets: application to priorities and assignments. Operations Research. 1967;15(3):537–42.

Triantaphyllou E. Multi-criteria decision making methods: a comparative study Dordrecht; Boston, Mass.: Kluwer Academic Publishers; 2000. xxviii, 288 p. p.

Bridgman PW. Dimensional analysis: Yale University Press; 1922.

Miller D, Starr M. Executive decisions and operations research Englewood Cliffs, 1969. Prentice-Hall, Inc: NJ.

Ching-Lai H, Yoon K. Multiple attribute decision making: Methods and applications: Springer-Verlag; 1981.

Rao RV. Applications of Improved MADM Methods to the Decision Making Problems of Manufacturing Environment Decision Making in Manufacturing Environment Using Graph Theory and Fuzzy Multiple Attribute Decision Making Methods. Springer Series in Advanced Manufacturing: Springer London; 2013. p. 41–135.

Chang C-L. A modified VIKOR method for multiple criteria analysis. Environ Monit Assess. 2010;168(1–4):339–44. 10.1007/s10661-009-1117-0 PubMed DOI

Tzeng G-H, Lin C-W, Opricovic S. Multi-criteria analysis of alternative-fuel buses for public transportation. Energy Policy. 2005;33(11):1373–83.

Opricovic S. Multi-criteria Optimization of Civil Engineering Systems, Faculty of Civil Engineering, Belgrade. Table II The performance matrix. 1998.

Tzeng G-H, Teng M-H, Chen J-J, Opricovic S. Multicriteria selection for a restaurant location in Taipei. International Journal of Hospitality Management. 2002;21(2):171–87.

Opricovic S, Tzeng G-H. Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS. European Journal of Operational Research. 2004;156(2):445–55.

Kackar R. Off-line Quality-Control, Parameter Design, and the Taguchi Method-Response. Journal of Quality Technology. 1985;17(4):207–9.

Yazdani M, Payam AF. A comparative study on material selection of microelectromechanical systems electrostatic actuators using Ashby, VIKOR and TOPSIS. Materials & Design. 2015;65(0):328–34. 10.1016/j.matdes.2014.09.004 DOI

Tong L-I, Chen C-C, Wang C-H. Optimization of multi-response processes using the VIKOR method. Int J Adv Manuf Technol. 2007;31(11–12):1049–57. 10.1007/s00170-005-0284-6 DOI

Mateo J. PROMETHEE. Multi Criteria Analysis in the Renewable Energy Industry. Green Energy and Technology: Springer; London; 2012. p. 23–32.

Anojkumar L, Ilangkumaran M, Sasirekha V. Comparative analysis of MCDM methods for pipe material selection in sugar industry. Expert Systems with Applications. 2014;41(6):2964–80. 10.1016/j.eswa.2013.10.028 DOI

Mulliner E, Malys N, Maliene V. Comparative analysis of MCDM methods for the assessment of sustainable housing affordability. Omega. 10.1016/j.omega.2015.05.013 DOI

Sánchez-Lozano JM, Teruel-Solano J, Soto-Elvira PL, Socorro García-Cascales M. Geographical Information Systems (GIS) and Multi-Criteria Decision Making (MCDM) methods for the evaluation of solar farms locations: Case study in south-eastern Spain. Renewable and Sustainable Energy Reviews. 2013;24:544–56. 10.1016/j.rser.2013.03.019 DOI

Fierek S, Zak J. Planning of an Integrated Urban Transportation System based on Macro–Simulation and MCDM/A Methods. Procedia—Social and Behavioral Sciences. 2012;54:567–79. 10.1016/j.sbspro.2012.09.774 DOI

Li M, Jin L, Wang J. A new MCDM method combining QFD with TOPSIS for knowledge management system selection from the user's perspective in intuitionistic fuzzy environment. Applied Soft Computing. 2014;21:28–37. 10.1016/j.asoc.2014.03.008 DOI

Hobbs BF, Chankong V, Hamadeh W. An Experiment in Water Resources Planning. Water Resources Research. 1992;28(7):1767–79.

Collier N, North M. Parallel agent-based simulation with Repast for High Performance Computing. Simulation. 2012:0037549712462620.