wseas-12074-20260922083644-40533d 20260922083644022 wseas/wseas wseas.group@gmail.com WSEAS WSEAS Transactions on Computers 1109-2750 2224-2872 04 14 2026 04 14 2026 25 Stefan Trajanoski Faculty of Communication Networks and Security-University of Information Science and Technology “St. Paul the Apostle” Partizanska bb, 6000 Ohrid, REPUBLIC OF NORTH MACEDONIA Aleskandar Karadimce Faculty of Communication Networks and Security-University of Information Science and Technology “St. Paul the Apostle” Partizanska bb, 6000 Ohrid, REPUBLIC OF NORTH MACEDONIA Enterprise adoption of Large Language Models demands evaluation beyond model accuracy, encompassing cost, latency, compliance, and update adaptability. This paper introduces a Quantitative Evaluation Framework (QEF) to benchmark GPT deployment strategies within Azure OpenAI infrastructure. Five configurations baseline inference, prompt engineering, supervised fine-tuning, Retrieval-Augmented Generation (RAG), and a hybrid architecture were evaluated against 500 domain-specific queries drawn from 12,000 enterprise policy documents. Six metrics were measured: Factual Accuracy Score, Hallucination Rate, Mean Latency, Cost per 1,000 Queries, Update Flexibility Index, and a composite Enterprise Deployment Efficiency Index. Results confirm statistically significant performance differences across configurations (p < 0.001). RAG achieved the optimal balance between factual grounding and cost efficiency, reducing hallucination by over 70% relative to baseline. A governance-integrated Deployment Decision Framework is proposed, aligning technical, economic, and regulatory dimensions for enterprise AI architecture selection. 09 22 2026 09 22 2026 148 14 https://creativecommons.org/licenses/by/4.0/ 10.37394/23205.2026.25.14 https://wseas.com/journals/articles.php?id=12074 OpenAI, GPT-4 Technical Report, Technical Report, arXiv:2303.08774 [cs.CL], 2024. Available: https://arxiv.org/abs/2303.08774(Accessed Date: 13 January 2026). doi: 10.48550/arXiv.2303.08774. European Parliament and Council of the European Union, Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act), Official Journal of the European Union, OJ L, 2024/1689, pp. 1–144, July 12, 2024. [Online]. Available: http://data.europa.eu/eli/reg/2024/1689/oj.(Accessed Date: 13 January 2026) M. Grabuloski, A. Karadimce, and A. Sefidanoski, "Enhancing Language Models with Retrieval-Augmented Generation: A Comparative Study on Performance," WSEAS Transactions on Information Science and Applications, vol. 22, pp. 272–297, 2025, doi:10.37394/23209.2025.22.23. Y. Gao, Y. Xiong, X. Gao, K. Jia, J. Pan, Y. Bi, Y. Dai, J. Sun, Q. Guo, M. Wang, and H. Wang, "Retrieval-Augmented Generation for Large Language Models: A Survey," arXiv preprint arXiv:2312.10997, 2024, doi:10.48550/arXiv.2312.10997. T. Yu, W. Zhou, L. Yang, A. Shukla, M. Madugula, P. Gundecha, N. Burnett, A. Xu, V. Seth, T. Bar, R. Akkiraju, and V. Zhang, "EKRAG: Benchmark RAG for Enterprise Knowledge Question Answering," in Proc. 4th Int. Workshop on Knowledge-Augmented Methods for Natural Language Processing (KnowledgeNLP 2025), Albuquerque, NM, USA, 2025, pp. 152–159, doi:10.18653/v1/2025.knowledgenlp-1.13. E. Karakurt and A. Akbulut, "Retrieval-Augmented Generation (RAG) and Large Language Models (LLMs) for Enterprise Knowledge Management and Document Automation: A Systematic Literature Review," Applied Sciences, vol. 16, no. 1, Art. no. 368, 2026, doi:10.3390/app16010368 D. M. Anisuzzaman, J. G. Malins, P. A. Friedman, and Z. I. Attia, "Fine-Tuning Large Language Models for Specialized Use Cases," Mayo Clinic Proceedings: Digital Health, vol. 3, no. 1, Art. no. 100184, 2025, doi:10.1016/j.mcpdig.2024.100184. C. Wang, Z. Yang, S. Gao, C. Gao, T. Peng, H. Huang, Y. Deng, and M. Lyu, "RAG or Fine-tuning? A Comparative Study on LCMs-based Code Completion in Industry," in Proc. 33rd ACM Int. Conf. on the Foundations of Software Engineering (FSE Companion '25), Trondheim, Norway, 2025, pp. 93–104, ISBN: 979-8-4007-1276-0, doi:10.1145/3696630.3728535. S. Liu, X. Li, Z. Liu, Y. Yan, C. Yang, Z. Zeng, Z. Liu, M. Sun, and G. Yu, "Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models," in Findings of the Association for Computational Linguistics: ACL 2025, Vienna, Austria, 2025, pp. 5788–5807, ISBN: 979-8-89176-256-5, doi:10.18653/v1/2025.findings-acl.301. P. P. Mishra, K. P. Yeole, R. Keshavamurthy, M. B. Surana, and F. Sarayloo, "A Systematic Framework for Enterprise Knowledge Retrieval: Leveraging LLM-Generated Metadata to Enhance RAG Systems," arXiv preprint arXiv:2512.05411, 2025, doi:10.48550/arXiv.2512.05411. P. Jiang, "A Comparative Study on Retrieval-Augmented Generation and Chain-of-Thought Applications for LLM-Assisted Engineering Design Ideation," Journal of Engineering Design, pp. 1–41, 2025, doi:10.1080/09544828.2025.2574209.