f2eaa151-4cdb-4168-9741-e6a252eeb23320210401044843705wseamdt@crossref.orgMDT DepositWSEAS TRANSACTIONS ON SIGNAL PROCESSING2224-34881790-505210.37394/232014http://wseas.org/wseas/cms.action?id=4062331202133120211710.37394/232014.2021.17https://wseas.org/wseas/cms.action?id=23315VyacheslavTuzlukovBelarusian State Aviation Academy 77, Uborevicha Str., 220096 Minsk, BelarusIn this paper, we investigate the performan-ce in terms of symbol error probability (SEP) of multipleinput multiple-output (MIMO) systems employing the ge-neralized receiver with high spectral efficiency. In particular, we consider the coherent detection of M-PSK signals in a flat Rayleigh fading environment. We focus on spectrally efficient MIMO systems where after serial-to-parallel con-version, several sub-streams of symbols are simultaneously transmitted by using an antenna array, thereby increasing the spectral efficiency. The reception is based on linear mi-nimum mean-square-error (MMSE) combining, eventually followed by successive interference cancellation. Exact and approximate expressions are derived for an arbitrary nu-mber of transmitting and receiving antenna elements. Sim-ulation results confirm the validity of our analytical meth-odology.33120213312021115https://www.wseas.org/multimedia/journals/signal/2021/a025114-001(2021).pdf10.37394/232014.2021.17.1https://www.wseas.org/multimedia/journals/signal/2021/a025114-001(2021).pdf10.1109/jsac.1987.1146600J. H. Winters, “On the capacity of radio communication systems with diversity in Rayleigh-fading environment.” IEEE Journal of Selected Areas in Communications. 1987, Vol. SAC-5, No. 5. Pp. 871-878. 10.1109/26.966069M. Z. Win and J.H. Winters, “Virtual branch analysis of symbol error probability for hybrid selection/maximal-ra-tio combining in Rayleigh fading.” IEEE Transactions on Communications. 2001, Vol. 49, No. 11, pp. 1926-1934. 10.1002/bltj.2015G. J. Foschini, “Layered space-time architecture for wire-less communication in a fading environment when using multiple antennas.” Bell Laboratory Technical Journal. 1996, Vol. 1, No. 2, pp. 41-59. 10.1023/a:1008889222784G. J. Foschini and M. J. Gans, “On limits of wireless co-mmunications in a fading when using multiple antennas.” Wireless Personal Communications. 1998. Vol. 6, No. 3, pp. 311-335. 10.1109/49.806815G. J. Foschini, G. D. Golden, R. A. Valenzuela, and P. W. Wolniansky, “Simplified processing for high spectral effi-ciency wireless communication employing multielement arrays,” IEEE Transactions on Communications. 1999, Vol. 17, No. 11, pp. 1841-1852. E. Telatar, “Capacity of multiantenna Gaussian channels”, European Transactions on Telecommunications. 1999, Vol. 10, No. 6, pp. 585-595. 10.1109/4234.975485S. Loyka and G. Tsoulos, “Estimating MIMO system per-formance using the correlation matrix approach.” IEEE Communications Letters. 2002, Vol. 6, No. 1, pp. 19-21. 10.1109/tit.2003.817437M. Chiani, M. Z. Win, and A., Zanella, “On the capacity of spatially correlated MIMO Rayleigh-fading channels.” IEEE Transactions on Information Theory. 2003, Vol. 49, No. 10, pp. 2363-2371. 10.1109/4234.892193S. Catreux, P. F. Driessen, and L. J. Grenstein, “Simulati-on results for an interference-limited multiple-input multi-ple-output cellular system.” IEEE Communications Lett-ers. 2000, Vol. 4, No. 11, pp. 334-336. 10.1109/26.983316N. Boubaker, K. B. Letaief, and D Murch, “Performance of BLAST over frequency-selective wireless communica-tion channels.” IEEE Transactions on Communications. 2002, Vol. 50, No. 2, pp. 196-199. 10.1109/26.975751A. Lozano and C. Papadias, “Layered space-time receiv-ers for frequency-selective wireless channels.” IEEE Tra-nsactions on Communications. 2002, Vol. 50, No. 1, pp. 65-73. 10.1109/26.983313X. Zhu and R. D. Murch, “Performance analysis of maxi-mum likelihood detection in a MIMO antenna system.” IEEE Transactions on Communications. 2002, Vol. 50, No. 2, pp. 187-191. 10.1109/glocom.2001.965669M. Chiani, M. Z. Win, A Zanella, R. K. Mallik, and J. H. Winters, “Bounds and approximations for optimum com-bining of signals in the presence of multiple co-channel interferers and thermal noise.” IEEE Transactions on Co-mmunications. 2002, Vol. 50, No. 1, pp. 65-73. 10.1006/dspr.1998.0315V. P. Tuzlukov, “A new approach to signal detection the- ory.” Digital Signal Processing. 1998, Vol. 8, No. 3, pp. 166–184. V.P. Tuzlukov, Signal Detection Theory, New York:Spri- nger-Verlag, 2001. V.P. Tuzlukov, Signal Processing Noise, Boca Raton, Lo- ndon, New York, Washington D.C.: CRC Press, Taylor & Francis Group, 2002. M. Maximov, “Joint correlation of fluctuative noise at the outputs of frequency filters. Radio Engineering. 1956,No. 9, pp. 28–38. Y. Chernyak, Y. “Joint correlation of noise voltage at out- puts of amplifiers with no overlapping responses. Radio Physics and Electronics. 1960. No. 4, pp. 551–561. 10.1016/j.dsp.2011.07.005V. P. Tuzlukov, “DS-CDMA downlink systems with fad- ing channel employing the generalized. Digital Signal Processing. 2011. Vol. 21, No. 6, pp. 725–733. 10.1007/s00034-011-9273-1V. P. Tuzlukov, “Signal processing by generalized detec- tor in DS-CDMA wireless communication systems with frequency-selective channels.” Circuits, Systems, and Si- gnal Processing. Published on-line on February 2, 2011, doi:10.1007/s00034-011-9273-1; 2011, Vol.30, No.6, pp. 1197–1230. 10.1016/j.dsp.2019.07.016M. Shbat, Tuzlukov, V.P. “Primary signal detection algo- rithms for spectrum sensing at low SNR over fading cha- nnels in cognitive radio.” Digital Signal Processing (2019) https://doi.org/10.1016/j.dsp. 2019.07.16. Digital Signal Processing. 2019, Vol. 93, No. 5, pp. 187- 207. M. Shbat, V. P. Tuzlukov, “Evaluation of detection perfo- rmance under employment of the generalized detector in radar sensor systems.” Radioengineering. 2014, Vol. 23, No. 1, pp. 50-65. 10.1049/iet-spr.2013.0235M. Shbat, V. P. Tuzlukov, “Definition of adaptive detec- tion threshold under employment of the generalized dete- ctor in radar sensor systems. IET Signal Processing.2014, Vol. 8, Issue 6, pp. 622–632. 10.3390/s150716105M. Shbat, V. P. Tuzlukov, SNR wall effect alleviation by generalized detector employment in cognitive radio net- works. Sensors, 2015, 15(7), pp.16105-16135;doi:10. 3390/s150716105. 10.37394/232014.2020.16.6V. P. Tuzlukov, “Quaternary DS-SSMA communications employing generalized detector over Rayleigh fading channels”. WSEAS Transactions on Signal Processing. 2020. Vol.16., Paper # 6, pp. 43-58. doi: 10. 37394/ 232014.2020.16.6 10.37394/23204.2020.19.15V.P. Tuzlukov, “Signal processing by generalized receiv- er using DS-CDMA with STBC technology in multidim- ensional systems over fading channels: capacity and error probability.” WSEAS Transactions on Communications. 2020. Vol. 19. Paper #15. pp. 124-141. doi:10.37394/ 23204.2020.19.15 R. N. McDonough and A. D. Whalen, Detection of Sig- nals in Noise. 2nd ed., San Diego, CA., USA: Academic Press, 1995. 10.1155/2012/781434M. Jayasheela and A. Rajeswari,”Improved successive interference cancellation for MIMO/UWB-based wireless body area network”, International Journal of Antennas and Propagation. Vol. 2012, Article ID 781434, 9 pages, 2012. https://doi.org/10.1155/2012/781434. 10.1155/2014/405487P. Meerasri, P. Uthansakul, M. Uthansakul, “Self-interfe- rence cancellation- based mutual-coupling model for full- duplex single-channel MIMO systems”. International Jo- urnal of Antennas and Propagation. Vol. 2014, Article ID 405487, 10 pages, 2014. https://doi.org/10.1155/2014/ 405487 10.1186/s13638-018-1186-2H. Na and C/ Lee, “An inter user interference cancellati- on scheme for two users in full-duplex MIMO system”. EURASIP Journal on Wireless Communications and Net- working. (2018) 2018: 171, 9 pages. https://doi.org/10. 1186/ s13638-018-1186-2 10.1016/j.aeue.2020.153223Saifullah Adnan, Yuli Fu, Bhutto Jameed Ahmed, Muha- mmad Faizan Tahir, Farhad Banoon, “Modified ordered successive interference cancellation MIMO detection us- ing low complexity constellation search”/AEU-Internati- onal Journal of Electronics and Communications. 2020, Vol. 121, Article ID 153223. https://doi.org/10/1016/j. aeue.2020.153223 10.3390/s20102753R. Chatan and R. Akl, “Massive MIMO systems for 5G and beyond 32 networks-overview, recent trends, chall- enges,and future research direction”. Sensors. 2020 May, 20 (10): 2753.doi:10.3390/s20102753 10.3390/s20216255Taehyoung Kim and Sangjoon Park, “Statistical beamfor- ming for massive MIMO systems with distinct spatial co- rrelations”. Sensors. 2020 November, 20 (21): 6255. doi: 10.3390/s20216255. 10.1109/26.602577M. Chiani, “Introducing erasures in decision-feedback eq- ualization to reduce error propagation.” IEEE Transacti- ons on Communications. 1997, Vol. 45, No. 7, pp. 757- 760. 10.1109/tit.1974.1055246D. L. Duttweiler, J. E. Mazo, and G. Messerschmitt,” An upper bound on the error probability in decision-feedback equalizers.” IEEE Transactions on Information Theory. 1974 Vol. IT- 20, No. 4, pp. 490-497. J. G. Proakis, Digital Communications. 4th ed. New York: McGraw-Hill, 2008. 10.1214/aoms/1177703550A. T. James, “Distributions of matrix variates and latent roots derived from normal samples”. Annual of Mathe- matical Statistics. 1964, Vol. 35, pp. 475-501