Browsing by Author "Foh, Chuan Heng"

Now showing 1 - 3 of 3

Citation - WoS: 1
Citation - Scopus: 5
Contextual Multi-Armed Bandit Based Beam Allocation in mmWave V2x Communication Under Blockage
(IEEE, 2023) Cassillas, Arturo Medina; Koset, Abdulkadir; Leet, Haeyoung; Foh, Chuan Heng; Leowt, Chee Yen; Lee, Haeyoung; Yen Leow, Chee; Kose, Abdulkadir
Due to its low latency and high data rates support, mmWave communication has been an important player for vehicular communication. However, this carries some disadvantages such as lower transmission distances and inability to transmit through obstacles. This work presents a Contextual Multi-Armed Bandit Algorithm based beam selection to improve connection stability in next generation communications for vehicular networks. The algorithm, through machine learning (ML), learns about the mobility contexts of the vehicles (location and route) and helps the base station make decisions on which of its beam sectors will provide connection to a vehicle. In addition, the proposed algorithm also smartly extends, via relay vehicles, beam coverage to outage vehicles which are either in NLOS condition due to blockages or not served any available beam. Through a set of experiments on the city map, the effectiveness of the algorithm is demonstrated, and the best possible solution is presented.
Machine Learning Based Beamwidth Adaptation for mmWave Vehicular Communications
(Institute of Electrical and Electronics Engineers Inc., 2023) Manic, Setinder; Heng Foh, Chuan; Köse, Abdulkadir; Lee, Haeyoung; Leow, Chee Yen; Chatzimisios, Periklis; Suthaputchakun, Chakkaphong; Foh, Chuan Heng
The incorporation of mmWave technology in vehicular networks has unlocked a realm of possibilities, propelling the advancement of autonomous vehicles, enhancing interconnectedness, and facilitating communication for intelligent transportation systems (ITS). Despite these strides in connectivity, challenges such as high path-loss have arisen, impacting existing beam management procedures. This work aims to address this issue by improving beam management techniques, specifically focusing on enhancing the service time between vehicles and base stations through adaptive mmWave beamwidth adjustments, accomplished using a Contextual Multi-Armed Bandit Algorithm. By leveraging various conditions to train the ML agent of the Contextual Multi-Armed Bandit Algorithm, it seeks to learn about vehicle mobility profiles and optimize the usage of different antenna beamwidth settings to maximize seamless connection time. The extensive simulation results showcase the effectiveness of an adaptive beamwidth for mobility profiles, extending the connection time a vehicle experiences with a base station when compared to the existing strategies. © 2024 Elsevier B.V., All rights reserved.
Citation - WoS: 8
Citation - Scopus: 10
Multi-Agent Context Learning Strategy for Interference-Aware Beam Allocation in mmWave Vehicular Communications
(IEEE-Inst Electrical Electronics Engineers Inc, 2024) Kose, Abdulkadir; Lee, Haeyoung; Foh, Chuan Heng; Shojafar, Mohammad
Millimeter wave (mmWave) has been recognized as one of key technologies for 5G and beyond networks due to its potential to enhance channel bandwidth and network capacity. The use of mmWave for various applications including vehicular communications has been extensively discussed. However, applying mmWave to vehicular communications faces challenges of high mobility nodes and narrow coverage along the mmWave beams. Due to high mobility in dense networks, overlapping beams can cause strong interference which leads to performance degradation. As a remedy, beam switching capability in mmWave can be utilized. Then, frequent beam switching and cell change become inevitable to manage interference, which increase computational and signalling complexity. In order to deal with the complexity in interference control, we develop a new strategy called Multi-Agent Context Learning (MACOL), which utilizes Contextual Bandit to manage interference while allocating mmWave beams to serve vehicles in the network. Our approach demonstrates that by leveraging knowledge of neighbouring beam status, the machine learning agent can identify and avoid potential interfering transmissions to other ongoing transmissions. Furthermore, we show that even under heavy traffic loads, our proposed MACOL strategy is able to maintain low interference levels at around 10%.