Reinforcement Learning-Based Link Adaptation and Grant-Free Mode Selection for O-RAN Systems

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：66

、訪客IP：18.218.1.38

姓名

許皓惟(Hao-Wei TSU) 查詢紙本館藏

畢業系所

通訊工程學系

論文名稱

(Reinforcement Learning-Based Link Adaptation and Grant-Free Mode Selection for O-RAN Systems)

相關論文

★ 基於馬賽克特性之低失真實體電路佈局保密技術	★ 多路徑傳輸控制協定下從無線區域網路到行動網路之無縫換手
★ 感知網路下具預算限制之異質性子頻段分配	★ 下行服務品質排程在多天線傳輸環境下的效能評估
★ 多路徑傳輸控制協定下之整合型壅塞及路徑控制	★ Opportunistic Scheduling for Multicast over Wireless Networks
★ 適用多用戶多輸出輸入系統之低複雜度比例公平性排程設計	★ 利用混合式天線分配之 LTE 異質網路 UE 與 MIMO 模式選擇
★ 基於有限預算標價式拍賣之異質性頻譜分配方法	★ 適用於 MTC 裝置 ID 共享情境之排程式分群方法
★ Efficient Two-Way Vertical Handover with Multipath TCP	★ 多路徑傳輸控制協定下可亂序傳輸之壅塞及排程控制
★ 移動網路下適用於閘道重置之群體換手機制	★ 使用率能小型基地台之拍賣是行動數據分流方法
★ 高速鐵路環境下之通道預測暨比例公平性排程設計	★ 用於行動網路效能評估之混合式物聯網流量產生器

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

[檢視]

[下載]

本電子論文使用權限為同意立即開放。
已達開放權限電子全文僅授權使用者為學術研究之目的，進行個人非營利性質之檢索、閱讀、列印。
請遵守中華民國著作權法之相關規定，切勿任意重製、散佈、改作、轉貼、播送，以免觸法。

摘要(中)

由於製造商正在開發用於性能和應用集成的 5G NR 基站 (BS)，當前的
解決方案主要基於傳統的技術規範，發展智能無線資源管理技術可以優
化當前小蜂窩系統的傳輸性能。為了在 O-RAN Near-RT RIC 中構建用於
鏈路自適應的 xApp，我們使用提供的 API 來完成傳輸觀察和參數自適
應等基本功能，然後採用深度強化學習。智能代理(Agent)以收到訊息作
為狀態(State)，可以動態選擇最佳的鏈路適配參數，實現高效傳輸。儘
管如此，我們將此功能打包到 xApp 中並在現實的 O-RAN 系統上進行測
試，觀察到了不錯的結果。
另一方面在超可靠低時延通信（URLLC）應用中，我們嘗試使用 5G
ns-3 模擬 IIoT 工廠場景，有別於傳統的上行方式， Grant-free（GF）可以在減少延遲下，同時保持一定的可靠性。在不同的傳輸條件下，我們開發了不同的 RL 方法來動態選擇 GF，最終在數值結果中也可以看到滿意率的良好趨勢。

摘要(英)

As manufacturers are developing 5G NR base stations (BS) for performance and application integration, current solutions are mainly based on conventional technical specifications. Developing intelligent wireless resource management
technology could optimize and refine the current small cell system transmission performance. To build an xApp in O-RAN Near-RT RIC for link adaptation, we use the provided API to complete essential functions such as transmission
observation and parameter adaptation. Then the deep reinforcement learning is adopted. Using the indication report as the state, the smart agent can dynamically select the best link adaptation parameters to achieve high-efficiency transmission. Nevertheless, we pack the agent into an xApp and test on a realistic O-RAN system with encouraging results observed.
In the ultra reliable low latency communication (URLLC) application, we try to use 5G ns-3 simulation and simulate the IIoT factory scenario, which is different from the traditional uplink method. Grant-free (GF) can reduce the
delay while maintaining certain reliability. Under various transmission conditions, we developed different reinforcement learning (RL) methods used to select mode dynamically. Finally, a promising trend in satisfaction rate can also be seen in the numerical result.

關鍵字(中)

★ O-RAN
★ xApps
★ Near-RT RIC
★ Link adaptation
★ Grant free

關鍵字(英)

論文目次

1 Introduction...1
1.1 Background...1
1.2 Contribution...2
2 Related Works...4
2.1 5G O-RAN...4
2.2 Link Adaptation...4
2.3 Grant-Free Transmission...5
3 System Model...7
3.1 O-RAN xApps and MatLab Simulator...7
3.2 5G IIoT Application Scenarios in ns-3...9
4 MDP model for smart O-RAN adaptation...10
5 DQN for xApp link adaptation...12
5.1 Data Collection and Numerical Analysis...12
5.2 The Setting of Actions and The Reward Design...13
6 Reinforcement Learning For Grant-free modes selection...15
6.1 Problem Formulation...15
6.2 Implementation of GF Modes...15
6.3 The Setting of Actions and The Reward Design...16
7 Numerical Results...19
7.1 Simulation Setup...19
7.2 Utility of Link Adaptation...21
7.3 Satisfaction Rate of Different Grant-Free Modes...21
8 Conclusions and Future Works...24

參考文獻

[1] C. Li and A. Akman, “O-RAN Use Cases and Deployment Scenarios,” O-RAN White Paper, feb 2020.
[2] S. Niknam, A. Roy, H. S. Dhillin, S. Singh, R. Banerji, J. H. Reed, N. Saxena, and S. Yoon, “Intelligent O-RAN for beyond 5G and 6G wireless networks,” arXiv:2005.08374, pp. 1–7, may 2020.
[3] O-RAN Alliance, “O-RAN working group 2: AI/ML workflow description and requirements,” mar 2019.
[4] A. Huff, M. Hiltunen, and E. P. Duarte, “Rft: Scalable and fault-tolerant microservices for the o-ran control plane,” pp. 402–409, 2021.
[5] S. K. Singh, R. Singh, and B. Kumbhani, “The evolution of radio access network towards open-ran: Challenges and opportunities,” in 2020 IEEE Wireless Communications and Networking Conference Workshops (WCNCW), 2020, pp. 1–6.
[6] O-RAN Alliance, “O-RAN: Towards an Open and Smart RAN,” O-RAN White Paper, oct 2018.
[7] H. Lee, J. Cha, D. Kwon, M. Jeong, and I. Park, “Hosting ai/ml workflows on o-ran
ric platform,” in 2020 IEEE Globecom Workshops (GC Wkshps, 2020, pp. 1–6.
[8] S. A. T. Kawahara and A. U. R. Matsukawa, “O-ran alliance standardization trends,” 2019.
[9] S. Lagen, L. Giupponi, A. Hansson, and X. Gelabert, “Modulation compression in next generation ran: Air interface and fronthaul trade-offs,” IEEE Communications
Magazine, vol. 59, no. 1, pp. 89–95, 2021.
[10] C. Yu, L. Yu, Y. Wu, Y. He, and Q. Lu, “Uplink Scheduling and Link Adaptation for Narrowband Internet of Things Systems,” IEEE Access, vol. 5, pp. 1724–1734,2017.
[11] J. Wang, C. Xu, Y. Huangfu, R. Li, Y. Ge, and J. Wang, “Deep reinforcement learning for scheduling in cellular networks,” 2019 11th International Conference on Wireless Communications and Signal Processing (WCSP), pp. 1–6, 2019.
[12] Y. Liu, Y. Deng, M. Elkashlan, A. Nallanathan, and G. K. Karagiannidis, “Analyzing grant-free access for urllc service,” IEEE Journal on Selected Areas in Communications, vol. 39, no. 3, pp. 741–755, 2021.
[13] T. Jacobsen, R. Abreu, G. Berardinelli, K. Pedersen, P. Mogensen, I. Z. Kovacs, and T. K. Madsen, “System level analysis of uplink grant-free transmission for urllc,” in
2017 IEEE Globecom Workshops (GC Wkshps), 2017, pp. 1–6.
[14] N. Ye, X. Li, H. Yu, A. Wang, W. Liu, and X. Hou, “Deep learning aided grantfree noma toward reliable low-latency access in tactile internet of things,” IEEE
Transactions on Industrial Informatics, vol. 15, no. 5, pp. 2995–3005, 2019.
[15] Institute for Information Industry, “5G Technology Workshop with RIC Theme Description,” jun 2021.
[16] C.-L. I and S. Katti, “O-RAN: Towards an Open and Smart RAN,” O-RAN White Paper, oct 2018.
[17] Institute for Information Industry, “xApp Manual of Developer-V2,” aug 2021.
[18] N. Patriciello, S. Lagen, L. Giupponi, and B. Bojovic, “An improved mac layer for the 5g nr ns-3 module,” in Proceedings of the 2019 Workshop on Ns-3, ser. WNS3 2019. New York, NY, USA: Association for Computing Machinery, 2019, p. 41–48. [Online]. Available: https://doi.org/10.1145/3321349.3321350
[19] S. Lagen, K. Wanuga, H. Elkotby, S. Goyal, N. Patriciello, and L. Giupponi, “New radio physical layer abstraction for system-level simulations of 5g networks,” in ICC 2020 - 2020 IEEE International Conference on Communications (ICC), 2020, pp. 1–7.
[20] T. Jiang, J. Zhang, P. Tang, L. Tian, Y. Zheng, J. Dou, H. Asplund, L. Raschkowski, R. D’Errico, and T. Jams ¨ a, “3gpp standardized 5g channel model for iiot scenarios: ¨
A survey,” IEEE Internet of Things Journal, vol. 8, no. 11, pp. 8799–8815, 2021.
[21] “Study on channel model for frequencies from 0.5 to 100 ghz, v16.1.0,” 3GPP, Sophia Antipolis, France, Rep. TR 38.901, Dec 2019.
[22] A. T. Z. Kasgari and W. Saad, “Model-free ultra reliable low latency communication (urllc): A deep reinforcement learning framework,” in ICC 2019 - 2019 IEEE
International Conference on Communications (ICC), 2019, pp. 1–6.

指導教授

黃志煒

審核日期

2022-8-24

推文