我們考慮到裝置對裝置之通訊(Device-to-Device communication, D2D)有可能在非理想情況下被建立，我們提出一個下行鏈路干擾緩解機制，在保障蜂巢式用戶的鏈路品質前提下，提升整體系統容量，我們模擬多個D2D用戶時採用抑制干擾範圍與正交資源分配，接著使用本實驗室學長先前所撰寫之位置推薦的結果，並稱之為傳統方法，本篇研究接續著傳統方法，搭配人工智慧的方法針對D2D提出功率調整演算法(Location Recommendation and Power Adjustment using A2C with LSTM, LR&PA_A2C+LSTM)，管理D2D複用蜂巢鏈路的資源時，基地台對D2D的干擾及D2D對MUE的干擾。我們比較LR的兩種策略，並且證明以最短移動距離作為唯一考量的策略較為實際，因此在我們的演算法中將採取此策略。模擬結果證明， 我們所提出的方法在提升D2D容量方面優於傳統方法，而蜂巢式用戶容量的減少相較於D2D容量的提升是非常小的，因此整體系統容量可以明顯地有所改善。

We consider the Device-to-Device (D2D) communication is likely to be established in non-ideal condition. The new downlink interference mitigation mechanism is proposed to enhance the overall system capacity on the premise of guaranteeing the links quality of macrocell user equipments (MUEs). We simulate the result of interference-suppression-area (ISA) and orthogonal resources allocation scheme with multiple D2D user equipment (DUE), using the Location Recommendation method the senior in our laboratory proposed before, and that is called conventional scheme. This paper proposes a power adjustment using A2C with LSTM (PA_A2C+LSTM) algorithm for DUEs to manage the interference from base station (BS) to DUEs and DUEs to MUEs when sharing same resources. We compared the two strategy about LR scheme and showed the strategy of LR by considering distance is more practical for users and hence this strategy is adopted by our proposed system. Numerical results show that our proposed algorithm is better than the conventional scheme in terms of DUE capacity. The loss of MUEs capacity is small compared to the gain of DUE capacity. The system capacity can thus be obviously improved.

參　考　文　獻

[1] 工業技術研究院產業經濟與趨勢研究中心, http://ieknet.iek.org.tw/BookView.do?domain=42&rptidno=624635173
[2] Qualcomm Technologies, https://www.qualcomm.com/invention/1000x
[3] J. Liu, Y. Kawamoto, H. Nishiyama, N. Kato, and N. Kadowaki, "Device-to-device communications achieve efficient load balancing in LTE-advanced networks," IEEE Wireless Communications, vol. 21, pp. 57-65, 2014.
[4] X. Xiao, X. Tao, and J. Lu, "A QoS-Aware Power Optimization Scheme in OFDMA Systems with Integrated Device-to-Device (D2D) Communications," in Vehicular Technology Conference (VTC Fall), 2011 IEEE, 2011, pp. 1-5.
[5] K. Doppler, M. Rinne, C. Wijting, C. B. Ribeiro, and K. Hugl, "Device-to-device communication as an underlay to LTE-advanced networks," IEEE Communications Magazine, vol. 47, pp. 42-49, 2009.
[6] H. Min, J. Lee, S. Park, and D. Hong, "Capacity Enhancement Using an Interference Limited Area for Device-to-Device Uplink Underlaying Cellular Networks," IEEE Transactions on Wireless Communications, vol. 10, pp. 3995-4000, 2011.
[7] X. Chen, L. Chen, M. Zeng, X. Zhang, and D. Yang, "Downlink resource allocation for Device-to-Device communication underlaying cellular networks," in 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC), 2012, pp. 232-237.
[8] P. Janis, V. Koivunen, C. Ribeiro, J. Korhonen, K. Doppler, and K. Hugl, "Interference-Aware Resource Allocation for Device-to-Device Radio Underlaying Cellular Networks," in Vehicular Technology Conference, 2009. VTC Spring 2009. IEEE 69th, 2009, pp. 1-5.
[9] B. Guo, S. Sun, and Q. Gao, "Downlink interference management for D2D communication underlying cellular networks," in Communications in China - Workshops (CIC/ICCC), 2013 IEEE/CIC International Conference on, 2013, pp. 193-196.
[10] 3GPP,3rd generation partnership project; technical specification group SA;feasibility study for proximity services (ProSe) (Release 12),”TR 22.803 V1.0.0,August 2012.
[11] 4G Americas’ Recommendations on 5G Requirements and Solutions, http://www.4gamericas.org/files/2714/1471/2645/4G_Americas_Recommendations_on_5G_Requirements_and_Solutions_10_14_2014-FINALx.pdf
[12] 蔡孟原, " D2D通訊用於蜂巢式網路之位置推薦及功率調整演算法" 碩士, 電機工程學系, 國立臺灣師範大學, 台北市, 2016.
[13] W. Li, M. Zhang and B. Bai, “Power Threshold Based Interference Alignment in Hybrid D2D & Cellular Uplink Transmissions,” 2017 IEEE 85th Vehicular Technology Conference (VTC Spring), Sydney, NSW, 2017, pp. 1-5.
[14] T. Peng, Q. Lu, H. Wang, S. Xu, and W. Wang, “Interference avoidance mechanisms in the hybrid cellular and device-todevice systems,” in Personal, Indoor and Mobile Radio Communications, 2009 IEEE 20th International Symposium on, pp. 617-621, IEEE, 2009.
[15] Asheralieva, Alia, and Y. Miyanaga. “QoS-Oriented Mode, Spectrum, and Power Allocation for D2D Communication Underlaying LTE-A Network.” IEEE Transactions on Vehicular Technology 65.12(2016):9787-9800.
[16] C. Sun, M. Peng, Y. Sun, Y. Li, and J. Jiang, “Distributed power control for device-to-device network using stackelberg game,” in Wireless Communications and Networking Conference (WCNC), 2014 IEEE, pp. 1344-1349, IEEE, 2014.
[17] H. Saad, A. Mohamed, and T. ElBatt, “A cooperative q-learning approach for online power allocation in femtocell networks,” in Vehicular Technology Conference (VTC Fall), 2013 IEEE 78th, pp. 1-6, IEEE, 2013.
[18] H. Saad, A. Mohamed, and T. ElBatt, “A cooperative q-learning approach for distributed resource allocation in multi-user femtocell networks,” in Wireless Communications and Networking Conference (WCNC), 2014 IEEE, pp. 1490-1495, IEEE, 2014.
[19] F. Wilhelmi, B. Bellalta, C. Cano and A. Jonsson, “Implications of decentralized Q-learning resource allocation in wireless networks,” 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC), Montreal, QC, 2017, pp. 1-5.
[20] M. Mendil, A. De Domenico, V. Heiries, R. Caire and N. Hadjsaid,“Fuzzy Q-Learning based energy management of small cells powered by the smart grid,” 2016 IEEE 27th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC), Valencia, 2016, pp. 1-6.
[21] Shiwen Nie, Zhiqiang Fan, Ming Zhao, Xinyu Gu, Lin Zhang,“Q-learning based power control algorithm for D2D communication.” IEEE, International Symposium on Personal, Indoor, and Mobile Radio Communications IEEE, 2016:1-6.

[22] Zhiqiang Fan, Xinyu Gu, Shiwen Nie,Ming Chen.“D2D power control based on supervised and unsupervised learning.”ICCC 2017, in press.
[23] Tang J, Deng C, Huang GB, “Extreme Learning Machine for Multilayer Perceptron”. IEEE transactions on neural networks and learning systems, 2016, 27(4):809.
[24] Jie Xu, Xinyu Gu, Zhiqiang Fan, “D2D Power Control Based on Hierarchical Extreme Learning Machine” 2018 IEEE 29th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC), 978-1-5386-6009-6/18/$31.00