摘要(英) |
In modern System On Chip (SOC) designs, the Power Delivery Network (PDN) plays a crucial role. Its primary function is to efficiently distribute power to every component on the chip, ensuring that each component receives an ample and stable power supply. IR-drop refers to the voltage drop phenomenon from the power source to the component due to the inherent resistance characteristics of the physical structure of the Power Delivery Network (PDN). Insufficiently designed PDN can lead to excessive IR-Drop, and such excessive IR-drop is often accompanied by reliability issues in the circuit, including timing violation and functional failure. This makes the IR-drop phenomenon an issue in IC design that cannot be ignored.
The planning of the PDN typically occurs in the floorplan stage before placement. Therefore, without placement, CTS, and routing information, it is challenging to design a perfect PDN at the early stage of the physical design flow. Hence, IR-drop is a common issue frequently encountered throughout the entire physical design flow. In many previous studies on improving IR-drop, a common approach is to adjust the physical structure of the PDN itself. This can be achieved by globally or locally increasing the width or density of power stripes. This technique effectively reduces the equivalent resistance from the power source to the component, thereby reducing the IR-Drop between these two points
However, as the P&R (Placement and Routing) stages progress, the available routing space decreases. Adjusting the physical structure of PDN within limited space may potentially impact the existing P&R results. In other words, adopting the aforementioned method would require multiple iterations of P&R. For industrial-scale designs with millions or even tens of millions of standard cells, despite the assistance of state-of-the-art EDA tools, both placement and routing still demand dozens of hours or even days. In the scenario where IR-drop is diagnosed in the late stages of P&R, going back to modify the physical structure of PDN would incur significant time costs, implying that the approach of adjusting the physical structure of the PDN itself to mitigate IR-Drop will inevitably encounter bottlenecks.
Therefore, this work proposes an approach to add extra power wires at the post-routing stage to improve IR-drop, with the help of reinforcement-learning. Compared to most previous works, our approach offers the following advantages: (1) By efficiently utilizing remaining routing spaces to add power wires, it avoids the need to adjust the main structure of the PDN, thus maximizing the preservation of existing P&R results. (2) In contrast to heuristic algorithms, reinforcement learning continuously updates strategies through trial and error, providing a better chance of finding the global optimal solution. |
參考文獻 |
[1] Jai-Ming Lin, Yu-Tien Chen, Yang-Tai Kung, and Hao-Jia Lin. 2023. Voltage-Drop Optimization Through Insertion of Extra Stripes to a Power Delivery Network. In Proceedings of the 2023 International Symposium on Physical Design (ISPD 2023).
[2] V. A. Chhabria, A. B. Kahng, M. Kim, U. Mallappa, S. S. Sapatnekar and B. Xu, "Template-based PDN Synthesis in Floorplan and Placement Using Classifier and CNN Techniques," 2020 25th Asia and South Pacific Design Automation Conference (ASP-DAC 2020).
[3] Wen-Hsiang Chang, Li-Yi Lin, Yu-Guang Chen, and Mango C.-T. Chao. 2020. Power distribution network generation for optimizing IR-drop aware timing. In Proceedings of the 39th International Conference on Computer-Aided Design (ICCAD 2020).
[4] W. -H. Chang, M. C. . -T. Chao and S. -H. Chen, "Practical Routability-Driven Design Flow for Multilayer Power Networks Using Aluminum-Pad Layer," in IEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2014.
[5] X. Wang, Y. Cai, X. Hong and S. X. . -d. Tan, "Optimal Wire Sizing for Early Stage Power/Ground Grid Planning," International Conference on Communications, Circuits and Systems, (ICCCAS 2006).
[6] Kwok-Shing Leung, "SPIDER: simultaneous post-layout IR-drop and metal density enhancement with redundant fill," IEEE/ACM International Conference on Computer-Aided Design(ICCAD 2005).
[7] T. -W. Tseng, C. -T. Lin, C. -H. Lee, Y. -F. Chou and D. -M. Kwai, "A power delivery network (PDN) engineering change order (ECO) approach for repairing IR-drop failures after the routing stage," Technical Papers of 2014 International Symposium on VLSI Design, Automation and Test (VLSI-DAT 2014).
[8] J. Yoon, S. Chung and T. Kim, "Analyses of Power Staple Inserting Methodologies for Mitigating IR-Drops," 2021 18th International SoC Design Conference (ISOCC 2021).
[9] V. Konda and J. Tsitsiklis, “Actor-critic algorithms,” Advances in neural information processing systems, vol. 12, 1999
[10] J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms”, 2017
[11] John Schulman, Philipp Moritz, Sergey Levine, Michael Jordan, Pieter Abbeel, “High Dimensional Continuous Control Using Generalized Advantage Estimation”, 2015
[12] Y. Bengio et al., “Curriculum learning,” in Proceedings of the 26th annual ICML, 2009. |