Circuits that Solve Optimization Problems by Exploiting Physics Inequalities

📋 论文概要

该论文提出利用物理不等式（如热力学不等式、电路定律）来设计专用电路，以高效求解优化问题，替代传统的数字梯度下降算法。通过物理系统的自然演化直接找到最优解，有望在深度学习、工程优化等领域实现低功耗、高速度的硬件加速。

💡 主要创新点

• 提出利用物理不等式（如基尔霍夫定律、热力学平衡）作为计算约束，让电路自动收敛到优化问题的最优解，无需迭代数字计算。
• 将优化问题映射到物理电路网络，利用物理系统的并行性和能量最小化原理实现高效求解，可能比传统数字方法快几个数量级。
• 展示了该电路架构在深度学习训练、流体力学优化等实际场景中的潜在应用，突破了传统冯·诺依曼瓶颈。

🏷 关键词

📄 原文摘要

Optimization is vital to Engineering, Artificial Intelligence, and to many areas of Science. Mathematically, we usually employ steepest-descent, or other digital algorithms. For example, Deep Learning is an optimization problem, Fig. 12.1.1. Everyday applications of optimization range from aerodynamic design of vehicles by fluid mechanics and physical stress optimization of bridges in civil engineering; to scheduling of airline crews and routing of delivery trucks in operations research. Furthermore, optimization is also indispensable in machine learning, reinforcement learning, computer vision, and speech processing. Given the preponderance of massive datasets and computations today, there has been a surge of activity in the design of hardware accelerators for neural network training and inference. But, every inequality in Physics, performs optimization in the normal course of dynamical evolution—for free. Nature provides us with the following optimization principles:

👥 作者与机构

Eli Yablonovitch, Qixin Feng, Sri Vadlamani, Patrick Xiao

University of California, Berkeley, CA