Landmark Papers

"Statistical mechanics provides us with the ‘eyes’ to appreciate collective phenomena in quantitative and insightful ways."

— Sidney Redner, Birds On A Wire

Statistical Physics and Thermodynamics

[source] Jaynes, E. T. (1957). Information theory and statistical mechanics. Physical Review, 106(4), 620–630.
- Information theoretical foundations of statistical physics.
[source] Callen, H. B., & Welton, T. A. (1951). Irreversibility and generalized noise. Physical Review, 83(1), 34–40.
- An extension of the fluctuation-dissipation theorem.
[source] D. H. Wolpert and W. G. Macready, “No free lunch theorems for optimization,” in IEEE Transactions on Evolutionary Computation, vol. 1, no. 1, pp. 67-82, April 1997.
- No Free Lunch Theorems and their implications for optimization algorithms.
[source] D.H. Wolpert et al., Is stochastic thermodynamics the key to understanding the energy costs of computation?, Proc. Natl. Acad. Sci. U.S.A. 121 (45) e2321112121 (2024).
- Bridging stochastic thermodynamics and computation theory.
[source] D.J. Skinner, & J. Dunkel, Improved bounds on entropy production in living systems, Proc. Natl. Acad. Sci. U.S.A. 118 (18) e2024300118 (2021).
- Entropy production in non-Markovian coarse-grained networks.

[source] Lorenz, E. N. (1963). Deterministic nonperiodic flow. Journal of the Atmospheric Sciences, 20(2), 130-141.
- Origin of the Lorenz attractor and chaos theory.
[source] Raphaël Sarfati et al. ,Self-organization in natural swarms of Photinus carolinus synchronous fireflies.Sci. Adv.7,eabg9259(2021).
- Study of the nonlinear dynamics in firefly synchronization.

[source] Krogh, A., & Sollich, P. (1997). Statistical mechanics of ensemble learning. Physical Review E, 55(1), 811–825.
- Ensemble learning.
[source] J.J. Hopfield, Neural networks and physical systems with emergent collective computational abilities., Proc. Natl. Acad. Sci. U.S.A. 79 (8) 2554-2558.
- Where everything about Hopfield networks started.

[source] Anderson, P. W. (1972). More is different. Science, 177(4047), 393–396.
- Emergence from the viewpoint of theoretical physics.
[source] Toner, J., & Tu, Y. (1998). Flocks, herds, and schools: A quantitative theory of flocking. Physical Review E, 58(4), 4828–4858.
- Theory of flocking. Flocking is originally used to describe the behavior exhibited by a flock of bird when foraging or in flight, and can be chcaracterized by three stages: separation, alignment, and cohesion.

[source] Clauset, A., Newman, M. E. J., & Moore, C. (2004). Finding community structure in very large networks. Physical Review E, 70(6), Article 066111.
- Important paper on finding structure in real life networks.

「統計物理提供給我們一雙『眼睛』，讓我們能以定量且有洞見的角度剖析集體行為（collective behavior）。」

— Sidney Redner, Birds On A Wire

[來源] Jaynes, E. T. (1957). Information theory and statistical mechanics. Physical Review, 106(4), 620–630.
- 用資訊理論中熵最大化的角度詮釋統計物理。
[來源] Callen, H. B., & Welton, T. A. (1951). Irreversibility and generalized noise. Physical Review, 83(1), 34–40.
- 漲落定理的一個延伸.
[來源] D. H. Wolpert and W. G. Macready, “No free lunch theorems for optimization,” in IEEE Transactions on Evolutionary Computation, vol. 1, no. 1, pp. 67-82, April 1997.
- 「無免費午餐定理」與它們在最佳化演算法中的影響。
[來源] D.H. Wolpert et al., Is stochastic thermodynamics the key to understanding the energy costs of computation?, Proc. Natl. Acad. Sci. U.S.A. 121 (45) e2321112121 (2024).
- 連結隨機熱力學和計算機理論。
[來源] D.J. Skinner, & J. Dunkel, Improved bounds on entropy production in living systems, Proc. Natl. Acad. Sci. U.S.A. 118 (18) e2024300118 (2021).
- 給出粗粒化非馬可夫網路中熵產生的下界。

[來源] Lorenz, E. N. (1963). Deterministic nonperiodic flow. Journal of the Atmospheric Sciences, 20(2), 130-141.
- Lorenz 吸引子及混沌研究的起源。
[來源] Raphaël Sarfati et al. ,Self-organization in natural swarms of Photinus carolinus synchronous fireflies.Sci. Adv.7,eabg9259(2021).
- 螢火蟲同步性的非線性動力學。

[來源] Krogh, A., & Sollich, P. (1997). Statistical mechanics of ensemble learning. Physical Review E, 55(1), 811–825.
- 整合學習（ensemble learning）的介紹。
[來源] J.J. Hopfield, Neural networks and physical systems with emergent collective computational abilities., Proc. Natl. Acad. Sci. U.S.A. 79 (8) 2554-2558.
- Hopfield 網路的起源。

[來源] Anderson, P. W. (1972). More is different. Science, 177(4047), 393–396.
- 從理論物理解釋湧現（emergence）。
[來源] Toner, J., & Tu, Y. (1998). Flocks, herds, and schools: A quantitative theory of flocking. Physical Review E, 58(4), 4828–4858.
- 群動（flocking）現象的理論。群動原指鳥群在飛行或覓食（foraging）過程中呈現的行為，可以大致分為分隔（separation）、順向（alignment）、凝聚（cohesion）三個階段。

[來源] Clauset, A., Newman, M. E. J., & Moore, C. (2004). Finding community structure in very large networks. Physical Review E, 70(6), Article 066111.
- 在實際網路中尋找結構。