Heavy-tailed large deviations and deep learning`s generalization mystery > 세미나

본문 바로가기
사이트 내 전체검색


세미나

모드선택 :              
세미나 신청은 모드에서 세미나실 사용여부를 먼저 확인하세요

Heavy-tailed large deviations and deep learning`s generalization myste…

김수현 0 14895
구분 수학강연회
일정 2021-09-16 16:00 ~ 17:00
강연자 이창한 (Northwestern University)
기타
담당교수 현동훈
https://snu-ac-kr.zoom.us/j/87197218314 Zoom ID: 871 9721 8314 Abstract: While the typical behaviors of stochastic systems are often deceptively oblivious to the tail distributions of the underlying uncertainties, the ways rare events arise are vastlydifferent depending on whether the underlying tail distributions are light-tailed or heavy-tailed. Roughly speaking, in light-tailed settings, a system-wide rare event arises because everything goes wrong a little bit as if the entire system has conspiredup to provoke the rare event (conspiracy principle), whereas, in heavy-tailed settings, a system-wide rare event arises because a small number of components fail catastrophically (catastrophe principle). In the first part of this talk, I will introduce therecent developments in the theory of large deviations for heavy-tailed stochastic processes at the sample path level and rigorously characterize the catastrophe principle. In the second part, I will explore an intriguing connection between the catastropheprinciple and a central mystery of modern AI—the unreasonably good generalization performance of deep neural networks. This talk is based on the ongoing research in collaboration with Mihail Bazhba, Jose Blanchet, Bohan Chen, Sewoong Oh, Insuk Seo, Zhe Su, Xingyu Wang, and Bert Zwart. Short Bio: Chang-Han Rhee is an Assistant Professor in Industrial Engineering and Management Sciences at Northwestern University. Before joining Northwestern University, he was a postdoctoralresearcher in the Stochastics Group at Centrum Wiskunde & Informatica and in Industrial & Systems Engineering and Biomedical Engineering at Georgia Tech. He received his Ph.D. in Computational and Mathematical Engineering from Stanford University. His researchinterests include applied probability, stochastic simulation, and statistical learning. He was a winner of the Outstanding Publication Award from the INFORMS Simulation Society in 2016, a winner of the Best Student Paper Award (MS/OR focused) at the 2012 WinterSimulation Conference, and a finalist of the 2013 INFORMS George Nicholson Student Paper Competition.

세미나명

   

상단으로

Research Institute of Mathematics
서울특별시 관악구 대학동 서울대학교 자연과학대학 129동 305호
Tel. 02-880-6562 / Fax. 02-877-6541 su305@snu.ac.kr

COPYRIGHT ⓒ 자연과학대학 수학연구소 ALL RIGHT RESERVED.