The Geometric Future of AI: Vector Tokenization and EdgeLLMs
| 구분 | DASOM,초청강연 |
|---|---|
| 일정 | 2026-06-30 16:00 ~ 17:00 |
| 강연자 | Greg Kielian (Google) |
| 기타 | |
| 담당교수 | 김도형 |
abstract: AI processing is rapidly shifting to memory-constrained edge devices, and the fundamental changes in computational limits demand that we rethink how machines represent language. To preserve model intelligence on smaller hardware and unlock real-time utility, language representations must align more seamlessly with modern LLM tokenization.
To illuminate the mechanics, we will step inside the neural networks themselves. Through interactive 3D visualizations of the LM Head, the Residual Stream, Attention mechanisms, and MLPs, we will explore how LLMs geometrically route and map semantic concepts into high-dimensional space.
Paired with the Johnson-Lindenstrauss Lemma, this geometric understanding opens the door to a profound global opportunity for a new vector-based International Phonetic Alphabet (IPA) inspired by Hangul’s multilingual adaptability. Adopting this unified framework can enable the training of vastly more efficient, cross-lingual edge models, potentially accelerating international literacy and including global second-language acquisition. We conclude with discussion of uniting standards bodies, academia and government to back natively LLM-compatible Hangul formatting standards – to position new Hangul tokenization as the foundational infrastructure for the future of global AI

