Andy J Yang

There are links on the tree branches below. Please click on them.

PhD student at the University of Notre Dame, advised by Dr. David Chiang in the NLP lab. Co-organizer for FLaNN. Supported by a Notre Dame Deans' Fellowship and an NSF Graduate Research Fellowship.

I study theoretical aspects of machine learning; proving what different kinds of machines can and cannot do.

Understanding small complexity classes will reveal the secrets of efficient natural language processing.

Publications

The Transformer Cookbook
Andy Yang, Christopher Watson, Anton Xue, Satwik Bhattamishra, Jose Llarena, William Merrill, Emile Dos Santos Ferreira, Anej Svete, and David Chiang.

Knee-deep in C-RASP: a transformer depth hierarchy
Andy Yang, Michaël Cadilhac, and David Chiang.
In Proc. NeurIPS 38. 2025. To appear.

Simulating hard attention using soft attention
Andy Yang, Lena Strobl, David Chiang, and Dana Angluin.
Transactions of the Association for Computational Linguistics, 2025. To appear.

A Formal Framework for Understanding Length Generalization in Transformers
Xinting Huang, Andy Yang, Satwik Bhattamishra, Yash Sarrof, Andreas Krebs, Hattie Zhou, Preetum Nakkiran, Michael Hahn.
In Proc. ICLR. 2025.

Counting like transformers: compiling temporal counting logic into softmax transformers
Andy Yang and David Chiang.
In Proc. CoLM. 2024.

Masked hard-attention transformers recognize exactly the star-free languages.
Andy Yang, David Chiang, and Dana Angluin.
In Proc. NeurIPS 37, 10202–10235. 2024.

Other Projects

MSLD 2025

B-RASP simulator

A lizard

Generating random origami

Swahili morphology notes

Randomized road trip

Notes and Such

A sketch of Kamp's Theorem

Transformer depth notes

Cellular automata and interactive genetic algorithms

Tu Youyou