The rise of large language models (LLMs) has drawn researchers from theory and empirical machine learning into a shared inquiry: what are the abilities and limitations of these models? A common thread across both perspectives is the use of formal languages to study LLMs, theoretically, to ask which languages or tasks are learnable, and empirically, to test whether these predictions hold in practice and to probe other phenomena of LLMs beyond learnability. The seminar is a chance to engage with LLMs from both angles, useful whether your interests lean toward formal methods or applied machine learning.