https://thegradientpub.substack.com/p/ted-gibson-language-structure-communication-llms 才发现有transcripts了

Substack

Ted Gibson: The Structure and Purpose of Language

On why language looks the way it does, how humans process and use language, and a perspective on LLMs from linguistics.

Binding Language Models in Symbolic Languages
https://lm-code-binder.github.io/
ICLR23 top-25% 终于也开始实际地评估LLM转换形式语言的效果了

https://doi.org/10.1146/annurev-linguistics-030521-044439

www.annualreviews.org

Compositionality in Computational Linguistics | Annual Reviews

Neural models greatly outperform grammar-based models across many tasks in modern computational linguistics. This raises the question of whether linguistic principles, such as the Principle of Compositionality, still have value as modeling tools. We review…

https://www.degruyter.com/document/doi/10.1515/lingvan-2022-0133/

De Gruyter

Measuring language complexity: challenges and opportunities

This special issue focuses on measuring language complexity. The contributions address methodological challenges, discuss implications for theoretical research, and use complexity measurements for testing theoretical claims. In this introductory article,…

https://t.co/P1s4wiWCsR

Google Docs

Scaling, emergence, and reasoning (Jason Wei, NYU)

Scaling, emergence, and reasoning in large language models Jason Wei Twitter: @\_jasonwei Mistakes & opinions my own, and not of my employer.

https://github.com/labmlai/annotated_deep_learning_paper_implementations 好生炫酷（

GitHub

GitHub - labmlai/annotated_deep_learning_paper_implementations: 🧑‍🏫 60 Implementations/tutorials of deep learning papers with side…

***🧑‍🏫*** 60 Implementations/tutorials of deep learning papers with side-by-side notes ***📝***; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gan...

https://yimeixiang.wordpress.com/teaching/ 一点逻辑语义学课程材料。没有太争议的主题，如语义的本体论问题、语义语用界面等，偏具体的语义学技术，对入门友好。

https://yimeixiang.wordpress.com/teaching/ 一点逻辑语义学课程材料。没有太争议的主题，如语义的本体论问题、语义语用界面等，偏具体的语义学技术，对入门友好。

Yimei Xiang ∙ 向伊梅

Teaching

Semantics II (Graduate, Rutgers, Spring 2021) Unit 1: Compositionality and Binding Part I: Compositionality, Heim & Kratzer theory of pronoun binding Readings: Heim & Kratzer (1998: Chapter…

https://drive.google.com/file/d/1BU5bV3X5w65DwSMapKcsr0ZvrMRU_Nbi/view Do large language models need sensory grounding for meaning and understanding? Spoiler: YES! Yann LeCun Courant Institute & Center for Data Science, NYU Meta – Fundamental AI Research…

vxTwitter / fixvx

Sander Dieleman (@sedielem)

Some thoughts on non-AR language models, and what it might take to dethrone autoregression: https://sander.ai/2023/01/09/diffusion-language.html ***💖*** 91 ***🔁*** 11

https://drive.google.com/file/d/1BU5bV3X5w65DwSMapKcsr0ZvrMRU_Nbi/view

Do large language models need sensory grounding for meaning and understanding?
Spoiler: YES!

Yann LeCun
Courant Institute & Center for Data Science, NYU
Meta – Fundamental AI Research
2023-03-24