On the emergence of representational geometry from the statistics of natural language
New Technologies in Mathematics Seminar Speaker: Yasaman Bahri (Google DeepMind) Title: On the emergence of representational geometry from the statistics of natural language Abstract: Large language models organize their internal representations into rich geometric structures that mirror the concepts of natural language. For example, categorical concepts often map to linear directions, while words and phrases […]