Valeria Ruscio
assegnista di ricerca
Biografia
Hello! I am a Post-doc researcher at Sapienza University of Rome, where I am part of the RSTLess lab under the guidance of Professor Fabrizio Silvestri. My research interests focus on studying the hidden states of different models, currently focusing on autoregressive transformers. So, i'd say i'm into representation learning, with a particular emphasis on spectral and signal processing approaches for explainability, but also NLP occasionally.
Interessi di ricerca
Embeddings, hidden states, transformers, explainability, attention
Membro di
Ultime pubblicazioni
| Attention-likelihood relationship in transformers in International Conference on Learning Representations | 2023 |
| Synonymy in Korean Lexicon through the Lens of Vector Semantics in Percorsi in Civiltà dell’Asia e dell’Africa II: Quaderni di studi dottorali alla Sapienza | 2023 |