Language, Speech and Interaction
Our main areas of interest are speech, vision and language processing, machine learning and interaction.
The purpose of our research is to investigate how humans process speech, language and vision, and to design mathematical models for automatic processing that can be used with communicating machines.
Our studies rely on computational models from batch or on-line examples and provide predictive models for data classification, automatic sequence labelling and structure inference.
Another research area the group is involved in is human-centered communication systems. We investigate models of interactions in any ICT scenario, such as speech-to-speech, speech-to-web and multimodal interactions. Our focus is both on the computational aspect of the interaction models as well as on the usability of user interfaces.
Finally, we also devote our attention to collaborative systems and web architecture. We are active in the design of software architecture for advanced web and multimedia collaborative systems.
Publications
28 publications for 14 currently enrolled students
Quality–diversity optimization of decision trees for interpretable reinforcement learning
Ferigo, Andrea; Custode, Leonardo Lucio; Iacca, Giovanni
in NEURAL COMPUTING & APPLICATIONS, v. 2023, (2023). - Publication URL . - DOI: 10.1007/s00521-023-09124-5
[other topics: Machine Learning and Intelligent Optimization
DH-FBK at HODI: Multi-Task Learning with Classifier Ensemble Agreement, Oversampling and Synthetic Data
Leonardelli, E.; Casula, C.
in CEUR Workshop Proceedings, Parma: CEUR-WS, 2023. - (CEUR WORKSHOP PROCEEDINGS). Proceedings of: 8th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop, EVALITA 2023, ita, 2023
[other topics: Deep and Structured Machine Learning
What{'}s New? Identifying the Unfolding of New Events in a Narrative
Mousavi, Seyed Mahed; Tanaka, Shohei; Roccabruna, Gabriel; Yoshino, Koichiro; Nakamura, Satoshi; Riccardi, Giuseppe
in Proceedings of the The 5th Workshop on Narrative Understanding, Association for Computational Linguistics: Association for Computational Linguistics, 2023, p. 1-10. Proceedings of: 5th Workshop on Narrative Understanding, toronto canada, July 14, 2023. - Publication URL . - DOI: 10.18653/v1/2023.wnu-1.1
Let's Give a Voice to Conversational Agents in Virtual Reality
Yin, Michele; Roccabruna, Gabriel; Azad, Abhinav; Riccardi, Giuseppe
in Proc. INTERSPEECH 2023, Dublin, Ireland: International Speech Communication Association, 2023. Proceedings of: Interspeech 2023, Dublin, Ireland, 20th August-24th August 2022
Understanding Emotion Valence is a Joint Deep Learning Task
Roccabruna, Gabriel; Mousavi, Seyed Mahed; Riccardi, Giuseppe
in Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, {\&} Social Media Analysis, Toronto, Canada: Association for Computational Linguistics, 2023. Proceedings of: ACL, Toronto, Canada, 9th July-14th July 2023
Interactive Neural Painting
Peruzzo, E.; Menapace, W.; Goel, V.; Arrigoni, F.; Tang, H.; Xu, X.; Chopikyan, A.; Orlov, N.; Hu, Y.; Shi, H.; Sebe, N.; Ricci, E.
in COMPUTER VISION AND IMAGE UNDERSTANDING, v. 235, (2023), p. 103778. - DOI: 10.1016/j.cviu.2023.103778
[other topic: Deep and Structured Machine Learning; Machine Learning and Intelligent Optimization
A Population-Based Approach for Multi-Agent Interpretable Reinforcement Learning
Crespi, Marco; Ferigo, Andrea; Custode, Leonardo Lucio; Iacca, Giovanni
in APPLIED SOFT COMPUTING, v. 2023, 147, (2023), p. 11075801-11075812. - Publication URL . - DOI: 10.1016/j.asoc.2023.110758
[other topics: Machine Learning and Intelligent Optimization
Gender Neutralization for an Inclusive Machine Translation: from
Theoretical Foundations to Open Challenges
Piergentili, Andrea; Fucci, Dennis; Savoldi, Beatrice; Bentivogli, Luisa; Negri, Matteo
in Proceedings of the first Workshop on Gender-Inclusive Translation Technologies, Tampere: ACL anthology, 2023. Proceedings of: GITT, Tampere, 15/06/2023. - Publication URL
Self-building Neural Networks
Ferigo, Andrea; Iacca, Giovanni
in GECCO '23 Companion: Proceedings of the Companion Conference on Genetic and Evolutionary Computation, New York: ACM, 2023. Proceedings of: GECCO '23, Lisbon, 15th July-19th July. - DOI: 10.1145/3583133.3590531
[other topics: Machine Learning and Intelligent Optimization
Quality Diversity Evolutionary Learning of Decision Trees
Ferigo, Andrea; Custode, Leonardo Lucio; Iacca, Giovanni
in SAC '23: Proceedings of the 38th ACM/SIGAPP Symposium on Applied Computing, New York: ACM, 2023. Proceedings of: SAC, Tallin, 27th March-31st March 2023. - DOI: 10.1145/3555776.3577591
[other topics: Machine Learning and Intelligent Optimization
Efficient yet Competitive Speech Translation: FBK@IWSLT2022
Gaido, Marco; Papi, Sara; Fucci, Dennis; Fiameni, Giuseppe; Negri, Matteo; Turchi, Marco
in Proceedings of the 19th International Conference on Spoken Language Translation (IWSLT 2022), Dublin, Ireland (in-person and online): Association for Computational Linguistics (ACL), 2022, p. 177-189. - ISBN: 978-1-955917-41-4. Proceedings of: 19th International Conference on Spoken Language Translation, IWSLT 2022, Dublin, Ireland (in-person and online), 26-27, May 2022. - Publication URL . - DOI: 10.18653/v1/2022.iwslt-1.13
[other topics: Deep and Structured Machine Learning
Evaluation of Response Generation Models: Shouldn't It Be Shareable and Replicable?
Mousavi, Seyed Mahed; Roccabruna, Gabriel; Lorandi, Michela; Caldarella, Simone; Riccardi, Giuseppe
in Proceedings of the 2nd Workshop on Natural Language Generation, Evaluation, and Metrics (GEM), Association for Computational Linguistics: Association for Computational Linguistics, 2022, p. 136-147. Proceedings of: EMNLP 22, abu dhabi, 5 december 2022. - Publication URL
Human-Machine Collaboration Approaches to Build a Dialogue Dataset for Hate Speech Countering
Bonaldi, Helena; Dellantonio, Sara; Tekiroglu, Serra Sinem; Guerini, Marco
in Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 209 N. Eighth Street, Stroudsburg PA 18360, USA: Association for Computational Linguistics, 2022, p. 8031-8049. Proceedings of: The Conference on Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, United Arab Emirates, 7th-11th December 2022. - Publication URL
Using Pre-Trained Language Models for Producing Counter Narratives Against Hate Speech: a Comparative Study
Tekiroglu, Serra Sinem; Bonaldi, Helena; Fanton, Margherita; Guerini, Marco
in Findings of the Association for Computational Linguistics: ACL 2022, 209 N. Eighth Street, Stroudsburg PA 18360, USA: Association for Computational Linguistics, 2022, p. 3099-3114. - ISBN: 978-1-955917-25-4. Proceedings of: Annual Meeting of the Association for Computational Linguistics (ACL), Dublin, Ireland, 22nd-27th May, 2022. - Publication URL . - DOI: 10.18653/v1/2022.findings-acl.245
What can Speech and Language Tell us About the Working Alliance in Psychotherapy
Peter Bayer, Sebastian; Roccabruna, Gabriel; Chowdhury, Shammur Absar; Ciulli, Tommaso; Danieli, Morena; Riedhammer, Korbinian; Riccardi, Giuseppe
in Proceedings Interspeech 2022, BAIXAS, FRANCE: International Speech Communication Association, 2022, p. 2443-2447. Proceedings of: Interspeech 2022, Incheon, Korea, 18th September-22nd September 2022. - Publication URL . - DOI: 10.21437/Interspeech.2022-347
Annotation of Valence Unfolding in Spoken Personal Narratives
Tammewar, Aniruddha Uttam; Braun, Franziska; Roccabruna, Gabriel; Bayerl, Sebastian; Riedhammer, Korbinian; Riccardi, Giuseppe
in Proceedings of the Thirteenth Language Resources and Evaluation Conference, Marsiglia, Francia: European Language Resources Association, 2022, p. 7004-7013. Proceedings of: LREC, Marsiglia, Francia, 20th-25th June 2022. - Publication URL
On the Entanglement between Evolvability and Fitness: an Experimental Study on Voxel-based Soft Robots
Ferigo, Andrea; Soros, L. B.; Medvet, Eric; Iacca, Giovanni
in Proceedings of the ALIFE 2022: The 2022 Conference on Artificial Life, Online: ASME, 2022, p. [1-10]. - (ALIFE: PROCEEDINGS OF THE ARTIFICIAL LIFE CONFERENCE). Proceedings of: ALIFE 2022, Online, 18th July-22nd July 2022. - Publication URL . - DOI: 10.1162/isal_a_00493
[other topics: Machine Learning and Intelligent Optimization
Multi-source Multi-domain Sentiment Analysis with BERT-based Models
Roccabruna, G.; Azzolin, Steve; Riccardi, G.
in European Language Resources Association, Parigi: European Language Resources Association, 2022, p. 581-589. - ISBN: 979-10-95546-72-6. Proceedings of: LREC, Marsiglia, 20th June - 25th June 2022. - Publication URL
Can Emotion Carriers Explain Automatic Sentiment Prediction? A Study on Personal Narratives
Mousavi, M.; Roccabruna, G.; Tammewar, A.; Azzolin, Steve; Riccardi, G.
in Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis, Dublin: ACL, 2022. Proceedings of: Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis, Dublin, 23rd - 27th May 2022. - Publication URL
Evolutionary Optimization of Spiking Neural P Systems for Remaining Useful Life Prediction
Custode, Leonardo Lucio; Mo, Hyunho; Ferigo, Andrea; Iacca, Giovanni
in ALGORITHMS, v. 15, n. 3 (2022), p. 9801-9818. - Publication URL . - DOI: 10.3390/a15030098
[other topics: Machine Learning and Intelligent Optimization
Evolving Hebbian Learning Rules in Voxel-based Soft Robots
Ferigo, Andrea; Iacca, Giovanni; Medvet, Eric; Pigozzi, Federico
in IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, v. 2022, (2022), p. 1-11. - Publication URL . - DOI: 10.1109/TCDS.2022.3226556
[other topics: Machine Learning and Intelligent Optimization
Optimizing the Sensory Apparatus of Voxel-Based Soft Robots Through Evolution and Babbling
Ferigo, Andrea; Medvet, Eric; Iacca, Giovanni
in SN COMPUTER SCIENCE, v. 3, n. 2 (2022), p. 10901-10917. - Publication URL . - DOI: 10.1007/s42979-021-00987-w
[other topics: Machine Learning and Intelligent Optimization
Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speech
Fanton, Margherita; Bonaldi, Helena; Tekiroglu, Serra Sinem; Guerini, Marco
in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 209 N. Eighth Street, Stroudsburg PA 18360, USA: Association for Computational Linguistics, 2021, p. 3226-3240. Proceedings of: Annual Meeting of the Association for Computational Linguistics (ACL), online, 2nd -5th August 2021. - Publication URL . - DOI: 10.18653/v1/2021.acl-long.250
Exploiting contextualized word representations to profile haters on Twitter
Ceron, T.; Casula, C.
in CEUR Workshop Proceedings, Aachen: CEUR-WS, 2021, p. 1871-1882. - (CEUR WORKSHOP PROCEEDINGS). Proceedings of: 2021 Working Notes of CLEF - Conference and Labs of the Evaluation Forum, CLEF-WN 2021, Online, Bucharest, 21st Sept- 24th Sept 2021. - Publication URL
[other topics: Deep and Structured Machine Learning
Beyond Body Shape and Brain: Evolving the Sensory Apparatus of Voxel-Based Soft Robots
Ferigo, A.; Iacca, G.; Medvet, E.
in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Verlag: Springer Science and Business Media Deutschland GmbH, 2021, p. 210-226. - (LECTURE NOTES IN ARTIFICIAL INTELLIGENCE). - ISBN: 978-3-030-72698-0. Proceedings of: 24th International Conference on the Applications of Evolutionary Computation, EvoApplications 2021 held as Part of EvoStar 2021, online, 2021. - Publication URL . - DOI: 10.1007/978-3-030-72699-7_14
[other topics: Machine Learning and Intelligent Optimization
A GPU-enabled compact genetic algorithm for very large-scale optimization problems
Ferigo, A.; Iacca, G.
in MATHEMATICS, v. 8, n. 5 (2020), p. 758. - DOI: 10.3390/MATH8050758
[other topics: Machine Learning and Intelligent Optimization
Hate speech detection with machine-translated data: The role of annotation scheme, class imbalance and undersampling
Casula, C.; Tonelli, S.
in CEUR Workshop Proceedings, Bologna: CEUR-WS, 2020. - (CEUR WORKSHOP PROCEEDINGS). Proceedings of: 7th Italian Conference on Computational Linguistics, CLiC-it 2020, Bologna, 1 March - 3 March 2021
[other topics: Deep and Structured Machine Learning
Multifunctional ISO standard Dialogue Act tagging in Italian
Roccabruna, G.; Cervone, A.; Riccardi, G.
in Seventh Italian Conference on Computational Linguistics, Aachen: CEUR Workshop Proceedings, 2020. - (CEUR WORKSHOP PROCEEDINGS). Proceedings of: Clicit, Bologna, 1-3 March 2021. - Publication URL
Students
 | Bonaldi, Helena | helena.bonaldi [at] unitn.it | webpage |
| Cappellazzo, Umberto | umberto.cappellazzo [at] unitn.it | webpage |
| Casula, Camilla | camilla.casula [at] unitn.it | webpage |
 | Ferigo, Andrea | andrea.ferigo [at] unitn.it | webpage |
| Fucci, Dennis | dennis.fucci [at] unitn.it | webpage |
| Hannan, Abdul | abdul.hannan [at] unitn.it | webpage |
 | Hassan, Mir | mir.hassan [at] unitn.it | webpage |
| Loginova, Olga | olga.loginova [at] unitn.it | webpage |
| Occhipinti, Daniela | daniela.occhipinti [at] unitn.it | webpage |
| Penzo, Nicolò | nicolo.penzo [at] unitn.it | webpage |
| Peruzzo, Elia | elia.peruzzo [at] unitn.it | webpage |
| Piergentili, Andrea | andrea.piergentili [at] unitn.it | webpage |
| Roccabruna, Gabriel | gabriel.roccabruna [at] unitn.it | webpage |
| Russo, Daniel | daniel.russo [at] unitn.it | webpage |