Projects
Eye movement and cognitive-interactional linguistics. In a multimodal approach to interaction management. KU Leuven
Face-to-face communication is an inherently multimodal process, with multiple semiotic channels operating simultaneously and collaboratively, including verbal, para-verbal (e.g. intonation, pace and volume of speech) and non-verbal behaviour (e.g. gaze, gesture, posture). This project presents a novel approach to multimodal interaction, with a specific focus on the role of interlocutors’ eye gaze in relation to the other semiotic channels. In ...
Next generation traffic management for empowering CAVs integration, cross-stakeholders collaboration and proactive multi-modal network optimization (FRONTIER). University of Antwerp
Towards Context-aware Implicit Multimodal Human-Computer Interaction Vrije Universiteit Brussel
Over the last decade, we have seen a clear trend towards smart environments and living spaces where information processing is embedded into everyday objects. This introduces some challenges in terms of human-computer interaction: How should we design any implicit interaction for these sensor-based systems? The intelligent interpretation and adaptation of human-machine interaction is addressed by the rapidly emerging ...
Multimodal dual-imaging-derived biomarkers for unravelling host response from lung disease progression in cystic lung fibrosis, infection and therapy KU Leuven
Despite the significant advances made by the introduction of imaging techniques for lung diseases and fungal infection research, there are still important gaps where we identify three priorities we want to address with our project. First, we will address the need for alternative antifungal treatment approaches by investigating fungicidal combinatorial treatment in vivo in mouse models of invasive pulmonary aspergillosis (IPA) (context of ...
A multimodal approach for high-spatial-resolution, time-resolved spectroscopy KU Leuven
To date, methods have been developed to investigate the atomic structure or the mesostructure (nanoscale structure) of the materials: electron scanning microscopy, atomic force microscopy, near-field scanning microscopy, X-ray microscopy, fluorescence microscopy. But these methods are not without drawbacks and many of them do not have time resolution capabilities. In this work, we focus our attention on combining optical microscopy with ...
Sabbatical Geert Brône: Developing a research program on eye gaze in face-to-face interaction KU Leuven
In recent years I, together with colleagues from my research group and in various interdisciplinary partnerships, have been working on a methodological testing ground for the study of viewing behavior in face-to-face interaction, using mobile eye-tracking technology. This method plays a central role in: (a) an ongoing KUL-C1 project of which I am the PI and will be completed in September 2020 (project no. 3H160232: “Eye gaze in multimodal ...
Collaborative grammar: the temporality and emergence of clause combination in Italian talk-in interaction KU Leuven
This research is part of a larger project on the topic of clause combination: Beyond the clause. Encoding and Inference in clause-combining (C14/18/034). In my thesis “Collaborative grammar: the temporality and emergence of clause combination in Italian talk-in-interaction”, I explore how collaborative practices of clause-combining relate to the sequential and temporal organization of turns and actions in talk-in-interaction. ...
Deep Learning image processing for crop management KU Leuven
Deep learning (DL) is a subfield of machine learning where algorithms are modeled to imitate human rationale. Among DL most important application areas are computer vision and natural language processing, impacting our everyday life when we access our phone through facial recognition authorization, interact with a company’s chatbot, or get support from a virtual assistant like Alexa. Two turning points in the technology era explain DL current ...