Titulo Estágio
Framework for live biosignal processing and hyperscanning
Áreas de especialidade
Sistemas Inteligentes
Engenharia de Software
Local do Estágio
CISUC-DEI e CIBIT-ICNAS
Enquadramento
A common approach for neuroscientific studies is to measure activity from one's brain as he/she performs a task. However, in the last decades, hyperscanning became possible as a way for measuring and processing simultaneously activity from multiple individuals. This approach allows the study of more complex paradigms such as social interactions [1]. If, besides the recording, one processes the data in real time, extracting information from it, and feed it back into the task (for instance, controlling the cursor of the computer with the mind), this is called neurofeedback [2]. Neurofeedback is a sub-category of biofeedback, where the same concept (feedback to the task information measured from the subject in real time) is applied to any signal measured from the body (heart-rate, skin conductance, electromyography, and so on) [3].
Hyperscanning setups are quite complex, with multiple signal recording hardware and software modules that must be integrated with the stimulation software (task), in order for complete the feedback loop.
[1] https://www.frontiersin.org/articles/10.3389/fnhum.2020.00039/full
[2] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4892319/
[3] https://ieeexplore.ieee.org/abstract/document/7903736
Objetivo
In this dissertation we aim to develop a framework that can, in a modular way, integrate several signal acquisition systems available at CIBIT, preprocess their signals in real-time, extract some features of interest, and integrate their information in the visual stimulation software. This modular solution must provide a user-friendly solution for non-technological researchers to select the signal acquisition modules, the feature to use for feedback, and provide a integrated, synchronized, solution. Furthermore, it must be flexible to allow the integration of future modules and features in a seamless way.
Biosignals to be considered:
- Electroencephalography (EEG)
- Functional Near Infra-Red Spectroscopy (fNIRS)
- Electrocardiogram (ECG)
- Electromyography (EMG)
- Electrodermal Activity (EDA)
- Respiration
- Eye movements
The focus on the project is the modular development and integration of the framework, not the processing and feature extraction of the signals, where in-house and open state of the art solutions can be directly adapted.
Plano de Trabalhos - Semestre 1
- State of the art review [1 month]
- Requirements analysis, including identification of the systems and signals to be included [1 month]
- Design of the solution [1 month]
- Writing of the intermediate report [1 month]
Plano de Trabalhos - Semestre 2
- Development and testing of the solution [4 months, 2-week sprints]
- Writing of the final report [1 month]
Condições
Access to hardware equipment and laboratories. Integration of an interdisciplinary team.
Orientador
Marco Simões
msimoes@dei.uc.pt 📩