This article provides a detailed guide for researchers and drug development professionals on achieving optimal sensor placement for simultaneous EEG-fNIRS acquisition.
This article provides a detailed guide for researchers and drug development professionals on achieving optimal sensor placement for simultaneous EEG-fNIRS acquisition. It covers the foundational principles of both modalities, exploring their synergistic potential and the core challenge of designing compatible montages. The content delves into practical methodologies, including the use of integrated caps and 3D coordinate systems, and addresses critical troubleshooting steps for mitigating common hardware and signal artifacts. Furthermore, it reviews validation frameworks and comparative analyses that demonstrate the enhanced spatiotemporal resolution and clinical utility of hybrid systems in areas such as Brain-Computer Interfaces (BCIs) and neurorehabilitation. The goal is to equip scientists with the knowledge to design robust, reliable, and effective multimodal neuroimaging studies.
Understanding the brain's complex activity requires tools that can capture its rapid electrical fluctuations and the metabolic changes that support them. Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) are two non-invasive neuroimaging techniques that provide complementary insights into these processes by measuring fundamentally different physiological phenomena [1] [2]. EEG captures the brain's direct electrical activity with millisecond temporal precision, while fNIRS measures the slower hemodynamic responses coupled to neural activity through neurovascular coupling [2]. This application note explores the core biophysical principles of these modalities and provides detailed protocols for their integrated use in simultaneous research, with particular emphasis on sensor placement compatibility—a critical consideration for obtaining clean, artifact-free data from both systems simultaneously.
EEG measures the electrical potential generated by the synchronized firing of populations of cortical pyramidal neurons [2]. When these neurons fire synchronously, their post-synaptic potentials summate sufficiently to propagate through the skull and scalp, where they can be detected as tiny voltage fluctuations (typically in the microvolt range) by electrodes placed on the scalp surface [1] [2]. The resulting signal represents the macroscopic electrical activity of the brain, which can be divided into various oscillatory rhythms (e.g., theta: 4-7 Hz, alpha: 8-14 Hz, beta: 15-25 Hz, gamma: >25 Hz) that correlate with different cognitive states and functions [2].
fNIRS is an optical neuroimaging technique that leverages the relative transparency of biological tissue to near-infrared light (wavelengths 600-1000 nm) to measure hemodynamic changes in the cerebral cortex [2] [3]. It detects changes in the concentration of oxygenated hemoglobin (HbO) and deoxygenated hemoglobin (HbR)—the primary light-absorbing chromophores in this wavelength range—which fluctuate in response to neural activity via neurovascular coupling [1] [2]. When a brain region becomes active, a complex physiological process directs increased blood flow to that region, typically resulting in increased HbO and decreased HbR, which fNIRS detects by measuring how much near-infrared light is absorbed as it passes through the tissue [2] [3].
Table 1: Comparative analysis of EEG and fNIRS technical specifications and performance characteristics.
| Feature | EEG (Electroencephalography) | fNIRS (Functional Near-Infrared Spectroscopy) |
|---|---|---|
| What It Measures | Electrical activity of neurons [1] [2] | Hemodynamic response (blood oxygenation levels) [1] [2] |
| Signal Source | Postsynaptic potentials in cortical neurons [1] | Changes in oxygenated and deoxygenated hemoglobin [1] |
| Temporal Resolution | High (milliseconds) [1] [2] | Low (seconds) [1] [2] |
| Spatial Resolution | Low (centimeter-level) [1] [2] | Moderate (better than EEG, but limited to cortex) [1] [2] |
| Depth of Measurement | Cortical surface [1] | Outer cortex (~1–2.5 cm deep) [1] [3] |
| Sensitivity to Motion | High – susceptible to movement artifacts [1] | Low – more tolerant to subject movement [1] |
The integration of EEG and fNIRS is powerfully motivated by the physiological phenomenon of neurovascular coupling [2] [3]. This mechanism describes the tight relationship between neural electrical activity and subsequent hemodynamic changes in the brain [2]. When neurons fire, they create an immediate electrical signature detectable by EEG. This activity increases the metabolic demand for oxygen and glucose, triggering a delayed hemodynamic response (over 2-6 seconds) that delivers oxygenated blood to the active region—a response measurable by fNIRS [1] [2].
This complementary relationship enables a more complete investigation of brain function than either modality can provide alone. EEG offers unparalleled temporal resolution to track rapid neural dynamics, while fNIRS provides superior spatial localization and is less susceptible to motion artifacts [2]. Together, they enable researchers to study both the initial electrical events and their metabolic consequences, providing a more comprehensive picture of brain activity across different temporal and spatial scales [4] [2].
This protocol is adapted from a study investigating semantic neural decoding to differentiate between imagined categories (animals vs. tools) during various mental imagery tasks [5].
Research Objective: To determine whether simultaneous EEG-fNIRS can distinguish between semantic categories (animals vs. tools) during silent naming and sensory-based imagery tasks.
Participant Preparation:
Equipment and Reagent Setup:
Table 2: Research reagents and essential materials for simultaneous EEG-fNIRS recording.
| Item | Function/Application | Specifications/Notes |
|---|---|---|
| Integrated EEG-fNIRS Cap | Provides stable platform for co-located sensor placement [4]. | Uses international 10-20 system for placement; ensures optodes do not obscure electrodes. |
| EEG Amplifier | Amplifies microvolt-scale electrical signals from the scalp. | Multi-channel system; sync capability with fNIRS hardware. |
| fNIRS Continuous Wave System | Emits NIR light and detects attenuation to calculate HbO/HbR [2] [3]. | Typically uses two wavelengths (~690nm, ~830nm); laser/LED sources. |
| Electrolyte Gel | Ensures conductive connection between scalp and EEG electrodes. | Apply carefully to avoid short-circuiting; use minimal gel near fNIRS optodes. |
| fNIRS Optode Holders | Maintains optical contact with scalp for consistent light transmission. | Ensures consistent source-detector distance; typically 3 cm for cortical sensitivity [3]. |
| Stimulus Presentation Software | Presents visual cues and records event markers. | Sends synchronization pulses (TTL) to both EEG and fNIRS systems. |
Simultaneous Sensor Placement Procedure:
Experimental Task:
Data Acquisition Parameters:
This protocol is based on a study using simultaneous EEG-fNIRS to identify neural correlates of implicit learning during a serial reaction time task [6].
Research Objective: To identify electrophysiological and hemodynamic biomarkers of implicit learning in healthy adults.
Participant Preparation: Follow the same preliminary steps as Protocol 1.
Equipment Setup: Utilize the same core equipment as listed in Table 2.
Experimental Task (Serial Reaction Time Task):
Post-Experiment Procedure:
Data Analysis Workflow:
Successful simultaneous EEG-fNIRS recording hinges on resolving the technical and physical challenges of sensor co-location. The primary goal is to achieve optimal signal quality from both modalities without cross-interference [4].
Several helmet fusion designs have been developed for simultaneous operation:
Integrated Caps with Pre-Defined Openings: High-density EEG caps with pre-defined fNIRS-compatible openings allow for optimal placement of both sensor types [1] [4]. This approach ensures consistent inter-sensor distances and proper scalp contact.
3D-Printed Custom Helmets: For precise requirements, 3D-printed custom helmets tailored to individual head morphology provide the most accurate and stable sensor placement, though at a higher cost [4].
Thermoplastic Custom Helmets: Composite polymer cryogenic thermoplastic sheets offer a cost-effective alternative that can be molded to fit individual head shapes when heated (~60°C), providing good stability upon cooling [4].
EEG and fNIRS provide complementary, non-invasive windows into brain function by measuring its electrical and hemodynamic activity, respectively. Their successful integration in simultaneous recordings offers a powerful approach to studying brain dynamics across multiple spatiotemporal scales. The protocols and considerations outlined herein provide a framework for designing and conducting simultaneous EEG-fNIRS studies, with particular attention to the critical aspect of sensor placement compatibility. As this multimodal approach continues to evolve, it holds significant promise for advancing our understanding of brain function in both research and clinical applications, from brain-computer interfaces and cognitive neuroscience to drug development and clinical monitoring [5] [4] [7].
The integration of Electroencephalography (EEG) and functional Near-Infrared Spectroscopy (fNIRS) represents a transformative approach in neuroimaging, creating a system where the whole is significantly greater than the sum of its parts. These two non-invasive technologies capture complementary aspects of brain activity: EEG measures electrical potentials from synchronized neuronal firing with millisecond temporal resolution, while fNIRS detects hemodynamic responses correlated with neural activity through optical measurements, offering superior spatial localization [8] [3]. This complementary relationship is fundamentally rooted in their measurement of linked physiological processes—electrical neuronal activity and the subsequent hemodynamic response—connected through neurovascular coupling mechanisms [8] [9].
The fusion of these modalities is particularly valuable for advancing brain-computer interfaces (BCIs), cognitive neuroscience research, and clinical applications ranging from stroke rehabilitation to monitoring neurological disorders [4] [10]. Unlike more restrictive neuroimaging methods like fMRI or MEG, combined EEG-fNIRS systems offer portability, relatively low cost, and significantly reduced physical constraints, making them ideal for studying brain function in naturalistic environments and across diverse populations [4] [3]. This integration enables researchers to capture both the rapid neural dynamics detectable through electrical signals and the more localized cortical activation patterns revealed by hemodynamic responses, providing a more complete picture of brain function than either modality could deliver independently.
Electroencephalography (EEG) operates by measuring electrical potentials generated by synchronized neuronal activity through electrodes placed on the scalp surface. This neuroelectrical activity manifests with exceptional temporal resolution at the millisecond level, allowing researchers to capture rapid neural dynamics including event-related potentials, oscillatory patterns, and coherence across neural networks [8] [4]. However, as electrical signals pass through multiple layers of non-neural tissue including cerebrospinal fluid, skull, and scalp, they become significantly attenuated and spatially blurred, resulting in limited spatial resolution of approximately 2 centimeters [5] [4]. This fundamental limitation makes precise localization of neural generators challenging from scalp recordings alone.
Functional Near-Infrared Spectroscopy (fNIRS) employs optical principles to measure hemodynamic responses correlated with neural activity. By emitting near-infrared light (typically at wavelengths between 650-950 nm) through the scalp and detecting the backscattered light, fNIRS can quantify concentration changes in oxygenated hemoglobin (Δ[HbO]) and deoxygenated hemoglobin (Δ[HbR]) in cortical tissues [11] [3]. This optical measurement technique provides several advantages: better spatial localization (5-10 mm resolution) than EEG, direct measurement of both hemoglobin species, and relative robustness to motion artifacts [10] [3]. However, fNIRS tracks the slower hemodynamic response to neural activity, which unfolds over seconds rather than milliseconds, resulting in fundamentally inferior temporal resolution compared to EEG [8] [3].
Table 1: Comparative Technical Specifications of EEG and fNIRS
| Parameter | EEG | fNIRS |
|---|---|---|
| Temporal Resolution | Millisecond level (~1-1000 Hz) [5] [4] | ~0.1-10 Hz, limited by hemodynamic response [8] [3] |
| Spatial Resolution | ~2 cm, limited by volume conduction [5] [4] | 5-10 mm, determined by source-detector separation [10] [3] |
| Measured Physiological Signals | Electrical potentials from synchronized neuronal firing [4] | Hemodynamic changes (Δ[HbO] and Δ[HbR]) [11] [3] |
| Depth Sensitivity | Primarily cortical, with sensitivity to deeper sources limited by spatial spread [4] | Superficial cortex (up to ~2-3 cm depth) [11] [3] |
| Primary Artifact Sources | Ocular, muscle, cardiac, and movement artifacts [8] | Scalp hemodynamics, motion, and systemic physiology [8] [11] |
| Typical Sampling Rates | 100-2000 Hz [10] [9] | 2-100 Hz, commonly ~10 Hz [10] [9] |
The complementary nature of EEG and fNIRS measurements is fundamentally grounded in the biological process of neurovascular coupling—the mechanism that links neural activity to subsequent changes in cerebral blood flow and oxygenation [8] [9]. When a brain region becomes active, the increased metabolic demands of firing neurons trigger a complex signaling cascade that ultimately leads to increased blood flow to that region, delivering oxygen and nutrients. This hemodynamic response manifests with a characteristic time delay of 1-6 seconds after the initial neural activation [8] [3]. This temporal relationship means that EEG captures the initial electrical neural events, while fNIRS detects the subsequent hemodynamic consequences, making these modalities inherently complementary rather than redundant.
Recent studies investigating structure-function relationships in brain networks using simultaneous EEG-fNIRS recordings have demonstrated that the functional information captured by both modalities shows consistency in early sensory cortical hierarchy but may diverge in higher-order association areas [9]. This suggests that the coupling between electrical and hemodynamic activities varies across different brain regions, following the unimodal to transmodal organizational gradient of the cortex [9]. Understanding these regional variations in neurovascular coupling is essential for proper interpretation of multimodal data and represents an active area of research in neuroimaging.
Successful simultaneous EEG-fNIRS recording requires careful consideration of sensor placement compatibility to ensure both modalities can acquire quality data from the regions of interest without interference. The fundamental challenge lies in the limited scalp real estate that must be shared between EEG electrodes and fNIRS optodes while maintaining proper coverage of target brain regions [12] [13]. The most common approach involves integrating both sensor types into a single headcap, with EEG electrodes typically placed according to international 10-20 or 10-5 systems, and fNIRS optodes positioned in between at appropriate source-detector distances [12] [13].
A critical technical consideration for fNIRS is maintaining proper inter-optode distance (IOD), typically around 30 mm for adults, which determines the depth sensitivity and penetration of the optical measurement [3] [13]. Shorter distances (~15 mm) primarily sensitivity to extracerebral layers (skin, skull), while longer distances (30-40 mm) enable sampling of cerebral cortical tissues [3]. Modern integration approaches include using customized headcaps with combined holders that accommodate both EEG electrodes and fNIRS optodes in precise spatial configurations [4] [13]. For high-density measurements, 3D-printed customized helmets or cryogenic thermoplastic sheets can provide optimal positioning and stability, though at increased cost and complexity [4].
Table 2: Equipment Specifications for Simultaneous EEG-fNIRS Recording
| Component | Specifications | Purpose/Function |
|---|---|---|
| EEG Amplifier | g.HIamp, g.Nautilus, g.USBamp (g.tec); Sampling: 256-1000 Hz [12] [10] | Signal acquisition and amplification of electrical potentials |
| fNIRS System | Continuous wave systems (NirScan, NIRSport2); Sampling: 11-12.5 Hz; Wavelengths: 760 & 850 nm [10] [9] | Measurement of hemodynamic changes via light absorption |
| EEG Electrodes | Active wet or hybrid dry electrodes (g.SCARABEO); 16-64 channels [12] | Scalp contact for electrical signal acquisition |
| fNIRS Optodes | Sources (LEDs/lasers) & detectors; Typical power: ~1mW [3] | Light emission and detection through scalp and brain tissue |
| Headcap | Neoprene fabric with optode/electrode holders; Light-absorbing properties [12] [13] | Secure sensor placement, stability, and light blocking |
| Synchronization | Event markers from E-Prime, LabStreamingLayer [10] [9] | Temporal alignment of multimodal data streams |
Precise temporal synchronization between EEG and fNIRS data streams is essential for meaningful multimodal analysis. There are two primary approaches to synchronization: (1) separate systems synchronized via host computer with external triggers, and (2) integrated systems with unified processors that simultaneously handle both data streams [4]. While the first approach offers flexibility in using existing equipment, the second provides more precise synchronization and streamlined data handling [4]. Modern systems typically use shared event markers from stimulus presentation software (e.g., E-Prime) that simultaneously trigger both recording systems during experimental paradigms [10] [9].
The significant disparity in typical sampling rates between EEG (often 256-1000 Hz) and fNIRS (typically 10-12.5 Hz) necessitates careful consideration in data analysis [10] [9]. In practice, the EEG system often acts as the "master" device in synchronized setups due to its higher sampling frequency requirements [12]. Successful integration requires ensuring that the electronic systems do not interfere with each other—thankfully, fNIRS as an optical technique typically doesn't electrically interfere with EEG, though proper grounding and maintaining low skin-electrode impedance can minimize potential artifacts [13].
Motor imagery (MI) represents one of the most established and clinically relevant paradigms for combined EEG-fNIRS research, particularly in brain-computer interfaces and neurorehabilitation [10]. The following protocol outlines a standardized approach for upper limb motor imagery experiments:
Participant Preparation and Setup: Begin with explaining the motor imagery concept to participants, emphasizing that it involves mentally simulating movements without physical execution. For enhanced task engagement, incorporate a grip strength calibration procedure using a dynamometer or stress ball to reinforce tactile and force-related aspects of the movement [10]. Proper cap placement is critical—use the international 10-20 system for EEG electrode placement and position fNIRS optodes over the primary sensorimotor cortex (C3, Cz, C4 regions) with appropriate inter-optode distances (typically 30mm for adults) [10] [13]. Ensure proper light coupling for fNIRS and electrode impedances below 10 kΩ for EEG quality.
Experimental Paradigm Structure: Implement a block design with the following structure for each trial: (1) Visual cue presentation (2 seconds) displaying a directional arrow (left/right) indicating the required MI; (2) Execution phase (10 seconds) where participants perform kinesthetic MI of the corresponding hand grasping movement at approximately one imagined grasp per second while fixating on a central cross; (3) Inter-trial interval (15 seconds) with blank screen for rest [10]. Include at least 30 trials per session (15 left/right each), with multiple sessions separated by sufficient rest intervals to mitigate fatigue. Begin with baseline recordings: 1-minute eyes-closed followed by 1-minute eyes-open states before task initiation [10].
Data Acquisition Parameters: Set EEG sampling rate to 256 Hz or higher with appropriate bandpass filtering (e.g., 0.5-40 Hz). Configure fNIRS sampling at 10 Hz or higher using dual wavelengths (typically 760 and 850 nm) to compute hemoglobin concentration changes [10]. Ensure precise synchronization between modalities using shared event markers from stimulus presentation software.
Semantic decoding using combined EEG-fNIRS offers promising avenues for developing more intuitive brain-computer interfaces for communication [5]. The following protocol enables investigation of neural representations during semantic category processing:
Stimuli and Task Design: Select appropriate visual stimuli representing distinct semantic categories (e.g., animals vs. tools) [5]. Present images against a neutral background with standardized size and luminance. Implement multiple mental tasks: (1) Silent naming—participants silently name the displayed object; (2) Visual imagery—participants visualize the object without focusing on the specific image presented; (3) Auditory imagery—participants imagine sounds associated with the object; (4) Tactile imagery—participants imagine the feeling of touching the object [5].
Trial Structure and Timing: Structure each trial as follows: (1) Stimulus presentation (3-5 seconds) showing the category image; (2) Mental task period (3-5 seconds) where participants perform the cued imagery task; (3) Inter-trial interval (15-20 seconds) for baseline recovery [5]. Use a block design with randomized task order across participants. Include sufficient trials per condition (typically 15-20) to ensure adequate statistical power for decoding analyses.
Data Acquisition Considerations: Position fNIRS optodes over language-related regions (inferior frontal gyrus, temporal cortex) alongside standard EEG placements [5]. For semantic tasks requiring higher cognitive processing, extend mental task periods to 5 seconds to capture the slower hemodynamic response more completely [5]. Implement appropriate artifact removal strategies, particularly for EEG during visual tasks where ocular artifacts are prominent.
Robust preprocessing is essential for extracting meaningful signals from both modalities while addressing their unique artifact profiles:
EEG Preprocessing: Apply bandpass filtering (0.5-40 Hz) to remove slow drifts and high-frequency noise. Identify and remove artifacts using independent component analysis (ICA) with a focus on ocular, cardiac, and muscle artifacts [8]. Implement artifact subspace reconstruction (ASR) for continuous data cleaning, particularly important for real-time applications [11]. For event-related analyses, epoch data around stimulus events and apply baseline correction.
fNIRS Preprocessing: Convert raw light intensity to optical density, then to hemoglobin concentration changes using the modified Beer-Lambert law [9]. Apply bandpass filtering (0.01-0.2 Hz) to isolate hemodynamic responses from physiological noise (cardiac ~1 Hz, respiratory ~0.3 Hz) [11] [9]. Implement motion artifact correction using wavelet-based methods or robust regression [11]. Incorporate short-separation regression to remove superficial scalp hemodynamics when short-distance channels are available [8].
Multimodal Quality Metrics: Calculate scalp-coupling index (SCI) for fNIRS to identify channels with poor optode-scalp contact [9]. For EEG, monitor electrode impedances throughout recording. Reject channels with excessive noise in either modality before further analysis.
Data fusion represents the core analytical challenge and opportunity in combined EEG-fNIRS research:
Data-Level Fusion: Concatenate features from both modalities into a unified feature space for machine learning applications [8] [10]. This approach requires careful normalization to address the different scales and dimensionalities of EEG and fNIRS data. For classification tasks, this strategy has demonstrated 5-10% improvement in accuracy compared to unimodal systems [10].
Model-Based Fusion: Implement joint generative models that incorporate neurovascular coupling principles to estimate underlying neural activity [8]. These approaches can include dynamic causal modeling or state-space models that formally represent the relationship between electrical neural activity and hemodynamic responses.
Decision-Level Fusion: Process each modality independently through separate pipelines before combining results at the decision stage through voting schemes or confidence-weighted integration [8]. This approach offers robustness to modality-specific failures but may fail to capture more subtle cross-modal interactions.
Asymmetric Fusion: Use one modality to inform processing of the other—for instance, using EEG-derived neural events to inform fNIRS general linear model analysis, or using fNIRS spatial information to constrain EEG source localization [8].
Table 3: Essential Equipment and Software for EEG-fNIRS Research
| Category | Item | Specification/Purpose | Example Brands/Platforms |
|---|---|---|---|
| Hardware | EEG Amplifier | 32-64 channels; Sampling ≥256 Hz; Referenced recording | g.HIamp, g.Nautilus, BrainAmp [12] [10] |
| fNIRS System | Continuous wave; 2+ wavelengths (760, 850 nm); Sampling ≥10 Hz | NirScan, NIRSport2, Artinis systems [10] [13] | |
| Integrated Caps | Neoprene fabric; Combined optode/electrode holders; Light-blocking | Custom designs with 10-20 system markers [12] [13] | |
| Software | Stimulus Presentation | Precision timing, trigger generation | E-Prime, PsychToolbox, Presentation [10] [9] |
| Data Acquisition | Synchronized multi-modal recording | LabStreamingLayer, BrainVision Recorder [10] | |
| Analysis Platforms | Preprocessing, fusion, visualization | MNE-Python, Brainstorm, Homer2, NIRS-KIT [9] | |
| Accessories | EEG Electrodes | Active/passive wet electrodes or hybrid dry systems | g.SCARABEO, sintered Ag/AgCl [12] |
| fNIRS Optodes | Source-detector pairs with spring-loaded holders | Custom designs for specific systems [13] | |
| 3D Digitization | Optode/electrode position registration | Polhemus, Structure Sensor, photogrammetry [9] |
The integration of EEG and fNIRS has demonstrated particular value across several research and clinical domains:
Brain-Computer Interfaces and Neurorehabilitation: Hybrid EEG-fNIRS BCIs have shown significantly improved classification accuracy compared to unimodal systems, particularly for motor imagery paradigms [10]. In clinical populations such as intracerebral hemorrhage patients, this multimodal approach can track both electrical abnormalities and hemodynamic impairments, providing a more complete assessment for neurorehabilitation [10].
Cognitive Neuroscience Research: The combined temporal and spatial resolution enables investigation of complex cognitive processes including semantic decoding, working memory, and attention [5] [9]. Studies examining structure-function relationships using simultaneous recordings have revealed how electrical and hemodynamic networks align with underlying structural connectivity across different brain states [9].
Clinical Monitoring and Assessment: The portability and relatively low cost of combined systems make them ideal for bedside monitoring in various clinical conditions including ADHD, epilepsy, disorders of consciousness, and stroke recovery [4]. The ability to capture both rapid electrical events (e.g., seizures) and slower hemodynamic changes provides complementary information for diagnosis and treatment monitoring.
Future advancements in EEG-fNIRS integration will likely focus on improving hardware miniaturization and wireless capabilities, developing more sophisticated real-time processing algorithms, and establishing standardized analytical frameworks for multimodal data fusion [4] [11]. As these technologies continue to evolve, they hold the promise of making high-quality brain imaging more accessible, portable, and applicable to real-world environments beyond traditional laboratory settings.
Neurovascular coupling (NVC) describes the fundamental physiological process that links neural activity with subsequent changes in cerebral blood flow and hemodynamics [14] [15]. This connection forms the foundational basis for several functional neuroimaging techniques, including functional magnetic resonance imaging (fMRI) and functional near-infrared spectroscopy (fNIRS), which rely on hemodynamic changes as a proxy for neural activity [14]. The adult brain, while constituting only approximately 2% of total body weight, accounts for about 20% of the body's total energy consumption [15]. To meet this high metabolic demand, the brain requires a continuous supply of oxygen and glucose, delivered via cerebral blood flow [15]. The NVC mechanism mediates this delivery through a complex biological signaling cascade wherein synaptic activity triggers the release of vasoactive molecules that act on vascular smooth muscle cells and pericytes, ultimately resulting in changes to cerebral blood flow (CBF), cerebral blood volume (CBV), and the cerebral metabolic rate of oxygen (CMRO₂) [14] [15].
Table 1: Key Components of Neurovascular Coupling
| Component | Description | Role in NVC |
|---|---|---|
| Neural Activity | Electrical signals from neuronal firing, particularly from pyramidal cells | Initiates the coupling process by triggering vasoactive signaling |
| Vasoactive Molecules | Nitric oxide (NO), prostaglandins, neuropeptides | Act as messengers that communicate between neurons and blood vessels |
| Vascular Response | Dilation/constriction of arterioles and capillaries | Directly alters blood flow and volume to active brain regions |
| Hemodynamic Response | Changes in oxygenated/deoxygenated hemoglobin | Measurable outcome used in fNIRS and fMRI imaging |
The intricate cellular pathways underlying NVC involve multiple cell types and signaling molecules. As illustrated in Figure 1, neuronal signaling activates GABAergic interneurons, pyramidal neurons, and astrocytes by stimulating calcium (Ca²⁺) influx [15]. This calcium facilitates distinct signaling pathways in different cells: in GABAergic interneurons, it promotes nitric oxide (NO) synthesis; in pyramidal neurons, it facilitates arachidonic acid metabolism to prostaglandin E₂ (PGE₂); and in astrocytes, it triggers production of additional vasoactive molecules including PGE₂, EET, and 20-HETE [15]. These pathways collectively regulate vascular tone in response to neural activity.
The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) provides a powerful multimodal approach for studying neurovascular coupling by capturing complementary aspects of brain activity [16]. EEG measures electrical activity resulting from synchronized firing of cortical neurons, primarily pyramidal cells, providing millisecond-level temporal resolution ideal for tracking rapid neural dynamics [16] [17]. In contrast, fNIRS monitors cerebral hemodynamic responses by measuring changes in oxygenated (HbO) and deoxygenated hemoglobin (HbR) using near-infrared light, offering better spatial resolution for surface cortical areas but slower temporal resolution due to the inherent delay of the hemodynamic response (2-6 seconds) [16].
Table 2: Comparative Characteristics of EEG and fNIRS
| Feature | EEG (Electroencephalography) | fNIRS (Functional Near-Infrared Spectroscopy) |
|---|---|---|
| What It Measures | Electrical activity of neurons | Hemodynamic response (blood oxygenation levels) |
| Signal Source | Postsynaptic potentials in cortical neurons | Changes in oxygenated and deoxygenated hemoglobin |
| Temporal Resolution | High (milliseconds) | Low (seconds) |
| Spatial Resolution | Low (centimeter-level) | Moderate (better than EEG, limited to cortex) |
| Depth of Measurement | Cortical surface | Outer cortex (~1-2.5 cm deep) |
| Sensitivity to Motion | High - susceptible to movement artifacts | Low - more tolerant to subject movement |
| Best Use Cases | Fast cognitive tasks, ERP studies, sleep research | Naturalistic studies, child development, motor rehab |
For simultaneous EEG-fNIRS recordings, proper sensor placement is crucial for effective data collection and interpretation. Both systems typically use the international 10-20 system for electrode and optode placement, ensuring standardized positioning across subjects and studies [16]. Technical considerations for compatible sensor placement include:
Modern experimental setups have successfully implemented integrated systems, such as a custom-designed hybrid EEG-fNIRS cap with 32 EEG electrodes and 62 fNIRS optodes (32 sources, 30 detectors) arranged to achieve 90 fNIRS measurement channels through source-detector pairing [10]. The systematic expansion of the international 10-20 system for EEG electrode placement ensures comprehensive coverage of major functional cortical areas, while fNIRS optodes follow an anatomically-guided configuration aligned with functional neuroanatomical parcellations [10].
A comprehensive simultaneous EEG-fNIRS protocol for investigating visual cognitive processing was established by Phukhachee and colleagues [18]. This protocol examines the neural correlates of intentional memory formation using a multimodal approach:
Participant Preparation and Setup
Experimental Paradigm
Data Collection Parameters
Another established protocol examines neural activity during motor execution, observation, and imagery using simultaneous EEG-fNIRS recordings [19]:
Participant Preparation
Experimental Conditions
Data Acquisition and Analysis
Figure 1: Experimental workflow for simultaneous EEG-fNIRS studies, illustrating the sequential steps from participant preparation to data analysis.
The neurovascular coupling process involves sophisticated signaling pathways between neurons and blood vessels. Research using optogenetics and microscopy in mice has revealed cell-specific contributions to the vascular response [14] [15]:
These specific cellular mechanisms are conserved across species and form the biological basis for interpreting combined EEG-fNIRS measurements [14]. The interplay between different neuronal subpopulations produces the characteristic biphasic hemodynamic response function (HRF) observed in neuroimaging, which features an initial peak at approximately 3-6 seconds after a brief stimulus, followed by a post-peak undershoot, with the entire response typically lasting 15-20 seconds [14].
Figure 2: Neurovascular coupling signaling pathways showing the progression from neural activity to hemodynamic response through cell-type specific mechanisms.
Table 3: Essential Research Materials for EEG-fNIRS Neurovascular Coupling Studies
| Research Tool | Function/Application | Examples/Specifications |
|---|---|---|
| Hybrid EEG-fNIRS Caps | Simultaneous sensor placement | Custom designs with 32 EEG electrodes + 62 fNIRS optodes; International 10-20 system compatibility [10] |
| fNIRS Systems | Hemodynamic response measurement | Continuous-wave systems (e.g., NirScan); 695 nm & 830 nm wavelengths; ~10 Hz sampling rate [10] [19] |
| EEG Amplifiers | Neural electrical activity recording | g.HIamp amplifier; 256 Hz sampling rate; 32+ channels [10] |
| 3D Digitizers | Precise optode localization | Fastrak Polhemus system; records coordinates relative to nasion, inion, preauricular landmarks [19] |
| Stimulus Presentation | Experimental paradigm delivery | E-Prime 3.0; synchronized event markers for both EEG and fNIRS [10] |
| Data Fusion Algorithms | Multimodal data integration | Structured sparse multiset CCA (ssmCCA); joint Independent Component Analysis (jICA) [20] [19] |
| Motion Correction Tools | Artifact reduction | Preprocessing algorithms for minimizing movement artifacts in both modalities [16] |
The integration of EEG and fNIRS data requires sophisticated analytical approaches that accommodate their different temporal characteristics and physiological origins. Several methodological frameworks have been developed specifically for multimodal neurovascular data:
Lin et al. (2023) developed a dedicated EEG-fNIRS analysis framework to investigate cognitive-motor interference through neurovascular coupling [20]. This approach:
Advanced deep learning approaches have shown promising results for classifying simultaneous EEG-fNIRS data. The Multimodal DenseNet Fusion (MDNF) model represents a significant technical advancement by [17]:
This approach effectively bridges the feature representation gap between the temporal richness of EEG and spatial specificity of fNIRS, demonstrating the potential for clinical applications in neurodiagnostics and rehabilitation [17].
Simultaneous EEG-fNIRS recording provides a powerful multimodal framework for investigating neurovascular coupling, leveraging the complementary strengths of electrophysiological and hemodynamic measurement techniques. The integration of these modalities requires careful consideration of sensor placement compatibility, experimental design, and advanced data fusion methodologies. The protocols and analytical approaches outlined in this document establish standardized methods for studying the fundamental relationship between electrical and metabolic brain activity, with significant implications for basic cognitive neuroscience, clinical research, and therapeutic development. As multimodal integration methodologies continue to advance, simultaneous EEG-fNIRS is poised to yield increasingly nuanced insights into the neurovascular basis of brain function in both healthy and pathological states.
The prefrontal cortex (PFC) and sensorimotor cortex (SMC) are critical brain regions for understanding higher-order cognitive functions and motor control. Research using multimodal neuroimaging, particularly simultaneous electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), has advanced our ability to investigate these regions in both healthy and clinical populations. These techniques leverage the complementary information provided by electrical neural activity (EEG) and hemodynamic responses (fNIRS), which are linked through neurovascular coupling—the relationship between neural electrical activity and subsequent changes in cerebral blood flow [2]. This application note details the anatomical significance, provides validated experimental protocols, and outlines technical considerations for studying the PFC and SMC using combined EEG-fNIRS.
The PFC is central to executive functions, including cognitive control, working memory, and decision-making [21]. Key subregions include the dorsolateral PFC (DLPFC), involved in planning and regulation; the ventrolateral PFC (VLPFC), and the orbitofrontal cortex (OFC), which is implicated in emotion and reward. In clinical contexts, PFC dysfunction is a hallmark of various neurodevelopmental and neurodegenerative disorders. For instance, in Parkinson's disease (PD), the progression of cognitive impairment is strongly linked to altered activation and functional connectivity within the PFC and related networks [21].
The SMC, encompassing the primary motor cortex (M1) and primary somatosensory cortex (S1), is responsible for motor execution and sensory processing. The premotor and supplementary motor areas (PMC/SMA) play a key role in motor planning and coordination [21]. Investigating the SMC is crucial for understanding motor deficits in conditions like PD and for developing rehabilitation strategies for stroke and other motor disorders.
Combining EEG and fNIRS provides a comprehensive view of brain activity by capturing its electrical and hemodynamic aspects simultaneously [2] [22]. The following protocol ensures high-quality data acquisition.
The design principle is to interlace EEG electrodes between fNIRS optodes. A sample montage for investigating the PFC and SMC is detailed in Table 1.
Table 1: Example EEG-fNIRS Montage for PFC and SMC Investigation
| Anatomical Region | EEG 10-20 Landmarks | Key fNIRS Channels | Targeted Function |
|---|---|---|---|
| Dorsolateral PFC (DLPFC) | F3, F4 | Between F3-AF3, F4-AF4 | Executive Function, Working Memory [21] |
| Medial PFC (mPFC) | FPz, AFz | Between FPz-AFz, AF3-AFz | Social/Emotional Processing [21] |
| Orbitofrontal Cortex (OFC) | FP1, FP2 | Inferior to FP1/FP2 | Reward, Decision-Making [21] |
| Primary Motor Cortex (M1) | C3, C4 | Between C3-CP3, C4-CP4 | Hand Motor Execution [21] |
| Premotor Cortex (PMC) | FC3, FC4 | Between FC3-C3, FC4-C4 | Motor Planning [21] |
| Supplementary Motor Area (SMA) | FCz, Cz | Between FCz-Cz | Motor Sequencing, Bimanual Coordination [21] |
The analysis of concurrent EEG-fNIRS data can be performed using three primary approaches: EEG-informed fNIRS analysis, fNIRS-informed EEG analysis, or parallel analysis [2]. A typical workflow is outlined below.
fNIRS studies have revealed distinct patterns of cortical activation and functional connectivity (FC) across different clinical stages, particularly in Parkinson's disease (PD). These findings can serve as benchmarks for your own research.
Table 2: Stage-Specific fNIRS Findings in Parkinson's Disease During a Stroop Task [21]
| Patient Group | Cortical Activation Pattern | Functional Connectivity (FC) Pattern | Association with Cognition |
|---|---|---|---|
| PD with Normal Cognition (PD-NC) | Not specified in results summary | Significantly enhanced interhemispheric connectivity compared to Healthy Controls (HCs) | Suggests early compensatory mechanisms |
| PD with Mild Cognitive Impairment (PD-MCI) | Significant hypoactivation in DLPFC, M1, and PMC | Extensive and pronounced interhemispheric connectivity | Suggests expanded cortical network as compensation for reduced activation |
| PD with Dementia (PDD) | Increased activation in mPFC, OFC, and DLPFC | Reduced connectivity among PMC, VLPFC, and OFC | Increased DLPFC activation correlated with poorer executive function |
This section lists essential materials and their functions for conducting simultaneous EEG-fNIRS studies.
Table 3: Essential Research Materials for EEG-fNIRS Studies
| Item | Function / Purpose | Example / Specification |
|---|---|---|
| Biosignal Amplifier | Acquires and digitizes high-quality EEG signals with high temporal resolution. | g.Nautilus, g.USBamp [22] |
| fNIRS Sensor Module | Adds fNIRS measurement capability to the EEG amplifier for simultaneous recording. | g.SENSOR fNIRS [22] |
| Integrated Head Cap | Holds both EEG electrodes and fNIRS optodes in a stable, predefined configuration. | g.GAMMAcap with electrode and optode holder rings [22] |
| Active EEG Electrodes | Improve signal quality and reduce preparation time; can be wet or hybrid dry. | g.SCARABEO electrodes [22] |
| Conductive Electrode Gel | Ensures low impedance between the scalp and EEG electrodes for optimal signal quality. | Saline-based or abrasive gel |
| fNIRS Source Detectors | Emit near-infrared light and detect the reflected signal from the cortex. | LEDs/Lasers (695/830 nm) [23] |
| Stimulus Presentation Software | Presents experimental paradigms and sends triggers to synchronize data with task events. | Presentation, E-Prime, PsychoPy |
| Integrated Analysis Software | Processes and analyzes synchronized EEG and fNIRS data. | g.HIsys, MATLAB toolboxes (e.g., BBCI, NIRS-KIT) |
The integration of EEG and fNIRS is particularly valuable for clinical translation. The following diagram summarizes the pathway from neural activity to measurable signals and its application in diagnosing brain disorders.
In conditions like Alzheimer's disease and stroke, the integrity of neurovascular coupling is compromised [2]. This impairment can be detected as a discrepancy or abnormal relationship between the EEG and fNIRS signals, offering a potential diagnostic biomarker. Similarly, in autism spectrum disorder (ASD), fNIRS has revealed abnormal prefrontal activation and reduced functional connectivity in children, demonstrating its utility as a potential biomarker for neurodevelopmental disorders [23].
Simultaneous electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) monitoring provides a comprehensive picture of brain function by capturing complementary aspects of neural activity—the millisecond-scale electrical discharges and the slower hemodynamic responses related to metabolic demand [24] [25]. The physical integration of these sensors into a single headcap is a critical step in the evolution of this multimodal field [24]. A well-designed integrated cap must overcome significant challenges, including mechanical interference between components, electrical crosstalk, and ensuring precise co-registration of the different signal types [24] [26]. This application note details the core design considerations for integrated EEG-fNIRS caps, surveys commercially available solutions, and provides a foundational protocol for researchers in neuroscience and drug development.
The development of an integrated EEG-fNIRS cap involves addressing several intertwined technical and practical challenges to ensure data quality and participant comfort.
The primary mechanical challenge is the competition for space on the scalp between EEG electrodes and fNIRS optodes (sources and detectors). This is particularly acute for studies involving populations with smaller head sizes, such as infants and children [24] [27].
fNIRS systems often use rapidly switching currents to drive their light sources (LEDs or laser diodes), which can create electrical noise that interferes with the sensitive analog EEG signals [24].
Precise time-locking of EEG and fNIRS data streams is fundamental for correlating the fast electrical events with the slower hemodynamic changes.
The market offers solutions ranging from fully integrated wireless headsets to customizable cap systems that accommodate various amplifiers and electrodes.
Table 1: Comparison of Select Commercial Integrated EEG-fNIRS Solutions
| Vendor / Product | Key Features | EEG Channels | fNIRS Channels | Notable Integration Aspects |
|---|---|---|---|---|
| g.tecg.Nautilus with g.GAMMAcap [31] | Wireless headset | 8 to 64 (wet or dry) | 8 | fNIRS sensor easily inserts into cap; pre-defined placement over frontal/sensorimotor cortices. |
| ArtinisHeadcaps [29] | Compatible with various systems | Customizable | Customizable | Full-head caps with printed fNIRS/10-20 grids; pre-punched or custom hole options. |
| NIRxNIRScaps [32] | High flexibility | Customizable (active/passive) | Customizable (high-density) | Supports arbitrary layouts; integration with active/passive EEG and other modalities (tDCS). |
| Easycap [28] | Modular or integrated | 19 to 128+ | Customizable (via layout) | Broad range of sizes (preterm to adult); options for multimodal bespoke designs (e.g., BrainCaps). |
| BIOPACMedelOpt+ [33] | Exoskeleton headset | Up to 512 Hz sampling | 64 to 128 theoretical | Flexible, adaptable headset fitting ages 4 to adult; unified with AcqKnowledge software. |
This protocol outlines a standard procedure for conducting a simultaneous EEG-fNIRS study using a Stroop task to elicit cognitive conflict in the prefrontal cortex (PFC) [26].
Table 2: Research Reagent Solutions and Essential Materials
| Item | Function / Explanation |
|---|---|
| Integrated EEG-fNIRS Cap | The central hardware, combining electrodes and optodes in a single headgear for simultaneous data acquisition. |
| Conductive EEG Gel (for wet electrodes) | Facilitates electrical conduction between the scalp and Ag/AgCl electrodes, crucial for obtaining low impedance. |
| Abrasive Prep Gel | Gently exfoliates the skin to lower impedance at EEG electrode sites. |
| Alcohol Wipes & Gauze | For cleaning and drying the scalp before sensor application. |
| Optode Positioning Tool | Ensures fNIRS sources/detectors are placed at the correct 10-20 locations and maintain proper scalp contact. |
| Task Presentation Software | Presents the Stroop task stimuli and records behavioral responses (accuracy, reaction time). |
| Synchronization Trigger Box | Sends precise electronic markers from the stimulus computer to the EEG and fNIRS acquisition systems to align data streams. |
Step 1: Participant Preparation and Cap Fitting
Step 2: System Setup and Signal Quality Check
Step 3: Data Acquisition and Task Execution
Step 4: Concluding the Session
The following workflow outlines the core steps for processing the acquired multimodal data. Separate preprocessing pipelines are required before integration due to the fundamentally different nature of the signals [25].
Diagram 1: EEG-fNIRS Data Processing Workflow. This diagram illustrates the separate preprocessing pipelines for EEG and fNIRS data, followed by joint fusion and analysis after synchronization.
Table 3: Key Hardware Components and Their Specifications
| Component | Types / Options | Key Considerations for Integration |
|---|---|---|
| EEG Electrodes | Wet (Ag/AgCl): Standard, reliable, low impedance. Dry: Faster setup, no gel, but higher impedance. Active: Include a pre-amplifier at the electrode site to reduce noise [24] [28]. | Wet electrodes are preferred for high signal quality but are less suitable for long-term monitoring. Dry/active electrodes reduce setup time and cabling. Choice affects cap design and space requirements. |
| fNIRS Sources | Light-Emitting Diodes (LEDs): Low cost, portable. Laser Diodes (LDs) / Vertical-Cavity Surface-Emitting Lasers (VCSELs): Higher power, better signal quality [30] [26]. | Higher power sources (e.g., for sensorimotor cortex) may be needed versus lower power (e.g., for frontal cortex) [31]. Switching frequency must be managed to avoid EEG crosstalk [26]. |
| fNIRS Detectors | Silicon Photodiodes (PDs): Common, good sensitivity. Avalanche Photodiodes (APDs): Higher sensitivity, but more complex and expensive [30]. | Sensitivity determines the quality of the detected light signal. The size and profile of the detector can influence mechanical design and comfort. |
Integrated EEG-fNIRS caps represent a significant technological advancement, enabling robust and convenient multimodal brain imaging. Successful implementation hinges on carefully balancing mechanical design, electronic integration, and experimental protocol. By understanding the core design principles and leveraging the growing range of commercial and custom solutions, researchers can effectively deploy this powerful technology to uncover new insights into brain function and dysfunction in both laboratory and real-world settings.
The integration of functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) provides a powerful multimodal approach for studying brain function by simultaneously capturing hemodynamic and electrical neural activity [2] [4]. A fundamental prerequisite for effective simultaneous recording is the precise spatial co-registration of fNIRS optodes with the International 10-20 EEG system [34] [35]. This co-registration ensures that the brain regions assessed by both modalities are anatomically aligned, enabling valid cross-modal data integration and interpretation. For researchers in neuroscience and drug development, establishing a standardized protocol for sensor placement is crucial for obtaining reliable, reproducible measurements in studies investigating neural correlates of cognition, disease states, or treatment effects [4]. This application note details the methodologies and protocols for achieving precise spatial co-registration, framed within the broader context of sensor placement compatibility for simultaneous EEG-fNIRS research.
The International 10-20 System is a globally recognized method for standardizing electrode placement on the scalp based on anatomical landmarks [34]. The system specifies locations using a proportional measurement system that accounts for individual head size and shape.
Several methodological approaches exist for co-registering fNIRS optodes to the 10-20 system, ranging from manual measurement to advanced computational and neuroimaging-assisted techniques.
For higher spatial precision, particularly for targeting specific cortical regions, MRI-assisted methods are employed.
The following protocols provide a framework for accurate co-registration in a research setting.
This protocol is suitable for studies without access to neuronavigation or individual MRI data.
This protocol is for studies requiring the highest degree of anatomical specificity.
Table 1: Comparison of fNIRS-EEG Co-registration Methods
| Method | Key Principle | Accuracy | Time/Cost | Primary Application |
|---|---|---|---|---|
| Manual Measurement | Proportional measurement from cranial landmarks [34] | Moderate | Low | Standard cognitive studies, field research |
| Semi-Automatic Digitization | 3D head surface reconstruction & virtual measurement [34] | High | Moderate | Studies requiring higher spatial precision |
| Virtual/Probabilistic Registration | Probabilistic mapping using group-level MRI templates [36] [37] | Good | Low to Moderate | Standalone fNIRS studies without subject-specific MRI |
| Subject-Specific MRI | Anatomical projection using individual structural MRI [36] | Very High | High | Clinical trials, studies targeting specific brain structures |
Successful co-registration and simultaneous data acquisition rely on a set of key materials and tools.
Table 2: Essential Materials for fNIRS-EEG Co-registration Research
| Item | Function/Description |
|---|---|
| Integrated EEG-fNIRS Caps | Elastic caps with pre-defined holders for both EEG electrodes and fNIRS optodes, ensuring fixed relative positions [4] [35]. |
| 3D Magnetic Digitizer (e.g., Polhemus Fastrak) | Records the 3D spatial coordinates of scalp landmarks, EEG electrodes, and fNIRS optodes for precise digital co-registration [34] [19]. |
| MRI-Visible Fiducial Markers (e.g., Vitamin E Capsules) | Placed on optodes during an MRI scan to make their locations visible on structural images, enabling anatomical co-registration [36]. |
| Neuronavigation System | Uses the participant's MRI and a 3D digitizer to visually guide the experimenter in placing optodes on the scalp over target cortical regions in real-time [38]. |
| Computational Toolboxes (e.g., fOLD, AtlasViewer) | Software that uses head models and photon migration simulations to optimize optode placement for sensitivity to specific regions-of-interest [37]. |
The following diagram illustrates the logical workflow for selecting and implementing a co-registration strategy in simultaneous fNIRS-EEG research.
Co-registration Strategy Workflow
The physical integration of both modalities is a critical step. The dominant approach is to use a single, integrated helmet or cap [4] [35].
Precise spatial co-registration of fNIRS optodes to the International 10-20 EEG system is not merely a technical preliminary but a foundational step for generating robust and interpretable data in simultaneous multimodal research. The choice of co-registration method—from cost-effective manual measurement to high-precision MRI-guided techniques—should be guided by the study's specific requirements for anatomical accuracy, available resources, and participant population. By adhering to the detailed protocols and leveraging the tools outlined in this document, researchers in both academic and pharmaceutical development settings can ensure sensor placement compatibility, thereby enhancing the validity of their findings on brain function and the effects of neuromodulatory compounds.
Simultaneous electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) recording provides a powerful, multimodal approach for studying brain function by capturing complementary electrical and hemodynamic activities [3]. The successful integration of these modalities hinges on optimizing their distinct hardware configurations: electrode density for EEG and source-detector distances for fNIRS. Optimal sensor placement is critical for maximizing signal quality, spatial specificity, and the overall fidelity of the collected data, which is a central theme in advanced neuroimaging research [11]. This protocol details the methodologies for determining these key parameters to ensure high-quality, compatible setups for simultaneous EEG-fNIRS studies.
The fundamental differences between EEG and fNIRS necessitate distinct optimization strategies for sensor placement. The table below summarizes their core technical characteristics.
Table 1: Technical comparison of EEG and fNIRS modalities.
| Feature | EEG (Electroencephalography) | fNIRS (Functional Near-Infrared Spectroscopy) |
|---|---|---|
| What It Measures | Electrical activity from postsynaptic potentials of cortical neurons [39] | Hemodynamic response (changes in oxygenated and deoxygenated hemoglobin) [39] |
| Temporal Resolution | High (millisecond scale) [39] | Low (seconds scale) [39] |
| Spatial Resolution | Low (centimeter-level) [39] | Moderate (better than EEG, but limited to cortical surface) [39] |
| Key Placement Parameter | Electrode Density & Location [40] | Source-Detector Distance [3] |
| Primary Optimization Goal | Maximize source localization accuracy and signal-to-noise ratio. | Balance sensitivity to cerebral cortex vs. extracerebral tissues and signal strength. |
The source-detector distance is a primary determinant of sensitivity and spatial specificity in fNIRS. Near-infrared light from a source optode is scattered and absorbed through tissue before being measured by a detector optode. The resulting measurement sensitivity profile is often described as a "banana-shaped" path. Key principles and challenges include:
Optimized distances are determined by the need to penetrate the skull and reach the cerebral cortex while maintaining an adequate signal-to-noise ratio.
Table 2: Guidelines for fNIRS source-detector distances.
| Distance | Target Tissue Sensitivity | Primary Application & Rationale |
|---|---|---|
| ~1.5 cm | Extracerebral layers (scalp, skull) only [3] | Used as a short-separation channel to regress out systemic physiological noise from scalp hemodynamics [3]. |
| ~3.0 cm | Cerebral cortex and extracerebral layers [3] | Standard distance for measuring brain activity in adults. Provides a balance between cortical sensitivity and signal amplitude [3]. |
| Up to 4-6 cm | Deeper cortical areas | Used in high-density diffuse optical tomography (HD-DOT) arrays to improve depth localization and spatial resolution (~1 cm). Requires high-quality systems due to low signal levels [3]. |
While high-density EEG (HD-EEG) systems with 64 to 256+ electrodes are available and generally provide superior source localization accuracy, recent research demonstrates that optimized low-density montages can be sufficient for specific applications [40]. The motivations for optimizing density include:
An automated methodology based on the Non-dominated Sorting Genetic Algorithm II (NSGA-II) has been proposed to identify the minimal electrode subsets that retain the localization accuracy of HD-EEG [40]. The workflow for this optimization is illustrated below.
EEG Electrode Optimization Workflow: The process identifies minimal electrode sets that preserve source localization accuracy [40].
This protocol provides a step-by-step guide for setting up a compatible and optimized simultaneous EEG-fNIRS system.
Table 3: Essential research reagents and materials for simultaneous EEG-fNIRS research.
| Item | Function/Application |
|---|---|
| Integrated EEG-fNIRS Cap | A head cap with dedicated holders for both EEG electrodes and fNIRS optodes, ensuring stable and co-registered sensor placement [42]. |
| Active EEG Electrodes | Electrodes with built-in amplification that provide high-quality signals with higher tolerance for skin impedance, reducing preparation time [42]. |
| fNIRS Short-Separation Detectors | Specialized detector optodes placed 1-1.5 cm from a source to measure systemic physiological noise from the scalp, enabling its regression from the cerebral signal [3]. |
| Conductive Gel | Electrolyte gel used with wet EEG electrodes to establish a stable electrical connection between the scalp and the electrode, crucial for low impedance [42]. |
| 3D Digitizer | A portable electromagnetic or optical system to record the precise 3D locations of EEG electrodes and fNIRS optodes on the participant's head, improving spatial accuracy of the coregistration with anatomical models [43]. |
| Synchronization Hardware (e.g., TTL) | A device that generates a precise, shared trigger pulse to synchronize the timing of data acquisition between the EEG and fNIRS systems [39]. |
This application note provides a detailed protocol for simultaneous electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) data acquisition, framed within the broader context of sensor placement compatibility for multimodal neuroimaging research. The complementary nature of EEG and fNIRS offers significant potential for brain-computer interfaces (BCIs), clinical neurology, and neurorehabilitation by combining EEG's millisecond temporal resolution with fNIRS's spatially localized hemodynamic responses [8] [44]. However, successful integration requires careful consideration of hardware compatibility, sensor placement strategies, and artifact mitigation to ensure data quality. This protocol synthesizes current methodologies to establish a standardized workflow for researchers investigating neural correlates in both healthy and clinical populations.
Table 1: Essential equipment and materials for simultaneous EEG-fNIRS research
| Category | Specific Item/Model | Key Specifications | Function/Purpose |
|---|---|---|---|
| EEG System | g.HIamp amplifier [10] | 32 channels, 256 Hz sampling rate [10] | Records electrical brain activity with high temporal resolution |
| fNIRS System | NirScan [10] | 11 Hz sampling rate, 730 nm & 850 nm wavelengths [45] [10] | Measures hemodynamic changes via HbO and HbR concentration |
| Hybrid Cap | Custom Model M [10] | 54-58 cm head circumference, 32 EEG electrodes, 32 fNIRS sources, 30 detectors [10] | Integrated platform for co-located EEG electrode and fNIRS optode placement |
| Stimulation Software | E-Prime 3.0 [10] | - | Presents experimental paradigms and sends synchronized event markers |
| Synchronization Interface | Custom trigger interface [10] | - | Ensures temporal alignment of EEG and fNIRS data streams |
| Auxiliary Sensors | Accelerometer [45] | - | Records head movement to assist with motion artifact correction |
The custom hybrid cap should systematically integrate both modalities:
Temporal synchronization between EEG and fNIRS is critical for multimodal fusion. Implement a hardware trigger system where stimulation software (e.g., E-Prime 3.0) sends simultaneous event markers to both EEG and fNIRS recording systems at the onset of each experimental trial [10]. This ensures precise temporal alignment of electrophysiological and hemodynamic data streams during subsequent analysis.
A typical motor imagery paradigm suitable for both healthy individuals and clinical populations (e.g., intracerebral hemorrhage patients) follows this trial structure [10]:
Conduct at least two consecutive sessions per participant, with each session containing 15 trials per hand (60 trials total), incorporating sufficient inter-session rest intervals to mitigate fatigue [10].
Table 2: Key acquisition parameters for simultaneous EEG-fNIRS recording
| Parameter | EEG Specification | fNIRS Specification | Notes |
|---|---|---|---|
| Sampling Rate | 256 Hz [10] | 11 Hz [10] | Higher EEG rate captures neural dynamics |
| Spatial Resolution | ~2 cm [5] | 1-3 cm [46] | fNIRS offers better spatial localization |
| Penetration Depth | Cortical surface | 1-2 cm deep [45] | fNIRS accesses superficial cortical regions |
| Measured Signals | Electrical potentials | HbO and HbR concentration changes [10] | Complementary neurophysiological measures |
| Typical Hemodynamic Response | N/A | Within 2-6 seconds [45] | Consider this delay in paradigm design |
Implement fusion strategies that leverage the complementary nature of EEG and fNIRS signals:
This application note provides a comprehensive workflow for simultaneous EEG-fNIRS research, emphasizing practical considerations for sensor placement compatibility and multimodal data integration. The protocol addresses the complete experimental pipeline from participant preparation to data acquisition and processing, with particular attention to the technical challenges of hardware synchronization, artifact mitigation, and multimodal fusion. By standardizing these methodologies, researchers can more effectively leverage the complementary strengths of EEG and fNIRS to investigate neural processes across diverse populations and settings, from laboratory environments to real-world applications. The integration of these modalities continues to show significant promise for advancing brain-computer interfaces, clinical diagnostics, and our fundamental understanding of brain function.
Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) represent a powerful multimodal neuroimaging approach, leveraging their complementary strengths to investigate brain function. EEG provides direct measurement of neural electrical activity with millisecond temporal resolution, while fNIRS tracks hemodynamic responses with better spatial specificity [4] [49]. This combination is particularly valuable for studying complex cognitive paradigms where both rapid neural processing and metabolic demands are of interest. Within this context, appropriate sensor placement is crucial for capturing relevant neural signatures while ensuring compatibility between modalities.
This article presents detailed application notes and experimental protocols for two key research paradigms: motor imagery and semantic decoding. We focus on the practical aspects of simultaneous EEG-fNIRS data acquisition, including technical specifications, experimental design considerations, and sensor placement strategies to optimize signal quality and minimize interference between systems.
Table 1: Core Equipment for Simultaneous EEG-fNIRS Research
| Component Category | Specific Equipment Examples | Key Functions & Specifications |
|---|---|---|
| EEG Acquisition System | Neuroscan SynAmps2 Amplifier [50]; ActiCHamp [51]; Brain Products EEG systems [49] | Measures electrical brain activity; typically uses 64+ electrodes [50]; sampling rates ≥ 1000 Hz; impedance kept below 10 kΩ [50]. |
| fNIRS Acquisition System | NIRScout System [50] [51]; NIRx NIRScout XP [51]; Hitachi ETG-4000 [52] | Measures hemodynamic changes via near-infrared light; uses sources & detectors; sampling rates ~7.8-10 Hz [50] [52]. |
| Integrated Head Cap | EasyCap with 128-160 slits [49] [51]; Custom 3D-printed helmets [4]; Elastic caps with 3D-printed sockets [53] | Holds both EEG electrodes and fNIRS optodes in stable positions; dark fabric reduces light contamination [49]; ensures proper source-detector distance (~3 cm) [53]. |
| Synchronization Interface | Lab Streaming Layer (LSL) protocol [49]; Shared hardware triggers [49] | Ensures precise temporal alignment of EEG and fNIRS data streams, critical for multimodal analysis. |
| Stimulus Presentation Software | Custom scripts (e.g., Python, MATLAB) | Presents visual/auditory cues and records event markers synchronized with brain data acquisition. |
Motor imagery (MI) involves the mental rehearsal of physical movements without actual execution. This paradigm is widely used in brain-computer interfaces (BCIs) and neurorehabilitation [50] [51].
Participant Preparation and Task Instructions:
Trial Structure and Timing: The trial structure follows a precise timeline to capture both rapid EEG responses and slower fNIRS hemodynamics:
Experimental Conditions: The protocol includes eight MI tasks focusing on different joints of the right upper limb: hand open/close, wrist flexion/extension, wrist abduction/adduction, elbow pronation/supination, elbow flexion/extension, shoulder pronation/supination, shoulder abduction/adduction, and shoulder flexion/extension [50]. Each session comprises 8 blocks, with 40 randomized trials per block (5 trials per task), totaling 320 trials per participant.
EEG Configuration:
fNIRS Configuration:
Synchronization:
The following diagram illustrates the signaling pathways and logical sequence of a single motor imagery trial.
EEG Analysis:
fNIRS Analysis:
Multimodal Integration:
Semantic decoding aims to identify which semantic concepts an individual is processing based on their brain activity patterns, with applications in direct semantic communication BCIs [5].
Participant Preparation and Task Instructions:
Trial Structure and Timing:
EEG Configuration:
fNIRS Configuration:
Synchronization:
The workflow for the semantic decoding paradigm, from stimulus presentation to analysis, is outlined below.
EEG Analysis:
fNIRS Analysis:
Multimodal Integration and Decoding:
Table 2: Protocol Comparison: Motor Imagery vs. Semantic Decoding
| Parameter | Motor Imagery Protocol | Semantic Decoding Protocol |
|---|---|---|
| Primary Brain Regions | Sensorimotor cortex (Contralateral to movement) [50] [51] | Temporal lobe, Frontal lobe, Occipital cortex [5] [52] |
| Key EEG Features | Event-Related Desynchronization (ERD) in Mu/Beta rhythms [51] | Event-Related Potentials (ERPs), Time-Frequency features [5] |
| Key fNIRS Features | HbO increase in primary motor cortex [50] | HbO/HbR changes in temporal and frontal regions [52] |
| Typical Trial Duration | 18-20 seconds [50] | 12-17 seconds [5] [52] |
| Task Duration | 4 seconds of active imagination [50] | 3-5 seconds of mental task [5] |
| Optimal Cap Coverage | Central scalp regions (C3, Cz, C4) [51] | Whole-head, with emphasis on temporal and occipital areas [5] [52] |
| Classification Performance | ~65% (EEG only, 2-class joints) [50]; Up to ~83% (Multimodal fusion) [47] | Significantly above chance (Exact accuracy varies by study and model) [52] |
Sensor Placement Compatibility Guidelines:
Combining electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) provides a powerful multimodal approach to investigating brain function by capturing complementary electrophysiological and hemodynamic information [2] [4]. However, the physical integration of these technologies creates significant challenges for signal quality, primarily through three interference types: hair and skin characteristics, inconsistent optode pressure, and light bleed between emission and detection points [4] [54]. These physical interference factors can introduce artifacts, reduce signal-to-noise ratio, and compromise data quality, ultimately threatening the validity of research findings. This application note systematically quantifies these interference sources and provides evidence-based protocols for their mitigation, with particular emphasis on ensuring equitable signal quality across diverse participant populations [54] [55].
Table 1: Impact of Hair and Skin Characteristics on fNIRS Signal Quality
| Factor | Impact on Signal Quality | Quantitative Effect | Recommended Mitigation |
|---|---|---|---|
| Hair Density | Increased absorption and scattering of NIR light [54] | Dense hair can reduce detected light intensity by >50% [54] | Hair parting with cotton-tipped applicators; use of ultrasound gel [54] |
| Hair Color | Darker hair absorbs more light [54] | Significant reduction in signal amplitude compared to light hair [54] | Ensure consistent optode-scalp coupling regardless of color [54] |
| Hair Type | Curly/kinky hair affects optode-scalp coupling [54] | Increased signal variance due to inconsistent contact [54] | Customized cap designs; extended optimization time [54] |
| Skin Pigmentation | Higher melanin increases light absorption [54] [55] | Reduced signal intensity; not correlated with functional signal quality [54] | Signal quality optimization protocols; inclusive hardware development [54] [55] |
Recent evidence indicates that these factors can disproportionately affect data quality from underrepresented populations, potentially introducing bias in neuroimaging research [55]. One study of stroke survivors found that fNIRS signals were generally worse for Black women compared to Black men and White individuals regardless of gender, highlighting the urgent need for hardware improvements to ensure equity in fNIRS research [55].
Table 2: Pressure-Related Artifacts and Solutions
| Factor | Impact | Solution | Experimental Evidence |
|---|---|---|---|
| Variable Pressure | Inconsistent scalp coupling; motion artifacts [4] | 3D-printed or thermoplastic custom helmets [4] | Custom helmets improve signal stability by >30% compared to elastic caps [4] |
| Cap Movement | Signal drift; complete signal loss [54] | Chin strap stabilization; cable management arms [54] | Proper stabilization reduces motion artifacts by 25-40% [54] |
| Optode Angle | Inconsistent light penetration; channel reliability [4] | Consistent optode orientation perpendicular to scalp surface | Critical for reproducible measurements across sessions [4] |
Light bleed occurs when near-infrared light travels directly from source to detector without penetrating brain tissue, typically when optodes are improperly spaced or insufficiently shielded [56] [57]. This superficial signal contaminates the cerebral hemodynamic data with systemic physiological noise from the scalp [57]. Research demonstrates that incorporating short-separation channels (approximately 8 mm source-detector distance) as regressors in the general linear model is the most effective method for removing this contaminating signal, significantly improving sensitivity and specificity in detecting true brain activity [57].
Objective: Establish consistent optode-scalp coupling across diverse hair and skin types. Materials: fNIRS-EEG cap, alcohol pads, cotton-tipped applicators, ultrasound gel, chin strap, cable management system. Duration: 20-30 minutes
Objective: Quantify and verify signal quality before experimental data collection. Materials: fNIRS-EEG system with signal visualization software, quality assessment toolbox. Duration: 5-10 minutes
Systematic Interference Mitigation Workflow: This diagram illustrates the integrated protocol for addressing physical interference throughout the experimental pipeline, from initial planning through data processing.
Table 3: Key Materials for fNIRS-EEG Interference Mitigation
| Item | Function | Application Notes |
|---|---|---|
| 3D-Printed Custom Caps | Ensures consistent optode placement and pressure [4] | Superior to elastic caps for maintaining consistent source-detector separation [4] |
| Short-Separation Detectors | Measures superficial signals for regression [57] | 8 mm source-detector distance optimal for scalp signal capture [57] |
| Ultrasound Gel | Improves optode-scalp coupling in dense hair [54] | More effective than conductive gels for optical coupling [54] |
| Cotton-Tipped Applicators | Precisely parts hair away from optode placement sites [54] | Essential for managing curly or dense hair types [54] |
| Chin Strap Stabilization | Reduces cap movement artifacts [54] | Particularly important for long-duration experiments [54] |
| Cable Management Arm | Prevents wire strain on cap and optodes [54] | Reduces motion-related signal artifacts [54] |
| Opaque Shower Cap | Blocks ambient light interference [54] | Simple solution for light bleed from external sources [54] |
| Quality Assessment Software | Quantifies signal quality metrics (e.g., SCI) [55] | Enables objective quality control standards [55] |
Successful simultaneous EEG-fNIRS research requires systematic attention to physical interference factors throughout the experimental pipeline. Hair characteristics, variable pressure, and light bleed represent significant challenges that can be effectively mitigated through standardized protocols, customized hardware, and appropriate signal processing techniques [4] [54] [57]. The implementation of these evidence-based practices is essential not only for data quality but also for promoting inclusivity in neuroimaging research by ensuring reliable signal acquisition across diverse participant populations [54] [55]. Future hardware developments should focus on improving optode design to automatically compensate for variations in hair and skin characteristics, thereby reducing the need for extensive manual optimization and making advanced neuroimaging accessible to broader research communities.
The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) offers a powerful, multimodal approach to investigating brain function by capturing complementary electrophysiological and hemodynamic activities [2]. However, the signals from both modalities are highly susceptible to physiological and motion-related artifacts, which can severely compromise data quality and interpretation [59] [60]. These artifacts present a particularly complex challenge in simultaneous EEG-fNIRS recordings, where the optimal physical placement of sensors is crucial for maximizing signal quality while minimizing cross-modal interference [61] [4]. This application note provides detailed protocols and analytical frameworks for advanced artifact removal, specifically contextualized within the constraints of dual-modality sensor compatibility.
Table 1: Physiological Artifacts in EEG and fNIRS Signals
| Artifact Type | Origin | Frequency Characteristics | Primary Impacted Modality |
|---|---|---|---|
| Ocular Artifacts | Eye movements and blinks [59] | Similar to EEG signals [59] | EEG |
| Muscle Artifacts | Head/neck muscle activity, talking, swallowing [59] | Broad distribution (0 Hz to >200 Hz) [59] | EEG |
| Cardiac Artifacts | Heartbeat (ECG) and pulse [59] | ~1.2 Hz (pulse) [59] | EEG, fNIRS |
| Motion Artifacts | Subject movement, optode decoupling [60] [62] | Non-stationary [60] | EEG, fNIRS |
| Systemic Physiological Noise | Respiration, Mayer waves, blood pressure changes [62] [63] | 0.1 Hz (Mayer), 0.25 Hz (respiration), 1 Hz (heartbeat) [62] | fNIRS |
In simultaneous EEG-fNIRS recordings, artifacts can manifest with different temporal profiles and affect both modalities simultaneously or independently. The neurovascular coupling relationship—where neuronal electrical activity (measured by EEG) triggers hemodynamic responses (measured by fNIRS)—creates a complex interdependence that must be considered during artifact removal [2]. Furthermore, sensor placement constraints in integrated systems can create unique artifact profiles, as EEG electrodes and fNIRS optodes must coexist on the same scalp surface without compromising signal quality from either modality [61] [4].
Table 2: Performance Comparison of Artifact Removal Techniques
| Method | Modality | Performance Metrics | Best Performing Parameters |
|---|---|---|---|
| WPD (Single-stage) | EEG | ΔSNR: 29.44 dB, η: 53.48% [60] | db2 wavelet (ΔSNR), db1 wavelet (η) [60] |
| WPD-CCA (Two-stage) | EEG | ΔSNR: 30.76 dB, η: 59.51% [60] | db1 wavelet [60] |
| WPD (Single-stage) | fNIRS | ΔSNR: 16.11 dB, η: 26.40% [60] | fk4 wavelet [60] |
| WPD-CCA (Two-stage) | fNIRS | ΔSNR: 16.55 dB, η: 41.40% [60] | db1 (ΔSNR), fk8 (η) wavelets [60] |
| GLM with tCCA | fNIRS | Correlation: +45%, RMSE: -55% [63] | With temporal embedding & auxiliary signals [63] |
Regression methods represent traditional approaches for artifact removal, particularly for ocular artifacts in EEG, where they define amplitude relationships between reference channels and EEG channels using transmission factors [59]. The regression equation takes the form:
EEGcor = EEGraw − γF(HEOG) − δF(VEOG) [59]
where γ and δ represent transmission coefficients between EOG and EEG channels [59].
Blind Source Separation (BSS) methods, particularly Independent Component Analysis (ICA), have emerged as powerful alternatives that exploit the statistical independence between neural signals and artifacts [59]. These methods are especially effective for muscle artifacts in EEG, as EMG contamination and EEG demonstrate substantial statistical independence both temporally and spatially [59].
Wavelet Packet Decomposition (WPD) represents a significant advancement for handling non-stationary artifacts in both EEG and fNIRS signals [60]. WPD decomposes signals into wavelet packet bases at multiple scales, allowing for precise time-frequency localization of artifacts [60]. The two-stage WPD-CCA (Canonical Correlation Analysis) method has demonstrated superior performance for motion artifact correction in both modalities, with percentage reduction in motion artifacts increasing by 11.28% for EEG and 56.82% for fNIRS compared to single-stage WPD [60].
For fNIRS specifically, the General Linear Model with temporally embedded Canonical Correlation Analysis (GLM with tCCA) has shown remarkable improvements in physiological noise regression [63]. This approach incorporates short-separation measurements and auxiliary signals within a temporally embedded framework to address challenging signal characteristics like non-instantaneous and non-constant coupling [63].
Application: Removal of motion artifacts from single-channel EEG and fNIRS signals [60]
Materials and Setup:
Procedure:
Sensor Placement Considerations: Ensure stable optode and electrode placement using integrated caps that minimize movement-induced decoupling [61].
Application: Advanced physiological noise regression in fNIRS signals [63]
Materials and Setup:
Procedure:
Integration Considerations: When using with simultaneous EEG, coordinate short-separation fNIRS detector placement with EEG electrode locations to avoid signal interference [4].
Application: Comprehensive artifact handling for dual-modality studies
Materials and Setup:
Procedure:
Sensor Compatibility Protocol: Use 3D-printed customized helmets or cryogenic thermoplastic sheets to ensure optimal sensor placement and stability for both modalities [4].
Table 3: Essential Research Reagents and Materials
| Item | Function | Application Notes |
|---|---|---|
| Short-Separation fNIRS Detectors | Measures superficial layer hemodynamics for noise regression [62] [63] | Place 8-10mm from sources; critical for GLM with tCCA [63] |
| Active EEG Electrodes | Reduces motion artifacts and preparation time [61] | Essential for combined systems; enables faster application [61] |
| Auxiliary Physiological Sensors | Measures cardiac, respiratory, and motion signals [62] | Provides reference signals for advanced regression methods [63] |
| Customized Integration Helmets | Maintains stable sensor placement for both modalities [4] | 3D-printed or thermoplastic designs improve sensor-scalp coupling [4] |
| Wavelet Packet Toolboxes | Implements WPD and WPD-CCA algorithms [60] | MATLAB Wavelet Toolbox or Python PyWavelets with custom CCA implementation [60] |
| Accelerometers | Detects head movements for motion artifact correction [63] | Integrated into sensor caps for direct motion measurement [63] |
Effective artifact removal is fundamental to extracting meaningful information from simultaneous EEG-fNIRS recordings. The advanced methods outlined in this application note—particularly WPD-CCA for motion artifacts and GLM with tCCA for physiological noise—demonstrate significant improvements over traditional approaches. When implementing these protocols, careful consideration of sensor placement compatibility is essential, as the physical integration of EEG electrodes and fNIRS optodes directly influences both signal quality and artifact profiles. By adopting these sophisticated artifact removal strategies within an optimized sensor integration framework, researchers can significantly enhance the reliability and interpretability of multimodal brain imaging data.
The simultaneous acquisition of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) represents a powerful, non-invasive approach to studying human brain function. These modalities offer complementary insights: EEG captures millisecond-scale electrical neural dynamics, while fNIRS tracks hemodynamic changes related to neural activity with better spatial resolution [64] [3]. This complementary nature makes them ideal candidates for multimodal fusion, which aims to provide a more comprehensive picture of brain activity than either modality could alone [4].
Data fusion techniques for these signals have evolved from simple concatenation to sophisticated source-decomposition methods. The integration of fNIRS and EEG is particularly valuable for investigating neurovascular coupling—the relationship between neural electrical activity and subsequent hemodynamic responses [3]. Furthermore, the portability and movement tolerance of these systems enable brain imaging in naturalistic scenarios and across diverse populations, from infants to clinical patients [65] [3].
EEG and fNIRS measure fundamentally different physiological processes, which accounts for their complementary strengths when combined.
Table 1: Comparison of EEG and fNIRS Technical Characteristics
| Feature | EEG | fNIRS |
|---|---|---|
| What It Measures | Electrical activity of neurons | Hemodynamic response (blood oxygenation) |
| Signal Source | Postsynaptic potentials in cortical neurons | Changes in oxygenated and deoxygenated hemoglobin |
| Temporal Resolution | High (milliseconds) | Low (seconds) |
| Spatial Resolution | Low (centimeter-level) | Moderate (better than EEG) |
| Depth of Measurement | Cortical surface | Outer cortex (~1–2.5 cm deep) |
| Sensitivity to Motion | High - susceptible to movement artifacts | Low - more tolerant to subject movement |
| Best Use Cases | Fast cognitive tasks, ERP studies, sleep research | Naturalistic studies, child development, motor rehab |
The simultaneous measurement of electrical and hemodynamic activity provides a window into the complex interplay between neural firing and metabolic support. The neurovascular coupling mechanism links the electrical activity measured by EEG to the hemodynamic responses measured by fNIRS [3]. However, this relationship is not perfectly spatiotemporal, and their interaction can be studied using combined technologies [3]. If a model of neurovascular coupling is assumed, increased accuracy of neural signal estimates can be obtained from multimodal measurements [3].
Data concatenation represents one of the simplest and most straightforward fusion approaches. This method combines features from both modalities into a single, high-dimensional feature vector that is then fed into a classifier or analysis pipeline. The fusion occurs at the feature level, before the classification stage [65] [66].
Decision-level fusion represents another relatively simple approach where each modality is processed through separate analysis pipelines, and their independent decisions or outputs are combined at the final stage. For example, in a classification task, EEG and fNIRS data might be processed separately, and their respective classification results combined through voting schemes or weighted averaging [65].
Model-based approaches incorporate physiological constraints or statistical models to integrate the two data types. These methods often leverage the hemodynamic response function to model the relationship between neural electrical activity (EEG) and the subsequent blood oxygenation changes (fNIRS) [65]. One example includes adaptive general linear models that incorporate both electrical and hemodynamic information to improve activation detection [65]. These approaches can be particularly powerful when incorporating neurovascular coupling models to constrain the solution space and improve the physiological plausibility of the results [3].
Source-decomposition methods represent more advanced fusion approaches that aim to separate mixed signals into their underlying components or sources.
Joint Independent Component Analysis (jICA) is a blind source separation technique that extends ICA to multiple modalities, assuming that the same underlying spatial components mix differently across modalities [64]. This approach can identify linked patterns of activation across electrical and hemodynamic domains.
Structured Sparse Multiset Canonical Correlation Analysis (ssmCCA) is a sophisticated method that identifies multivariate relationships between multiple datasets. As applied in recent research, ssmCCA fuses neural electrical and hemodynamic responses to pinpoint brain regions consistently detected by both fNIRS and EEG [19]. This method has been successfully used to identify activation over the left inferior parietal lobe, superior marginal gyrus, and post-central gyrus during motor execution, observation, and imagery [19].
Canonical Correlation Analysis (CCA) is a classical method that finds linear combinations of variables from two datasets that have maximum correlation with each other. In multimodal fusion, CCA can identify common temporal patterns or spatial components that are shared between EEG and fNIRS signals [64].
Table 2: Data Fusion Techniques for fNIRS-EEG
| Fusion Category | Specific Methods | Key Characteristics | Applications |
|---|---|---|---|
| Concatenation | Feature concatenation | Simple implementation, may ignore modality relationships | Basic brain-state classification [65] |
| Decision-Level | Voting schemes, weighted averaging | Preserves modality-specific processing, simpler integration | Hybrid brain-computer interfaces [65] |
| Model-Based | Adaptive general linear models, Kalman filters | Incorporates physiological constraints | Neurovascular coupling studies [65] [3] |
| Source-Decomposition | jICA, ssmCCA, CCA | Reveals latent components, handles high-dimensional data | Identifying shared neural regions [64] [19] |
Recent advances have introduced sophisticated deep learning architectures specifically designed for multimodal fusion:
Multi-Branch Convolutional Neural Networks with Attention (MBC-ATT) employ independent branch structures to process EEG and fNIRS signals separately, leveraging the advantages of each modality [66]. These networks incorporate cross-modal attention mechanisms to dynamically weight the importance of features from each modality, strengthening the model's ability to focus on relevant signals [66].
Time-Distributed CNN-LSTM frameworks combine convolutional neural networks for spatial feature extraction with long short-term memory networks for temporal modeling, effectively capturing spatiotemporal patterns across modalities [66].
Successful multimodal fusion begins with proper experimental setup, particularly regarding sensor placement compatibility. Both systems often use the international 10–20 system for electrode/sensor placement [64]. To avoid interference:
Optimal Montage Design: Computational approaches can optimize optode placement to target specific regions of interest. The NIRSTORM toolbox with Optimal Montage functionality uses realistic head models to simulate light propagation and determines optode positions that maximize sensitivity to predefined target regions while respecting constraints on the number of sources, detectors, and distances [67].
Diagram 1: Optimal Montage Design Workflow (47 characters)
Motor imagery (MI) paradigms are widely used in both basic neuroscience and clinical applications, particularly for brain-computer interfaces and stroke rehabilitation.
Participant Preparation and Calibration:
Trial Structure:
Data Acquisition Parameters:
Block designs are commonly used in fNIRS and multimodal studies due to their high signal-to-noise ratio and statistical power [68].
Standard n-back Working Memory Protocol:
Best Practices for Block Design:
Diagram 2: Block Design Experimental Structure (44 characters)
Hardware Integration:
Synchronization Methods:
Table 3: Essential Materials for Simultaneous fNIRS-EEG Research
| Item | Function/Purpose | Example Specifications |
|---|---|---|
| Integrated EEG-fNIRS Cap | Provides stable platform for co-registered sensor placement | 32 EEG electrodes, 32 fNIRS sources, 30 detectors forming 90 channels [10] |
| fNIRS System | Measures hemodynamic responses via near-infrared light | Continuous wave system, 2 wavelengths (695 & 830 nm), 10 Hz sampling [19] |
| EEG Amplifier | Records electrical brain activity | 256 Hz sampling rate, high input impedance [10] |
| Stimulus Presentation Software | Prescribes experimental paradigm and records behavioral responses | E-Prime, PsychoPy, Presentation |
| 3D Digitizer | Records precise sensor locations for accurate co-registration | Fastrak (Polhemus) or similar magnetic digitizer [19] |
| Computational Tools | For data fusion analysis and montage optimization | NIRSTORM with CPLEX optimization, MCXlab for light simulation [67] |
| Auxiliary Calibration Equipment | Enhances task performance and data quality | Dynamometer, stress ball for motor imagery calibration [10] |
The evolution of fNIRS-EEG data fusion techniques from simple concatenation to advanced source-decomposition methods represents significant progress in multimodal brain imaging. Each fusion approach offers distinct advantages depending on the research question, with source-decomposition techniques like ssmCCA showing particular promise for identifying neural regions consistently activated across electrical and hemodynamic domains [19].
Successful implementation requires careful attention to experimental design, sensor compatibility, and appropriate analysis techniques. The continued development of sophisticated fusion methods, coupled with optimized experimental protocols, will further enhance our ability to study brain function in naturalistic settings and advance clinical applications in neurology and psychiatry.
Longitudinal neuroimaging studies, which track changes in brain function over time, are essential for understanding brain development, cognitive aging, and the progression of neurological disorders [69]. Simultaneous electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) recordings present a powerful multimodal approach for such investigations, combining excellent temporal resolution with improved spatial localization [5] [17]. However, maintaining both participant comfort and signal stability across multiple sessions presents unique methodological challenges that can significantly impact data quality and study validity. This application note provides detailed protocols and evidence-based recommendations for optimizing sensor placement compatibility to ensure the reliability and comfort of longitudinal EEG-fNIRS studies, framed within the context of a broader thesis on multimodal integration.
Table 1: Key study parameters and participant demographics from relevant EEG-fNIRS research.
| Study Reference | Participant Count & Demographics | Primary Cognitive Tasks | Data Modalities | Key Stability & Comfort Considerations |
|---|---|---|---|---|
| Phukhachee et al. (2025) [18] | 16 participants (14M, 2F) Age: 21-37 years | Intentional visual memory encoding | Simultaneous EEG-fNIRS | Experiment duration; minimization of movements during 3s stimulus presentation and 9s decision period |
| Semantic Decoding Dataset (2025) [5] | 12 native English speakers (3M, 9F) Age: 20-57 years (mean 32.75) | Silent naming, Visual/Auditory/Tactile imagery of animals/tools | Simultaneous EEG-fNIRS | Instructions to minimize physical movements, eye movements, facial expressions; right-handed participants only |
| Shin et al. (2018) [70] | 26 right-handed (9M, 17F) Age: 26.1±3.5 years | n-back, DSR, Word Generation | Simultaneous EEG-fNIRS | ~3.5 hour session duration; comfortable armchair; fixed finger placement; instructions to minimize body movement |
| Li et al. (2020) [71] | 29 subjects (>50 years) HC, MCI, MAD, MSAD | Random digit encoding-retrieval | Simultaneous EEG-fNIRS | Special considerations for clinical populations (AD patients); all subjects able to follow instructions independently |
Table 2: Signal quality and performance metrics from hybrid EEG-fNIRS studies.
| Study Reference | Classification Accuracy | Data Quality Measures | Stability Measures |
|---|---|---|---|
| Li et al. (2020) [71] | Hybrid: 79.31% EEG-only: 65.52% fNIRS-only: 58.62% | PCCFS feature selection; right prefrontal and left parietal regions most informative for AD classification | Four-class classification (HC, MCI, MAD, MSAD) demonstrating stability across disease stages |
| MDNF Model (2024) [17] | Superior to state-of-the-art methods on two public datasets | STFT for EEG 2D image transformation; fNIRS spectral entropy; strategic EEG channel selection based on neuroanatomy | Enhanced classification across MI, n-back, DSR, and WG tasks |
| EEG-fNIRS Cognitive Motivation (2025) [18] | ERP amplitudes enhanced in motivated conditions (parietal/occipital channels, 300ms peak) | Time-frequency analysis (theta/low alpha power); Cohen's D and ANOVA for fNIRS statistical analysis | fNIRS showed variable HbO responses without significant differences between motivation conditions |
Background: This protocol investigates the feasibility of semantic neural decoding to develop brain-computer interfaces that communicate conceptual meaning directly, bypassing character-by-character spelling approaches [5].
Participant Preparation:
Stimuli and Task Design:
Data Acquisition Parameters:
Background: This protocol examines the neural correlates of cognitive motivation during intentional memory encoding, combining early EEG responses with slower fNIRS hemodynamic changes [18].
Participant Preparation:
Experimental Paradigm:
Data Acquisition and Analysis:
Background: This protocol enables classification of Alzheimer's disease stages using complementary EEG and fNIRS information, demonstrating clinical application of hybrid monitoring [71].
Participant Recruitment:
Task Design:
Data Processing and Feature Selection:
Table 3: Essential research reagents and materials for simultaneous EEG-fNIRS studies.
| Item Name | Specification/Function | Application Notes |
|---|---|---|
| EEG Recording System | High-density caps (e.g., 32+ channels); electrode gel for impedance reduction | Strategic channel selection based on neuroanatomy; prioritize contralateral posterior sites for visual processing [72] |
| fNIRS Recording System | Paired source-detector optodes; wavelengths for HbO/HbR differentiation | Positioning for superficial cortical coverage; compatible with EEG cap design; minimal cross-talk effect >1cm [71] |
| EEG-fNIRS Compatible Caps | Integrated solutions with pre-configured electrode and optode holders | Critical for reproducible sensor placement across longitudinal sessions; ensures consistent spatial registration |
| Conductive Electrolyte Gel | Hypoallergenic formulation; stable impedance properties | Minimize skin irritation for extended recordings; ensure compatibility with fNIRS optodes |
| Abrasive Skin Prep Gel | Mild exfoliation to reduce electrode-skin impedance | Improve signal quality while maintaining participant comfort; pre-application protocol |
| Photo-Blocking Caps | Light-blocking material to prevent optode light leakage | Essential for signal fidelity; consider comfort and breathability for extended wear |
| Behavioral Task Software | Precisely timed stimulus presentation (e.g., Psychophysics Toolbox) | Ensure synchronization with neural data acquisition; millisecond timing precision |
| Data Synchronization System | Hardware/software solution for EEG-fNIRS temporal alignment | Critical for multimodal data fusion; TTL pulses or shared clock infrastructure |
Experimental workflow for longitudinal EEG-fNIRS studies illustrating the integration of participant comfort measures throughout the study timeline.
Signal processing and analysis pathway for simultaneous EEG-fNIRS data, demonstrating the complementary nature of both modalities and their integration for longitudinal analysis.
Successful longitudinal EEG-fNIRS studies require meticulous attention to both participant comfort and signal stability across multiple sessions. The protocols and recommendations presented here provide a framework for optimizing sensor placement compatibility while maintaining data quality. Key considerations include strategic EEG channel selection based on neuroanatomy, implementation of comfortable yet stable sensor mounting systems, standardized protocols for minimizing movement artifacts, and careful temporal synchronization of multimodal data streams. By addressing these methodological challenges, researchers can leverage the complementary strengths of EEG and fNIRS to investigate dynamic brain processes across development, aging, and disease progression with enhanced reliability and participant tolerance.
Simultaneous electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) offers a powerful, non-invasive window into brain function by capturing complementary electrical and hemodynamic signals. A critical step in validating this multimodal approach involves benchmarking its signals against the established gold standard in hemodynamic imaging—functional magnetic resonance imaging (fMRI). This application note details the theoretical basis, quantitative benchmarks, and experimental protocols for correlating hybrid EEG-fNIRS data with fMRI, with a specific focus on implications for sensor placement compatibility. Such benchmarking is essential for refining integrated helmet design and ensuring that concurrent recordings accurately capture coupled brain activity, thereby building researcher confidence in the hybrid system's validity for basic research and clinical drug development.
The physiological link between these modalities is neurovascular coupling, the process where neural electrical activity triggers a metabolic demand, leading to a localized hemodynamic response [2]. fMRI measures the Blood Oxygen Level Dependent (BOLD) signal, which reflects the balance of oxygenated and deoxygenated hemoglobin. fNIRS directly quantifies this balance by measuring concentration changes in oxygenated hemoglobin (HbO) and deoxygenated hemoglobin (HbR) [2] [19]. This shared physiological origin creates a direct correlation between the fNIRS hemodynamic signal and the fMRI BOLD signal. Furthermore, the neuronal populations activated during a task generate both the electrical potentials measured by EEG and the metabolic demand that drives the hemodynamic response measured by fNIRS and fMRI, creating a temporal and spatial link between EEG features and the BOLD signal [73].
Establishing quantitative benchmarks is crucial for evaluating the performance of EEG-fNIRS systems against fMRI. The following tables summarize key correlation metrics and quality control benchmarks derived from empirical studies.
Table 1: Correlation Metrics Between fNIRS and fMRI Hemodynamic Signals
| Brain Region | Experimental Paradigm | Correlation Coefficient (fNIRS-fMRI) | Key Findings |
|---|---|---|---|
| Sensorimotor & Parietal Cortices [19] | Motor Execution, Observation, Imagery | HbO and BOLD show strong positive correlation (r > 0.70 in activated regions) | Multimodal fusion (ssmCCA) identified consistent activation in left inferior parietal lobe across conditions. |
| Prefrontal Cortex [2] | Cognitive Tasks (e.g., Mental Arithmetic) | HbO correlates with positive BOLD; HbR correlates with negative BOLD signal. | fNIRS provides a comparable hemodynamic measure to fMRI with superior motion tolerance. |
| General Cortical Areas [2] | Resting-State & Various Tasks | fNIRS signals are "similar to the BOLD response obtained by fMRI." | Confirms fNIRS as a valid surrogate for fMRI BOLD in superficial cortical layers. |
Table 2: fMRI Quality Control Benchmarks for Reliable Functional Connectomics
Pipeline performance is critical for benchmarking. A systematic evaluation of 768 fMRI data-processing pipelines established that optimal pipelines must simultaneously minimize spurious test-retest discrepancies while remaining sensitive to biological effects of interest [74]. The following benchmarks are derived from this large-scale analysis:
| Evaluation Criterion | Optimal Pipeline Performance Benchmark | Implication for EEG-fNIRS Correlation |
|---|---|---|
| Test-Retest Reliability | Minimizes Portrait Divergence (PDiv) between networks from repeated scans of the same individual. | High test-retest reliability in fMRI suggests a stable hemodynamic baseline against which to correlate fNIRS. |
| Sensitivity to Individual Differences | Network topology should reliably distinguish different subjects. | Ensures correlated signals reflect true inter-subject variability, not pipeline noise. |
| Sensitivity to Experimental Effects | Network topology should detect significant changes (e.g., pharmacological intervention like propofol). | Confirms that correlated fNIRS-EEG-fMRI changes are driven by the experimental manipulation. |
| Motion Confound Resistance | Topology is robust to varying levels of head motion. | Critical for comparing with fNIRS/EEG, which are also motion-tolerant, ensuring correlations are not motion-artifact driven. |
This protocol is designed for studies that cannot physically operate an fMRI scanner and an fNIRS-EEG system simultaneously. It relies on a standardized task performed by the same participants across different sessions.
1. Objective: To validate fNIRS hemodynamic responses and EEG-derived features against the fMRI BOLD signal acquired in a separate session using an identical task paradigm.
2. Materials and Reagents:
3. Procedure:
This protocol utilizes advanced analytics to fuse EEG and fNIRS data, creating a unified metric that can be more powerfully correlated with fMRI-derived networks.
1. Objective: To leverage the high temporal resolution of EEG and the superior spatial specificity of fNIRS via data fusion, creating a composite biomarker for benchmarking against fMRI network topology.
2. Materials and Reagents:
3. Procedure:
Table 3: Key Materials for Simultaneous EEG-fNIRS-fMRI Benchmarking Studies
| Item Name | Function / Application | Example Specifications / Notes |
|---|---|---|
| Integrated fNIRS-EEG Helmet | Houses optodes and electrodes in a stable, co-registered configuration for simultaneous acquisition. | Custom designs using 3D-printing or cryogenic thermoplastic sheets improve fit and reduce cross-modality interference [4]. |
| fNIRS System | Measures hemodynamic activity via changes in HbO and HbR concentration. | Continuous-wave systems (e.g., Hitachi ETG-4100) with 2+ wavelengths (695 nm, 830 nm); 24+ channels [19]. |
| EEG System | Measures electrical brain activity with high temporal resolution. | 64+ electrode systems (e.g., Electrical Geodesics); integrated amplifier with synchronization input [19] [73]. |
| 3D Magnetic Digitizer | Coregisters sensor locations with anatomical MRI scans for spatial accuracy. | Critical for mapping fNIRS/EEG data to fMRI space (e.g., Polhemus Fastrak) [19]. |
| Structured Sparse Multiset CCA (ssmCCA) | Data fusion algorithm to integrate EEG and fNIRS signals into a unified activation profile. | Identifies brain regions consistently activated across both modalities, enhancing spatial localization [19]. |
| HOMER3 Software Package | Standardized preprocessing and analysis of fNIRS data. | Converts raw intensity to hemoglobin concentrations, performs motion correction, and bandpass filtering [75]. |
| EEGLab Toolbox | Open-source toolbox for preprocessing and analyzing EEG data. | Used for filtering, artifact removal (e.g., ASR), and ERP analysis [75]. |
| Optimal fMRI Pipeline | Constructs reliable functional connectomes from BOLD data for benchmarking. | Involves specific combinations of parcellation, connectivity definition, and filtering as per systematic evaluation [74]. |
The correlation strength between fNIRS-EEG and fMRI is highly dependent on accurate spatial co-registration of sensors. Benchmarking studies directly inform helmet design and sensor placement strategies:
In conclusion, rigorous benchmarking of simultaneous EEG-fNIRS against the gold standard of fMRI is not an isolated validation exercise. It is an iterative process that directly refines the physical integration and sensor placement strategies of multimodal systems. By adhering to the detailed protocols and benchmarks outlined herein, researchers can enhance the validity, reliability, and spatial precision of their findings, thereby advancing the utility of hybrid EEG-fNIRS in neuroscience and drug development.
The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) represents a paradigm shift in brain-computer interface (BCI) development and clinical diagnostics. This multimodal approach leverages the complementary strengths of each modality: EEG provides millisecond-scale temporal resolution of electrical neural activity, while fNIRS offers centimeter-scale spatial resolution of hemodynamic responses [49] [19]. Within the context of sensor placement compatibility for simultaneous EEG-fNIRS research, quantifying the precise added value in classification accuracy and diagnostic precision becomes paramount for advancing robust BCI systems and neurological assessment tools. This protocol outlines standardized methodologies for quantifying these improvements through controlled experimentation and analytical validation.
Table 1: Classification Accuracy Improvements with fNIRS-Specific Advanced Methods
| Method | Task | Baseline Accuracy | Enhanced Accuracy | Improvement | Reference |
|---|---|---|---|---|---|
| Common Spatial Pattern (CSP) + SVM | Hand Motion/Motor Imagery | 59.81% | 81.63% | +21.82% | [77] |
| Common Spatial Pattern (CSP) + LDA | Hand Motion/Motor Imagery | 69.00% | 84.19% | +15.19% | [77] |
| z-score Channel Selection | Motor Imagery vs. Rest | ~80% (est.) | 87.2% | ~7% | [78] |
| Kalman Filter/a-GMM | Mental Arithmetic vs. Mental Singing | Conventional Methods | Proposed Method | >10% (vs. BPF-statistical features) | [79] |
| Deep Learning Stack/FFT | Hand Gripping | 85.16% (CNN) | 90.11% (FFT) | +4.95% | [80] [81] |
Table 2: Performance of Multimodal EEG-fNIRS Fusion Approaches
| Fusion Level | Method | Task | Classification Accuracy | Reference |
|---|---|---|---|---|
| Feature-Level | Mutual Information Feature Selection | Visuo-Mental Task | Significantly improved vs. single modality | [82] |
| Feature-Level | Multi-Domain Features + Multi-Level Learning | Motor Imagery | 96.74% | [83] |
| Feature-Level | Multi-Domain Features + Multi-Level Learning | Mental Arithmetic | 98.42% | [83] |
| Decision-Level | SVM Classifier Fusion | Mental Stress Detection | +7.76% vs. EEG; +10.57% vs. fNIRS | [83] |
| Data-Level | Structured Sparse Multiset CCA | Motor Execution/Observation/Imagery | Identified shared AON regions | [19] |
This protocol quantifies the added value of advanced signal processing for fNIRS-BCI, establishing a baseline for subsequent multimodal comparison.
This protocol directly quantifies the value added by integrating EEG with fNIRS, with explicit consideration of sensor placement.
Added Value = Accuracy(EEG-fNIRS) - max( Accuracy(EEG), Accuracy(fNIRS) )
This formula directly quantifies the performance gain attributable to multimodal integration.Table 3: Key Materials and Equipment for Simultaneous EEG-fNIRS Research
| Item | Function/Description | Example/Specification |
|---|---|---|
| Integrated EEG-fNIRS Cap | Holds both EEG electrodes and fNIRS optodes in a stable, pre-defined montage. Black fabric reduces optical reflection. | actiCAP Xpress with 160 slits [49]. |
| EEG Amplifier | Records electrical brain activity with high temporal resolution. | Brain Products actiCHamp Plus [49]. |
| fNIRS System | Measures hemodynamic changes by emitting NIR light and detecting attenuation. | NIRSport2 (NIRx) [80]; Hitachi ETG-4100 [19]. |
| Synchronization Interface | Ensures precise temporal alignment of multimodal data streams. | Lab Streaming Layer (LSL) software protocol [49]. |
| 3D Digitizer | Records the precise 3D locations of EEG electrodes and fNIRS optodes for accurate spatial coregistration. | Fastrak (Polhemus) [19]. |
| Analysis Software | For data preprocessing, feature extraction, fusion, and classification. | nirsLAB [80], MATLAB with toolboxes (e.g., BBCI, Homer2). |
This diagram visualizes the complete experimental and analytical pipeline for a simultaneous EEG-fNIRS study, from participant preparation to the quantification of added value.
This diagram outlines the critical technical considerations and logical decisions involved in setting up a compatible sensor montage for simultaneous EEG-fNIRS recordings.
Stroke remains a leading cause of global disability and mortality, with intracerebral hemorrhage (ICH) representing a particularly severe stroke subtype accounting for 6.5%–19.6% of all stroke cases and contributing disproportionately to stroke-related mortality [10] [84]. Motor impairment, especially upper limb dysfunction, is a recognized sequelae in approximately 55%–75% of stroke survivors, critically impacting functional independence and socioeconomic participation [10]. Modern neurorehabilitation increasingly leverages technological systems to facilitate recovery, with unimodal and hybrid neuroimaging approaches emerging as promising tools for understanding and promoting neuroplasticity.
The fundamental distinction between unimodal and hybrid systems lies in their data acquisition architecture. Unimodal systems rely on a single neuroimaging modality—typically measuring either electrical neural activity (e.g., EEG, EMG) or hemodynamic responses (e.g., fNIRS)—while hybrid systems integrate complementary modalities to capture multifaceted brain activity [2] [4]. This analysis systematically compares the efficacy, technical requirements, and clinical applications of both approaches within stroke and ICH rehabilitation contexts, with particular emphasis on sensor placement compatibility for simultaneous EEG-fNIRS research.
Table 1: Comparative performance metrics of hybrid versus unimodal systems
| System Type | Modalities | Classification Accuracy | Temporal Resolution | Spatial Resolution | Key Advantages |
|---|---|---|---|---|---|
| Hybrid | EEG-fNIRS | 82.30%-87.24% [85] | Millisecond (EEG) [2] | ~1-2 cm (fNIRS) [2] | Spatiotemporal complementarity, robust cross-subject generalization [85] |
| Hybrid | EMG-EEG | 94.5% (vs. 88.5% EMG-only) [86] | Millisecond (both) [86] | N/A (EMG) | Fatigue-adaptive control, enhanced robustness [86] |
| Unimodal | EEG | Limited in ICH populations [10] | Millisecond [2] | ~2 cm [5] | High temporal resolution, portable [4] |
| Unimodal | fNIRS | Limited in ICH populations [10] | ~1s [2] | ~1-2 cm [2] | Superior spatial resolution, motion artifact resistant [10] |
| Multimodal Treatment | Resistance + Endurance | N/A | N/A | N/A | Significantly improved knee-extensor strength (SMD=1.25) [87] |
Figure 1: Complementary spatiotemporal resolution of EEG and fNIRS forms the foundation for hybrid system superiority in neurorehabilitation applications.
Table 2: Clinical efficacy measures across rehabilitation system types
| System Type | Patient Population | Primary Outcome Measures | Clinical Efficacy | Limitations |
|---|---|---|---|---|
| Hybrid EEG-fNIRS | ICH patients [85] | Motor imagery classification accuracy | 74.87% mean accuracy with transfer learning [85] | Neurophysiological heterogeneity, complex setup |
| Hybrid EMG-EEG | Post-stroke (evaluated with healthy participants) [86] | Intention classification accuracy during fatigue | 91.4% vs. 83.1% (EMG-only) under high fatigue [86] | Limited validation in clinical populations |
| Unimodal EEG | Stroke patients [10] | Motor imagery decoding | Variable, signal quality issues in ICH [10] | Susceptibility to motion artifacts, poor spatial specificity [10] |
| Unimodal fNIRS | Stroke patients [10] | Hemodynamic response detection | Variable, limited temporal resolution [2] | Poor temporal resolution, limited penetration depth [2] |
| Multimodal Exercise | Post-stroke patients [87] | Knee-extensor strength, gait speed, endurance | Significant improvement in lower limb function [87] | Requires physical capability, equipment access |
Figure 2: Hybrid systems demonstrate particular advantage in ICH rehabilitation where neurovascular uncoupling challenges unimodal approaches, creating a compelling case for multimodal integration.
Objective: To achieve synchronized acquisition of electrophysiological (EEG) and hemodynamic (fNIRS) activity during motor imagery tasks for ICH rehabilitation.
Equipment Requirements:
Sensor Placement Configuration:
Experimental Paradigm (Adapted from HEFMI-ICH Dataset [10]):
Data Synchronization and Processing:
Objective: To implement real-time fatigue-adaptive intention detection for upper-limb robotic rehabilitation using hybrid EMG-EEG signals.
Equipment Requirements:
Sensor Placement Configuration:
Signal Processing and Fusion Pipeline:
Experimental Implementation:
Table 3: Essential research materials for hybrid neuroimaging in stroke rehabilitation
| Item | Function | Example Products/Specifications |
|---|---|---|
| Hybrid EEG-fNIRS Cap | Integrated sensor placement for simultaneous acquisition | Custom designs with 32 EEG electrodes, 32 fNIRS sources, 30 detectors [10] |
| Biosignal Amplifiers | Signal acquisition and preprocessing | g.HIamp, g.Nautilus (g.tec), NIRSport2 (NIRx) [88] |
| Synchronization Interface | Temporal alignment of multimodal data | E-Prime 3.0, LabStreamingLayer [10] |
| EMG-EEG Fusion Algorithm | Real-time intention classification | Adaptive Bayesian fusion with fatigue estimation [86] |
| Transfer Learning Framework | Cross-subject generalization for ICH patients | Wasserstein metric-driven source domain selection [85] |
| Motor Imagery Paradigm | Standardized cognitive task protocol | HEFMI-ICH dataset paradigm [10] |
| Robotic Rehabilitation Interface | Physical implementation of intention detection | Portable elbow rehabilitation robot with bilateral arm support [86] |
Hybrid neuroimaging systems demonstrate significant advantages over unimodal approaches for stroke and ICH rehabilitation, primarily through their ability to capture complementary neural signatures and maintain robust performance under challenging clinical conditions. The integration of EEG with fNIRS or EMG creates synergistic systems that overcome individual modality limitations, particularly relevant for ICH populations where neurovascular uncoupling complicates unimodal assessment. Successful implementation requires careful attention to sensor placement compatibility, synchronization protocols, and adaptive fusion algorithms tailored to the unique neurophysiological presentations of stroke patients. Future developments should focus on standardized acquisition hardware, automated sensor placement systems, and clinically viable protocols to translate hybrid neuroimaging benefits from research laboratories to rehabilitation clinics.
The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) offers a powerful multimodal approach to non-invasive brain imaging. EEG provides millisecond-level temporal resolution for tracking rapid neural electrical activity, while fNIRS delivers superior spatial localization of slower hemodynamic responses through measurements of oxygenated (HbO) and deoxygenated hemoglobin (HbR) concentrations [10] [89]. This complementary relationship enables more comprehensive investigation of brain function, particularly for applications in brain-computer interfaces (BCIs), motor rehabilitation, and cognitive neuroscience [90] [91].
A significant challenge in simultaneous EEG-fNIRS research involves optimizing sensor placement compatibility to ensure both modalities capture neural activity from the same cortical regions without technical interference. Publicly available datasets provide essential resources for methodological validation, algorithm benchmarking, and protocol standardization before researchers invest in costly original data collection [10] [91]. This application note outlines how to strategically leverage these resources, with a specific focus on addressing sensor placement considerations within multimodal neuroimaging research.
Several research groups have recently contributed high-quality, publicly available datasets that combine EEG and fNIRS recordings across various experimental paradigms. These resources provide valuable benchmarks for methodological development.
Table 1: Publicly Available Multimodal EEG-fNIRS Datasets for Methodological Validation
| Dataset Name | Primary Focus | Participants | EEG Channels | fNIRS Channels | Key Features | Sensor Placement Documentation |
|---|---|---|---|---|---|---|
| HEFMI-ICH [10] | Motor Imagery for Intracerebral Hemorrhage Rehabilitation | 17 healthy, 20 ICH patients | 32 | 90 | Clinical population, synchronized acquisition | 3D coordinates under MNI template for both modalities |
| Multi-Joint MI Dataset [91] | Upper Limb Motor Imagery | 18 healthy | 64 | 20 fNIRS channels (8 sources, 8 detectors) | 8 MI tasks across 4 joint types | Diagram of integrated cap layout with co-located sensors |
| Semantic Decoding Dataset [5] | Imagery of Animals vs. Tools | 12 healthy | 128 | 86 | Semantic category decoding | Co-registered using standard 10-20 system |
| Implicit Learning Dataset [6] | Serial Reaction Time Task | 30 healthy | 32 | 48 (24 per hemisphere) | Learning classification | Reference file mapping fNIRS to EEG 10-20 system |
| EEG-fNIRS NFB Protocol [89] [51] | Motor Imagery Neurofeedback | 30 healthy | 32 (19 over sensorimotor) | Custom layout targeting sensorimotor cortex | Real-time NFB platform | Custom cap integrating both systems; code publicly available |
Table 2: Technical Specifications Across Featured EEG-fNIRS Datasets
| Dataset | EEG Sampling Rate | fNIRS Sampling Rate | fNIRS Measurement Types | Trigger Synchronization | Data Formats |
|---|---|---|---|---|---|
| HEFMI-ICH [10] | 256 Hz | 11 Hz | HbO, HbR | E-Prime 3.0 event markers | Raw, preprocessed, feature-engineered |
| Multi-Joint MI Dataset [91] | 1000 Hz | 7.8125 Hz | HbO, HbR | Simultaneous recording system | European Data Format (.edf), CSV |
| Semantic Decoding Dataset [5] | 500 Hz | 10 Hz | HbO, HbR | Not specified | BIDS format |
| Implicit Learning Dataset [6] | 500 Hz or 1000 Hz | 10 Hz | HbO, HbR, Total Hb | Event markers in separate files | .edf, CSV with event markers |
| EEG-fNIRS NFB Protocol [51] | Not specified | Not specified | HbO, HbR | Custom real-time platform | Real-time streaming compatible |
Purpose: To validate that EEG and fNIRS sensors are capturing complementary neural activity from the same cortical regions during motor imagery tasks.
Materials and Equipment:
Procedure:
Analysis:
Purpose: To evaluate the consistency of multimodal measurements across repeated sessions with sensor replacement.
Background: fNIRS signals show better reproducibility for HbO than HbR, and source localization improves reliability [92]. Optode placement shifts reduce spatial overlap across sessions.
Procedure:
Analysis:
Research Workflow for Sensor Placement Validation
The physiological relationship between EEG and fNIRS signals is governed by neurovascular coupling, the process by which neural activity triggers hemodynamic responses. Understanding these pathways is essential for interpreting multimodal data.
Neurovascular Coupling Between EEG and fNIRS
Table 3: Essential Materials for Simultaneous EEG-fNIRS Research
| Item | Specification | Research Function | Compatibility Considerations |
|---|---|---|---|
| Integrated EEG-fNIRS Caps | Custom designs with 32-64 EEG electrodes, 16-32 fNIRS optodes | Ensures consistent spatial relationship between modalities | Look for MNI coordinate documentation; consider head size variations |
| fNIRS Systems | Continuous wave systems with 760/850 nm wavelengths | Measures HbO and HbR concentration changes | Ensure synchronization capability with EEG systems |
| EEG Amplifiers | High-impedance (>1 GΩ) with 256+ Hz sampling rate | Records electrical brain activity | Select systems with optical isolation to reduce fNIRS interference |
| Abrasive Preparatory Gels | EEG-specific abrasive gels | Reduces electrode impedances | Ensure compatibility with fNIRS optodes (non-interfering) |
| 3D Digitizers | Magnetic or optical digitization systems | Documents precise sensor locations | Essential for coregistration with anatomical scans |
| Synchronization Hardware | TTL pulse generators, parallel port interfaces | Maintains temporal alignment between systems | Verify compatibility with both EEG and fNIRS equipment |
| Paradigm Presentation Software | E-Prime, PsychoPy, Presentation | Prescribes experimental tasks | Must output synchronous triggers to both recording systems |
Public multimodal EEG-fNIRS datasets provide critical resources for validating sensor placement methodologies and analytical approaches before undertaking original research. The protocols and resources outlined in this application note enable researchers to systematically address the technical challenges of simultaneous data acquisition, particularly the spatial compatibility between EEG electrodes and fNIRS optodes. As multimodal neuroimaging continues to advance, standardized validation approaches using these public resources will enhance methodological rigor and reproducibility across the field.
The strategic integration of EEG and fNIRS through compatible sensor placement creates a powerful tool that transcends the limitations of either modality alone. By understanding the foundational principles, implementing robust methodological designs, proactively troubleshooting artifacts, and adhering to rigorous validation standards, researchers can unlock a more complete picture of brain function. The future of this multimodal approach is exceptionally promising, driven by advancements in machine learning for data fusion, the development of more sophisticated and comfortable wearable systems, and the translation of these technologies into personalized clinical diagnostics and neurorehabilitation protocols for conditions like intracerebral hemorrhage and stroke. This progression will fundamentally enhance how we monitor therapeutic efficacy and understand neurological disorders in drug development and clinical practice.