A multimodal sensing and analytics platform integrating fNIRS and EMG with machine learning to decode consumer emotional responses during product interaction, translating insights into design and value metrics.
The multimodal fNIRS–EMG platform is designed to decode implicit consumer emotional responses as they interact with products. By integrating functional near-infrared spectroscopy (fNIRS) and electromyography (EMG) data, the platform employs advanced machine learning models to identify affective states such as interest, hesitation, and comfort. This technology translates these insights into actionable product-design and value-creation metrics, enabling a deeper understanding of consumer preferences and behaviors.
Currently at TRL 3, the platform is in the experimental proof-of-concept phase. Future validation involves a structured one-year plan to refine tasks, enhance preprocessing methods, and validate metrics against consumer preferences and perceived quality.
San José State University is a comprehensive public R2 research university serving a large, diverse community in the heart of Silicon Valley. Industry engagement is built in: the Office of Innovation & Corporate Partnerships is a single front door for companies, and the SJSU Research Foundation supports contracting and compliance for sponsored projects. The College of Engineering’s co‑op program and industry advisory connections link corporate R&D to workforce‑ready talent. New facilities, including the Interdisciplinary Science Building, provide modern labs and collaboration spaces downtown. Research is supported by competitive federal funding from agencies such as NSF, NIH, and NASA.