课题组从自发性面部微表情数据库出发,研究微表情自动分析算法。
1、特征描述子与深度网络基础研究
(1)较早将时空局部二元模算法以及多种衍生算法应用于微表情的跟踪以及分析,并取得当前最优效果。
(2)运用动态幅度增大的算法,大幅度提升微表情自动分析的性能(论文发表于2018年IEEE Transactions on Affective Computing,论文标题为“Towards reading hidden emotions: a comparative study of spontaneous micro-expression spotting and recognition methods”)。
(3)在多特征描述子与深度网络方面,本人及合作者多次提出描述微表情面部变化的特征衍生算法。提出了最显著的微表情定位的快速算法,以及采用深度学习网络提取最显著的微表情图像的特征,从而高效率地识别微表情。提出了一种基于多流Inception网络的微表情识别分类模型(论文发表于2022年Pattern Recognition)。
2、跨库微表情识别
首次开创性地提出了跨库微表情自动分析的研究 (论文发表于2018年IEEE Transactions on Multimedia)。该研究突破了传统微表情分析仅局限于单一数据库的限制,创新性地构建了能够整合多个不同来源数据库数据的分析框架。通过先进的机器学习与计算机视觉技术,对跨库数据中的微表情特征进行深度挖掘与精准识别,进一步深入探讨微表情自动分析在实际应用场景,如安全监控、心理评估、人机交互等方面的可行性。
微表情分析成果得到了该领域诸多权威专家的高度认可。其中,Dr. Moi Hoon Yap,作为 Royal Society Industry Fellow,不仅对该研究成果给予了积极评价,还在其相关学术论文中进行了引用,充分肯定了该研究在拓展微表情分析应用边界方面的重要价值。
主要代表作:
Qirong Mao, Ling Zhou, Wenming Zheng, Xiuyan Shao, and Xiaohua Huang*. Objective class-based micro-expression recognition under partial occlusion via region-inspired relation reasoning network. IEEE Transactions on Affective Computing, vol. 13, no. 4, pp. 1998-2016, 2022. (SCI一区)
Ling Zhou#, Qirong Mao, Xiaohua Huang*, Feifei Zhang, and Zhihong Zhang. Feature refinement: an expression-specific feature learning and fusion method for micro-expression recognition. Pattern Recognition, vol. 122, 108275, 2022. (CCF-A)
Yante Li#, Xiaohua Huang, and Guoying Zhao. Micro-expression action unit detection with spatial and channel attention. Neurocomputing, vol. 436, pp. 221-231, 2021. (CCF-A, SCI一区)
Yante Li#, Xiaohua Huang, and Guoying Zhao. Joint local and global information learning with single apex frame detection for micro-expression recognition. IEEE Transactions on Image Processing, vol. 30, pp. 249-263, 2020. (CCF-A, SCI一区)
Xiaohua Huang, Sujing Wang, Xin Liu, Guoying Zhao, Xiaoyi Feng, and Matti Pietikäinen. Discriminative spatiotemporal local binary pattern with revisited integral projection for spontaneous facial micro-expression recognition. IEEE Transactions on Affective Computing, vol. 10, no. 1, pp. 32-47, 2019. (CCF-B,SCI一区)
Xiaobai Li, Xiaopeng Hong, Antti Moilanen, Xiaohua Huang, Tomas Pfister, Guoying Zhao and Matti Pietikäinen. Towards reading hidden emotions: a comparative study of spontaneous micro-expression spotting and recognition methods. IEEE Transactions on Affective Computing, vol. 9, no. 4, pp. 563-577, 2018. (CCF-B,SCI一区)
Sujing Wang, Bingjun Li, Yongjin Liu, Wenjing Yan, Xinyu Ou, Xiaohua Huang, Feng Xu, Xiaolan Fu. Micro-expression recognition with small sample size by transferring long-term convolutional neural network. Neurocomputing, vol. 312, pp. 251-262, 2018. (CCF-C,SCI一区)
Yuan Zong, Wenming Zheng, Xiaohua Huang, Jingang Shi, Zhen Cui and Guoying Zhao. Domain regeneration for cross-database micro-expression recognition, IEEE Transactions on Image Processing,vol. 27, no. 5, pp. 2484-2498, 2018. (CCF-A,SCI一区)
Yuan Zong, Xiaohua Huang, Wenming Zheng, Zhen Cui and Guoying Zhao. Learning from hierarchical spatiotemporal descriptors for micro-expression recognition. IEEE Transactions on Multimedia, vol. 20, no. 11, pp. 3160-3172, 2018. (CCF-B,SCI一区)
Xiaohua Huang, Guoying Zhao, Xiaopeng Hong, Wenming Zheng and Matti Pietikäinen. Spontaneous facial micro-expression analysis using spatiotemporal completed local quantized pattern. Neurocomputing, Vol. 175, Part A, pp. 564-578, 2016. (CCF-C,SCI一区)