Nan Ma (马楠)

Professor

Dean, School of Artificial Intelligence, Beijing University of Technology

Deputy Director, Engineering Research Center of Intelligence Perception and Autonomous Control, Ministry of Education

Deputy Secretary General, Chinese Association for Artificial Intelligence

Room M827, The Science Building, Beijing University of Technology

manan123@bjut.edu.cn

Research Interests

Interactive Cognitive

Embodied Intelligence

Autonomous Driving

Intelligent Robot

I have published more than 90 papers in domestic and international academic journals and conferences, including IEEE TRO, TIP, TNNLS, TMM, PR, Science China Information Sciences, ACM MM and ICRA.

Recent Work Highlights

Q1 CCF A Sci. China Inf. Sci. Future vehicles: interactive wheeled robots
Q1 CCF A Sci. China Inf. Sci. Future Vehicle: Learnable Wheeled Robot
SCIS 自驾驶中的交互认知 [Interactive cognition in self-driving]
Robot Top T-RO Autonomous Tomato Harvesting With Top-Down Fusion Network for Limited Data
Q1 CCF A TIP Multi-View Time-Series Hypergraph Neural Network for Action Recognition
Q1 CCF B PR THTFormer: Topology-adaptive Hypergraph Transformer Network for Skeleton-based Action Recognition
CCF A ACM MM Kinematic Enhanced Hypergraph Convolutional Network for Skeleton-based Human Action Recognition with LLM Training Guides
Q1 CCF B PR Spatial-Temporal Hypergraph Based on Dual-Stage Attention Network for Multi-View Data Lightweight Action Recognition
Q1 T-MM Image-based Structured Vehicle Behavior Analysis Inspired by Interactive Cognition
Robot Top ICRA FF-LOGO: Cross-Modality Point Cloud Registration with Feature Filtering and Local to Global Optimization
Robot Top ICRA AHPPEBot: Autonomous Robot for Tomato Harvesting based on Phenotyping and Pose Estimation
Q2 Top ESWA Multimodal driver distraction detection using dual-channel network of CNN and Transformer
Q1 CCF A T-IP Exploring High-order Spatio-temporal Correlations from Skeleton for Person Re-identification
Q2 TSINGHUA SCI TECHNOL A Survey of Human Action Recognition and Posture Prediction
Main Publications

[1] Nan Ma, Deyi Li*, Wen He, Yue Deng, Jiahong Li, Yue Gao, Hong Bao, Huan Zhang, Xinkai Xu, Yuansheng Liu, Zhixuan Wu, Li Chen. Future vehicles: interactive wheeled robots[J]. Science China-Information Sciences, 2021, 64 (5): 56101:1–156101:3.

[2] Deyi Li, Nan Ma*, Yue Gao. Future Vehicle: Learnable Wheeled Robot[J]. Science China-Information Sciences, 2020, 63 (9):193201.

[3] 马楠,高跃,李佳洪,李德毅*.自驾驶中的交互认知[J]. 中国科学:信息科学, 2018, 48(8): 1083–1096.

[4] Xingxu Li, Yiheng Han, Nan Ma*, Yongjin Liu, Jia Pan, Shun Yang, Siyi Zheng. Autonomous Tomato Harvesting With Top–Down Fusion Network for Limited Data[J]. IEEE Transactions on Robotics, 2025, 41: 3609-3628.

[5] Nan Ma, Zhixuan Wu, Yifan Feng, Cheng Wang and Yue Gao*, Multi-View Time-Series Hypergraph Neural Network for Action Recognition[J]. IEEE Transactions on Image Processing, 2024, 33: 3301-3313.

[6] Zhixuan Wu, Nan Ma*, Cheng Wang, Cheng Xu, Genbao Xu, Mingxing Li. Spatial-temporal hypergraph based on dual-stage attention network for multi-view data lightweight action recognition[J]. Pattern Recognition, 2024: 110427.

[7] Luntian Mou*, Haitao Xie, Shasha Mao, Dandan Yan, Nan Ma*, Baocai Yin, Wen Gao. Image-based Structured Vehicle Behavior Analysis Inspired by Interactive Cognition[J]. IEEE Transactions on Multimedia, 2024, 26, 9121–9134.

[8] Jiaxuan Lu, Hai Wan, Peiyan Li, Xibin Zhao,Nan Ma*, Yue Gao*. Exploring High-order Spatio-temporal Correlations from Skeleton for Person Re-identification[J]. IEEE Transactions on Image Processing, 2023, 32:949-969.

[9] Heyuan Shi, Yubo Zhang, Zizhao Zhang, Nan Ma*, Xibin Zhao, Yue Gao*, Jiaguang Sun. Hypergraph-Induced Convolutional Networks for Visual Classification[J]. IEEE Transactions on Neural Networks and Learning Systems, 2019, 30(10): 2963-2972.

[10] Nan Ma*, Zhixuan Wu, Yue Gao, Yuchen Guo, Jiahong Li. A Survey of Human Action Recognition and Posture Prediction[J]. Tsinghua Science and Technology, 2022, 27(6), 973-1001.

[11] Luntian Mou*, Jiali Chang, Chao Zhou, Yiyuan Zhao, Nan Ma*, Baocai Yin, Ramesh Jain, Wen Gao. Multimodal driver distraction detection using dual-channel network of CNN and Transformer[J]. Expert Systems with Applications, 2023, 234: 121066.

[12] Li Chen, Nan Ma*, Patrick Wang, Guilin Pang, Xiaojun Shi. Survey of pedestrian action recognition techniques for autonomous driving[J]. Tsinghua Science and Technology, 2020, 25(4): 458-470.

[13] Zhixuan Wu, Nan Ma*, Yue Gao, Jiahong Li, Xinkai Xu, Yongqiang Yao, Li Chen. Attention Mechanism Based on Improved Spatial-Temporal Convolutional Neural Networks for Traffic Police Gesture Recognition[J]. International Journal of Pattern Recognition and Artificial Intelligence, 2022, 36(8), 2256001:1-2256001:19.

[14] Yongqiang Yao, Nan Ma*, Cheng Wang, Zhixuan Wu, Cheng Xu, Jin Zhang. Research and implementation of variable-domain fuzzy PID intelligent control method based on Q-Learning for self-driving in complex scenarios[J]. Mathematical Biosciences and Engineering, 2023, 20(3): 6016-6029.

[15] Nan Ma, Hamido Fujita, Yun Zhai, Shupeng Wang. Ensembles of Fuzzy Cognitive Map Classifiers Based on Quantum Computation[J]. Acta Polytechnica Hungarica, 2015, 12(4) :7-20.

[16] Nan Ma, Sicheng Zhao, Zhen Sun, Xiuping Wu, Yun Zhai. An improved ridge regression algorithm and its application in predicting TV ratings[J]. Multimedia Tools and Applications, 2019, 78 (1): 525-535.

[17] Nan Ma, Patrick Wang, Qin He, Wenjia Li, Ying Zheng. Prediction of Television Audience Rating Based on Fuzzy Cognitive Maps with Forward Stepwise Regression[J]. International Journal of Pattern Recognition and Artificial Intelligence, 2017, 31 (1): 1-13.

[18] Nan Ma, Mohan Wang, Yihan Han*, and Yongjin Liu. FF−LOGO: Cross−Modality Point Cloud Registration with Feature Filtering and Local to Global Optimization[C]//2024 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2024: 744-750..

[19] Xingxu Li, Nan Ma*, Yiheng Han, Shun Yang, and Siyi Zheng. AHPPEBot: Autonomous Robot for Tomato Harvesting based on Phenotyping and Pose Estimation[C]//2024 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2024: 18150-18156.

[20] Nan Ma, Beining Sun, Yiheng Han* and Genbao Xu. Kinematic Enhanced Hypergraph Convolutional Network for Skeleton-based Human Action Recognition with LLM Training Guides[C].In Proceedings of the 33th ACM International Conference on Multimedia (Dublin,Ireland) (ACM MM 2025) (已录用)

[21] Nan Ma, Genbao Xu, Yiheng Han*, Beining Sun. SA-P2T: Sparse Attention-based Pyramid Pooling Transformer Network for Object Detection[C]//2024 IEEE 24th International Conference on Software Quality, Reliability, and Security Companion (QRS-C). IEEE, 2024: 946-951. Best Paper

[22] Nan Ma, Tiancong Han, Qin Xia, Yiheng Han*. Road Information Recognition and Decision Making Based on YOLO Algorithm[C]//2024 3rd International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR). IEEE, 2024: 197-202. Best paper

[23] Nan Ma, Jiahui Wang, Kongjian Qin , Yiheng Han*. A Real-Time Vehicle Detection and Tracking System Based on an Improved YOLOv5 with Lightweight Convolutions and Multi-Scale Fusion Combined with BYTETrack[C]//2024 3rd International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR). IEEE, 2024: 203-209. Best paper

[24] Zhixuan Wu, Nan Ma*, Tao Zhi and Genbao Xu. Spatial-Temporal Hypergraph Neural Network based on Attention Mechanism for Multi-view Data Action Recognition[C]//2023 10th International Conference on Dependable Systems and Their Applications (DSA). IEEE, 2023: 487-493. Best Paper

[25] Xiaokang Chen, Nan Ma*, Mohan Wang. Yolov5-pothole:an improved road pothole perception method based on yolov5-seg[C]//The 2nd International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR 2023), 2023. Best paper

[26] Nan Ma*, Beining Sun, Zhixuan Wu, Tao Zhi, Genbao Xu, Mohan Wang. A Survey of Human Action Recognition Based on Graph Convolutional Networks[C]//The 2nd International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR 2023), 2023. Best paper

[27] Nan Ma, Shangyuan Li, Yiheng Han*, Mohan Wang. PreBEV: Leveraging Predictive Flow for Enhanced Bird's-Eye View 3D Dynamic Object Detection[C]//2024 IEEE 24th International Conference on Software Quality, Reliability, and Security Companion (QRS-C). IEEE, 2024: 1062-1066.

[28] Nan Ma, Weien Suo, Qin Xia, Yiheng Han*. Construction and Performance Evaluation of a Comprehensive Multi-Scenario Road Vehicle and Pedestrian Detection Dataset[C]//2024 3rd International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR). IEEE, 2024: 210-215.

[29] Nan Ma, Zhijie Liu, Yiheng Han*, Jichang Ma. A review of cross-modal 3D point cloud semantic segmentation methods based on deep learning[C]//2024 2nd International Conference on Computer, Vision and Intelligent Technology (ICCVIT). IEEE, 2024: 1-6.

[30] Shangyuan Li, Nan Ma*, Zhixuan Wu, Qiang Lin. License Plate Detection and Recognition Based on Light-Yolov7[C]//Chinese Intelligent Automation Conference. Singapore: Springer Nature Singapore, 2023: 83-91.

[31] Feifan He, Nan Ma*, Xingxu Li, Zhijie Liu. A Review of Multi-agent Collaborative Control[C]//The 2nd International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR 2023), 2023: 506-510.

[32] Zecheng Yang, Nan Ma*, Yongqiang Yao. A Survey on Cooperative Control of Multi-agent Systems[C]//International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR 2023), 2023: 511-515.

[33] Nan Ma*, Shangyuan Li, Chuansheng Xiao, Mohan Wang, Beining Sun, and Mengye Zhang. A review of SAM-based visual semantic segmentation[C]//2023 2nd International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR). IEEE, 2023: 496-500.

[34] Nan Ma*, Mengye Zhang, Mohan Wang, Genbao Xu, Chuansheng Xiao, Shangyuan Li. A Review of Graph Convolutional Networks for Skeleton-based Human Action Recognition[C]//The Nineteenth International Conference on Computational Intelligence and Security (CIS'2023), 2023.

[35] Chuansheng Xiao, Nan Ma*, Kongjian Qin, Genbao Xu, Mohan Wang. BIR−AHC: Balanced Iterative Reducing and Agglomerative Hierarchical Clustering for Stair Detection.[C]//2023 10th International Conference on Dependable Systems and Their Applications (DSA). IEEE, 2023: 623-627.

[36] Nan Ma*, Chuansheng Xiao, Mohan Wang, Genbao Xu. A review of point cloud and image cross-modal fusion for self-driving[C]//2022 18th International Conference on Computational Intelligence and Security (CIS). IEEE, 2022: 456-460.

[37] Nan Ma, Li Chen, Jiancheng Hu, Qiuna Shang, Jiahong Li, Guoping Zhang. Pedestrian Detection Based on HOG Features and SVM Realizes Vehicle-Human Environment Interaction[C]// The 15th International Conference on Computational Intelligence and Security (CIS2019), Macao, China, 2019.

[38] Zhixuan Wu, Nan Ma*, Yongqiang Yao, Guoping Zhang. Survey of Action Recognition Based on Attention Mechanism[C]//Proceedings of 2021 Chinese Intelligent Automation Conference. Springer, Singapore, 2022, pp. 555-563.

[39] Li Chen, Nan Ma*, Guoping Zhang. Bi-GRU-Attention Enhanced Unsupervised Network for Skeleton-Based Action Recognition [C] //2021 International Conference on Autonomous Unmanned Systems (ICAUS 2021), 2021, pp. 1090-1098.

[40] Yongqiang Yao, Nan Ma*, Jiahong Li, Zhixuan Wu, Guoping Zhang. Emergency Obstacle Avoidance based on Gradient Descent Distance for Self-driving Vehicles [C]//2021 International Conference on Autonomous Unmanned Systems (ICAUS 2021). Springer, Singapore, 2021: 2980-2989.

[41] Zongli Jiang, Jieru Liang, Nan Ma*, An Graph Neural Network and Feature Interaction Based Fraud Detection[C]//2021 17th International Conference on Computational Intelligence and Security (CIS 2021), 2021: 464-468.

[42] Yongqiang Yao, Nan Ma*, Jiahong Li, Zhixuan Wu, Guoping Zhang. Research on Control Method of Self-driving Vehicle Based on Adaptive Fuzzy PID[C]//2021 17th International Conference on Computational Intelligence and Security (CIS 2021), 2021: 212-216.

[43] Jiahong Li, Nan Ma*. Design of Vehicle Cooperative localization System Based on Cooperative Communication Switching Strategy [C]//2021 17th International Conference on Computational Intelligence and Security (CIS 2021), 2021: 237-241.

[44] Guoping Zhang, Nan Ma*, Jiahong Li, Beiyan Jiang, Zhixuan Wu. Gesture Recognition Algorithm Based on Lightweight 3DCNN Network[C]//2021 17th International Conference on Computational Intelligence and Security (CIS 2021), 2021: 217-221.

[45] Jiahong Li, Nan Ma, Fang Deng. Distributed Noise Covariance Matrices Estimation in Sensor Networks[D]. in IEEE 59th Conference on Decision and Control (CDC), Jeju Island, Republic of Korea, Dec. 2020, pp. 1-6.

[46] Zhixuan Wu, Nan Ma*, Yiu-ming Cheung, Jiahong Li, Qin He, Yongqiang Yao, Guoping Zhang. Improved Spatio-Temporal Convolutional Neural Networks for Traffic Police Gestures Recognition[C]//International Conference on Computational Intelligence and Security(CIS2020), 2020, pp. 109-115.

[47] Jiahong Li, Nan Ma, Xiangmin Han. Multi-agent Robust Time Differential Reinforcement Learning over communicated networks[C]//2018 37th Chinese Control Conference (CCC). IEEE, 2018: 7221-7225.

[48] Li Chen, Nan Ma*, Pengfei Wang, et al. Survey of Pedestrian Action Recognition in Autonomous Driving[C]//2018 Third International Conference on Cognitive Systems and Information Processing (ICCSIP 2018), 2018.

[51] 陈丽, 马楠*, 逄桂林, 高跃, 李佳洪, 张国平, 吴祉璇, 姚永强. 多视角数据融合的特征平衡YOLOv3行人检测研究[J].智能系统学报, 2021, 16(1): 9.

[52] 张国平, 马楠, 贯怀光, 吴祉璇. 深度学习方法在二维人体姿态估计的研究进展[J].计算机科学, 2022, 49(12):219-228.

Professional Services

Deputy Secretary General, Chinese Association for Artificial Intelligence

Deputy Director and Secretary-General of the Education Working Committee, Chinese Association for Artificial Intelligence (CAAI)

Distinguished Member, China Society of Image and Graphics (CSIG)

Standing Council Member and Chair of the Women in Science and Technology Committee, Beijing Society of Image and Graphics

Editorial Board Member, Intelligent Computing, Journal of Intelligent Systems (智能系统学报)

Associate Editors, International Journal of Pattern Recognition and Artificial Intelligence (IJPRAI)

Senior Member, Institute of Electrical and Electronics Engineers (IEEE), IEEE Computational Intelligence Society (CIS)

General-Chair, International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics; IEEE International Symposium on Autonomous Vehicle Software

Session Chair, International Conference on Brain Informatics (BI 2019); International Conference on Cognitive System and Information Processing (ICCSIP 2018)

Research Grants and Projects

National Key R&D Program of China, "National Quality Infrastructure System" Key Special Project: Multi-Dimensional Data Calibration Key Technologies and Standards for Quality Trustworthiness (2023–2027)

Beijing Natural Science Foundation–Shunyi Innovation Joint Fund, User Behavior Analysis, Modeling, and Evaluation Based on Multi-Modal Data in Intelligent Cockpit Interaction (2024–2026)

Beijing Science and Technology Plan Project, Intelligent Manufacturing and Robotics Innovation: Humanoid Robot Perception in Dynamic Indoor/Outdoor Environments and 3D Navigation (2022–2023)

National Natural Science Foundation of China (NSFC) General Program, Theory and Technology of Cross-Modal Visual Information Acquisition and Processing for Autonomous Vehicles (2024–2027)

National Natural Science Foundation of China (NSFC) General Program, Key Technologies for Multi-View Video Information Acquisition and Localization in Autonomous Vehicles (2019–2022)

National Natural Science Foundation of China (NSFC) Key Program, Theory and Methods of Coded Imaging for Front-End Fusion (2020–2024)

Qiyuan Laboratory Innovation Fund (Exploratory Research), Key Technologies for Interactive Cognition and Collaboration in Intelligent Robotics (2023–2024)

Beijing Natural Science Foundation General Program, Behavior Recognition in Complex Scenarios for Autonomous Driving (2022–2024)

Beijing Natural Science Foundation General Program, Multi-View Object Recognition for Autonomous Vehicles (2018–2020), Rated "Excellent" upon completion

Honors and Awards

First Prize, China Science and Technology Progress Award (CSIG, 2022) - Key Technologies and Applications of Visual Understanding and Interactive Cognition for Mobile Robots in Complex Scenarios (First Rank)

Second Prize, China Electronics Society Science and Technology Award - Technology Invention Category (2020) - Intelligent Interaction Technology and Applications for Autonomous Driving (First Rank)

First Prize, China Electronics Society Science and Technology Award - Natural Science Category (2022) - Complex Correlation Computing for Visual Information (Third Rank)

Outstanding Women in Science and Technology Award, Beijing Society of Image and Graphics (2022)

Best Paper Award, IEEE International Symposium on Autonomous Vehicle Software (AVS 2024)

Best Paper Award, IEEE International Symposium on Autonomous Vehicle Software (AVS 2023)

Best Paper Award, 3rd International Conference on AI, HCI and Robotics (AIHCIR 2024)

Best Paper Award, 2nd International Conference on AI, HCI and Robotics (AIHCIR 2023)

Best Workshop Organization Award, 2022 International Conference on VR, HCI and AI (VRHCIAI) - Intelligent Interaction Technology Workshop

Best Workshop Organization Award, 2nd International Conference on Image, Vision and Intelligent Systems (ICIVIS 2022) - IntelliSense and Cross-modal Recognition Workshop

Outstanding Contribution Award, IEEE International Symposium on Autonomous Vehicle Software (AVS 2023)

Excellence in Service as Chair, 2nd International Conference on AI, HCI and Robotics (AIHCIR 2023)

Lead Instructor, MOOC "Intelligent Interaction Technology" on China University MOOC platform, certified as National First-Class Online Course

Chief Editor, textbook "Intelligent Interaction Technologies and Applications": Selected for National Key Publications Planning Project (13th Five-Year Plan) and awarded Beijing Higher Education "High-Quality Textbook & Courseware" (2021)

Chief Editor, "Intelligent Interaction Technologies and Applications (2nd ed.)": Selected for MOE's Strategic Emerging Fields "14th Five-Year Plan" Higher Education Textbook Plan

Second Prize, 6th National Outstanding Achievement Award in Educational Science Research (2022) for "Education in the Intelligent Age" (Second Contributor)

Second Prize, Beijing Higher Education Teaching Achievement Award (2022) for "Exploration and Practice of New Engineering Talent Cultivation Model for Robotics Industry" (Second Contributor)

Second Prize, Beijing Higher Education Teaching Achievement Award (2018) for "Cultivating Innovative Talent in Intelligent Robotics via Science-Mission-Driven Approaches" (Third Contributor)

Second Prize, University-Level Teaching Achievement Award (2020) for "Three-Dimensional Curriculum Development for New Engineering Education" (Lead Contributor)

Talks

Research on Interactive Cognition Technology in Coordination between “Human-Vehicle-Road" for Unmanned Vehicle

Research on Interactive Cognition in Coordination Between Human-vehicle-road for Unmanned Vehicle

Embodied Interactive Intelligence Towards Autonomous Driving

Teaching

Undergraduate Courses

Principles of Database Systems (Bilingual Instruction)

Fundamental Database Practices

Intelligent Human-Robot Interaction

Machine Learning

Training for University Student Robotics Competitions (Competition-based Course)

Graduate Courses

Machine Intelligence Interaction

Advanced Database Systems