About me
Zhijie Wang is currently a Ph.D. student in the Department of Electrical and Computer Engineering, University of Alberta, supervised by Prof. Lei Ma. He received an M.Eng degree in Electrical and Computer Engineering from the University of Waterloo in Dec 2020, and a B.Eng degree in Telecommunication Engineering from the Beijing University of Posts and Telecommunications in Jun 2019.
Zhijie’s current research interest focuses on Software Engineering (SE)support for complex AI-based software systems. His most recent work covers software testing, analysis, and repair for AI models and systems. Besides, he is also interested in the intersection of Software Engineering, AI, and Human-Computer Interaction (HCI). He designs and develops interactive interfaces to help developers interpret and debug AI-based software.
Contact
5-362 Donadeo Innovation Centre for Engineering (DICE)
9211 116 St NW, Edmonton, AB T6G 1H9
Email: {First Name} dot {Last Name} at {University} dot ca
My first name is Zhi Jie, pronounced /ʈʂɚ/ /tɕjɛ/, similar to (Chih-Chieh).
Our paper “Benchmarking Robustness of AI-enabled Multi-sensor Fusion Systems: Challenges and Opportunities” has won the ACM SIGSOFT Distinguished Paper Award in ESEC/FSE 2023! Congratulations to all my co-authors!
I’m attending ICSE 2024 and CHI 2024. Look forward to meeting you in Lisbon and Hawaii!
Research Highlights
Our work on the robustness benchmark of complex AI-based software and systems reveals their vulnerabilities, calling for researchers’ and practitioners’ attention to build trustworthy AI systems ([ICSE 2022, FSE 2023, TMM 2023]).
Our work on AI system analysis and its SE support helps developers decouple complex AI systems and identify root causes of incorrect system behavior, solving critical robustness and reliability issues for our industrial partners ([TOSEM 2023, ICSE 2024]).
Our work on interactive interfaces for debugging AI-based software and its data at scale helps both novice and experienced developers identify potential software bugs with enriched feedback loops and interpretability ([CHI 2023a, CHI 2023b, CHI 2024], ).
Publications
* All of my published works have open-sourced repositories or replication packages.
2024
PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement
Zhijie Wang, Yuheng Huang, Da Song, Lei Ma, Tianyi Zhang
Accepted by the 2024 CHI Conference on Human Factors in Computing Systems (CHI ‘24).
Paper Code
MultiTest: Physical-Aware Object Insertion for Testing Multi-sensor Fusion Perception Systems
Xinyu Gao*, Zhijie Wang*, Yang Feng, Lei Ma, Zhenyu Chen, Baowen Xu (* equal contribution)
Accepted by the 46th International Conference on Software Engineering (ICSE ‘24).
Paper Code Project
2023
Common Corruption Robustness of Point Cloud Detectors: Benchmark and Enhancement
Shuangzhi Li, Zhijie Wang, Felix Juefei-Xu, Qing Guo, Xingyu Li, Lei Ma
IEEE Transactions on Multimedia.
Paper Code Project
Generation-Based Differential Fuzzing for Deep Learning Libraries
Jiawei Liu, Yuheng Huang, Zhijie Wang, Lei Ma, Chunrong Fang, Mingzheng Gu, Xufan Zhang, Zhenyu Chen
ACM Transactions on Software Engineering.
Paper Code Project
Benchmarking Robustness of AI-enabled Multi-sensor Fusion Systems: Challenges and Opportunities
Xinyu Gao, Zhijie Wang, Yang Feng, Lei Ma, Zhenyu Chen, Baowen Xu
In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ‘23). 871-882. SIGSOFT Distinguished Paper Award
Paper Code Project
ArchRepair: Block-Level Architecture-Oriented Repairing for Deep Neural Networks
Hua Qi*, Zhijie Wang*, Qing Guo, Jianlang Chen, Felix Juefei-Xu, Fuyuan Zhang, Lei Ma, Jianjun Zhao (* equal contribution)
ACM Transactions on Software Engineering.
Paper Replication Package Project
DeepSeer: Interactive RNN Explanation and Debugging via State Abstraction
Zhijie Wang, Yuheng Huang, Da Song, Lei Ma, Tianyi Zhang
In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ‘23). Article 740, 1–20.
Paper Code Preview Demo Presentation
DeepLens: Interactive Out-of-distribution Data Detection in NLP Models
Da Song*, Zhijie Wang*, Yuheng Huang, Lei Ma, Tianyi Zhang (* equal contribution)
In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ‘23). Article 739, 1–17.
Paper Code Preview Demo Presentation
2022
When Cyber-Physical Systems Meet AI: A Benchmark, an Evaluation, and a Way Forward
Jiayang Song, Deyun Lyu, Zhenya Zhang, Zhijie Wang, Tianyi Zhang, Lei Ma
In Proceedings of 2022 IEEE/ACM 44th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), pp. 343-352
Paper Code Project
Selected Pre-prints
Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Models
Yuheng Huang, Jiayang Song, Zhijie Wang, Shengming Zhao, Huaming Chen, Felix Juefei-Xu, Lei Ma
Pre-print
Is Model Attention Aligned with Human Attention? An Empirical Study on Large Language Models for Code Generation
Bonan Kou, Shengmai Chen, Zhijie Wang, Lei Ma, Tianyi Zhang
Pre-print
An Exploratory Study of AI System Risk Assessment from the Lens of Data Distribution and Uncertainty
Zhijie Wang, Yuheng Huang, Lei Ma, Haruki Yokoyama, Susumu Tokumoto, Kazuki Munakata
Pre-print
CarveNet: Carving Point-Block for Complex 3D Shape Completion
Qing Guo*, Zhijie Wang*, Felix Juefei-Xu, Di Lin, Lei Ma, Wei Feng, Yang Liu (* equal contribution)
Pre-print
Professional Services
2024
Program Committee: ISSTA Artifact Evaluation
Journal Reviewer: IEEE Transactions on Reliability
External Reviewer: CHI, CHI-LBW, CSCW
2023
Program Committee: ESEC/FSE Artifact Evaluation
Journal Reviewer: IEEE Transactions on Reliability
2022
Journal Reviewer: IEEE Transactions on Reliability
External Reviewer: ICML, NeurIPS, ASE
2021
Journal Reviewer: IEEE Transactions on Reliability
Volunteers
Student Volunteer, MODELS 2021
Teaching
Teaching Assistant @ University of Alberta
ECE 422 Reliable and Secure Systems Design (Winter 2023, 2024)
ECE 325 Object-Oriented Software Design (Fall 2021, 2022, 2023)
ECE 321 Software Requirements Engineering (Fall 2022, 2023)
ECE 720 Advanced Topics in Software Engineering and Intelligent Systems (Winter 2022, 2023, 2024)
ECE 380 Introduction to Communication Systems(Winter 2021).
Teaching Assistant @ University of Waterloo
ECE 203 Probability Theory and Statistics 1 (Spring 2020).
Talks
Invited Talk: Human-Centred Interactive Design for Data-Driven AI Software June 2023, Beihang University, Beijing
Invited Talk: Human-Centred Interactive Design for Data-Driven AI Software June 2023, Institute of Information Engineering, CAS, Beijing
ECE 720 Guest Lecture: Human-Centred Interactive Design for Data-Driven AI Software March 2023, University of Alberta, Edmonton, AB
Tutorial on AI Quality Assurance @ SEMLA2022 Oct 2023, Montreal, QC ( Material)
Tutorial on AI Quality Assurance @ ASE2022 Oct 2023, Michigan, USA (Remote, Material)
Industry
Joint Research Project @ Fujitsu Research, Tokyo (Remote) 2021-2022
Research Intern @ Megvii Research, Beijing 2018-2019
Misc.
When I’m not in the office, you can usually find me in a hockey rink (Go Bears Go! 🟢🟡 / Let’s go Oilers! 🟠🔵), in a concert, in a ski resort…
I love taking photos when traveling (an amateur photographer lol), you can find some of them here.
Acknowledgment
My research has been supported by
Alberta Machine Intelligence Institute (Amii)
Canadian Institute for Advanced Research (CIFAR)
Fujitsu Research