About me

Zhijie Wang is currently a Ph.D. student in the Department of Electrical and Computer Engineering, University of Alberta, supervised by Prof. Lei Ma. He received an M.Eng degree in Electrical and Computer Engineering from the University of Waterloo in Dec 2020, and a B.Eng degree in Telecommunication Engineering from the Beijing University of Posts and Telecommunications in Jun 2019.

Zhijie’s current research interest focuses on Software Engineering (SE)support for complex AI-based software systems. His most recent work covers software testing, analysis, and repair for AI models and systems. Besides, he is also interested in the intersection of Software Engineering, AI, and Human-Computer Interaction (HCI). He designs and develops interactive interfaces to help developers interpret and debug AI-based software.

Contact

5-362 Donadeo Innovation Centre for Engineering (DICE)
9211 116 St NW, Edmonton, AB T6G 1H9
Email: {First Name} dot {Last Name} at {University} dot ca


My first name is Zhi Jie, pronounced /ʈʂɚ/ /tɕjɛ/, similar to (Chih-Chieh).


  Our paper “Benchmarking Robustness of AI-enabled Multi-sensor Fusion Systems: Challenges and Opportunities” has won the ACM SIGSOFT Distinguished Paper Award in ESEC/FSE 2023! Congratulations to all my co-authors!

I’m attending ICSE 2024 and CHI 2024. Look forward to meeting you in Lisbon and Hawaii!

Research Highlights

  • Our work on the robustness benchmark of complex AI-based software and systems reveals their vulnerabilities, calling for researchers’ and practitioners’ attention to build trustworthy AI systems ([ICSE 2022, FSE 2023, TMM 2023]).

  • Our work on AI system analysis and its SE support helps developers decouple complex AI systems and identify root causes of incorrect system behavior, solving critical robustness and reliability issues for our industrial partners ([TOSEM 2023, ICSE 2024]).

  • Our work on interactive interfaces for debugging AI-based software and its data at scale helps both novice and experienced developers identify potential software bugs with enriched feedback loops and interpretability ([CHI 2023a, CHI 2023b, CHI 2024], ).

Publications

* All of my published works have open-sourced repositories or replication packages.

2024

PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement
Zhijie Wang, Yuheng Huang, Da Song, Lei Ma, Tianyi Zhang
Accepted by the 2024 CHI Conference on Human Factors in Computing Systems (CHI ‘24).
 Paper     Code

MultiTest: Physical-Aware Object Insertion for Testing Multi-sensor Fusion Perception Systems
Xinyu Gao*, Zhijie Wang*, Yang Feng, Lei Ma, Zhenyu Chen, Baowen Xu (* equal contribution)
Accepted by the 46th International Conference on Software Engineering (ICSE ‘24).
 Paper     Code     Project   

2023

Common Corruption Robustness of Point Cloud Detectors: Benchmark and Enhancement
Shuangzhi Li, Zhijie Wang, Felix Juefei-Xu, Qing Guo, Xingyu Li, Lei Ma
IEEE Transactions on Multimedia.
 Paper     Code     Project   

Generation-Based Differential Fuzzing for Deep Learning Libraries
Jiawei Liu, Yuheng Huang, Zhijie Wang, Lei Ma, Chunrong Fang, Mingzheng Gu, Xufan Zhang, Zhenyu Chen
ACM Transactions on Software Engineering.
 Paper     Code     Project

Benchmarking Robustness of AI-enabled Multi-sensor Fusion Systems: Challenges and Opportunities
Xinyu Gao, Zhijie Wang, Yang Feng, Lei Ma, Zhenyu Chen, Baowen Xu
In Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ‘23). 871-882.   SIGSOFT Distinguished Paper Award
 Paper     Code     Project   

ArchRepair: Block-Level Architecture-Oriented Repairing for Deep Neural Networks
Hua Qi*, Zhijie Wang*, Qing Guo, Jianlang Chen, Felix Juefei-Xu, Fuyuan Zhang, Lei Ma, Jianjun Zhao (* equal contribution)
ACM Transactions on Software Engineering.
 Paper     Replication Package     Project

DeepSeer: Interactive RNN Explanation and Debugging via State Abstraction
Zhijie Wang, Yuheng Huang, Da Song, Lei Ma, Tianyi Zhang
In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ‘23). Article 740, 1–20.
 Paper     Code     Preview     Demo      Presentation

DeepLens: Interactive Out-of-distribution Data Detection in NLP Models
Da Song*, Zhijie Wang*, Yuheng Huang, Lei Ma, Tianyi Zhang (* equal contribution)
In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ‘23). Article 739, 1–17.
 Paper     Code     Preview      Demo      Presentation

2022

When Cyber-Physical Systems Meet AI: A Benchmark, an Evaluation, and a Way Forward
Jiayang Song, Deyun Lyu, Zhenya Zhang, Zhijie Wang, Tianyi Zhang, Lei Ma
In Proceedings of 2022 IEEE/ACM 44th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), pp. 343-352
 Paper     Code     Project


Selected Pre-prints

Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Models
Yuheng Huang, Jiayang Song, Zhijie Wang, Huaming Chen, Lei Ma
Pre-print

Is Model Attention Aligned with Human Attention? An Empirical Study on Large Language Models for Code Generation
Bonan Kou, Shengmai Chen, Zhijie Wang, Lei Ma, Tianyi Zhang
Pre-print

An Exploratory Study of AI System Risk Assessment from the Lens of Data Distribution and Uncertainty
Zhijie Wang, Yuheng Huang, Lei Ma, Haruki Yokoyama, Susumu Tokumoto, Kazuki Munakata
Pre-print

CarveNet: Carving Point-Block for Complex 3D Shape Completion
Qing Guo*, Zhijie Wang*, Felix Juefei-Xu, Di Lin, Lei Ma, Wei Feng, Yang Liu (* equal contribution)
Pre-print

Professional Services

Program Committee (PC) Members

ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2023) - Artifact Evaluation

Conference Reviewer

2024 ACM CHI Conference on Human Factors in Computing Systems (CHI 2024)

Thirty-ninth International Conference on Machine Learning (ICML 2022)

Thirty-sixth Conference on Neural Information Processing Systems - Datasets\&Benchmark (NeurIPS 2022)

The 37th IEEE/ACM International Conference on Automated Software Engineering (ASE 2022)

Journal Reviewer

IEEE Transactions on Reliability (2021~)

Volunteers

Student Volunteer, MODELS 2021

Teaching

@ University of Alberta (Lecture or Lab TA)

ECE 422 Reliable and Secure Systems Design (Winter 2023, 2024)

ECE 325 Object-Oriented Software Design (Fall 2021, 2022, 2023)

ECE 321 Software Requirements Engineering (Fall 2022, 2023)

ECE 720 Advanced Topics in Software Engineering and Intelligent Systems (Winter 2022, 2023, 2024)

ECE 380 Introduction to Communication Systems(Winter 2021).

@ University of Waterloo (Lecture TA)

ECE 203 Probability Theory and Statistics 1 (Spring 2020).

Talks

Invited Talk: Human-Centred Interactive Design for Data-Driven AI Software June 2023, Beihang University, Beijing

Invited Talk: Human-Centred Interactive Design for Data-Driven AI Software June 2023, Institute of Information Engineering, CAS, Beijing

ECE 720 Guest Lecture: Human-Centred Interactive Design for Data-Driven AI Software March 2023, University of Alberta, Edmonton, AB

Tutorial on AI Quality Assurance @ SEMLA2022 Oct 2023, Montreal, QC ( Material)

Tutorial on AI Quality Assurance @ ASE2022 Oct 2023, Michigan, USA (Remote, Material)

Industry

Joint Research Project @ Fujitsu Research, Tokyo (Remote) 2021-2022

Research Intern @ Megvii Research, Beijing 2018-2019

Misc.

When I’m not in the office, you can usually find me in a hockey rink (Go Bears Go! 🟢🟡 / Let’s go Oilers! 🟠🔵), in a concert, in a ski resort…

I love taking photos when traveling (an amateur photographer lol), you can find some of them here.

Acknowledgment

My research has been supported by

  • Alberta Machine Intelligence Institute (Amii)

  • Canadian Institute for Advanced Research (CIFAR)

  • Fujitsu Research