Maestro: Multi-Level Attack and Defense Simulation Environment for Artificial Intelligence Education and Research


Summary

Artificial intelligence (AI) techniques, particularly machine learning (ML), are increasingly integrated into safety- and security-critical applications such as autonomous vehicles and malware detection. However, research has shown AI techniques can be vulnerable to cyber-attacks such as adversarial perturbation and data poisoning, potentially leading to catastrophic outcomes when decisions made by AI systems are manipulated.

This project aims to promote robust AI with synergistic efforts in AI, cybersecurity, and education. 1) A new platform named Maestro will be developed, which provides a unified environment to simulate and evaluate attacks and defenses on AI. 2) Maestro will be integrated into undergraduate and graduate courses at the University of California, Irvine and made publicly available to researchers and educators. 3) Maestro will be leveraged to conduct new research activities related to robust AI, such as on application domains that are currently underserved like malware detection.

People


  • Zhou Li. PI on this project, project leader and professor (UCI EECS).
  • Sergio Gago-Masague. Co-PI on this project, project leader and professor (UCI CS).
  • Sameer Singh. Co-PI on this project, project leader and professor (UCI CS).
  • Junlin Wang. Student Researcher (UCI CS).
  • Jiacen Xu. Student Researcher (UCI EECS).
  • Hamza Errahmouni Barkam. Student Researcher (UCI CS).
  • Margarita Geleta. Student Researcher (UCI CS).
  • Manikanta Loya. Student Researcher (UCI CS).
  • Ishana Patel. Student Researcher (UCI CS).

Project Timeline


Task Projected Year Status
Create and open a project web site. Year 1 done
Set up a GitHub repo for Maestro and release part of code. Year 1 done
Create the user interface of Maestro. Year 1 done
Implement the attacks against text data. Year 1 done
Implement the attacks against image data. Year 1 done
Implement the attacks against cyber-security applications. Year 1 done
Implement the defenses. Year 1 done
Create the course syllabus for a project-based course CS 175 at UCI. Year 2 done
Teach CS 175 at UCI. Year 2 done
Collect and evaluate students feedback of CS 175. Year 2 done
Attend SaTC PI meeting. Year 2 done
Submit papers about Maestro (platform, education, etc.). Year 2 ongoing
Update the Maestro repo with well-organized instructions. Year 3
Give tutorials/presentations at conferences/workshops. Year 3

Publications


Outreach


  • Course taught at UCI: CS 175 (Winter 2022 and Spring 2022)
  • Poster and highlight slides at SaTC PI meeting 2022.