Ethical Decision Making
TLDR: Enable autonomous systems to comply with ethical theories.
“Ethically Compliant Autonomous Systems under Partial Observability
Qingyuan Lu, Justin Svegliato, Samer Nashed, Shlomo Zilberstein, Stuart Russell
International Conference on Robotics and Automation (ICRA)”
“Ethically Compliant Planning within Moral Communities
Samer Nashed, Justin Svegliato, Shlomo Zilberstein
Conference on AI, Ethics, and Society (AIES)”
“Ethically Compliant Sequential Decision Making — Distinguished Paper Award
Justin Svegliato, Samer Nashed, Shlomo Zilberstein
AAAI Conference on Artificial Intelligence (AAAI)”
“An Integrated Approach to Moral Autonomous Systems
Justin Svegliato, Samer Nashed, Shlomo Zilberstein
European Conference on Artificial Intelligence (ECAI)”
Adversarial Robustness
TLDR: Safeguard LLMs against adversarial attacks.
“A StrongREJECT for Empty Jailbreaks
Alexandra Souly, Qingyuan Lu, Dillon Bowen, Tu Trinh, Elvis Hsieh, Sana Pandey, Pieter Abbeel, Justin Svegliato, Scott Emmons, Olivia Watkins, Sam Toyer
arXiv preprint arXiv:2402.10260”
“Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game — Spotlight Talk
Sam Toyer, Olivia Watkins, Ethan Mendes, Justin Svegliato, Luke Bailey, Tiffany Wang, Isaac Ong, Karim Elmaaroufi, Pieter Abbeel, Trevor Darrell, Alan Ritter, Stuart Russell
International Conference on Learning Representations (ICLR)”
State Abstractions
TLDR: Solve MDPs using partial state abstractions.
“Selecting the Partial State Abstractions of MDPs: A Metareasoning Approach with Deep RL
Samer Nashed*, Justin Svegliato*, Abhinav Bhatia, Shlomo Zilberstein, Stuart Russell
International Conference on Intelligent Robots and Systems (IROS)”
“Solving Markov Decision Processes with Partial State Abstractions
Samer Nashed*, Justin Svegliato*, Matteo Brucato, Connor Basich, Shlomo Zilberstein
International Conference on Robotics and Automation (ICRA)”
Exception Recovery
TLDR: Allow autonomous systems to recover from exceptions.
“Introspective Autonomous Vehicle Operational Management
Justin Svegliato, Kyle Wray, Stefan Witwicki, Shlomo Zilberstein
US Patent 10,649,453”
“Belief Space Metareasoning for Exception Recovery
Justin Svegliato, Kyle Wray, Stefan Witwicki, Joydeep Biswas, Shlomo Zilberstein
International Conference on Intelligent Robots and Systems (IROS)”
Optimal Stopping
TLDR: Optimize the stopping point of anytime planners.
“A Model‑Free Approach to Meta‑Level Control of Anytime Algorithms
Justin Svegliato, Prakhar Sharma, Shlomo Zilberstein
International Conference on Robotics and Automation (ICRA)”
“Meta‑Level Control of Anytime Algorithms with Online Performance Prediction
Justin Svegliato, Kyle Wray, Shlomo Zilberstein
International Joint Conference on Artificial Intelligence (IJCAI)”
Agent-Aware State Estimation
TLDR: Enable autonomous systems to discover their state by observing the behavior of other agents.
“Agent‑Aware State Estimation for Autonomous Vehicles
Shane Parr*, Ishan Khatri*, Justin Svegliato, Shlomo Zilberstein
International Conference on Intelligent Robots and Systems (IROS)”
Competence Awareness
TLDR: Allow autonomous systems to learn/improve their competence via human feedback.
“Competence‑Aware Systems
Connor Basich, Justin Svegliato, Kyle Wray, Stefan Witwicki, Joydeep Biswas, Shlomo Zilberstein
Artificial Intelligence Journal (AIJ)”
“Improving Competence via Iterative State Space Refinement
Connor Basich, Justin Svegliato, Allyson Beach, Kyle Wray, Stefan Witwicki, Shlomo Zilberstein
International Conference on Intelligent Robots and Systems (IROS)”
“Learning to Optimize Autonomy in Competence‑Aware Systems
Connor Basich, Justin Svegliato, Kyle Wray, Stefan Witwicki, Joydeep Biswas, Shlomo Zilberstein
International Conference on Autonomous Agents and Multiagent Systems (AAMAS)”
Safe Decision Making
TLDR: Enable autonomous systems to be more safe.
“Defining Deception in Decision Making
Marwa Abdulhai, Micah Carroll, Justin Svegliato, Anca Dragan, Sergey Levine
International Conference on Autonomous Agents and Multiagent Systems (AAMAS)
”
“Fairness and Sequential Decision Making: Limits, Lessons, and Opportunities
Samer Nashed, Justin Svegliato, Su Lin Blodgett
arXiv preprint arXiv:2301.05753”
“Metareasoning for Safe Decision Making in Autonomous Systems
Justin Svegliato, Connor Basich, Sandhya Saisubramanian, Shlomo Zilberstein
International Conference on Robotics and Automation (ICRA)”
Optimal Hyperparameter Tuning
TLDR: Optimize the hyperparameters of anytime planners.
“Tuning the Hyperparameters of Anytime Planning: A Metareasoning Approach with Deep RL
Abhinav Bhatia, Justin Svegliato, Samer Nashed, Shlomo Zilberstein
International Conference on Planning and Scheduling (ICAPS)”
“On the Benefits of Randomly Adjusting Anytime Weighted A*
Abhinav Bhatia, Justin Svegliato, Shlomo Zilberstein
Symposium on Combinatorial Search (SoCS)”
Agent Architectures
TLDR: Formally compose the architecture of agents.
“Formal Composition of Robotic Systems as Contract Programs
Mason Nakamura, Justin Svegliato, Samer Nashed, Shlomo Zilberstein, Stuart Russell
International Conference on Intelligent Robots and Systems (IROS)”
Active Teacher Selection
TLDR: Actively select teachers during RLHF.
“Active Teacher Selection for Reinforcement Learning from Human Feedback
Rachel Freedman, Justin Svegliato, Kyle Wray, Stuart Russell
arXiv preprint arXiv:2310.15288”