DARPA
AI Research & Innovation
The challenge our customer brought us.
The goal is to identify mechanisms of explaining black box deep machine learning algorithms to increase transparency, trust, and use by the government and public.
What we designed and delivered.
Evaluate explainable ML techniques in custom challenge problems that showcase trust and use.
Identify measures and metrics that showcase the effectiveness of explanation of black box models.
Identify challenge problems relevant to the 12 performer teams and measures/metrics of the XAI program
Generate, conduct, and manage multiple program-wide evaluations to collect results that compare the methods used by performer teams.
Write reports to DARPA keeping them apprised of the status, potential roadblocks, and noteworthy advances made by performer teams.
The difference it made.
Identification of key methods and mechanisms to ensure understandable and appropriately trusted black box models through experiments that contained 12,700 participants in user studies.
Successfully guided 11/12 of performer teams through evaluation to best understand AI explainability.
Creation of follow-on programs based on the work performed on the XAI program.
13
Other programs we’ve delivered.
Next Generation Threat System (NGTS) GPT
Learn More
1
Generative AI Logistics for Communication and Execution (GAILFORCE)
Learn More
2
Augmenting CILEMP to Enable Fleet Autonomy with Generative AI (CILEMP-FLAG)
Learn More
3
Goal Reasoning for Satellite Constellation Decision Making (GRANITE)
Learn More
4
Deep Reinforcement Learning
Learn More
5
AI-Powered Multi-Asset, Multi-Domain Operations Planning and Replanning Software (AMORE)
Learn More
6
Minefield Planning Evaluation and Gaming Suite
Learn More
7
Information Technology Services (LITeS) III
Learn More
8
Cyber Warning and Operations Center (CWOC) Research and Analysis
Learn More
9
Intelligence, Surveillance, and Reconnaissance Operations (ISRO)
Learn More
10
All Source Intelligence Cyberspace II
Learn More
11
Continuous Interactive Learners for Mission Planning (CILEMP)
Learn More
12
NIST Privacy Engineering Program
Learn More
14
U.S. Census Disclosure Avoidance System
Learn More
15
NAVAIR Next Generation Threat System (NGTS)
Learn More
16