Scientific Test and Analysis Techniques (STAT) Center of Excellence (COE)

Mission

Provide independent advice and assistance to major defense acquisition programs to successfully apply scientific test and analysis techniques toward the development of test and evaluation strategies and plans and to increase the understanding and effective use of scientific test and analysis techniques in the Department of Defense’s acquisition community.

Special Tactics Airmen conduct close air support with F-35 Lightning II’s during Emerald Warrior at Hill Air Force Base, Utah, Jan. 27, 2020. Emerald Warrior 20-1 provides annual, realistic pre-deployment training encompassing multiple joint operating areas to prepare special operations forces, conventional force enablers, partner nations, and interagency elements to integrate with, and execute full spectrum special operations in an arctic climate, sharpening U.S. forces' abilities to operate around the globe. (U.S. Air Force photo by Tech. Sgt. Sandra Welch)
shutterstock_247925119_engineer_planning

Vision

The STAT COE is recognized as the premier technical test planning/engineering organization in the world with an emphasis on defense acquisition test planning and analysis.

About

DASD (DT&E), predecessor to D,DTE&A, in collaboration with the Commander, Air Education and Training Command, established the OSD STAT Center of Excellence (COE) in April 2012 under the stewardship of the Air Force Institute of Technology (AFIT). The COE attained Full Operational Capability in July 2012. See www.afit.edu for more information.

In addition to working with approximately 30 major defense acquisition programs, the COE’s recent work with the Ground Based Strategic Deterrent (GBSD) include STAT T&E injections to:

shutterstock_1682713573_planning
  • Model-based systems engineering through the GBSD requirements verification architectural model (RVAM) by defining STAT elements to track within the RVAM
  • TEMP inputs with respect to Bayesian reliability estimation, system decomposition of the major subsystems, and identification of subsystem testing useful to the Bayesian reliability estimation methodology
  • Right-sizing the flight test matrix—evaluating and communicating risk to the program office using statistical measures of merit
  • Educating the workforce on STAT and Design of Experiments (DOE) methods

Current Special Projects include:

  • Advancements in T&E of Autonomous Systems – developing DTE&A guidebook in collaboration with a wide-range of government agencies, identifying the novel T&E challenges, and capturing best practices
  • Scientific Test and Analysis Techniques (STAT) applied to Automated Test & Analysis (SAAS) to include the Software Acquisition Pathway –STAT injection to Agile software development and DevSecOps pipelines to improve T&E outcomes
  • Applying STAT to Digital Engineering (DE)—Development of model readiness levels (MRLs) to assist with the challenges to curating Programs’ authoritative sources of truth

Significant Impacts/Accolades

  • $120M in Test Cost saved across 62 programs (2012-2021)!
  • Navy Littoral Combat Ship: Called out as one of four best practices of 2018.
    • “Delivered a fully compliant test outcome, while simultaneously reducing the number of development test (DT) and operational test (OT) raid events. As a result, they avoided $16M in test costs, saved over 72 missiles and 25 surface targets… and achieved IOC… approximately 3 months earlier.” Assistant Secretary of the Navy for Research, Development, and Acquisition (HON James “Hondo” Geurts)
  • Army CIRCM: “The support you've provided… has been priceless.” –Kirklin Williams, T&E Branch Chief, Aircraft Survivability Equipment (ASE) PMO
  • Director, Operational Test and Evaluation: “Programs who engage with the STAT COE early have better structured test programs that will provide valuable information. The STAT COE has provided these programs with direct access to experts… which would otherwise have been unavailable.” 2016 Annual Report
  • Joint F-35 Onboard Oxygen Generation System (OBOGS) Estimated test and program cost savings of at least $1.5M. Strategy prevented fleet grounding, eliminated need for follow-on flight tests, provided two additional tests, and shortened test time
  • Ground Based Strategic Deterrent (GBSD) STAT infusion generated baseline case for risk in flight test; first of its kind inclusion of STAT requirements language in contracting documents to inform embedding STAT process into the upcoming Mission-Based Systems Engineering tools
USD(R&E)

DDR&E(AC)

Directorate of Defense Research and
Engineering for Advanced Capabilities
The Pentagon, Washington, DC 20301