DDR&E, Advanced Capabilities
DDR&E, Advanced Capabilities
Scientific Test & Analysis Techniques
Scientific Test and Analysis Techniques (STAT) Center of Excellence (COE)
Provide independent advice and assistance to major defense acquisition programs to successfully apply scientific test and analysis techniques toward the development of test and evaluation strategies and plans and to increase the understanding and effective use of scientific test and analysis techniques in the Department of Defense’s acquisition community.
DASD (DT&E), predecessor to D,DTE&A, in collaboration with the Commander, Air Education and Training Command, established the OSD STAT Center of Excellence (COE) in April 2012 under the stewardship of the Air Force Institute of Technology (AFIT). The COE attained Full Operational Capability in July 2012. See www.afit.edu for more information.
In addition to working with approximately 30 major defense acquisition programs, the COE’s recent work with the Ground Based Strategic Deterrent (GBSD) include STAT T&E injections to:
- Model-based systems engineering through the GBSD requirements verification architectural model (RVAM) by defining STAT elements to track within the RVAM
- TEMP inputs with respect to Bayesian reliability estimation, system decomposition of the major subsystems, and identification of subsystem testing useful to the Bayesian reliability estimation methodology
- Right-sizing the flight test matrix—evaluating and communicating risk to the program office using statistical measures of merit
- Educating the workforce on STAT and Design of Experiments (DOE) methods
Current Special Projects include:
- Advancements in T&E of Autonomous Systems – developing DTE&A guidebook in collaboration with a wide-range of government agencies, identifying the novel T&E challenges, and capturing best practices
- Scientific Test and Analysis Techniques (STAT) applied to Automated Test & Analysis (SAAS) to include the Software Acquisition Pathway –STAT injection to Agile software development and DevSecOps pipelines to improve T&E outcomes
- Applying STAT to Digital Engineering (DE)—Development of model readiness levels (MRLs) to assist with the challenges to curating Programs’ authoritative sources of truth
- $120M in Test Cost saved across 62 programs (2012-2021)!
- Navy Littoral Combat Ship: Called out as one of four best practices of 2018.
- “Delivered a fully compliant test outcome, while simultaneously reducing the number of development test (DT) and operational test (OT) raid events. As a result, they avoided $16M in test costs, saved over 72 missiles and 25 surface targets… and achieved IOC… approximately 3 months earlier.” Assistant Secretary of the Navy for Research, Development, and Acquisition (HON James “Hondo” Geurts)
- Army CIRCM: “The support you've provided… has been priceless.” –Kirklin Williams, T&E Branch Chief, Aircraft Survivability Equipment (ASE) PMO
- Director, Operational Test and Evaluation: “Programs who engage with the STAT COE early have better structured test programs that will provide valuable information. The STAT COE has provided these programs with direct access to experts… which would otherwise have been unavailable.” 2016 Annual Report
- Joint F-35 Onboard Oxygen Generation System (OBOGS) Estimated test and program cost savings of at least $1.5M. Strategy prevented fleet grounding, eliminated need for follow-on flight tests, provided two additional tests, and shortened test time
- Ground Based Strategic Deterrent (GBSD) STAT infusion generated baseline case for risk in flight test; first of its kind inclusion of STAT requirements language in contracting documents to inform embedding STAT process into the upcoming Mission-Based Systems Engineering tools