AFIT / STAT Center of Excellence / Publications

Publications

Category View

Artificial Intelligence (AI)
1	Fundamentals of Gradient Descent Gradient Descent,Machine Learning,Optimization Techniques,loss function,decision making in AI
2	Fundamentals of Backpropagation backpropagation,machine learning,AI,Neural Networks
3	Fundamentals of Backpropagation AI,Machine Learning,backpropagation
4	Cross Validation for Machine Learning Models machine learning,cross-validation,validation,modeling and simulation
Bayesian Capability
1	Bayesian Methods in Test and Evaluation: A Decision Maker's Perspective Credible Interval,Bayesian,Prior,Analysis,T&E Strategy
2	Bayesian Model Checking Bayesian,Prior,Model Checking,Box Criterion
3	Bayesian Reliability for Complex Systems Reliability,Credible Interval,Prior,Bayesian,Test Planning
4	Assessing if a System Meets a Requirement Using Bayesian Inference Bayesian,Probability,Factors
5	Case Study on Bayesian Analysis and Test Planning for Binary Reliability Evaluation bayesian,Test Planning,Binary,Reliablility
Data Analysis and Statistics
1	An Introduction to Mixture Designs Analysis,Design,JMP,Optimal,Space Filling Designs
2	Confidence Intervals for the Median and Other Percentiles Confidence Interval; Confidence; Analysis; Median; Percentile; JMP
3	Data-Driven Model Development M&S; VV&A; Validation; Training; Model Checking
4	Equivalence Testing Analysis; JMP; Hypothesis Testing; Equivalence Acceptance Criterion
5	Improving the Interpretability of Bayesian Priors Analysis; Bayesian; Prior; Monte Carlo
6	Interpreting Confidence Intervals Confidence Interval; Confidence; Sample Size; Analysis; Margin of Error
7	MATLAB and R Integration with JMP JMP,MATLAB,R,Regression Trees
8	Model Building Process Part 1: Checking Model Assumptions Version 1.1 Analysis; Linear Regression; Outliers; Variance; Independence; Normality
9	Model Building Process Part 2: Factor Assumptions Analysis; Linear Regression; Multicollinearity; Lack of Fit; Variance Inflation Factor
10	Model Building Process Part 3: Model Goodness Metrics linear regression,R2,adjusted R2,AIC,BIC,PRESS
11	Nonparametric Tolerance Intervals Best Practice Analysis; Tolerance Interval; Sample Size; Nonparametric Nonparametric Tolerance Interval Tool Analysis; Tolerance Interval; Sample Size; Nonparametric
12	Sampling from Arbitrary Distributions using the Rejection Method Analysis; Sampling; Bayesian; Monte Carlo; Acceptance Region
13	Scientific Test and Analysis Techniques in Technology Readiness Assessment Analysis; TRA; Test Planning; System Decomposition; Test Objectives; STAT Candidates
14	Statistical Hypothesis Testing Analysis; Hypothesis Testing; Sample Size; Risk; Significance Level; P-value
15	Statistics Reference Series Part 1: Descriptive Statistics Analysis; Descriptive Statistics; Graphical Summary; Numerical Summary
16	Statistics Reference Series Part 2: Probability Analysis; Probability; Continuous; Discrete; Probability Distribution
17	Statistics Reference Document Series Part 3: Inferential Statistics Estimation,Statistical Intervals,Hypothesis Testing,Linear Regression,Inferential Statistics
18	Tolerance Intervals Demystified Analysis; Tolerance Interval; Sample Size; Requirements; Normality
19	Uncertainty Quantification: An Overview Uncertainty Quantification; M&S; Emerging Technologies; Machine Learning; Bayesian; Monte Carlo; Design
20	Understanding Analysis of Variance Design; Analysis; ANOVA; Hypothesis Testing; JMP
21	Using Regression Trees Analysis; M&S; JMP; Prediction; Regression Trees
22	Using Statistical Intervals to Assess System Performance Analysis; Confidence; Design; Linear Regression; Prediction Interval; Tolerance Interval; Confidence Interval
23	Parametric Survivability Analysis Case Study parametric survivability,censored data
24	Case Study: Effects of Incomplete Randomization and Test Dependence in Flight Helmet Testing Randomization,Test Dependence,T&E Strategy,Independence
25	Interactive Inferential Statistics Flowchart Confidence Interval,Test design,measures,T&E strategy
26	Art of Stat Web Apps [artofstat.com/web-apps] Tool,Website
27	Test Science Interactive Tools [testscience.org/interactive-tools/] Tool,Website
28	Reliability Analytics Toolkit [https://reliabilityanalyticstoolkit.appspot.com/] Tool,Website
29	Top N Pareto Front Search Add-In (Ver. 1) Guide Pareto front,Define-Measure-Reduce-Combine-Select,reliability,decision-making,multiple criteria
30	Comprehensive Data Analysis for Decision Quality Information Analysis,Test Planning
31	Female Body Armor: Planning for Survey Success Survey,Sampling,Analysis
Emerging Technologies
1	Best Practice for Effective Requirements and Measures for Autonomous Defense Systems Autonomy,Measures,Requirements
Homeland Security Community of Best Practices (HS COBP)
1	Benefits, Best Practices, & Risks of Using Cloud Technologies Cloud,Software,Risk,T&E Strategy
2	Designing a Test for Prediction relative prediction variance,margin of error,fraction of design space,JMP
3	Logistic and Probit Regression Computational Algorithms logistic regression,maximum likelihood,Newton-Raphson
4	Recommended Confidence Intervals for a Binomial Proportion Binary Response; Confidence Interval; Bayesian; Proportion
Modeling and Simulation
1	Constructing a Metric for Fidelity in Model Validation M&S; Validation; VV&A; Fidelity; Digital Engineering
2	Elements of a Mathematical Framework for Model Validation Levels Digital Engineering; M&S; Validation; Fidelity; Referent Authority; Scope
3	Model Based Systems Engineering for Developmental System Verification and Validation M&S,Digital Engineering,Validation,VV&A,MBSE,Systems Engineering
4	Model Selection and Use of Empiricism in Digital Engineering M&S; Digital Engineering; Digital Thread
5	STAT COE MRL White Paper: A Conceptual Framework for the Establishment of Model Readiness Levels M&S; Digitial Engineering; VV&A; Fidelity; Validation; Scope; Referent Authority
6	Model Validation Levels: Methods and Implementation Model valiation levels,validation,modeling and simulation,digital engineering,fidelity,test an evaluation
7	Case Studies on Model Validation Levels model validation levels,validation,modeling an simulation,test and evaluation
8	Evolutionary Design and Machine Learning for Modeling and Simulation Sampling,Artificial Intelligence,Design
9	Machine Learning Model Monitoring Machine Learning,Model Retaining,model monitoring,drift
10	Model Validation Levels: Methods and Implementation v2 model validation levels,validation,modeling and simulation,digital engineering,fidelity,test and evaluation
11	Applying Model Validation Levels within Modeling and Simulation as a Service for Continuous Test and Evaluation of Complex System of Systems model validation levels,modeling and simulation
12	MVL User Guide v4 Model Validation Levels,MVL
Planning
1	Polar Plot Graph Builder Guide JMP,Exploratory Data Analysis,Polar Plot Polar Plot Test Design- Add-In JMP,Exploratory Data Analysis,Polar Plot
2	System Decomposition Worksheet System Decomposition,Test Objectives,Requirements
3	STAT Planning Worksheet Reponses,Factors,Constraints and Limitations
4	Test Planning Worksheet Test Objectives,Responses,Sequential Test,Strategy,Power,Confidence,Signal,Design
5	Categorical Data in a Designed Experiment: Sizing Calculator Calculator,Categorical,Sizing,Design of Experiments
6	A Method to Quantify STAT Impact in DoD Test Design-Calculator STAT,Quantify,Calculator,Tool
7	Test Design Comparison and Selection Tables Test Design,Tool,T&E Strategy
8	Shiny App Binary Test Tools [https://stat-coe.shinyapps.io/BinaryTestTools/] Website,Shiny,Binary
9	Developing Unmanned Tests of Aircraft Life Support Systems Test Planning,Analysis,Air Force
Reliability
1	Availability Confidence Intervals from Bootstrap Sampling Reliability,Availability,Bootstrap,Monte Carlo,Confidence
2	Impact of Test Time on Estimation of Mean Time Between Failure Reliability; Confidence Interval; Confidence
3	Practical Bayesian Analysis for Failure Time Data Reliability; Bayesian; Prior; MATLAB; Sample Size MTBF Bayes Exponential Gamma Post Analysis Censor V3.1 Reliability; Bayesian; Prior; MATLAB; Sample Size MTBF Bayes Exponential Gamma Posterior Analysis V2.2 Reliability; Bayesian; Prior; MATLAB; Sample Size
4	Reliability Test Planning for Mean Time Between Failures Reliability; Confidence; Power; Hypothesis Testing Reliability Test Plans for Binary Responses: Excel Tool Guide Reliability; Confidence; Power; Hypothesis Testing Reliability Test Planning Tool Proportion or MTBF Reliability; Confidence; Power; Hypothesis Testing Reliability Test Planning Utility Guide test and evaluation,reliability planning,risk assessment STAT COE Reliability Test Planning Tool App test and evaluation,reliability planning,risk assessment
Software Testing
1	Applying STAT within the DevSecOps Lifecycle Software,Agile,DevSecOps,Reliability,Automated Testing,Confidence Interval
2	Automated Software Test Implementation Guide for Managers and Practitioners Software,Automated Testing,Risk,Analysis,Design,T&E Strategy,Information Technology,Measures,Requirements,Test Objectives
3	Automated Software Testing Practices and Pitfalls Software,Automated Testing,VV&A,Test Objectives,Test Planning
4	Combinatorial Test Designs Software; Combinatorics; ACTS; Interactions
5	Software Reliability Fundamentals Software; Reliability; Information Technology; FRACAS; Agile
6	STAT for Software Testing Software; Design; Combinatorics; Covering Arrays; Measures; Interactions; Risk
Test and Evaluation Strategy
1	Applying STAT to Defense Business Systems Software,Design,Combinatorics,Information Technology,Defense Business Systems
2	Assessing Rigor in Test Plans Scientific Test and Analysis Techniques,Rigorous Testing,Assessment
3	Calculating a Consensus of Opinion Subject Matter Expert; Consensus; Ratio-Scale Matrix; Multi-criteria Decision; Factor Reduction; T&E Strategy
4	Critical STAT Questions DOD Leadership Should Ask T&E Strategy; Critical Questions; Test Planning; Test Readiness Review
5	Effective Requirements and Measure for Autonomous Defense Systems Autonomy; Measures; Requirements
6	Evaluating Delivered Test Plans For STAT Content T&E Strategy; Test Planning
7	Implementing Rigor in Test Plans TEMP; T&E Strategy; System Decomposition; Factors; STAT Candidates
8	Quantifying STAT Impact in DoD Test Design Design; T&E Strategy; Quantification; Return on Investment; Monetize
9	Specifying STAT Requirements In Defense Contracts T&E Strategy; Contractor Testing; Design; Analysis; Requirements
10	Survey of AI-Enabled Tools for Application in Test & Evaluation Artificial Intelligence; Autonomy; Emerging Technology
11	Testing via Sequential Experiments T&E Strategy; Sequential Test; Design; Test Phases; Factor Reduction; Response Surface
12	Understanding Requirements for Effective Test Planning T&E Strategy; Test Planning; Requirements
13	Workshop Report: 2015 Advancement in Test and Evaluation of Autonomous Systems T&E Strategy,Autonomy,Requirements,Measures,Design
14	Workshop Report: 2019 Advancements in Test and Evaluation of Autonomous Systems T&E Strategy,Autonomy,Requirements,Measures,Design
15	Workshop Report: 2022 Advancements in Test and Evaluation of Autonomous Systems T&E Strategy,Autonomy,Requirements,Measures,Design
16	Radar Detection Performance using Design of Experiments - Case Study Experimental Design,Fractional Factorial,Statistical Analysis
17	Designed Experiments in a Heavily Constrained Operational Space Optimal Designs,Constraints,Design of Experiments,Prediction Variance
18	Split Plot Design of Experiments-Mortar Vehicle Ballistic Similitude Case Study mortar vehicle,factor comparison,screening design,sequential design,hard to change
19	On the Construction of a Standard Scale for Model Validation Referent Authority Referent Authority,Validation,Digital Engineering,Trust
20	Building Bridges, A Case Study: Assisting a Program from the Outside STAT Candidates,Strategy,T&E Strategy
21	FAMUS Case Study Design,Air Force,T&E Strategy,Test Objectives,System Decomposition
22	Continuous Machine Learning for Test and Evaluation machine learning,test and evaluation,modeling and simulation,validation
Test Design
1	Binary Response and Single Stress Factor Test Methods Sequential Test; Logistic Regression; Three Phase Optimal Design; Sensitivity Testing; Ballistic Resistance; Design
2	Categorical Data in a Designed Experiment Part 1: Avoiding Categorical Data Design; Binary Response; Sample Size; Categorical Data; Confidence; Power
3	Categorical Data in a Designed Experiment Part 2: Sizing a design with a Binary Response Design; Binary Response; Categorical Data; Sample Size; Power; Confidence
4	Categorical Data in a Designed Experiment Part 3: Logistic Regression Design; Generalized Linear Model; Logistic Regression; Linear Regression; Binary Response; Categorical Factors
5	Categorical Data in a Designed Experiment Part 4: Estimating Power of Test Designs for a Binary Response Design; Power; Monte Carlo; Binary Response; Categorical Data
6	Classical Designs: Fractional Factorial Designs Design; Factor Reduction; JMP; Fractional Factorial; Interactions
7	Classical Designs: Full Factorial Designs Design; Randomization; Blocking; JMP; Interactions
8	Computer Experiments: Space Filling Design and Gaussian Process Modeling Design; Space Filling Design; Computer Simulations; Deterministic Response; Sample Size
9	Controlling Conditions is Key for Meaningful Operational Test Results Design; Factors; Constraints and Limitations; Operational Test
10	Developing Effective Test Objectives Design; Test Planning; Test Objectives; Sequential Test
11	Iterative Developmental Testing Considerations Design; Sequential Test; Linear Regression; Factor Reduction; Augmentation
12	Quantifying Test Risk Using Design of Experiments Risk; Design; Quantification; Power; Test Planning
13	Randomization: A Core Principle of DOE Randomization; Design; Split Plot; Constraints and Limitations; Factors; Power
14	STAT Planning Tool Guide Design; TEMP; Test Planning; Test Objectives; Factors; Responses; Constraints and Limitations
15	STAT Planning Tool - Application Design; TEMP; Test Planning; Test Objectives; Factors; Responses; Constraints and Limitations
16	Study Guide to Design of Experiments Learning Series by J. Stuart Hunter, Lessons 10-15 Design; Hypothesis Testing; Analysis
17	Study Guide to Design of Experiments Learning Series by J. Stuart Hunter, Lessons 1-9 Design; ANOVA; Randomization; Blocking
18	Survey & Questionnaire Design Survey; Bias; Sampling; Design; Likert Scale; Factor Analysis; Principal Component Analysis; Cluster Analysis
19	Test Design Comparison and Selection Design; Factors; Power; Test Planning
20	Test Facility DOE Survey Randomization,replication,blocking,sequential testing,execution
21	Understanding the Signal to Noise Ratio in Design of Experiments Design; Power; Signal; Noise; Variance
22	Using OC Curves to Balance Cost and Risk Design; Operating Characteristic Curves; Acceptance Testing; Sampling Plan
23	The Test Design for Ship Defense Against a Small Boat Threat Small Boat Threat,Mission Decomposition,Design of Experiments
24	Lessons Learned from an Incompletely Randomized Test Design Design; Randomization; Analysis; Factors; Constraints and Limitations
25	B-52 Case Study DOE,planning,design,execution,analysis,significant effect
26	Test design strategy for DCGSN Website Teaser Navy; T&E Strategy; Design; System Decomposition; Requirements
27	Test design strategy for MGUE IST T&E Strategy; Design; System Decomposition; Requirements
28	Case Study SBIRS Block 20 T&E Strategy; Design; System Decomposition; Requirements; SBIRS
29	Shiny App Availability Tool [https://kolsti-dev-apps.shinyapps.io/Availability_Conf_Interval_Tool/] Availability,Shiny,Tool
30	Practical Design of Experiments Considerations for Iterative Developmental Testing Sequential Test,Regression Trees
31	Sizing Test Designs with Binary Versus Continuous Responses: Improving the Major League Baseball Playoffs Binary Response,Modeling and Simulation,M&S,Factors
32	Assessment of Radar Detection Performance using Design of Experiments Design,Risk,Analysis
33	Developing Test Designs with Constrained Factors for Military Fast Jet Life Support Systems Air Force,Design,Optimal,Constraints,Limitations

About AFIT

Graduate Education

Continuing Education

Featured Topics

Research

Consulting

Students

Alumni

Search

Resources

Publications

Category View