2025 FTC Short Courses

Short courses will be held on October 7, 2025. Attendees may registers for the conference and short courses together or separately. Conference attendance is not required to attend a short course.

Half Day

Jon Stallrich – A Practitioner’s Guide to Optimal Design

Mindy Hotchkiss – Practical Experimentation: Improving the Logistics of Experiment Management

HALF DAY COURSES

A Practitioner’s Guide to Optimal Design
8:00am to 12:00pm

Jon Stallrich, North Carolina State University

Abstract: What makes one experimental design better than another? In this short course, I will first introduce a general optimal design framework that answers this question by ranking designs according to a so-called “design criterion” that summarizes the amount of statistical information held by a design. Popular design criteria, such as the D- and A-criterion, that seek to minimize estimation variances will be discussed and compared. This comparison will spark a discussion on the importance of choosing an appropriate design criterion to match your analysis goals, leading to an introduction to more flexible variance-based criteria and criteria to minimize estimator bias. Computational search algorithms will be presented to help identify optimal (or nearly optimal) designs for a general criterion. R code will be provided that perform these search algorithms. Examples will focus on one factor studies, factorial experiments, and response surface designs. By the end of the course, participants will be experts in the general optimal design framework; be familiar with popular optimality criteria targeting the variance and bias of least-squares estimators; and be able to program design search algorithms to optimize a general criterion.

Target audience: Practitioners who often perform designed experiments and want to learn more about why some designs are superior to others.

Prerequisites: Familiar with regression, factorial analysis, and basic design of experiments. Familiar with the R programming language.

Contact: jwstalli@ncsu.edu

Joh Stallrich Jon Stallrich is an Associate Professor in the Department of Statistics at North Carolina State University. He earned his Ph.D. in Statistics from Virginia Tech in 2014. His research interests include design and analysis of screening experiments, computer experiments, online controlled experiments, functional data analysis, and variable selection. He has served in multiple leadership roles for the American Statistical Association, including member of the Committee for Applied Statisticians, Program Chair and Chair for SPES, and General Conference Chair for the 2024 Fall Technical Conference. In 2021, his co-authored paper won the ASA SPES Award recognizing excellence in partnerships among statisticians, scientists, and engineers across the many disciplines encompassed by the physical and engineering sciences.

Practical Experimentation: Improving the Logistics of Experiment Management
1:00pm to 5:00pm

Mindy Hotchkiss, Enquery Research

Abstract:  The process of creating statistically structured designed experiments, known as the Design of Experiments (DOE/DOX), is widely recognized as best practice for test planning. It is used in countless fields and industries to facilitate knowledge development and establish causality, which is foundational to repeatable research. DOE is a multipurpose tool that uses balance and structure to effectively characterize, improve, and optimize systems and processes. However, good test practices are critical for obtaining robust results that can be reproduced by other experimenters, enabling extension into further research.

The objective of experimentation is, in its simplest form, attempting to detect a signal clouded by some degree of noise (e.g. natural process variability). For example, the most common form is to establish if a change in factor X is inducing an effect in some response Y. Statistical analysis methods are used to quantitatively differentiate the signal from the noise. However, there are any number of logistical reasons that could contribute to why a particular signal could not be detected, such as poor factor level selection, suboptimal blocking, high measurement variability in independent and dependent variables, unstable test setup, improper data post-processing, etc.. To improve the clarity of experimental results, there are two options: one must either increase the signal, decrease the noise, or some combination of the two.

Since experiments rarely if ever have an opportunity to be redone, decisions made during the test planning process have the potential for enormous downstream consequences for the outcome of the entire experiment. It is critical that experimenters consider what could contribute to noise during the test planning process, in order to most effectively achieve the benefits of the investment made in planned testing. This course will discuss practical test strategies to both enhance the signal and reduce noise, as well as general experimental practices that can be utilized during the experimental design and test planning process, as well as implementation. The objective of this course is to provide a resource for practitioners, those implementing experiments, both as statisticians and other subject-matter experts involved in projects as part of cross-functional teams.

Target audience: Those involved in conducting designed experiments, including facilitation of experimental test planning processes and implementation, with an interest in improving experimental reproducibility.

Prerequisites: General familiarity with experimental design and statistical analysis methods.

Contact: mindy.hotchkiss@enqueryresearch.com

Mindy Hotchkiss is an independent consultant operating as Enquery Research LLC. She was Technical Specialist and enterprise-wide Subject Matter Expert in Statistics at Aerojet Rocketdyne, now an L3Harris Technologies company. She has over 25 years of experience as a statistical consultant between Pratt & Whitney and Aerojet Rocketdyne, supporting engineering, operations, and technology development across the enterprise, including hypersonics and additive manufacturing, and where she spent many years facilitating complex multi-phase experiments in a wide variety of different physical and virtual environments. She has BS degrees in Mathematics and Statistics and an MBA from the University of Florida, and a Masters of Statistics from North Carolina State University. She is an ASQ CRE, CQE, and CSSBB, and a Past Chair of the ASQ Statistics Division.