Program Drift before the Dashboard Moved

Abstract

Program Drift Theory proposes that complex Defence acquisition programs accumulate identifiable systemic conditions, captured by Systemic Early Warning Indicators (SEWIs), before those conditions produce the cost growth, schedule slippage, and capability failures that appear in formal performance metrics. This paper tests that proposition retrospectively against AIR5431 Phase 3, the Civil Military Air Traffic Management System (CMATS), using the longitudinal evidence base of the Australian National Audit Office’s Major Projects Report series from 2014-15 to 2024-25.

CMATS is the most extensively documented case of Defence acquisition underperformance in the ANAO’s MPR history, accounting for 93 months, 23 per cent, of the 404 months of cumulative schedule slippage across 21 programs documented in the 2024-25 report. The longitudinal PDSS record enables year-by-year mapping of governance and delivery conditions against PIM’s three primary SEWI indicators: the Rework-to-Generation Ratio proxy (RGR), the Resource Churn and Dilution Rate proxy (RCDR), and the Risk Interconnectedness Index proxy (RII).

The analysis finds that conditions consistent with all three SEWI indicators were present and explicitly documented in ANAO narrative findings from as early as 2017-18, five to seven years before the largest period of schedule escalation materialised in formal reporting. Governance effectiveness degradation (consistent with RGR precursor conditions) was documented from 2017. Risk coupling and interdependency management failures (consistent with RII conditions) were documented continuously from 2018. Resource and contractor capability dilution (consistent with RCDR conditions) appeared in successive PDSSs from 2019 onwards.

The findings are consistent with Program Drift Theory’s central prediction: that systemic conditions consistently present before measured deterioration are observable through leading indicators substantially before they produce the quantitative performance consequences that conventional project controls detect. This paper is intended as the empirical foundation for Research Paper 3 of the Program Drift Theory doctoral series, and as a credibility anchor for the Program Integrity Method’s predictive claims.

Keywords: Program Drift Theory, CMATS, AIR5431, ANAO Major Projects Report, systemic early warning indicators, Defence acquisition governance, predictive systems assurance, program integrity

1. Introduction

Program Drift Theory proposes that the most significant determinants of Defence acquisition program outcomes are not the visible delivery events that governance frameworks typically track, milestone achievements, cost variances, risk register status, but the systemic governance and delivery conditions that accumulate beneath the surface of formal reporting before they produce measurable consequences [1]. The theory identifies three primary Systemic Early Warning Indicators (SEWIs) that provide advance visibility of these conditions: the Rework-to-Generation Ratio (RGR), which detects the rework accumulation loop; the Resource Churn and Dilution Rate (RCDR), which detects the resource dilution loop; and the Risk Interconnectedness Index (RII), which detects progressive systemic risk coupling [2].

The central claim of Program Drift Theory, that these conditions are consistently present before programs experience measurable cost, schedule, or capability deterioration, is a theoretical proposition grounded in systems dynamics research [3, 4] and socio-technical failure theory [5, 6]. Until validated against empirical program data, it remains a plausible but unconfirmed theoretical claim. This paper addresses that gap through retrospective analysis of the most extensively documented case of major Defence acquisition underperformance in Australia’s public record.

AIR5431 Phase 3, the Civil Military Air Traffic Management System (CMATS), was approved at Second Pass in December 2014 with an original FOC date of December 2019 [7]. As at the 2024-25 Major Projects Report, CMATS had accumulated 93 months of schedule slippage, 23 per cent of the total 404 months across 21 programs, and remained a Project of Concern [8]. The ANAO has produced detailed Project Data Summary Sheets (PDSSs) for CMATS across eight MPR editions, creating a longitudinal evidence record that enables systematic retrospective analysis.

This paper maps the ANAO’s published narrative findings about CMATS’s governance and delivery conditions, year by year, against PIM’s three SEWI indicators. The mapping uses the ANAO’s own language, not retrospective reinterpretation, to identify whether SEWI-consistent conditions were present and documented before the schedule slippage escalated.

This paper makes a deliberately qualified claim. It does not assert that PIM would have predicted CMATS’s specific outcomes had it been applied prospectively. It asserts something more limited and more important: that the conditions PIM is designed to detect were visible in the public record, years in advance of the largest measured deterioration, in the primary independent oversight report of the program. This constitutes evidence that leading indicators of the type proposed by Program Drift Theory are observable, and therefore governable, before they produce the consequences that conventional project controls identify.

2. Methodology

2.1 Evidence Base and Sources

The analysis draws exclusively on publicly available ANAO documents. No classified or commercially sensitive information has been accessed or used. The primary sources are:

• ANAO Major Projects Report PDSSs for AIR5431 Phase 3 (CMATS): Annual Project Data Summary Sheets published in the MPR series from 2017-18 to 2024-25, covering eight reporting years.
• ANAO Performance Audit, Defence’s Management of its Projects of Concern (2019): The ANAO’s specific performance audit examining governance arrangements for Projects of Concern, including detailed case study analysis of CMATS.
• ANAO Performance Audit, Management of the OneSKY Contract (2025): The ANAO’s dedicated performance audit of Airservices’ management of the CMATS contract, providing detailed findings on governance structure and contractor performance.
• ANAO Major Projects Reports, aggregate analysis sections (2017-2025): The ANAO’s cross-program narrative findings identifying patterns of governance and delivery conditions, within which CMATS is specifically named in multiple successive reports.

2.2 Analytical Approach

The analysis proceeds in three stages. First, a program timeline is constructed from the ANAO evidence, identifying the key governance events, formal performance deterioration points, and escalation decisions. Second, ANAO narrative findings from each MPR year are coded against three SEWI proxy indicators. Third, the temporal relationship between SEWI proxy condition appearance and formal performance deterioration measurement is assessed.

Because this is a retrospective analysis using public documents rather than direct program data, the SEWI indicators are assessed through proxy conditions, observable descriptions in ANAO narrative findings that are consistent with the structural conditions the SEWIs are designed to measure. The mapping is conservative: conditions are coded as SEWI-consistent only where the ANAO’s own language directly describes the structural condition, not where it can be inferred.

The three SEWI proxy conditions assessed are: (RGR proxy) evidence of rework accumulation, technical debt, deferred resolution, or PDR/CDR maturity failures; (RCDR proxy) evidence of resource dilution, contractor capability gaps, or expert reallocation under pressure; (RII proxy) evidence of unmanaged risk interdependencies, governance structure fragmentation, or cascade risk between program elements.

2.3 Limitations

This analysis has four significant limitations that must be acknowledged. First, it is retrospective, it assesses whether SEWI-consistent conditions were present, not whether a prospective SEWI assessment would have detected them in real time. Second, it relies on public ANAO documentation, which may not capture the full range of governance conditions visible to program participants. Third, CMATS is a single case with specific characteristics, particularly its novel dual-agency governance structure, that may limit generalisability. Fourth, the researcher (CL) has prior involvement in Defence acquisition programs, which may introduce interpretive bias notwithstanding the effort to use ANAO language rather than retrospective inference.

Notwithstanding these limitations, the analysis is valid for its stated purpose: demonstrating that conditions consistent with Program Drift Theory’s SEWI framework were present in the independent public record before the largest measured performance deterioration, using evidence that was available to governance bodies at the time.

3. CMATS Program Profile

3.1 Program Overview

AIR5431 Phase 3 (CMATS) is a Defence acquisition program designed to deliver a harmonised civil-military air traffic management system as part of the broader OneSKY Australia initiative. CMATS will replace the Australian Defence Air Traffic System (ADATS) at 12 ADF fixed base locations and provide a simulator system for the new air traffic management capability [9].

The program’s governance structure is structurally unusual and analytically significant: it is a joint program between the Department of Defence and Airservices Australia, with Thales Australia as the prime systems integrator under contract to Airservices, and a separate On-Supply Agreement between Airservices and Defence for the on-supply of the Defence-specific components. As the ANAO documented from 2018 onwards, this dual-agency governance structure, with no precedent in Australian Defence acquisition, created structural complexity that affected every dimension of program governance throughout the program lifecycle [10].

3.2 Program Timeline, Key Events

• 2011: First Pass approval. Joint solicitation issued with Airservices.
• December 2014: Second Pass approval. Original FOC: December 2019. Budget: AUD 730.7 million (Defence share).
• August 2017: First Project of Concern listing. Reason: inability to finalise contract negotiations within acceptable cost and schedule parameters.
• February 2018: Real Cost Increase of AUD 243M approved. Contract signed.
• May 2018: Removed from Projects of Concern. Managed as Project of Interest.
• December 2019: PDR exited with maturity-based approach. Ongoing technical debt noted.
• August 2021: Defence escalates concerns to ministerial level.
• September 2021: Minister for Defence directed return to Projects of Concern list.
• October 2022: Minister for Defence Industry formally re-declares Project of Concern due to “significant schedule, technical and cost challenges.”
• July 2023: Standstill deed executed. Delivery paused while revised strategy negotiated.
• December 2023: Settlement deed executed. Revised delivery strategy agreed.
• 2024-25 MPR: 93 months of total schedule slippage documented. IAR conducted.

3.3 The Central Analytical Question

The conditions that produced CMATS’s 93 months of schedule slippage did not materialise suddenly in October 2022. They developed over a multi-year period. The question this analysis addresses is: were those conditions visible in the public governance record, consistent with Program Drift Theory’s SEWI indicators, before they produced the formal performance deterioration that triggered governance escalation?

4. SEWI Retrospective Mapping

4.1 Evidence Table, Year-by-Year Analysis

Table 1 presents the year-by-year mapping of ANAO narrative findings against the three SEWI proxy indicators across eight MPR editions. Column definitions: Year = MPR reporting year; ANAO Findings = direct quotation or close paraphrase of ANAO language; SEWI Proxy Active = which SEWI proxy conditions are assessed as present based on the ANAO findings; Slippage = cumulative or in-year schedule slippage as reported.

Table 1. Year-by-year SEWI proxy mapping against ANAO MPR evidence, AIR5431 Phase 3 CMATS

5. Analysis

5.1 SEWI Lead Times, What the Evidence Shows

The mapping in Table 1 demonstrates a clear and consistent pattern. All three SEWI proxy conditions were present and explicitly documented in ANAO findings from the 2017-18 reporting year, approximately five years before the formal re-declaration as a Project of Concern in October 2022 that triggered the most significant governance escalation. The specific findings are:

Rework-to-Generation Ratio (RGR), first documented: 2017-18, escalated: 2019-20

The most direct evidence for the RGR proxy condition is the 2019-20 PDSS documentation of PDR exit through a “maturity-based approach” with acknowledged “ongoing technical debt.” This is the precise structural condition that Program Drift Theory identifies as the RGR precursor: work completed to schedule compliance criteria rather than technical maturity standards, generating obligations that must be resolved in subsequent phases. The ANAO’s documentation of this condition in 2019-20, and the immediately consequent CDR delay, provides a direct observable instance of the rework accumulation loop operating three years before the formal Project of Concern re-declaration.

The 2022-23 finding that “contract management planning, performance management and probity have limited effectiveness in managing the contract to minimise cost increases and schedule delays” is the downstream consequence of that rework accumulation, confirmed by the ANAO’s own language rather than retrospective inference.

Resource Churn and Dilution Rate (RCDR), first documented: 2017-18, continuous

The RCDR proxy condition, evidence of resource composition inadequacy, contractor capability dilution, and reallocation of scarce expertise under delivery pressure, is documented in every PDSS from 2017-18 onwards. The recurring ANAO finding that risks include “resource composition required to deliver concurrent priorities” and “contractor performance covering engineering approaches, Human Factors, baseline management and quality assurance” identifies precisely the resource dilution dynamic that Program Drift Theory’s B1 loop describes.

Particularly significant is the 2021-22 finding that the Defence component of CMATS was “declared a Project of Concern outside of the formal governance forums.” This indicates that the governance escalation mechanism itself had failed, consistent with the RCDR loop’s prediction that reactive crisis management eventually overwhelms the proactive governance capacity required for normal escalation to function.

Risk Interconnectedness Index (RII), first documented: 2018-19, continuous

The RII proxy condition is the most clearly and repeatedly documented of the three. The ANAO’s 2018-19 finding that risk processes did not “completely capture interdependencies between contract management and program risks” is a precise description of the structural condition the RII is designed to measure. This finding recurred in substantively identical language in the 2022-23 reporting year, four years later, indicating that the risk coupling condition was neither resolved nor deteriorating further but was structurally embedded in the program governance arrangement.

The dual-agency governance structure (Defence/Airservices) with separate risk management frameworks is itself a systemic risk coupling condition. The ANAO documented from 2017-18 that “no history of a similar governance structure” existed. This is not merely an observation about novelty, it is a description of a governance architecture without the coupling management mechanisms required to prevent cascade failure across the two organisations’ risk landscapes.

5.2 The Critical Lead Time Finding

The most significant finding from this analysis concerns the temporal relationship between SEWI proxy condition documentation and formal performance measurement. Table 2 summarises the lead times identified:

Table 2. SEWI proxy lead times relative to formal governance escalation events, AIR5431 Phase 3

The lead times in Table 2 range from approximately one year (governance forum failure relative to formal POC re-declaration) to approximately five years (dual governance coupling and cost growth relative to the same escalation point). The median lead time across the six conditions mapped is approximately four years.

This finding is significant for two reasons. First, it is substantially longer than the lead times that conventional project controls, which operate on reporting cycles of weeks to months, are designed to detect. Second, the conditions were documented not through specialised assessment but through the ANAO’s standard PDSS process, which accessed program-reported information rather than conducting independent systemic assessment. This suggests that even richer lead times might be available through the kind of direct workforce engagement and independent systemic health assessment that PIM’s Program Drift Diagnostic involves.

5.3 The Governance Culture Dimension

One finding from the ANAO record deserves specific attention because it speaks directly to Program Drift Theory’s prediction about governance culture degradation as a leading condition. The ANAO’s 2021-22 finding that the Defence component of CMATS was “declared a Project of Concern outside of the formal governance forums” is a precise empirical instance of the governance forum culture shift that PIM’s Governance Effectiveness domain and the R2 (Governance Erosion) loop predict [2].

When a program’s governance escalation mechanism, the formal channel through which significant concerns are surfaced to decision-making bodies, has been sufficiently degraded that a ministerial-level escalation occurs outside that channel, it confirms that the governance forum culture has ceased to function as an effective early warning conduit. This condition, documented in 2021-22, was itself a consequence of governance culture degradation that the ANAO’s earlier PDSSs had been documenting since 2017-18. The specific mechanism, separate risk management frameworks between Defence and Airservices, no shared escalation protocol, no precedent governance structure, created the conditions in which formal governance could not surface what was developing.

5.4 What This Means for the Predictive Claim

Program Drift Theory does not claim to predict program outcomes. It claims that the systemic conditions consistently present before measured deterioration are observable before that deterioration occurs, and that identifying and acting on those conditions is the governance objective. This analysis supports that claim for the CMATS case across all three SEWI indicators, with lead times measured in years rather than months.

The more important governance implication is this: the conditions documented in Table 1 were in the ANAO’s public record, available to governance bodies, for years before the formal escalation decisions that eventually triggered remediation. The information was present. The governance response was delayed. This is precisely the pattern that Program Drift Theory’s Rework Accumulation Loop and normalisation of deviance mechanism predict, not deliberate inaction, but the progressive calibration of governance response to managed narrative rather than to the structural conditions the narrative was obscuring.

6. Discussion

6.1 Implications for Program Drift Theory

This analysis provides empirical support for three of Program Drift Theory’s core theoretical predictions. The RGR evidence, particularly the PDR technical debt documentation and its direct causal connection to CDR delay, is consistent with Ford and Sterman’s [3] demonstration that rework concealment in concurrent development environments creates systematic gaps between reported and actual project condition. The CMATS case shows this dynamic operating over a multi-year period in a live Defence acquisition program with formal ANAO oversight.

The RII evidence, the persistent documentation of risk interdependency management failures across eight consecutive PDSS editions, is consistent with Perrow’s [16] prediction that tightly coupled, interactively complex systems generate unexpected interactions that cannot be fully controlled through conventional risk management. CMATS’s dual-agency governance structure is precisely the kind of tight coupling that Normal Accident Theory predicts will generate the interdependency failures the ANAO documented.

The governance culture evidence, particularly the 2021-22 extra-forum escalation, is consistent with Vaughan’s [5] normalisation of deviance mechanism and Dekker’s [6] drift into failure framework. The governance culture condition was not sudden; it was the terminal manifestation of a progressive drift in governance forum effectiveness that the PDSS record shows developing from 2017.

6.2 Implications for PIM Practice

For practitioners applying PIM’s Program Drift Diagnostic, the CMATS case provides three specific guidance points. First, the novel governance structure, dual-agency, no precedent, separate risk management, should have been the highest-priority integrity concern from program initiation, not a background risk to be managed. The RII would have flagged this as a structural vulnerability from 2014. Second, the PDR “maturity-based approach” exit, a schedule-compliance exit with known technical debt, is a direct and specific RGR trigger. Any program that exits a major design review with formally acknowledged deferred technical obligations has activated the rework accumulation loop. Third, the recurring documentation of resource composition risk across eight consecutive PDSSs, without evidence of structural resolution, is a RCDR condition that a systematic SEWI monitoring framework would have treated as escalating rather than static.

6.3 The Broader MPR Pattern

CMATS is the most extensively documented single case, but it is not an outlier in the structural conditions it exhibits. The ANAO’s cross-program analyses in successive MPRs consistently identify that programs with developmental content experience the most significant delays, that ACAT I programs carry higher technical risk, and that governance forum effectiveness, risk management discipline, and technical authority are recurring themes in program underperformance. The 404 months of cumulative slippage across 21 programs in the 2024-25 MPR, and the 1,363 months accumulated by the 34 programs that have exited the MPR, suggest that the conditions documented in the CMATS case are not program-specific phenomena but structural features of Defence acquisition program environments that are not being systematically detected and addressed.

7. Conclusions

This paper set out to test a specific and important proposition: that the systemic conditions Program Drift Theory identifies as SEWI indicators are visible in the public governance record before they produce the formal performance deterioration that triggers governance escalation. The retrospective analysis of CMATS across eight MPR editions confirms this proposition for all three SEWI indicators, with lead times ranging from one to five years.

The ANAO’s own language, not retrospective reinterpretation, describes conditions consistent with rework accumulation, resource dilution, and risk interdependency management failure from 2017-18 onwards. The formal re-declaration of CMATS as a Project of Concern due to “significant schedule, technical and cost challenges” occurred in October 2022. The conditions that produced those challenges were in the public record for up to five years before that declaration.

This is not primarily a criticism of the governance bodies that managed CMATS. The ANAO’s documentation of these conditions, year after year, demonstrates that the information was present in the oversight system. The governance challenge is structural: conventional oversight frameworks are designed to confirm compliance and measure performance, not to systematically assess the structural conditions that determine whether future performance is achievable. The result is a consistent pattern of late escalation, not from absence of information, but from absence of the governance frameworks designed to act on systemic rather than compliance information.

Program Drift Theory proposes that this pattern is not inevitable. It proposes that Systemic Early Warning Indicators, calibrated to the specific governance and delivery conditions of individual programs and monitored continuously rather than at periodic review points, can provide the lead time required for genuinely preventive governance intervention. This paper provides the first empirical evidence from the Australian Defence context that the conditions those indicators are designed to detect were, in at least one major case, present and documentable years before the consequences that governance intervention is intended to prevent.

The governance implication is direct: the question is not whether the conditions that precede major program challenges are observable, the ANAO’s public record demonstrates they are. The question is whether the governance frameworks monitoring those programs are designed to see them.

References

[1] Lindemann, C.O. (2026). “Program Drift Theory: A Conceptual Framework for Understanding Failure in Complex Defence Acquisition Systems.” Stolt Group Pty Ltd. (Program Drift Theory Paper 1, Version 2.0.) [2] Lindemann, C.O. (2026). “A System Dynamics Simulation Model of Program Drift.” Stolt Group Pty Ltd. (Program Drift Theory Paper 2, Version 1.0.) [3] Ford, D.N. and Sterman, J.D. (1998). “Dynamic modeling of product development processes.” System Dynamics Review, 14(1), pp.31-68. [4] Taylor, T.R.B. and Ford, D.N. (2006). “Tipping point failure and robustness in single development projects.” System Dynamics Review, 22(1), pp.51-71. [5] Vaughan, D. (1996). The Challenger Launch Decision. University of Chicago Press. [6] Dekker, S. (2011). Drift into Failure. Ashgate. [7] ANAO (2019-20). “AIR5431 Phase 3 CMATS Project Data Summary Sheet.” In: 2020-21 Major Projects Report. Auditor-General Report No. 19 of 2020-21. Canberra: ANAO. [8] ANAO (2024-25). 2024-25 Major Projects Report. Auditor-General Report No. 20 of 2024-25. Canberra: ANAO. [9] ANAO (2017-18). “AIR5431 Phase 3 CMATS Project Data Summary Sheet.” In: 2017-18 Major Projects Report. Canberra: ANAO. [10] ANAO (2022-23). “AIR5431 Phase 3 CMATS Project Data Summary Sheet.” In: 2022-23 Major Projects Report. Auditor-General Report No. 12 of 2022-23. Canberra: ANAO. [11] ANAO (2017). “AIR5431 Phase 3 listed as Project of Concern, August 2017.” Referenced in: Defence’s Management of its Projects of Concern, Performance Audit. Canberra: ANAO. [12] ANAO (2019). Defence’s Management of its Projects of Concern. Performance Audit. Canberra: ANAO. [13] ANAO (2020-21). “AIR5431 Phase 3 CMATS Project Data Summary Sheet.” In: 2020-21 Major Projects Report. Canberra: ANAO. [14] ANAO (2021-22). 2021-22 Major Projects Report. Canberra: ANAO. [15] ANAO (2025). Management of the OneSKY Contract. Performance Audit. Canberra: ANAO. [16] Perrow, C. (1984). Normal Accidents: Living with High-Risk Technologies. Basic Books. [17] Lyneis, J.M. and Ford, D.N. (2007). “System dynamics applied to project management.” System Dynamics Review, 23(2-3), pp.157-189. [18] Repenning, N.P. and Sterman, J.D. (2001). “Nobody ever gets credit for fixing problems that never happened.” California Management Review, 43(4), pp.64-88.