Document 34

SEBoK *Assessing Systems Engineering Performance of Business and Enterprises*, Distilled

framework

SEBoK Assessing Systems Engineering Performance of Business and Enterprises, Distilled

Top-20 distillation #16 (substituting for Capability Maturity Models, which 404'd; this page covers the same ground via CMMI). The SEI CMMI's five maturity levels are SIPE-with-threshold at the school's self-formalization rung — each level is a threshold-crossing the organization passes through as its SE practice matures. The twelve typical performance measures are universal-sibling lattice (Doc 572 Appendix D). The "what gets measured gets done" warning is canonical Doc 270 pin-art with explicit acknowledgment of pin-set side effects. The CMMI-vs-business-effectiveness caution is Doc 372 hypostatic-boundary discipline applied at the maturity-model layer. Six corpus forms compose; one provisional refinement candidate (a "school maturity" form articulating SIPE-with-threshold at the school's self-formalization rung).

I. Source

II. Source Read

Enterprise-level SE measurement ensures SE "adds value to the organization, is aligned to the organization's purpose, and implements relevant parts of the organization's strategy." SEI CMMI is "a structured way for businesses and enterprises to assess their SE processes" with process areas (clusters of related practices), Capability Levels 0-3 per process area, and overall organizational maturity 1-5. Governance levers: People (selection, training, culture, incentives) / Process / Tools and infrastructure / Organization. Twelve typical measures (effectiveness of SE process, ability to mobilize resources, quality and timeliness of outputs, value added at multiple scopes, capability development, individual competence development, resource utilization, productivity, tool deployment). Critical claim: "CMMI maturity level is not a direct measure of business effectiveness unless the SE measures are properly integrated with business performance measures." "What gets measured gets done" warning. Goal-question-metric paradigm (Basili 1992). Position: Part 5 Enabling SE > Enabling Businesses and Enterprises. Authors: Hillary Sillitto, Alice Squires, Heidi Davidz.

III. Structural Read

Form I — SIPE with Threshold (Doc 541), at the school's self-formalization rung. CMMI's five maturity levels (Initial / Managed / Defined / Quantitatively Managed / Optimizing) are SIPE-with-thresholds at the organizational practice rung. Each level is a threshold-crossing where the organization's SE practice matures into a new operative state:

  • Level 1 → 2 threshold: SE practice becomes managed (project-by-project, repeatable within projects).
  • Level 2 → 3 threshold: SE practice becomes defined (organization-wide standard processes).
  • Level 3 → 4 threshold: SE practice becomes quantitatively managed (measured and predicted).
  • Level 4 → 5 threshold: SE practice becomes optimizing (continuously improved through process feedback).

Each threshold-crossing produces a property the organization has at the higher level that did not exist at the lower level. The substrate is the organization's accumulated SE practice; the constraint is the CMMI's named process areas; the threshold-crossings are when the practice's character shifts qualitatively. This is canonical SIPE at the school-formalization rung — a third independent instance after SE-027 ESE and SE-033 Roles & Competencies, both of which surfaced SIPE at the institutional substrate. The cluster (SIPE applied at the school / institutional substrate) is now well-supported.

Form III (extension) — Lattice Extension of the Ladder (Doc 572), with Appendix D universal-sibling at the measurement rung. The twelve typical measures are universal-sibling lattice at the measurement rung. Each measure binds the organization's SE performance assessment universally; the discriminator is aspect (effectiveness vs. mobilization vs. quality vs. timeliness vs. value-at-various-scopes vs. capability-development vs. competence-development vs. resource-utilization vs. productivity vs. tool-deployment). This is the fourth Appendix D instance after requirements (SE-024), architecture views (SE-031), and competency dimensions (SE-033). The pattern is now well-attested.

Form IV — Pin-Art Model (Doc 270). "What gets measured gets done" is Doc 270's central claim made explicit at the management layer: the substrate's behavior is shaped by the pin-set the keeper installs; if the metric is the pin, the metric drives the behavior. The page's accompanying caution that "process flexible enough to allow innovation will also be flexible enough to allow mistakes" is direct acknowledgment of pin-art's tradeoff: tight pins constrain undesired behavior at the cost of constraining desired innovation; loose pins permit innovation at the cost of permitting mistakes. The keeper-side discipline of pin-set design (Doc 270) names this tradeoff explicitly; SE practice has rediscovered it empirically.

Form V — Hypostatic Boundary (Doc 372). "CMMI maturity level is not a direct measure of business effectiveness" is Doc 372's discipline applied at the maturity-model layer. CMMI level functions as a measure of SE process maturity; it does not BE business effectiveness. The page is honest that the maturity rating is functional, not ontological. The "unless properly integrated with business performance measures" caveat is the bridge: the function only correlates with effectiveness when the measurement design connects them explicitly.

Form III — Substrate-and-Keeper Composition (Doc 510). The four governance levers (People / Process / Tools and infrastructure / Organization) are the keeper's operational surfaces at the enterprise-SE rung. Doc 510's apparatus reads each lever as a keeper-side discipline: People is keeper-side practitioner-formation (SE-033); Process is keeper-side pin-art (Doc 270); Tools and infrastructure is keeper-supplied substrate-flow apparatus; Organization is keeper-side institutional ground (Doc 571).

Form X — Institutional Ground (Doc 571). "Higher CMMI levels are concerned with systemic integration of capabilities across the business or enterprise" engages Doc 571's institutional ground at progressively wider scopes. CMMI levels 1-2 operate at organization-component (formal positions, defined processes); levels 3-5 reach into enterprise-component (cross-organizational integration, optimization patterns, cultural reproduction of high-quality practice). Doc 571 §X.5's organization-vs-enterprise sub-form composes naturally: maturity progression is the organization's binding effect deepening into enterprise-level integration.

IV. Tier-Tags

  • CMMI's structure (process areas, capability levels 0-3, organizational maturity 1-5) — π / α (well-cited; SEI 2010).
  • Five maturity levels — π / α as cited; μ / β under corpus when read as SIPE-with-threshold at the school-formalization rung.
  • Twelve typical measures — π / α as cited; μ / β under corpus when read as Doc 572 Appendix D universal-sibling at the measurement rung.
  • "What gets measured gets done" — π / α (universally acknowledged in management literature); μ / β under corpus as Doc 270 pin-art canonical.
  • "CMMI maturity level is not a direct measure of business effectiveness" — π / α as cited; μ / β under corpus when read as Doc 372 hypostatic-boundary discipline at the maturity-model layer.
  • "Higher CMMI levels are concerned with systemic integration of capabilities" — π / α as cited; μ / β under corpus when read as Doc 571 §X.5 progression from organization to enterprise scope.
  • Goal-question-metric paradigm — π / α (Basili 1992 well-cited).
  • Four governance levers (People / Process / Tools / Organization) — π / α; μ / β under corpus as Doc 510 keeper-side surfaces.

V. Residuals

No structural residuals against the apparatus. The page provides confirmation across multiple forms and refinements:

  • SIPE at school-formalization rung (third instance, cluster now well-supported).
  • Doc 572 Appendix D universal-sibling (fourth instance).
  • Doc 571 §X.5 organization-vs-enterprise (fourth confirmation).
  • Doc 270 pin-art tradeoff (canonical statement of the form's central claim).
  • Doc 372 hypostatic boundary applied to abstract measures.

VI. Provisional Refinements

A "school maturity" form candidate. SIPE-with-threshold at the school's self-formalization rung is now supported by three independent instances (SE-027 ESE, SE-033 Roles & Competencies, SE-034 CMMI maturity progression). The cluster is strong enough to warrant its own corpus document articulating the form: how a school's accumulated practice crosses thresholds into new operative levels of self-formalization, and what the structural conditions for those threshold-crossings are. CMMI is the most explicit articulation in SE practice; analogous patterns exist in other disciplines (Kuhn's normal-science → revolutionary-science thresholds, software engineering's CMM heritage, etc.). Worth documenting as a Doc 541 worked example or its own derivative form.

VII. Cross-Links

Form documents. Doc 541 (SIPE with Threshold), Doc 572 (Lattice Extension, Appendix D universal-sibling), Doc 270 (Pin-Art), Doc 372 (Hypostatic Boundary), Doc 510 (Substrate-and-Keeper), Doc 571 (Institutional Ground, §X.5 organization-vs-enterprise).

Part-level reformulation. SE-008 (Part 5 — Enabling SE).

Related distillations. SE-033 (Roles and Competencies — individual-rung competency assessment). SE-027 (Enterprise SE — institutional ground at enterprise scope). SE-026 (SE-SWE relationship — school-formalization parallel).

Adjacent SEBoK concepts (per source). Assessing Individuals, Enabling Individuals, Enabling Businesses and Enterprises, Lean Engineering, CMMI for Development.

Appendix: Originating Prompt

"Continue with next 10"

(SE-034 is the sixteenth of twenty. The originally-targeted Capability Maturity Models page returned 404; Assessing SE Performance of Business and Enterprises is the SEBoK page that covers the same ground via CMMI. The structural reformulation produces three independent confirmations of recently-landed refinements and one provisional refinement candidate: a "school maturity" form articulating SIPE-with-threshold at the school's self-formalization rung.)

Referenced Documents

More in framework