An assembly is provided for a gas turbine engine (20). This gas turbine engine (20) assembly includes a stationary engine structure (34). The stationary engine structure (34) includes a diffuser (60), a combustor (50), an engine case (112) and a plenum (58...