I'd guess it's because of the poor combustion characteristics of gasoline under diesel-level pressures. For maximum efficiency (in a diesel) you want ignition at the forefront of the vapor wave as it enters the cylinder, with combustion proceeding smoothly back through the cloud. Gasoline vapor would tend to spontaneously ignite at unpredictable points within the vapor cloud, resulting in turbulent combustion, poor oxygenation of the flame, and inefficiencies.
According to Wikipedia, some diesel engines can run on E95, which is 5% gasoline and 95% ethanol; the high "octane" (ignition temperature) of the ethanol prevents the vapor from igniting at the wrong places.
Surely you're not denying that higher compression means higher gas temperature (volume being constant)? And that higher temperature increases the likelihood of ignition? I'm not sure what exactly you're taking exception to in the quoted paragraph.
Indeed it is, but I fail to see how the comparison is relevant.
Perhaps so. I'll retract my claim about why high-compression engines are more expensive.
At any rate, the basic point is that the "octane" rating of a sample of gasoline refers to its ignition temperature, and that higher octane means less knock, and that the appropriate octane for an engine will maximize gasoline performance for that engine, with no additional benefit for going higher.