An answer? Hardware assisted Performance Optimization
Compilers using feedback from actual runs.
Feedback is based upon instrumentation inserted into the code.
This instrumentation provides data on the actual performance of the functional units as coupled to the object code.
Most optimization is based upon static analysis and minimization. Why?