Record Details

An Adaptive Recompilation Framework For Rotor And Architectural Support For Online Program Instrumentation

Electronic Theses of Indian Institute of Science

View Archive Info
 
 
Field Value
 
Title An Adaptive Recompilation Framework For Rotor And Architectural Support For Online Program Instrumentation
 
Creator Vaswani, Kapil
 
Subject Computer and Information Science
Dynamic compilation
Profile-Guided Optimization
Computer Programs - Optimization
Computer Programs - Recompilation
Instrumentation Based Profilers
Basic Block Profiling
Edge Profiling
Call Graph Profiling
Dynamic Optimization
Rotor Architecture
Common Language Infrastructure (CLI)
Profile Flag Prediction
 
Description Microsoft Research
Although runtime systems and the dynamic compilation model have revolutionized the process of application development and deployment, the associated performance overheads continue to be a cause for concern and much research. In the first part of this thesis, we describe the design and implementation of an adaptive recompilation framework for Rotor, a shared source implementation of the Common Language Infrastructure (CLI) that can increase program performance through intelligent recompilation decisions and optimizations based on the program's past behavior. Our extensions to Rotor include a low overhead runtime-stack based sampling profiler that identifies program hotspots. A recompilation controller oversees the recompilation process and generates recompilation requests. At the first-level of a multi-level optimizing compiler, code in the intermediate language is converted to an internal intermediate representation and optimized using a set of simple transformations. The compiler uses a fast yet effective linear scan algorithm for register allocation. Hot methods can be instrumented in order to collect basic-block, edge and call-graph profile information.

Profile-guided optimizations driven by online profile information are used to further optimize
heavily executed methods at the second level of recompilation. An evaluation of the framework using a set of test programs shows that performance can improve by a maximum of 42.3% and by 9% on average. Our results also show that the overheads of collecting accurate profile information through instrumentation to an extent outweigh the benefits of profile-guided optimizations in our implementation, suggesting the need for implementing techniques that can reduce such overheads. A flexible and extensible framework design implies that additional profiling and optimization techniques can be easily incorporated to further improve performance.
As previously stated, fine-grained and accurate profile information must be available at low cost for advanced profile-guided optimizations to be effective in online environments. In this second part of this thesis, we propose a generic framework that makes it possible for instrumentation based profilers to collect profile data efficiently, a task that has traditionally been associated with high overheads. The essence of the scheme is to make the underlying hardware aware of instrumentation using a special set of profile instructions and tuned microarchitecture. This not only allows the hardware to provide the runtime with mechanisms to control the profiling activity, but also makes it possible for the hardware itself to optimize the process of profiling in a manner transparent to the runtime.
We propose selective instruction dispatch as one possible controlling mechanism that can be used by the runtime to manage the execution of profile instructions and keep profiling overheads under check. We propose profile flag prediction, a hardware optimization that complements the selective dispatch mechanism by not fetching profile instructions when the runtime has turned profiling off. The framework is light-weight and flexible. It eliminates the need for expensive book-keeping, recompilation or code duplication. Our simulations with benchmarks from the SPEC CPU2000 suite show that overheads for call-graph and basic block profiling can be reduced by 72.7% and 52.4% respectively with a negligible loss in accuracy.
 
Publisher Indian Institute of Science
 
Contributor Srikant, Y N
 
Date 2005-12-07T08:45:35Z
2005-12-07T08:45:35Z
2005-12-07T08:45:35Z
2003-08
 
Type Electronic Thesis and Dissertation
 
Format 4305810 bytes
application/postscript
 
Identifier http://hdl.handle.net/2005/174
null
 
Language en
 
Rights I grant Indian Institute of Science the right to archive and to make available my thesis or dissertation in whole or in part in all forms of media, now hereafter known. I retain all proprietary rights, such as patent rights. I also retain the right to use in future works (such as articles or books) all or part of this thesis or dissertation.