Automatic Generation of Executable Benchmarks
It is realistic to expect that the majority of future benchmark workloads will be automatically generated using benchmark program generators. According to Moore's law the memory capacity and the performance/price ratio exponentially grow doubling each 12-18 months. Consequently, industrial benchmarks should follow the exponential growth of computer performance, and this cannot be achieved using natural workloads that are updated once in several years. In addition, automatic workload generators are crucial for software testing and for performance analysis of modern compilers.
Previous work in this area was devoted to generators of programs that were used for compiler performance analysis, and therefore were mostly non-executable. This talk presents a next step in the direction of automatic benchmark generators: a methodology that is used for generating executable programs. Our approach is based on an expandable library of kernel program segments and several algorithms for combining kernels into executable benchmark programs that have desired size and characteristics.
Dr. Jozo Dujmovic is Professor of Computer Science at San Francisco State University, where he served for four years as Chair of Computer Science Department. His teaching and research activities are in the areas of software metrics, decision analysis, and computer performance evaluation. He is the author of more than 100 publications, recipient of three best paper awards, and a Senior Member of IEEE. He served as General Chair of MASCOTS 2000.