Science and Art of the Computer Performance Benchmarking
As computer architecture is making tremendous progress in complexity and performance the task of comparison of computer performance moves to the frontier between Science and Art. A number of existing benchmarks quantify some computer performance characteristics. However, the choice of the right benchmark cannot be formalized and depends on the individual set of applications. In this talk we will cover some collections of existing benchmarks such as HPC Challenge, the NAS Parallel Benchmarks (NPB), and the NAS Grid Benchmarks (NGB). We also describe recent additions to the NPB. We assume familiarity with computer performance and architecture, and with basic numerical algorithms.
Michael Frumkin received his M.S. in Mathematics from the Moscow State University and his Ph.D. in Computer Science from the Russian Academy of Sciences. For the last eight years he has wored at the NASA Ames Research Center. He contributed to the NAS benchmarking effort, performance analysis of NASA applications and developed new methods of optimizing cache performance of explicit operators on structured meshes. His interests include application and computer performance, computational complexity, and fast parallel algorithms.