High Performance Computing: Modern Systems and Practices is a fully comprehensive and easily accessible treatment of high performance computing, covering fundamental concepts and essential knowledge while also providing key skills training. With this book, domain scientists will learn how to use supercomputers as a key tool in their quest for new knowledge. In addition, practicing engineers will discover how supercomputers can employ HPC systems and methods to the design and simulation of innovative products, and students will begin their careers with an understanding of possible directions for future research and development in HPC.
Those who maintain and administer commodity clusters will find this textbook provides essential coverage of not only what HPC systems do, but how they are used.
- Covers enabling technologies, system architectures and operating systems, parallel programming languages and algorithms, scientific visualization, correctness and performance debugging tools and methods, GPU accelerators and big data problems
- Provides numerous examples that explore the basics of supercomputing, while also providing practical training in the real use of high-end computers
- Helps users with informative and practical examples that build knowledge and skills through incremental steps
- Features sidebars of background and context to present a live history and culture of this unique field
- Includes online resources, such as recorded lectures from the authors' HPC courses
1. Introduction 2. HPC Architecture 3. Commodity Clusters 4. Benchmarking 5. The Essential Moab 6. SMP 7. The Essential OpenMP 8. The Essential MPI 9. Parallel Algorithms 10. Libraries 11. Operating Systems 12. Scientific Visualization 13. Performance Monitoring 14. Debugging 15. Accelerators 16. Essential OpenACC 17. Mass Storage 18. File Systems 19. Map Reduce 20. Checkpointing 21. Beyond (Next Steps)
Appendices: Essential C Linux User Interface
Thomas Sterling is Professor of Informatics and Computing at Indiana University. He serves as the Executive Associate Director of the Center for Research in Extreme Scale Technologies (CREST) and as its Chief Scientist. He is most widely known for his pioneering work in commodity cluster computing as leader of the Beowulf Project for which he and colleagues were awarded the Gordon Bell Prize. Professor Sterling currently leads a team of researchers at IU to enable a new generation of extreme scale computing systems and applications. He is the co-author of six books and holds six patents. He has taught a graduate level course upon which this textbook will be heavily informed, five times.
Matthew is Principal Software Research Engineer at the Center for Research in Extreme Scale Technologies (CREST) at Indiana University.
Maciej Brodowicz is Advanced Parallel Computing Engineer at the Center for Research in Extreme Scale Technologies (CREST) at Indiana University.