Evolution or Revolution?
Thomas Sterling and Pete Beckman argue the "revolutionary" and "evolutionary" paths for achieving exascale computation by the end of this decade.
Over the past 60 years HPC has changed in dramatic spurts punctuated by fairly long periods of stability. During that time we've been through five computing epochs in HPC, including sequential execution, sequential issue, vector, and SIMD models of computation processing. And along the way there have been excursions into dataflow, systolic, and global shared memory models.
Each of the phase changes from one model to another was precipitated by a prior change in hardware design and system architecture. Often our programming models were a consequence of the hardware designer's art, not the result of a collaborative effort between software and hardware designers to develop the most sensible system.
Today we stand firmly in the epoch of communicating sequential processes, enabled primarily by MPI. As we look forward to achieving the goal of a sustained exaFLOPS system by the end of this decade, we asked two leading experts in the exascale community this question: are we on the cusp of a new phase change, a new revolution, in HPC, or can we extend and adapt today's programming model to get us there?
Can the Exascale Effort Survive the Need for Global Cooperation?
The Battle of San Romano. Paolo Uccello, c. 1438-1440.
Technology leadership has long driven fierce competition among nations.
The Top 500 list of the most powerful computers in the world has evolved into a measurement not just of system benchmark performance, but one of bragging rights to claim technical prowess for system manufacturers and the countries where these systems are installed. Having a system placed on the Top 500 has become an annual quest.
Now, a new quest is underway — the quest to achieve exascale-level computation. Industry experts say we'll never get there without many years of global cooperation. Visionaries say this is not a problem, the global HPC community will come together to achieve this dreamed of goal. But naysayers contend that global cooperation sounds good — and it might even work for the short term — but it's more likely that the global cooperation will turn into fierce global competition as exascale moves closer to reality.
DARPA Jump Starts a Revolution
Bohumil Kubišta, Pobrezni guns in combat with the navy (1913).
Anyone familiar with DARPA knows the agency is not averse to taking risks. Tackling really tough technological problems by funding innovative research is fundamental to its mission statement.
But with the Ubiquitous High Performance Computing (UHPC) program, DARPA is really pushing the envelope. It’s calling for nothing less than a revolution that could drastically and permanently alter the nature of computing.
Response from the HPC community has been predictable. Two opposing camps have sprung up — those who side with DARPA’s call for a totally new computing paradigm versus those who believe the road to exascale should be evolutionary — leveraging what is already in place, moving along the roadmap. But Bill Harrod, DARPA Program Manager for UHPC, makes no bones about where he and the agency stand. As far as the BAA is concerned, incrementalists need not apply.
DARPA Pushes High End Computing Frontier
EU Considers New Exascale Initiative
New Ethernet Standards Hold Promise for Big Science
Exascale Development Flows to Europe
Intel and ParTec agreed to create the ExaCluster Laboratory. From left, Achim Bachem, Kirk Skaugen, Hugo R. Falter. (courtesy Intel)
DOE to Collaborate with Cray on Next Gen Interconnect
On the Web
The International Exascale Software Project is the exemplar of the kinds of global cooperation our community will need to sustain if we are to build a usable system capable of delivering an exaFLOPS of computation by the end of this decade.
Happily, the IESP is also an exemplar of open communication. Briefings, reports, and summaries from all four meetings, including most of the presentations given over the past year, are available on their web site.
