Satellites, the Space Race, and Supercomputing:How NASA Goddards Beowulf Cluster ComputerBecame an Award-Winning Space Technology
Above: James Fischer (third from the right) and Thomas Sterling (second from the right), both formerly of NASA Goddard Space Flight Center in Greenbelt, Maryland, stand to the left of astronaut and NASA Associate Administrator Bob Cabana during the 2022 Space Technology Hall of Fame induction ceremony. Photo Credit: Space Foundation.
On April 7, 2022, Beowulf Cluster Computing was inducted into the Space Technology Hall of Fame during the 37th annual Space Symposium hosted by Space Foundation in Colorado Springs, Colorado. The stated purpose of the hall of fame is to recognize the life-changing technologies emerging from global space programs; honor the scientists, engineers, and innovators responsible; and communicate to the public the importance of these technologies as a return on investment in space exploration.
During the induction ceremony, computer scientists James Fischer, former Project Manager of NASAs Earth and Space Sciences (ESS) Project, and Thomas Sterling, former ESS Evaluation Coordinator, were both recognized and honored for their key roles in developing the first Beowulf computer cluster at NASA Goddard Space Flight Center in 1994. The NASA ESS Project was part of NASAs High-Performance Computing and Communications (HPCC) program. Fischer was involved in NASA Goddards high-performance computer architecture research for decades, and Sterling joined the team in 1992 to help NASA scientists better use the projects innovative parallel computer architectures. The Beowulf computer cluster was a major breakthrough for the ESS Project team: it set a new standard for scalable parallel computing using arrays of inexpensive, networked personal computers.
Mike Little, a long-time NASA computer systems expertwho worked at NASA headquarters (HQ) in the 1990s, managing a different part of the agency's supercomputing program in Code R (the former Research and Engineering Directorate), recalled that he had known about Fischer and Sterlings work and attended the HPCC program reviews at NASA HQ. Little recalled, I was acutely aware of and excited about what they were doing on the ESS Project.
Noting the life-changing impact of the ESS Project, Little observed, The Beowulf computer cluster was a breakthrough at NASA that enabled many other innovations, including accurate, data-driven numerical weather forecasting and the evolution of aircraft design without the use of wind tunnels. Virtually every other area of science, math, and biology continue to be direct beneficiaries of this groundbreaking work.
However, what was the original impetus for NASA to develop faster computers in the first place? What were the technical and societal environments that spurred these innovations? According to Jim Fischer, thats a story that goes all the way back to the Space Race in the mid 1950s, when the United States and the former Soviet Union were competing for dominance in missile technology and spaceflight capability during the historic Cold War.
In 1955, the Eisenhower administration had publicly announced the intent to launch an American scientific satellite into orbit during the International Geophysical Year (IGY), which spanned July 1957-December 1958. This collaborative, global scientific research effort was designed to study several Earth science phenomena, collect data, and share research results among the dozens of participating nations. Several World Data Centers were also established to store shared IGY data. Notable results from the IGY explorations include the confirmation of plate tectonic theory, polar exploration, the discovery of the Van Allen radiation belts in Earths magnetosphere, and the development of scientific satellites.
Above, all four corners: As part of the National Academy of Sciences (NAS) educational outreach efforts for the International Geophysical Year, the academys IGY Committee developed a booklet and several posters designed by artist/writer/director Herbert Danska representing different areas of geophysics studied during the 1957-1958 IGY. At center, the official IGY emblem. Image credits: NAS.
After the Soviet Union successfully launched the first Sputnik satellite in October of 1957, achieving that spaceflight milestone before the United States could, the so-called Sputnik crisis began, with the shocking perception that the U.S. lagged behind the Soviet Union in technology and science education. In response, the U.S. government doubled its efforts in advancing spaceflight.
The U.S.Congress quickly passed the National Aeronautics and Space Act of 1958, and two new government agencies were born out of the Sputnik crisis: the civilian-oriented National Aeronautics and Space Administration (NASA) and the military-oriented Defense Advanced Research Projects Agency(DARPA). NASA became the successor to its predecessor, the former National Advisory Committee for Aeronautics (NACA), a civilian group founded in 1915 to catch up with then-superior European aviation technology during World War One. The NACA committee of presidential appointees, which included pioneering aviator Orville Wright, established the Langley Research Center (LaRC) in Hampton, Virginia in 1920 and began building a series of wind tunnels to test new aircraft, a classic example of the commercial and public benefits of NASA-derived technologies.
In May 1959, NASA established its first space flight facility in Greenbelt, Maryland, the Goddard Space Flight Center. The United States Naval Research Laboratory had developed Project Vanguard with a goal to launch a scientific satellite during the IGY using a 3-stage Vanguard rocket and track the spacecraft. After the Sputnik launch, NRL staff from Project Vanguard were transferred from the Washington, D.C. laboratory to NASA Goddard. The Vanguard Project was then managed by NASA, and the satellite staff became the first occupants of the new NASA facility.
Three of the eleven Vanguard satellite launches were successful, including the final satellite launched in September 1959, Vanguard III. Onboard were four distinct experiments, measuring Earths magnetic field; the X-ray emissions from theSun; upper atmospheric densities; and the impact ofmicrometeorites on the outer shell of the small, (50.8 cm diameter) spacecraft. The Vanguard III satellite is still in Earth orbit after 62 years and may continue to orbit for another 200 years.
Left: The backup version of the Vanguard III satellite hanging in the NASA Goddard Visitor Center. Right: A schematic of the satellite and its scientific instruments. NASA images.
Early computer research at NASA Goddard was a response to the mid-20th Century Space Race. Former NRL Project Vanguard manager Jack Townsend became the Assistant Director for Space Science and Satellite Applications at NASA Goddard, and David Schaefer, a physicist who was part of the original NRL team that worked on theVanguard satellites telemetry system, moved from NRL to NASA at the same time.
Schaefer was an expert in magnetic amplifiers. At NRL, he developed the radio telemetry for the Project Vanguard satellites, enabling the transmission of the count of micrometeorite strikes in real time back to receivers on Earth. At NASA Goddard, Schaefer took on the role of developing computing for space.
With each new satellite that was developed at NASA Goddard, more onboard computing was incrementally added, with Schaefer flying the first transistor and the first integrated circuit in space. Fischer recalled, the addition of onboard computing became something that the scientists appreciated, because if they had some kind of intelligence on board, they could get more science data back by working with the computing people. Over time, Schaefer's attention expanded to also improving the ability of ground-based computers of those days to capture the scientific data being transmitted by each new satellite.
The early data rate was one bit per second, but when the data rate increased in the 1970s, data started piling up at NASA Goddard in huge rooms full of round storage tapes that had to be indexed, mounted, and requested to access. The whole process was inefficient, time-consuming, and expensive. In the 1970s, NASA managers anticipated the need for greatly increased downlink speeds for the new, Earth-observing Landsat satellites. Since the Landsat satellites produce a complete image of Earths land surface in a little over two weeks, the amount of data increase demanded more efficient data transfer as well as faster, more powerful computing capabilities. NASA needed to come up with a new way to conduct more onboard data processing or somehow reduce the volume of the satellite-collected data.
With those needs in mind, and with a funding stream to address the Landsat Missions requirements, Dave Schaefer led his team to develop a massively parallel processor (MPP), the first of its kind. He hired Jim Fischer in 1974 to work on ideas for implementing MPP. In 1978, George Rumney, now at the NASA Center for Climate Simulation (NCCS), came aboard to work on the MPPs software. When Schaefer retired in 1981, Fischer became the team lead. Massively parallel computing caught on with the NASA science community and was commercialized by companies such as Digital Equipment Corporation and MasPar Computer Corporation. Goddards successful use of the MasPar computer positioned the team to have the lead role in the HPCC programs ESS Project starting in 1992.
One of the technical goals of ESS was to develop a massively parallel workstation for use by Goddard scientists. With that goal in mind, Sterling came up with the idea to combine the newly-available, open-source Linux operating system with leading edge personal computers and Ethernet cables for networking, integrating these technologies into computer clusters termed Beowulf. Sterling brought Don Becker aboard to help with the project, because Becker was a Linux guru who had developed useful Ethernet drivers and could integrate the Beowulf prototype. ESS lead for systems software, John Dorband, embraced this new idea, and he began to find applications for it among ESSs network of scientific researchers.
NASA computer systems engineer Mike Little, who, like Fischer and Schaefer, has been involved in high-end computing for several decades, remarked on the impact of the first Beowulf computer cluster and the importance of these technologies as a return on investment in space exploration, In the early 1990s, as NASA grew more and more dependent on supercomputing to create physics-based models, resolution became increasingly important. In order to run these models, bigger vector supercomputers were needed, but their high cost limited what the agency could afford. The Beowulf approach offered comparable performance, but it was ten times less expensive.
Jim Fischer proudly holds his Space Technology Hall of Fame medal for Beowulf cluster computing, awarded for products in space benefiting planet Earth. Photos by Jarrett Cohen, NASA.
The Beowulf computer cluster, invented by the ESS Project team at NASA Goddard, is the foundation of todays high-end computing systems. The original Beowulf was a new model for enabling the efficient storage and retrieval of massive datasets and scalable parallel computing and set a new standard at NASA for experimentally integrating new technologies to accelerate computational research and adapt to the ever-changing scale of scientific datasets. With relatively little project funding and a lot of ingenuity, passion, and creativity, the NASA Goddard teams award-winning project, now inducted into the Space Technology Hall of Fame, accelerated the global move away from expensive, proprietary supercomputer systems and toward the adoption of PC clusters and open-source software by the scientific community.
Beyond the impact to scientific research, the benefits of this revolution in cluster computing at NASA Goddard has a direct, daily impact on the lives of Earth and its inhabitants, as high-end computing continues to experiment, evolve, and enable accurate, complex, detailed Earth system models used to understand and predict important phenomena such as Arctic amplification, storm systems, ozone climatology, solar eruptions, and climate science.
Sean Keefe, NASA Goddard Space Flight CenterMay 13, 2022
Read the original here:
- 7 Reasons to Retire and Relocate When Savings Fall Short ... - ThinkAdvisor - October 9th, 2023 [October 9th, 2023]
- Strive Asset Management vs. Engine No. 1: How Did the Activists ... - Morningstar - September 21st, 2023 [September 21st, 2023]
- New Taskforce to build UK nuclear skills - GOV.UK - July 31st, 2023 [July 31st, 2023]
- National Bank of Canada FI Has $16.22 Million Position in ... - Defense World - June 26th, 2023 [June 26th, 2023]
- RIT part of National Science Foundation grant to help spur next ... - Rochester Institute of Technology - May 22nd, 2023 [May 22nd, 2023]
- 2023 NAIA Outdoor Track & Field Regional Awards - U.S. Track & Field and Cross Country Coaches Association - May 22nd, 2023 [May 22nd, 2023]
- P&I wins ASBPE national gold award for managers microsite - Pensions & Investments - May 22nd, 2023 [May 22nd, 2023]
- The National - January 30th, 2023 [January 30th, 2023]
- Dimon Highlights Need For More Oil And Gas Investment As Vanguard Bails On ESG Group - Forbes - December 16th, 2022 [December 16th, 2022]
- About Us | National Vanguard - November 19th, 2022 [November 19th, 2022]
- Vanguard News Network - October 11th, 2022 [October 11th, 2022]
- Retirement Clearinghouse Announces Auto-Portability Network with Fidelity, Vanguard and Alight | PLANSPONSOR - PLANSPONSOR - October 11th, 2022 [October 11th, 2022]
- Abenaa Jones named Ann Atherton Hertzler Early Career Professor - Pennsylvania State University - August 6th, 2022 [August 6th, 2022]
- City of Detroit, Charles H. Wright Museum of African American History, join the Black Theatre Network (BTN) to host Broadway Comes Home to Detroit, a... - July 25th, 2022 [July 25th, 2022]
- California Senate Votes to Keep Legalized Slavery in its Prisons - The Peoples Vanguard of Davis - June 29th, 2022 [June 29th, 2022]
- Schneider National (NYSE:SNDR) Now Covered by Analysts at Credit Suisse Group - Defense World - June 29th, 2022 [June 29th, 2022]
- Introducing the Truckstop.com Partner Marketplace: A Comprehensive Transportation and Logistics Ecosystem Empowering the Freight Community - Yahoo... - June 29th, 2022 [June 29th, 2022]
- A Pilgrimage to the Birthplace of the Modern Womens Rights Movement - AFAR Media - June 29th, 2022 [June 29th, 2022]
- White Child Adopted by Black Reality TV Star Beaten to Death - June 24th, 2022 [June 24th, 2022]
- National Car Rental - Wikipedia - June 24th, 2022 [June 24th, 2022]
- Down 15% in 2022, is it time to jump on Vanguard Australian Shares Index ETF? - The Motley Fool Australia - June 24th, 2022 [June 24th, 2022]
- LIVE BLOG: 2022 Corps at the Crest - San Diego - FloMarching - June 24th, 2022 [June 24th, 2022]
- Greater Sacramento Attends Bio International Convention in San Diego - The Peoples Vanguard of Davis - June 22nd, 2022 [June 22nd, 2022]
- Vanguard International Semiconductor : VIS and National Yang Ming Chiao Tung University Cofound Intelligent Manufacturing and Management Laboratory -... - June 22nd, 2022 [June 22nd, 2022]
- The Shadow Of June 12 - The Left and Nigeria's Democratic Revolution, By Baba Aye - SaharaReporters.com - June 22nd, 2022 [June 22nd, 2022]
- Yolo County Honors Juneteenth with Celebration - The Peoples Vanguard of Davis - June 22nd, 2022 [June 22nd, 2022]
- Commentary: Why San Francisco May Not Be the Best Test Case for Progressivism - The Peoples Vanguard of Davis - June 22nd, 2022 [June 22nd, 2022]
- As tennis fans gather Wimbledon worries expansion won't get over the line - The National - June 22nd, 2022 [June 22nd, 2022]
- Vanguard Charitable survey: More than 1 in 3 American donors gave half or more of their charitable contributions to disaster relief efforts in the... - May 20th, 2022 [May 20th, 2022]
- National Grid warns on cost-of-living challenges after strong profit (NYSE:NGG) - Seeking Alpha - May 20th, 2022 [May 20th, 2022]
- Is it a good time to buy the Vanguard Australian Shares Index ETF? - The Motley Fool Australia - May 20th, 2022 [May 20th, 2022]
- Student Opinion: The Biden Administration and Cable Companies Working Together to Bring Internet to Millions of Households - The Peoples Vanguard of... - May 20th, 2022 [May 20th, 2022]
- THE POWER OF LEADERSHIP - THISDAY Newspapers - May 20th, 2022 [May 20th, 2022]
- Vanguard may be shorting much vaunted 'owners' of its low-cost index funds as it upshifts to more Wall Street-style exec-comp tactics to thwart... - May 17th, 2022 [May 17th, 2022]
- Opinion | BlackRock, Vanguard and State Street Control a Piece of Nearly Everything - The New York Times - May 17th, 2022 [May 17th, 2022]
- Somalis receive explosive threat reduction training | Shephard - Shephard News - May 17th, 2022 [May 17th, 2022]
- JV Article: Platinum Group Metals is at the vanguard of next generation lithium-ion batteries - The Northern Miner - May 17th, 2022 [May 17th, 2022]
- Neo-Nazi Alex Davies guilty of belonging to banned terror group National Action - Tell MAMA - May 17th, 2022 [May 17th, 2022]
- Firearm-Related Homicides Reach an Unprecedented Level in the 21st Century - The Peoples Vanguard of Davis - May 17th, 2022 [May 17th, 2022]
- Vanguard may be shorting much vaunted 'owners' of its low-cost index funds as it shifts to Wall Street-style exec-comp tactics to thwart competitors... - May 15th, 2022 [May 15th, 2022]
- Senate Democrats Fail to Codify Abortion Rights; Don't Have Votes to Overcome Filibuster Dem Manchin Votes with GOP - The Peoples Vanguard of Davis - May 15th, 2022 [May 15th, 2022]
- The School Buzz: Vanguard rocketry team competing for national title - KRDO - May 9th, 2022 [May 9th, 2022]
- The Anglo-Indian-Nigerian designer at the vanguard of British fashion - The National - May 9th, 2022 [May 9th, 2022]
- Candidate for Yolo County District Attorney Cynthia Rodriguez Announced Her Growing List of Endorsements in a Press Release on Thursday - The Peoples... - May 9th, 2022 [May 9th, 2022]
- Commentary: Trends Are Pushing Tech, Housing Toward Sacramento Region - The Peoples Vanguard of Davis - May 9th, 2022 [May 9th, 2022]
- UK Government announces 2 billion investment into nuclear submarines - The National - May 9th, 2022 [May 9th, 2022]
- Workers grapple with new stresses as they return to office - Tampa Bay Times - May 9th, 2022 [May 9th, 2022]
- Who is Ib Kamara, the new Off-White art director to fill Virgil Abloh's shoes? - The National - May 9th, 2022 [May 9th, 2022]
- Vanguard Lions Defeat Statesmen To End The Year - Victory Sports Network - April 15th, 2022 [April 15th, 2022]
- Other days - Arkansas Online - April 15th, 2022 [April 15th, 2022]
- Democrats are in danger of losing three congressional strongholds in South Texas - Standard-Times - April 15th, 2022 [April 15th, 2022]
- Remembering the WNBA's Portland Fire - Vanguard - Psuvanguard.com - April 13th, 2022 [April 13th, 2022]
- Honoring the life of Amara Marluke - Vanguard - Psuvanguard.com - April 13th, 2022 [April 13th, 2022]
- The grim outlook of owning and renting - Vanguard - Psuvanguard.com - April 13th, 2022 [April 13th, 2022]
- 2022 NAIA Women's Outdoor Track & Field Rating Index Week 3 - U.S. Track & Field and Cross Country Coaches Association - April 13th, 2022 [April 13th, 2022]
- ECOWAS and Nigeria Agree on a Roadmap to Institutionalise a Government and Society Wide Approach - African Business - March 17th, 2022 [March 17th, 2022]
- LA Treasurer joins other states in divesting Russian investments - KATC News - March 8th, 2022 [March 8th, 2022]
- How the US and Europe helped Ukraine prep for insurgency - ArmyTimes.com - March 8th, 2022 [March 8th, 2022]
- A Trailblazing Engineer Says Invention Is in Everything I Do - Tufts Now - March 8th, 2022 [March 8th, 2022]
- Russias Invasion of Ukraine and Implications for the Korean Peninsula - Council on Foreign Relations - March 8th, 2022 [March 8th, 2022]
- Vanguard University saying goodbye to the Pit - Los Angeles Times - January 14th, 2022 [January 14th, 2022]
- Energy Ended Up as a Good Bet Last Year. But Now What? - The New York Times - January 14th, 2022 [January 14th, 2022]
- Kensington Vanguard National Land Services - December 19th, 2021 [December 19th, 2021]
- Barry Harris, Pianist and Devoted Scholar of Bebop, Dies at 91 - The New York Times - December 10th, 2021 [December 10th, 2021]
- From Our Archives: a Profile of Bob Dole, Once the Senate's "Funniest Member" - Washingtonian - December 7th, 2021 [December 7th, 2021]
- National Auto Care on acquisition spree amid F&I consolidation - Automotive News - December 5th, 2021 [December 5th, 2021]
- A decade of marketisation has left lecturers with no choice but to strike - The Guardian - December 5th, 2021 [December 5th, 2021]
- A New Vanguard Is Reshaping the Art World - HarpersBAZAAR.com - December 5th, 2021 [December 5th, 2021]
- Opinion | The Trump Conspiracy Is Hiding in Plain Sight - The New York Times - December 5th, 2021 [December 5th, 2021]
- The forgotten importance of the War of Jenkins' Ear - The Economist - December 5th, 2021 [December 5th, 2021]
- What Conservative Critics of Higher Education Share - The Atlantic - December 5th, 2021 [December 5th, 2021]
- The Unite the Right trial is exposing the chasm between who plans White nationalism's battles and who does the fighting - ABC17News.com - November 19th, 2021 [November 19th, 2021]
- Tordue Salem: Journalists ask National Assembly to order independent inquiry into death of missing reporter - Premium Times - November 19th, 2021 [November 19th, 2021]
- Abu Dhabi to Welcome Two New Museums in Addition to Guggenheim and Zayed - Artforum - November 19th, 2021 [November 19th, 2021]
- Gauteng government at the vanguard of SAs green economy plans - Business Day - November 17th, 2021 [November 17th, 2021]
- 25 years of school and family connections | Hub - The Hub at Johns Hopkins - November 17th, 2021 [November 17th, 2021]
- Opinion: Organized crime is a top driver of global deforestation and climate change - Houston Chronicle - November 17th, 2021 [November 17th, 2021]
- Letters to the editor: Lend a hand to these family caregivers - Austin American-Statesman - November 15th, 2021 [November 15th, 2021]
- University of Chicago to award four honorary degrees at 2022 Convocation - UChicago News - November 9th, 2021 [November 9th, 2021]
- Review of Misfire by Tim Mak: How the Wheels Came Off at the NRA - The New Republic - November 9th, 2021 [November 9th, 2021]