Untangling the evolution of our home galaxy, the Milky Way, is a challenge similar to mapping the human genome, according to the European Space Agency (ESA). ESA's galaxy mapper, Gaia, takes trillions of measurements of 2 billion of the brightest stars in the sky. Here, we look at what it takes to unpick those measurements to reveal the galaxy's secrets.
On June 13, the Gaia Data Processing and Analysis Consortium (DPAC), a collaboration of 450 European astronomers and engineers supporting the galaxy-mapping endeavor, released what DPAC chair Anthony Brown described as "the richest set of astronomical data ever published."
To create the 10-terabyte catalog of compressed data, DPAC computers had to ingest 940 billion observations of 2 billion of the brightest light sources in the sky, Brown, an astronomer at Leiden University in the Netherlands, said at an ESA news conference on June 13.
Related: New trove of Gaia data will uncloak the Milky Way's dark past and future
The data, captured by Gaia between June 2014 and June 2017, contained information about 1.5 billion stars' precise positions and motions in the sky; details about the ages, temperatures and brightness levels of about half a billion of those stars; and detailed chemical compositions of several million of them.
It took five years for the data to pass through the sophisticated computational pipeline of validation, calibration and analysis procedures, which involve six supercomputing centers in six European countries. It would take a thousand years for a single (and rather powerful) personal computer to process the data set, Gonzalo Gracia, DPAC project coordinator for data processing, told Space.com.
As of 2022, the main Gaia database contains 1 petabyte of data, Gracia added, which is equivalent to the data capacity of 200,000 DVDs. To date, the telescope has made over 100 measurements of every single one of the 2 billion light sources it sees.
"Every day, Gaia sends us between 20 and 100 gigabytes of data," Gracia said. "That might not seem like that much if you compare it to the bandwidth you have at home, but we are talking about a satellite that is 1.5 million kilometers [930,000 miles] away from Earth."
From Gaia's vantage point at Lagrange Point 2, a stable point in the sun-Earth system where the gravitational pulls of the two bodies are in balance, the spacecraft observes the cosmos while shielded from the sun's glare.
Three ESA deep-space antennas (one each near Madrid; Malarge, Argentina; and New Norcia, Australia) receive the data collected by the space probe's two telescopes and other instruments. From those ground stations, the measurements travel on conventional internet lines to the European Space Operations Centre in Darmstadt, Germany, for basic checks, before the data are sent to the agency's Science Operations Center in Madrid.
"This is when we do the first round of processing," Gracia said. "We do some initial calibrations and run the data through a piece of software to assess the health of the satellite. This happens in the first hours after the data is received."
Then, things start to get complicated. A data-processing center at CNES, the French space agency, in Toulouse scans the data set for fast-moving objects in the solar system: asteroids and comets that might be on a collision course with Earth.
"They have a pipeline, which detects those objects and checks whether they are already known," Gracia said. "If they are not known, they raise an alarm with the solar system objects community in the world, who can do the follow-up observation and find what the object is about and what is its trajectory."
Gaia is quite efficient in monitoring asteroids and might even be able to see some that are not visible from Earth. The mission's June 13 data release contained information about detailed trajectories of 60,000 solar system space rocks. On top of that, Gaia measured light spectra of these space rocks, revealing their chemical compositions. Previously, astronomers knew detailed chemical compositions of only 4,500 asteroids.
Separately, a team in Cambridge, England, compares new brightness measurements delivered by Gaia with data acquired earlier. Significant changes in brightness levels of stars are always a reason for excitement, as they might indicate supernovas, explosions that occur when massive stars die before collapsing into black holes or neutron stars.
Sometimes, dim distant stars and galaxies can temporarily lighten up through microlensing, an odd phenomenon that happens when an extremely massive object comes between the dim star and the observer, its powerful light-bending gravity acting as a magnifying glass. Gaia, which completes a scan of the entire sky every two months, sees all that.
In the meantime, the rest of the consortium conducts what Gracia calls "cyclic processing": endless rounds of redigesting, validating and analyzing the data to extract the most accurate information that astronomers can use to create precise maps of the Milky Way galaxy and model its life into the past and future. Several thousand servers running tens of thousands of core processors are involved in the operation.
"We have to process the data several times," Gracia said. "We process it, we give it to the scientists for checks, and then we have to tune our calibrations, our algorithms; we have to improve them every time."
The data sets are also dependent on each other. For example, without information about precise positions of the observed objects, the data on brightness changes or movements of asteroids would be worthless.
"We essentially have the information about the amount of photons hitting the Gaia telescopes, and from their position in the window, we derive the positions in the sky," Gracia said. "This is done in Barcelona, where we produce this astrometric information for all the sources in the sky. This is the input for basically all the other processing that we do. It takes a lot of time to do all that and to do it with a sufficient amount of data to ensure that the data is really of the best quality."
This amount of processing is the reason behind the delay between the acquisition of the data and its release. Gaia launched in December 2013, but the astronomical community didn't get their hands on the first batch of data until September 2016. The second data release followed in April 2018. The June 13 data dump was preceded by a partial early release in December 2020. Each new catalog increases the precision of the data as well as the amount of available information about each of the 2 billion light sources the telescope sees. Although the mission is already in its ninth year, there is no stopping for the 450 researchers and engineers at DPAC.
While the world's Milky Way researchers are unpacking the gifts of the June 13 data release, looking for evidence of the galaxy's dynamic life, Gracia and his colleagues are already busy working on the next data dump, which promises, among other things, to unleash Gaia's potential to spot planets around faraway stars. Thousands of new finds are expected to enrich the existing exoplanet catalog as the DPAC researchers train their algorithms to spot the characteristic mild dimming of a star caused by a planet crossing in front of its disk.
"We started processing data for the fourth cycle two years ago and are already planning the fifth cycle," Gracia said. "It's really nonstop."
Follow Tereza Pultarova on Twitter @TerezaPultarova. Follow us on Twitter @Spacedotcom and on Facebook.
More here:
Untangling the Milky Way's evolution through big-data astronomy - Space.com
- Astronomy clubs want to help you enjoy the eclipse safely - NPR - March 16th, 2024 [March 16th, 2024]
- You Can See a Rare, Bright Comet This Month. Will It Be Visible During the Solar Eclipse? - Smithsonian Magazine - March 16th, 2024 [March 16th, 2024]
- Solar Eclipse Path Map Shows States Where Sun Will Be Blocked Out - Newsweek - March 16th, 2024 [March 16th, 2024]
- Deep-space astronomy sensor peers into the heart of an atom - Space.com - March 16th, 2024 [March 16th, 2024]
- Physics and Astronomy Colloquium - Professor Paul Cassak; Department of Physics and Astronomy, West Virginia ... - The University of Iowa - March 16th, 2024 [March 16th, 2024]
- United Nations prioritizes discussion of Dark and Quiet Skies - Astrobites - March 16th, 2024 [March 16th, 2024]
- The burning acid behind ant stings was spotted around two stars - WAPT Jackson - March 16th, 2024 [March 16th, 2024]
- The oddities known as Centaurs may sprout their tales after jumping to new orbits - Astronomy Magazine - March 16th, 2024 [March 16th, 2024]
- Pair of astronomy brothers to host eclipse viewing event - KAIT - March 16th, 2024 [March 16th, 2024]
- How to watch the solar eclipse online - Astronomy Magazine - March 16th, 2024 [March 16th, 2024]
- How does a black hole get to the center of a galaxy, and does the galaxy revolve around it? - Astronomy Magazine - March 16th, 2024 [March 16th, 2024]
- The eclipse gives astronomy clubs an opportunity to shine - Voice Of Alexandria - March 16th, 2024 [March 16th, 2024]
- AI 'for all': How access to new models is advancing academic research, from astronomy to education - Source - Microsoft - March 16th, 2024 [March 16th, 2024]
- KU Department of Physics & Astronomy professor receives prestigious NSF award for black hole research - Salina Post - March 16th, 2024 [March 16th, 2024]
- Inspect impressive Mare Imbrium Astronomy Now - Astronomy Now Online - March 16th, 2024 [March 16th, 2024]
- The Sky This Week from March 15 to 22: A conjunction of Venus and Saturn - Astronomy Magazine - March 16th, 2024 [March 16th, 2024]
- Pons-Brooks and M31 - Astronomy Magazine - March 16th, 2024 [March 16th, 2024]
- The slightly weird mathematical coincidence behind an eclipse - Astronomy Magazine - March 16th, 2024 [March 16th, 2024]
- APOD: 2024 March 17 NGC 7714: Starburst after Galaxy Collision - Astronomy Picture of the Day - March 16th, 2024 [March 16th, 2024]
- How to Safely View the Eclipse National Radio Astronomy Observatory - National Radio Astronomy Observatory - March 16th, 2024 [March 16th, 2024]
- NOIRLab releases jaw-dropping images, video of remnants from massive star explosion | Astronomy.com - Astronomy Magazine - March 16th, 2024 [March 16th, 2024]
- JWST spots oceans' worth of water evaporating from a distant disk - Astronomy Magazine - March 16th, 2024 [March 16th, 2024]
- Radiation is vaporizing a young star's disk in the Orion Nebula - Astronomy Magazine - March 16th, 2024 [March 16th, 2024]
- APOD: 2024 March 12 A Galaxy Shaped Rocket Exhaust Spiral - Astronomy Picture of the Day - March 16th, 2024 [March 16th, 2024]
- Best laptops for astronomers and astrophotographers in 2024 - Space.com - March 16th, 2024 [March 16th, 2024]
- Why astronomers are worried about 2 major telescopes right now - Space.com - March 16th, 2024 [March 16th, 2024]
- The People Behind Webb | Webb - WebbTelescope.org - March 16th, 2024 [March 16th, 2024]
- X-ray image of universe reveals almost 1 million high-energy objects: 'These are mind-blowing numbers' - Space.com - February 1st, 2024 [February 1st, 2024]
- Galaxy named 'Nube' is almost invisible, baffling astronomers Earth.com - Earth.com - February 1st, 2024 [February 1st, 2024]
- Giant Star Seen 150 Days Before it Exploded as a Supernova - Universe Today - February 1st, 2024 [February 1st, 2024]
- UH astronomer named to prominent national astronomical society | University of Hawaii System News - University of Hawaii - February 1st, 2024 [February 1st, 2024]
- The Art of SeeingStates of Astronomy - Announcements - E-Flux - February 1st, 2024 [February 1st, 2024]
- Pluto isn't really a planet, but it might be Arizona's official state planet - Arizona Mirror - February 1st, 2024 [February 1st, 2024]
- Did You Know? Stars Near and Far Reveal Their Secrets to CSUN Scientists - California State University, Northridge - February 1st, 2024 [February 1st, 2024]
- Top 10 space stories of 2023 - Astronomy Magazine - February 1st, 2024 [February 1st, 2024]
- How we found the Milky Way's bar: This Week in Astronomy with Dave Eicher - Astronomy Magazine - February 1st, 2024 [February 1st, 2024]
- The best telescope to use with a smartphone - Astronomy Magazine - February 1st, 2024 [February 1st, 2024]
- JWST releases 19 awe-inspiring images of spiral galaxies - Astronomy Magazine - February 1st, 2024 [February 1st, 2024]
- Learning Shines Brightly at SuperKnova National Radio Astronomy Observatory - National Radio Astronomy Observatory - February 1st, 2024 [February 1st, 2024]
- The Crafoord Prize 2024 goes to three ERC grantees for their pioneering contributions to astronomy and mathematics ... - European Research Council - February 1st, 2024 [February 1st, 2024]
- The Moon's south pole is likely not the safest place for manned missions - Astronomy Magazine - February 1st, 2024 [February 1st, 2024]
- The moon could be perfect for cutting-edge telescopes but not if we don't protect it - Space.com - February 1st, 2024 [February 1st, 2024]
- February Astronomy: Spot the Milky Way and the Zodiacal Light While the Skies Are Darkest - Coachella Valley Independent - February 1st, 2024 [February 1st, 2024]
- You can stream an asteroid whizzing past Earth this weekend - Astronomy Magazine - February 1st, 2024 [February 1st, 2024]
- Chinese Astronomy at the Royal Observatory | Royal Observatory | Things to do in London - Time Out London - February 1st, 2024 [February 1st, 2024]
- Astronomers in Chile to scour universe with car-sized mega camera - - February 1st, 2024 [February 1st, 2024]
- Dark Matter Might Help Explain How Supermassive Black Holes Can Merge - Universe Today - February 1st, 2024 [February 1st, 2024]
- How far away is the sun? They went on a perilous journey to find out. - National Geographic - February 1st, 2024 [February 1st, 2024]
- Scientists spotted an asteroid hours before it burned up over Germany - Astronomy Magazine - February 1st, 2024 [February 1st, 2024]
- XRISM Unveils the Invisible: A New Era in X-Ray Astronomy - SciTechDaily - January 10th, 2024 [January 10th, 2024]
- New Astronomy Finding Uncovers the Mystery of Star Formation at the Edge of Galaxies - SBU News - Stony Brook News - January 10th, 2024 [January 10th, 2024]
- The Future Of Astronomy Lies In Artificial Intelligence - Forbes - January 10th, 2024 [January 10th, 2024]
- The 'Super Bowl of Astronomy' begins next week in New Orleans - Space.com - January 10th, 2024 [January 10th, 2024]
- Scientific American proposes policing the language of astronomy to make it beautiful and elegant, as well as ... - Why Evolution Is True - January 10th, 2024 [January 10th, 2024]
- 'Blob-like' home of farthest-known fast radio burst is collection of seven galaxies - Northwestern Now - January 10th, 2024 [January 10th, 2024]
- Astronomers revealed mysterious star formation by hearts of molecular clouds - Tech Explorist - January 10th, 2024 [January 10th, 2024]
- Spectroscopic sizing of interstellar icy grains with JWST - Nature.com - January 10th, 2024 [January 10th, 2024]
- Kip Thorne and the mind-bending science of Interstellar | Astronomy.com - Astronomy Magazine - January 10th, 2024 [January 10th, 2024]
- Here There Be DRAGNs National Radio Astronomy Observatory - National Radio Astronomy Observatory - January 10th, 2024 [January 10th, 2024]
- Unistellar's latest smart telescopes take the hassle out of backyard astronomy - Engadget - January 10th, 2024 [January 10th, 2024]
- 20 of the best places to view the 2024 total solar eclipse - Astronomy Magazine - January 10th, 2024 [January 10th, 2024]
- Northern Arizona astronomy: How old is our third generation sun? - Grand Canyon News - January 10th, 2024 [January 10th, 2024]
- Evidence builds that Kamo'oalewa is a chunk of the Moon accompanying Earth - Astronomy Magazine - January 10th, 2024 [January 10th, 2024]
- The Sky This Week from January 5 to 12: Visitors to the Scorpion - Astronomy Magazine - January 10th, 2024 [January 10th, 2024]
- AAS 243 NRAO Press Announcement - National Radio Astronomy Observatory - January 10th, 2024 [January 10th, 2024]
- Your guide to the sky in 2024 - Astronomy Magazine - January 10th, 2024 [January 10th, 2024]
- The best binoculars for astronomy in 2024 - Popular Science - January 10th, 2024 [January 10th, 2024]
- Are we visible to alien astronomers? This study makes the case - Astronomy Magazine - January 10th, 2024 [January 10th, 2024]
- Mystery of Star Formation Revealed by Hearts of Molecular Clouds - National Radio Astronomy Observatory - January 10th, 2024 [January 10th, 2024]
- Astronomers Solve the Mystery of Giant Radio Circles - AZoQuantum - January 10th, 2024 [January 10th, 2024]
- Early Evolution of Planetary Disk Structures Seen for the First Time - National Radio Astronomy Observatory - January 10th, 2024 [January 10th, 2024]
- XRISM's Revolutionary Insights into X-Ray Astronomy - AZoQuantum - January 10th, 2024 [January 10th, 2024]
- Vatican's chief astronomer talks about stars, beauty, truth - Aleteia - January 10th, 2024 [January 10th, 2024]
- Explore the cosmos in EAC Payson Campus astronomy workshops - Payson Roundup - January 10th, 2024 [January 10th, 2024]
- Neptune is more of a greenish blue than is commonly depicted - NPR - January 10th, 2024 [January 10th, 2024]
- First Yale Gravitational Wave Symposium sparks research innovation | Department of Physics - Yale University - January 10th, 2024 [January 10th, 2024]
- The best expensive telescopes for those ready to splurge - Astronomy Magazine - January 10th, 2024 [January 10th, 2024]
- Dinosaurs and a touch of astronomy | Education | paysonroundup.com - Payson Roundup - January 10th, 2024 [January 10th, 2024]
- Astronomical Illusions: New Images Reveal What Neptune and Uranus Really Look Like - SciTechDaily - January 10th, 2024 [January 10th, 2024]
- Book Review: Things That Go Bump in the Universe, by C. Rene James - The New York Times - December 16th, 2023 [December 16th, 2023]