One way to minimize such delays is by cutting a path through the Internet, one that takes into account the traffic conditions up ahead. My company, Subspace, has built such a network using custom hardware and a proprietary fiber-optic backbone. And we've shown it doesn't have to be complicatedusers don't have to do anything more complicated than logging onto a Web portal. Put together, Subspace has created a "weather map" for the Internet that can spot choppy or stormy parts of the network and work around them for better, faster real-time data movement.
The online transformation occasioned by the current pandemic can be seen in a single statistic. In December 2019 the videoconferencing company Zoom had 10 million daily participants, and by April of the following year it had 300 million. Most of those new recruits to the real-time Internet were taken by surprise by problems that have been plaguing online gamers for decades.
Subspace was founded in early 2018. When we started, we anticipated that Internet performance for real-time applications wasn't optimal, but it turned out to be far worse than we had imagined. More than 20 percent of Internet-connected devices experienced performance issues at any given time, and 80 percent had major disruptions several times a day.
We initially focused on multiplayer games, where a player's experience depends on real-time network performance and every millisecond counts. In the second half of 2019, we deployed our network and technology for one of the largest game developers in the world, resulting in an order-of-magnitude increase in engagement and doubling the number of players with a competitive connection.
Internet performance directly affects online gaming in two ways: First you must download the game, a one-time request for a large amount of datasomething that today's Internet supports well. Playing the game requires small transfers of data to synchronize a player's actions with the larger state of the gamesomething the Internet does not support nearly as well.
Gamers' problems have to do with latency, variations in latency called jitter, and disruptions in receiving data called packet loss. For instance, high-latency connections limit the speed of "matchmaking," or the process of connecting players to one another, by restricting the pool of players who can join quickly. Slower matchmaking in turn can cause frustrated players to quit before a game starts, leaving a still smaller matchmaking pool, which further limits options for the remaining players and creates a vicious cycle.
In 2020, when COVID-19 pushed the world to videoconferencing and distance learning, these performance issues suddenly began to affect many more people. For example, people who worked on IT help desks began working remotely, and managers had to scramble to find ways for those workers to answer calls in a clear and reliable way. That's far harder to do from a person's home than from a central office that's on a robust fiber-optic cable line. On top of that, call volume at contact centers is also at an all-time high. Zendesk, a customer-service software provider, found that support tickets increased by 30 percent during the period of February 2020 to February 2021, compared with the previous year. The company also estimates that call volume will stabilize at about 20 percent higher than the prepandemic average.
The shifts in online usage created by the pandemic are also strengthening the case to further democratize the Internetthe idea that there must be a universal, consistent standard of use to everyone, regardless of who or where they are. This is not an unqualified good, because email has very different requirements from those of an online game or a videoconference.
In the 1990s, Internet access was expanded from the world of the military and certain educational organizations to a truly universal system. Then, content delivery networks (CDNs) like Akamai and Cloudflare democratized data caching by putting commonly requested data, such as images and videos, into data centers and servers closer to the "last mile" to the ultimate users. Finally, Amazon, Microsoft, and others built cloud-computing data centers that put artificial intelligence, video editing, and other computationally intensive projects closer to last-mile users.
Connections between nodes are designed around delivering as much data as possible, rather than delivering data consistently or with minimal delay.
But there's still one final stage of democratization that hasn't happenedthe democratization of the paths through which data is routed. The Internet connects hundreds of millions of nodes, but the actual performance of the paths connecting these nodes varies wildly, even in major cities. Connections between nodes are designed around delivering as much data as possible, rather than delivering data consistently or with minimal delay.
To use the analogy of a highway: Imagine you're in the middle of a road trip from Los Angeles to Chicago, and a prolonged blizzard is raging in the Rocky Mountains. While driving through Denver would typically be the most direct (and quickest) route, the blizzard will slow you down at best, or at worst result in an accident. Instead, it might make more sense to detour through Dallas. In doing so, you would be responding to the actual current conditions of the route, rather than relying on what their capabilities should be.
Democratized network elements wouldn't necessarily choose the best route based on the lowest cost or highest capacity. Instead, as Google Maps, Waze, and other navigation and route-planning apps do for drivers, a fully democratized Internet would route data along the pathway with the best performance and stability. In other words, the route with the most throughput or the least number of hops would not be automatically prioritized.
The traditional emphasis on pushing more data through the network ignores all the things that cause latencyissues like instability, geographic distance, or circuitous paths. This is why you can have a Wi-Fi connection of 100 megabits per second and still have a choppy Zoom call. When that happens, the network elements connecting you to the others in your call aren't delivering a consistent performance.
Internet routing often takes circuitous pathsfollowing national borders, mountain ranges, and morejust as driving cross-country often requires several highways. Even worse, ISP and carrier networks don't know what exists beyond themselves, and as they pass packets to one another, they often backtrack. The last mile in particularakin to pulling off the interstate and onto local roadsis thorny, as traffic changes hands between carriers based on cost, politics, and ownership. It's this indirect routing, networks' lack of awareness of the entire Internet, and last-mile inconsistency that make delivering data with minimal delay extremely difficult.
A better solution is to reroute data to the path with the best performance at the moment. This may sound simple enough in theory, but it can be complicated to implement for a few reasons.
For one, the emergence of Netflix and other video-streaming platforms over the past 20 years has tended to impede real-time applications. Because such platforms prioritize putting often-requested data closer to network edges, these networks have become less conducive to latency-sensitive video calls and online games. At the same time, while ISPs have advertisedand providedfaster upload and download speeds over time, established network infrastructures have only become more entrenched. It's a perfect case of the adage "If all you have is a hammer, everything looks like a nail."
A more significant problem is that ISPs and CDNs have no practical control over data after it's been routed through their networks. Just because you pay a particular ISP for service doesn't mean that every request you make stays confined to the parts of the network they control. In fact, more often than not, requests don't.
One operator might route data along an optimal path in its own network, and transfer the data to another operator's network, with no idea that the second operator's network is currently clogged. What operators need is an eye in the sky to coordinate around potential and emerging delays that they themselves might not be aware of. That's one aspect of what Subspace does.
In essence, Subspace has created its own real-time mapping of Internet traffic and conditions, similar to the way Waze maps traffic on roads and highways. And like Waze, which uses the information it gathers to reroute people based on the current traffic conditions, Subspace can do the same with Internet traffic, seeing beyond any one portion controlled by a particular operator.
Subspace uses custom global routers and routing systems, as well as dedicated fiber mesh networks, to provide alternative pathways for routes that, for one reason or another, tend to suffer from latency more than most. This hardware has been installed inside more than 100 data-center facilities worldwide. An IT administrator can easily arrange to route outgoing traffic through the Subspace network and thus get that traffic to its destination sooner than the traditional public domain name system (DNS) could manage.
In essence, Subspace has created its own real-time mapping of Internet traffic and conditions, similar to the way Waze maps traffic on roads and highways.
Subspace uses custom software to direct the traffic around any roadblocks that may lie between it and its target destination. In real time, the software takes network measurements of latency (in milliseconds), jitter (in latency variation), and packet loss (in the number of successfully delivered data packets within a time interval) on all possible paths. Whenever there is an unusual or unexpected latency spikewhat we like to call "Internet weather"the software automatically reroutes traffic across the entire network as needed.
Enterprises have tried to avoid bad Internet weather by building private networks using technologies such as SD-WAN (software-defined wide area networking) and MPLS (multiprotocol label switching). However, these methods work only when an entire workforce is reporting to a handful of centralized offices. If large numbers of employees are working from home, each home has to be treated as a branch office, making the logistics too complex and costly.
Besides random bad weather, there are some traffic problems on the public Internet that arise as side effects of certain security measures. Take the act of vandalism known as a distributed denial-of-service (DDoS) attack, in which malicious actors flood servers with packets in order to overload the systems. It's a common scourge of multiplayer games. To thwart such attacks, the industry standard "DDoS scrubbing" technique attempts to separate malicious traffic from "safe" traffic. However, getting traffic to a scrubbing center often means routing it through hairpin twists and turns, detours that can add upwards of 100 milliseconds in latency.
Subspace instead protects against DDoS attacks by acting as a traffic filter itself, without changing the path that packets take or in any way adding latency. In the last two years, we estimate that Subspace has already prevented hundreds of DDoS attacks on multiplayer games.
The tricks that helped the Internet grow in its early decades are no longer delivering the expected bang for their buck, as people now demand more from networks than just bandwidth. Just pushing large volumes of data through the network can no longer sustain innovation.
The Internet instead needs stable, direct, speed-of-light communication, delivered by a dedicated network. Until now, we've been limited to working with large companies to address the particular network needs they might have. However, we've recently made our network available to any application developer in an effort to give any Internet application more network performance.
With this new, improved Internet, people won't suffer through choppy Zoom calls. Surgeons performing telemedicine won't be cut off in mid-suture. And the physical, augmented, virtual-realities-merging metaverse will at last become possible.
This article appears in the November 2021 print issue as "The Internet's Coming Sunny Days."
From Your Site Articles
Related Articles Around the Web
Read this article:
What Computing Tech Will Drive Future Space Exploration? - IEEE Spectrum
- 10 Fun Facts of the Day: Space Exploration - - BladenOnline.com - June 1st, 2024 [June 1st, 2024]
- NASA Unveils Game-Changing Infrared Cameras for Earth and Space Exploration - SciTechDaily - June 1st, 2024 [June 1st, 2024]
- China lands uncrewed spacecraft on far side of the moon - Yahoo News Australia - June 1st, 2024 [June 1st, 2024]
- Peru and Slovakia sign the Artemis Accords for peaceful moon exploration - Space.com - June 1st, 2024 [June 1st, 2024]
- Chandra X-ray Observatory's sharp imaging has been crucial for space exploration the past 25 years - Fast Company - June 1st, 2024 [June 1st, 2024]
- In-space electric propulsion: powering the future EU space ecosystem - Cordis News - June 1st, 2024 [June 1st, 2024]
- Narrow escapes: When space missions almost ended in disaster - The National - June 1st, 2024 [June 1st, 2024]
- Why planetary protection matters to the future of space exploration - The Space Review - June 1st, 2024 [June 1st, 2024]
- Space & Sustainability Part 2: The Role of Mobility in Ensuring the Space Industry's Growth - Fragomen - June 1st, 2024 [June 1st, 2024]
- South Korea is Planning to Send a Mission to Mars by 2045 - Universe Today - June 1st, 2024 [June 1st, 2024]
- ISRO and Wipro 3D partner for space exploration with 3D-printed rocket engine - Business Today - June 1st, 2024 [June 1st, 2024]
- A Chinese spacecraft lands on moon's far side to collect rocks in growing space rivalry with US - pentictonherald.ca - June 1st, 2024 [June 1st, 2024]
- Peru and Slovakia sign the Artemis Accords - SpaceNews - June 1st, 2024 [June 1st, 2024]
- Ed Dwight finally goes to space on Blue Origin as 1st U.S. Black astronaut - The Washington Post - June 1st, 2024 [June 1st, 2024]
- Japans Wooden Satellite to Combat Space Debris - DirectIndustry e-Magazine - June 1st, 2024 [June 1st, 2024]
- Europe's space sector to soon welcome Ariane 6: 'The missions will be longer and more versatile' - Euronews - June 1st, 2024 [June 1st, 2024]
- South Korea will fly to Mars in 2045 - The Universe. Space. Tech - June 1st, 2024 [June 1st, 2024]
- ISRO and Wipro 3D partner for space exploration with 3D-printed rocket engine - MSN - June 1st, 2024 [June 1st, 2024]
- Japanese space agency loses contact with Venus orbiter Akatsuki - Washington Times - June 1st, 2024 [June 1st, 2024]
- 15 of the Most Life-Changing Spacecraft and Missions That Fueled Our Curiosity - DISCOVER Magazine - June 1st, 2024 [June 1st, 2024]
- Zebrafish flourish in China's space station amid unusual behavior - NewsBytes - June 1st, 2024 [June 1st, 2024]
- The Future of the Space Industry - Quillette - May 27th, 2024 [May 27th, 2024]
- US economy to benefit from NASA investment in 3D-printable superalloy - Space.com - May 27th, 2024 [May 27th, 2024]
- NASA Engages in Artemis Accords Workshop to Advance Exploration - NASA - May 27th, 2024 [May 27th, 2024]
- Jennifer Scott Williams: Leading the Next Giant Leap in Space Exploration and Championing STEM Advocacy - NASA - May 27th, 2024 [May 27th, 2024]
- ESA selects Thales Alenia Space and The Exploration Company for commercial cargo program - SpaceNews - May 27th, 2024 [May 27th, 2024]
- Clare Luckey: Shaping the Future of Mars Missions and Inspiring the Artemis Generation - NASA - May 27th, 2024 [May 27th, 2024]
- ISRO and US Discuss Future Space Collaboration Projects - SpaceWatch.Global - May 27th, 2024 [May 27th, 2024]
- International Space Development Conference 2024 beams up Star Trek's William Shatner and more in Los Angeles - Space.com - May 27th, 2024 [May 27th, 2024]
- How astronauts exercise to stay fit and healthy in space - Earth.com - May 27th, 2024 [May 27th, 2024]
- ARK Space Exploration & Innovation ETF (ARKX) - The Motley Fool - May 27th, 2024 [May 27th, 2024]
- Space calendar 2024: Rocket launches and skywatching dates - Space.com - May 27th, 2024 [May 27th, 2024]
- How Artemis astronauts will be protected from solar storms - SpaceNews - May 27th, 2024 [May 27th, 2024]
- 50 years ago: USSR kills its Moon rocket - RussianSpaceWeb.com - May 27th, 2024 [May 27th, 2024]
- Where Are India-US Ties Headed In Commercialisation Of Space? Expert Speaks To NDTV - NDTV - May 27th, 2024 [May 27th, 2024]
- Chinese Spaceplane Releases Mysterious Orbital Object - The Daily Galaxy --Great Discoveries Channel - May 27th, 2024 [May 27th, 2024]
- ESA - Celebrating Andreas - European Space Agency - May 27th, 2024 [May 27th, 2024]
- NASA scrapped the next phase of its Mars mission. Now what? - Marketplace - May 27th, 2024 [May 27th, 2024]
- NASA defends Artemis cost and schedule amid planning of possible changes - SpaceNews - May 27th, 2024 [May 27th, 2024]
- Max Just Released a Documentary That Finally Does Justice to a Tragic NASA Disaster - MovieWeb - May 27th, 2024 [May 27th, 2024]
- A Q&A with Katya Echazarreta, the first Mexican-born woman to travel to space - Astronomy Magazine - April 24th, 2024 [April 24th, 2024]
- Japans planning its first lunar steps with the Artemis program - The Hill - April 24th, 2024 [April 24th, 2024]
- DC Eyes Beijing's Investments In Space - Payload - Payload - April 24th, 2024 [April 24th, 2024]
- THIS WEEK @NASA: More Partners in Space Exploration, Upgrade to Testing Facilities for Artemis II - SpaceCoastDaily.com - April 24th, 2024 [April 24th, 2024]
- Explore Space and Poetry with NASA and Poet Laureate Ada Limn - sxsw.com - April 24th, 2024 [April 24th, 2024]
- NASA warns of secret military presence in space disguised as civilian programs - TweakTown - April 24th, 2024 [April 24th, 2024]
- NEW: UAH wins first place in college division in NASA's 30th Human Exploration Rover Challenge - Hville Blast - April 24th, 2024 [April 24th, 2024]
- Are we prepared for Chinese preeminence on the moon and Mars? (op-ed) - Space.com - April 24th, 2024 [April 24th, 2024]
- As space exploration increases, effective space regulation is a necessity - Verdict - April 24th, 2024 [April 24th, 2024]
- NASA Announces Winners of Power to Explore Challenge - NASA - April 24th, 2024 [April 24th, 2024]
- NASA tests walking robot on Mount Hood for space exploration with universities - KTVL - April 24th, 2024 [April 24th, 2024]
- Five future astronauts certified from European Space Agency's 2022 graduating class - UPI News - April 24th, 2024 [April 24th, 2024]
- Sweden becomes 38th country to sign NASA's Artemis Accords for moon exploration - Space.com - April 24th, 2024 [April 24th, 2024]
- Space start-up claims to have discovered propellant-free propulsion system - NewsBytes - April 24th, 2024 [April 24th, 2024]
- Soyuz Spacecraft Launches to Space Station With NASA Astronaut - SciTechDaily - March 24th, 2024 [March 24th, 2024]
- This Week In Space podcast: Episode 103 Starship's Orbital Feat - Space.com - March 24th, 2024 [March 24th, 2024]
- From 3D To Outer Space: Register For WCC Youth Summer Camps - mitechnews.com - March 24th, 2024 [March 24th, 2024]
- NASA and SpaceX: Enhancing Space Exploration with the 30th Resupply Mission - Space Daily - March 24th, 2024 [March 24th, 2024]
- The Cosmic Enigma: How Space Exploration is Unraveling the Universe's Birth Secrets - yTech - March 24th, 2024 [March 24th, 2024]
- Following Safe Return, NASA's SpaceX Crew-7 to Recount Space Mission - NASA - March 24th, 2024 [March 24th, 2024]
- The Heat: Space Exploration - CGTN America - March 24th, 2024 [March 24th, 2024]
- SpaceX Time-Lapse Video Captures the Essence of Space Travel - yTech - March 24th, 2024 [March 24th, 2024]
- TOP 4 Reasons to Return to the Moon - The Universe. Space. Tech - March 24th, 2024 [March 24th, 2024]
- SpaceX Dragon Successfully Attaches to ISS Bringing Vital Research Payloads - yTech - March 24th, 2024 [March 24th, 2024]
- End of an Era: Delta IV Heavy Makes Final Journey to the Stars - yTech - March 24th, 2024 [March 24th, 2024]
- Photography exhibition at the Mound delves into space exploration - The National - March 24th, 2024 [March 24th, 2024]
- Lunar Node 1: the trailblazing lunar beacon guiding NASA's future in space exploration - Boing Boing - March 24th, 2024 [March 24th, 2024]
- SpaceX's CRS-30 Mission: Delivering Innovations and Research to the ISS - yTech - March 24th, 2024 [March 24th, 2024]
- Remembering Tom Stafford, the Space Races Peacemaker (1930-2024) - AmericaSpace - March 24th, 2024 [March 24th, 2024]
- 9 Hints That Kingdom Of The Planet Of The Apes Involves Space Travel - Screen Rant - March 24th, 2024 [March 24th, 2024]
- NASA sends science projects and hardware aboard SpaceX's 30th resupply launch to ISS SatNews - SatNews - March 24th, 2024 [March 24th, 2024]
- SpaceX Dragon Spacecraft Docks to Space Station With New Science and Supplies - SciTechDaily - March 24th, 2024 [March 24th, 2024]
- Moon Race 2.0: Why so many nations and private companies are aiming for lunar landings - BBC.com - February 16th, 2024 [February 16th, 2024]
- NASA Selects Texas A&M As First Approved Exploration Park Facility - Texas A&M University Today - February 16th, 2024 [February 16th, 2024]
- The Space Economy in 2024 - OODA Loop - February 16th, 2024 [February 16th, 2024]
- Opinion | It's an exciting time in space exploration. But U.S. leadership is at risk. - The Washington Post - February 16th, 2024 [February 16th, 2024]
- NASA Experiment With Fire in Space Ends When Entire Spacecraft Burns Up - Futurism - February 16th, 2024 [February 16th, 2024]
- NASA Selects Texas A&M as First Approved Exploration Park Facility - NASA - February 16th, 2024 [February 16th, 2024]
- Ground-Based Lasers Could Accelerate Spacecraft to Other Stars - Universe Today - February 16th, 2024 [February 16th, 2024]
- 8 Space Exploration Books to Add to Your TBR - Book Riot - February 16th, 2024 [February 16th, 2024]