One way to minimize such delays is by cutting a path through the Internet, one that takes into account the traffic conditions up ahead. My company, Subspace, has built such a network using custom hardware and a proprietary fiber-optic backbone. And we've shown it doesn't have to be complicatedusers don't have to do anything more complicated than logging onto a Web portal. Put together, Subspace has created a "weather map" for the Internet that can spot choppy or stormy parts of the network and work around them for better, faster real-time data movement.
The online transformation occasioned by the current pandemic can be seen in a single statistic. In December 2019 the videoconferencing company Zoom had 10 million daily participants, and by April of the following year it had 300 million. Most of those new recruits to the real-time Internet were taken by surprise by problems that have been plaguing online gamers for decades.
Subspace was founded in early 2018. When we started, we anticipated that Internet performance for real-time applications wasn't optimal, but it turned out to be far worse than we had imagined. More than 20 percent of Internet-connected devices experienced performance issues at any given time, and 80 percent had major disruptions several times a day.
We initially focused on multiplayer games, where a player's experience depends on real-time network performance and every millisecond counts. In the second half of 2019, we deployed our network and technology for one of the largest game developers in the world, resulting in an order-of-magnitude increase in engagement and doubling the number of players with a competitive connection.
Internet performance directly affects online gaming in two ways: First you must download the game, a one-time request for a large amount of datasomething that today's Internet supports well. Playing the game requires small transfers of data to synchronize a player's actions with the larger state of the gamesomething the Internet does not support nearly as well.
Gamers' problems have to do with latency, variations in latency called jitter, and disruptions in receiving data called packet loss. For instance, high-latency connections limit the speed of "matchmaking," or the process of connecting players to one another, by restricting the pool of players who can join quickly. Slower matchmaking in turn can cause frustrated players to quit before a game starts, leaving a still smaller matchmaking pool, which further limits options for the remaining players and creates a vicious cycle.
In 2020, when COVID-19 pushed the world to videoconferencing and distance learning, these performance issues suddenly began to affect many more people. For example, people who worked on IT help desks began working remotely, and managers had to scramble to find ways for those workers to answer calls in a clear and reliable way. That's far harder to do from a person's home than from a central office that's on a robust fiber-optic cable line. On top of that, call volume at contact centers is also at an all-time high. Zendesk, a customer-service software provider, found that support tickets increased by 30 percent during the period of February 2020 to February 2021, compared with the previous year. The company also estimates that call volume will stabilize at about 20 percent higher than the prepandemic average.
The shifts in online usage created by the pandemic are also strengthening the case to further democratize the Internetthe idea that there must be a universal, consistent standard of use to everyone, regardless of who or where they are. This is not an unqualified good, because email has very different requirements from those of an online game or a videoconference.
In the 1990s, Internet access was expanded from the world of the military and certain educational organizations to a truly universal system. Then, content delivery networks (CDNs) like Akamai and Cloudflare democratized data caching by putting commonly requested data, such as images and videos, into data centers and servers closer to the "last mile" to the ultimate users. Finally, Amazon, Microsoft, and others built cloud-computing data centers that put artificial intelligence, video editing, and other computationally intensive projects closer to last-mile users.
Connections between nodes are designed around delivering as much data as possible, rather than delivering data consistently or with minimal delay.
But there's still one final stage of democratization that hasn't happenedthe democratization of the paths through which data is routed. The Internet connects hundreds of millions of nodes, but the actual performance of the paths connecting these nodes varies wildly, even in major cities. Connections between nodes are designed around delivering as much data as possible, rather than delivering data consistently or with minimal delay.
To use the analogy of a highway: Imagine you're in the middle of a road trip from Los Angeles to Chicago, and a prolonged blizzard is raging in the Rocky Mountains. While driving through Denver would typically be the most direct (and quickest) route, the blizzard will slow you down at best, or at worst result in an accident. Instead, it might make more sense to detour through Dallas. In doing so, you would be responding to the actual current conditions of the route, rather than relying on what their capabilities should be.
Democratized network elements wouldn't necessarily choose the best route based on the lowest cost or highest capacity. Instead, as Google Maps, Waze, and other navigation and route-planning apps do for drivers, a fully democratized Internet would route data along the pathway with the best performance and stability. In other words, the route with the most throughput or the least number of hops would not be automatically prioritized.
The traditional emphasis on pushing more data through the network ignores all the things that cause latencyissues like instability, geographic distance, or circuitous paths. This is why you can have a Wi-Fi connection of 100 megabits per second and still have a choppy Zoom call. When that happens, the network elements connecting you to the others in your call aren't delivering a consistent performance.
Internet routing often takes circuitous pathsfollowing national borders, mountain ranges, and morejust as driving cross-country often requires several highways. Even worse, ISP and carrier networks don't know what exists beyond themselves, and as they pass packets to one another, they often backtrack. The last mile in particularakin to pulling off the interstate and onto local roadsis thorny, as traffic changes hands between carriers based on cost, politics, and ownership. It's this indirect routing, networks' lack of awareness of the entire Internet, and last-mile inconsistency that make delivering data with minimal delay extremely difficult.
A better solution is to reroute data to the path with the best performance at the moment. This may sound simple enough in theory, but it can be complicated to implement for a few reasons.
For one, the emergence of Netflix and other video-streaming platforms over the past 20 years has tended to impede real-time applications. Because such platforms prioritize putting often-requested data closer to network edges, these networks have become less conducive to latency-sensitive video calls and online games. At the same time, while ISPs have advertisedand providedfaster upload and download speeds over time, established network infrastructures have only become more entrenched. It's a perfect case of the adage "If all you have is a hammer, everything looks like a nail."
A more significant problem is that ISPs and CDNs have no practical control over data after it's been routed through their networks. Just because you pay a particular ISP for service doesn't mean that every request you make stays confined to the parts of the network they control. In fact, more often than not, requests don't.
One operator might route data along an optimal path in its own network, and transfer the data to another operator's network, with no idea that the second operator's network is currently clogged. What operators need is an eye in the sky to coordinate around potential and emerging delays that they themselves might not be aware of. That's one aspect of what Subspace does.
In essence, Subspace has created its own real-time mapping of Internet traffic and conditions, similar to the way Waze maps traffic on roads and highways. And like Waze, which uses the information it gathers to reroute people based on the current traffic conditions, Subspace can do the same with Internet traffic, seeing beyond any one portion controlled by a particular operator.
Subspace uses custom global routers and routing systems, as well as dedicated fiber mesh networks, to provide alternative pathways for routes that, for one reason or another, tend to suffer from latency more than most. This hardware has been installed inside more than 100 data-center facilities worldwide. An IT administrator can easily arrange to route outgoing traffic through the Subspace network and thus get that traffic to its destination sooner than the traditional public domain name system (DNS) could manage.
In essence, Subspace has created its own real-time mapping of Internet traffic and conditions, similar to the way Waze maps traffic on roads and highways.
Subspace uses custom software to direct the traffic around any roadblocks that may lie between it and its target destination. In real time, the software takes network measurements of latency (in milliseconds), jitter (in latency variation), and packet loss (in the number of successfully delivered data packets within a time interval) on all possible paths. Whenever there is an unusual or unexpected latency spikewhat we like to call "Internet weather"the software automatically reroutes traffic across the entire network as needed.
Enterprises have tried to avoid bad Internet weather by building private networks using technologies such as SD-WAN (software-defined wide area networking) and MPLS (multiprotocol label switching). However, these methods work only when an entire workforce is reporting to a handful of centralized offices. If large numbers of employees are working from home, each home has to be treated as a branch office, making the logistics too complex and costly.
Besides random bad weather, there are some traffic problems on the public Internet that arise as side effects of certain security measures. Take the act of vandalism known as a distributed denial-of-service (DDoS) attack, in which malicious actors flood servers with packets in order to overload the systems. It's a common scourge of multiplayer games. To thwart such attacks, the industry standard "DDoS scrubbing" technique attempts to separate malicious traffic from "safe" traffic. However, getting traffic to a scrubbing center often means routing it through hairpin twists and turns, detours that can add upwards of 100 milliseconds in latency.
Subspace instead protects against DDoS attacks by acting as a traffic filter itself, without changing the path that packets take or in any way adding latency. In the last two years, we estimate that Subspace has already prevented hundreds of DDoS attacks on multiplayer games.
The tricks that helped the Internet grow in its early decades are no longer delivering the expected bang for their buck, as people now demand more from networks than just bandwidth. Just pushing large volumes of data through the network can no longer sustain innovation.
The Internet instead needs stable, direct, speed-of-light communication, delivered by a dedicated network. Until now, we've been limited to working with large companies to address the particular network needs they might have. However, we've recently made our network available to any application developer in an effort to give any Internet application more network performance.
With this new, improved Internet, people won't suffer through choppy Zoom calls. Surgeons performing telemedicine won't be cut off in mid-suture. And the physical, augmented, virtual-realities-merging metaverse will at last become possible.
This article appears in the November 2021 print issue as "The Internet's Coming Sunny Days."
From Your Site Articles
Related Articles Around the Web
Read this article:
What Computing Tech Will Drive Future Space Exploration? - IEEE Spectrum
- A Q&A with Katya Echazarreta, the first Mexican-born woman to travel to space - Astronomy Magazine - April 24th, 2024 [April 24th, 2024]
- Japans planning its first lunar steps with the Artemis program - The Hill - April 24th, 2024 [April 24th, 2024]
- DC Eyes Beijing's Investments In Space - Payload - Payload - April 24th, 2024 [April 24th, 2024]
- THIS WEEK @NASA: More Partners in Space Exploration, Upgrade to Testing Facilities for Artemis II - SpaceCoastDaily.com - April 24th, 2024 [April 24th, 2024]
- Explore Space and Poetry with NASA and Poet Laureate Ada Limn - sxsw.com - April 24th, 2024 [April 24th, 2024]
- NASA warns of secret military presence in space disguised as civilian programs - TweakTown - April 24th, 2024 [April 24th, 2024]
- NEW: UAH wins first place in college division in NASA's 30th Human Exploration Rover Challenge - Hville Blast - April 24th, 2024 [April 24th, 2024]
- Are we prepared for Chinese preeminence on the moon and Mars? (op-ed) - Space.com - April 24th, 2024 [April 24th, 2024]
- As space exploration increases, effective space regulation is a necessity - Verdict - April 24th, 2024 [April 24th, 2024]
- NASA Announces Winners of Power to Explore Challenge - NASA - April 24th, 2024 [April 24th, 2024]
- NASA tests walking robot on Mount Hood for space exploration with universities - KTVL - April 24th, 2024 [April 24th, 2024]
- Five future astronauts certified from European Space Agency's 2022 graduating class - UPI News - April 24th, 2024 [April 24th, 2024]
- Sweden becomes 38th country to sign NASA's Artemis Accords for moon exploration - Space.com - April 24th, 2024 [April 24th, 2024]
- Space start-up claims to have discovered propellant-free propulsion system - NewsBytes - April 24th, 2024 [April 24th, 2024]
- Soyuz Spacecraft Launches to Space Station With NASA Astronaut - SciTechDaily - March 24th, 2024 [March 24th, 2024]
- This Week In Space podcast: Episode 103 Starship's Orbital Feat - Space.com - March 24th, 2024 [March 24th, 2024]
- From 3D To Outer Space: Register For WCC Youth Summer Camps - mitechnews.com - March 24th, 2024 [March 24th, 2024]
- NASA and SpaceX: Enhancing Space Exploration with the 30th Resupply Mission - Space Daily - March 24th, 2024 [March 24th, 2024]
- The Cosmic Enigma: How Space Exploration is Unraveling the Universe's Birth Secrets - yTech - March 24th, 2024 [March 24th, 2024]
- Following Safe Return, NASA's SpaceX Crew-7 to Recount Space Mission - NASA - March 24th, 2024 [March 24th, 2024]
- The Heat: Space Exploration - CGTN America - March 24th, 2024 [March 24th, 2024]
- SpaceX Time-Lapse Video Captures the Essence of Space Travel - yTech - March 24th, 2024 [March 24th, 2024]
- TOP 4 Reasons to Return to the Moon - The Universe. Space. Tech - March 24th, 2024 [March 24th, 2024]
- SpaceX Dragon Successfully Attaches to ISS Bringing Vital Research Payloads - yTech - March 24th, 2024 [March 24th, 2024]
- End of an Era: Delta IV Heavy Makes Final Journey to the Stars - yTech - March 24th, 2024 [March 24th, 2024]
- Photography exhibition at the Mound delves into space exploration - The National - March 24th, 2024 [March 24th, 2024]
- Lunar Node 1: the trailblazing lunar beacon guiding NASA's future in space exploration - Boing Boing - March 24th, 2024 [March 24th, 2024]
- SpaceX's CRS-30 Mission: Delivering Innovations and Research to the ISS - yTech - March 24th, 2024 [March 24th, 2024]
- Remembering Tom Stafford, the Space Races Peacemaker (1930-2024) - AmericaSpace - March 24th, 2024 [March 24th, 2024]
- 9 Hints That Kingdom Of The Planet Of The Apes Involves Space Travel - Screen Rant - March 24th, 2024 [March 24th, 2024]
- NASA sends science projects and hardware aboard SpaceX's 30th resupply launch to ISS SatNews - SatNews - March 24th, 2024 [March 24th, 2024]
- SpaceX Dragon Spacecraft Docks to Space Station With New Science and Supplies - SciTechDaily - March 24th, 2024 [March 24th, 2024]
- Moon Race 2.0: Why so many nations and private companies are aiming for lunar landings - BBC.com - February 16th, 2024 [February 16th, 2024]
- NASA Selects Texas A&M As First Approved Exploration Park Facility - Texas A&M University Today - February 16th, 2024 [February 16th, 2024]
- The Space Economy in 2024 - OODA Loop - February 16th, 2024 [February 16th, 2024]
- Opinion | It's an exciting time in space exploration. But U.S. leadership is at risk. - The Washington Post - February 16th, 2024 [February 16th, 2024]
- NASA Experiment With Fire in Space Ends When Entire Spacecraft Burns Up - Futurism - February 16th, 2024 [February 16th, 2024]
- NASA Selects Texas A&M as First Approved Exploration Park Facility - NASA - February 16th, 2024 [February 16th, 2024]
- Ground-Based Lasers Could Accelerate Spacecraft to Other Stars - Universe Today - February 16th, 2024 [February 16th, 2024]
- 8 Space Exploration Books to Add to Your TBR - Book Riot - February 16th, 2024 [February 16th, 2024]
- Meet the Elected Members of the African Space Council - Space in Africa - February 16th, 2024 [February 16th, 2024]
- NASA working with Texas A&M to build new spaceflight research facilities - 25 News KXXV and KRHD - February 16th, 2024 [February 16th, 2024]
- Inflatable Habitats: Expanding Space Exploration - Lockheed Martin - February 16th, 2024 [February 16th, 2024]
- China's Rising Ambitions in Space Exploration: Chang'e Missions and International Cooperation - Medriva - February 16th, 2024 [February 16th, 2024]
- Pressured Space Exploration in Today's Era - Mirage News - February 16th, 2024 [February 16th, 2024]
- Exoplanet Hunter Sets Its Sights on Jupiter: A New Twist in Space Exploration - SciTechDaily - February 16th, 2024 [February 16th, 2024]
- Frontier Aerospace TALOS Engines Used For Space Exploration - PR Newswire - February 16th, 2024 [February 16th, 2024]
- Exploring the Potential of Minimoons - Medriva - February 16th, 2024 [February 16th, 2024]
- Understanding the Role of TRISH in Space Health and its Future Innovations - Medriva - February 16th, 2024 [February 16th, 2024]
- The Future of Satellite Refueling and In-Orbit Servicing - Medriva - February 16th, 2024 [February 16th, 2024]
- Japan makes third attempt to launch next-gen rocket - Yahoo Singapore News - February 16th, 2024 [February 16th, 2024]
- Uruguay becomes latest nation to join NASA's Artemis Accords - UPI News - February 16th, 2024 [February 16th, 2024]
- An astronomer's lament: Satellite megaconstellations are ruining space exploration - The Conversation - February 16th, 2024 [February 16th, 2024]
- Asteroid Mining: A Glimpse into the Future - Medriva - February 16th, 2024 [February 16th, 2024]
- Singapore's ESS and Australia's ELA Join Forces to Redefine Space Exploration - BNN Breaking - February 16th, 2024 [February 16th, 2024]
- Intuitive Machines makes history with lunar lander launch - InnovationMap - February 16th, 2024 [February 16th, 2024]
- The Potential of Minimoons in Interplanetary Exploration and Space Travel - Medriva - February 16th, 2024 [February 16th, 2024]
- In space exploration, Switzerland punches above its weight - SWI swissinfo.ch - SWI swissinfo.ch in English - February 16th, 2024 [February 16th, 2024]
- Odysseus Mission: Pioneering the Lunar Economy and Space Exploration - BNN Breaking - February 16th, 2024 [February 16th, 2024]
- Starlab Announces Leadership Team With new CEO and CFO - SpaceWatch.Global - February 16th, 2024 [February 16th, 2024]
- The New Space Race: Private American Companies Compete to Land on the Moon - Medriva - February 16th, 2024 [February 16th, 2024]
- Spectrum Advanced Manufacturing Technologies Plays Vital Role in NASA's Deep Space Optical Communications - PR Newswire - February 16th, 2024 [February 16th, 2024]
- Intuitive Machines Odyssey lunar lander to be launched early Wednesday - The Washington Post - February 16th, 2024 [February 16th, 2024]
- New funding for space projects ensures the UK's role in global missions - Innovation News Network - February 16th, 2024 [February 16th, 2024]
- SpaceX and Intuitive Machines Lunar Mission: Challenges, Expectations, and Future - Medriva - February 16th, 2024 [February 16th, 2024]
- Farewell to a NASA Hero: Apollo Astronaut Thomas K. Mattingly II Departs at 87 - SciTechDaily - November 4th, 2023 [November 4th, 2023]
- NASA Welcomes Netherlands as Newest Artemis Accords Signatory - NASA - November 4th, 2023 [November 4th, 2023]
- China's astronauts tend orbital garden to aid deep space exploration - Space.com - November 4th, 2023 [November 4th, 2023]
- All-UK astronaut mission shows that private enterprise is vital to the ... - The Conversation Indonesia - November 4th, 2023 [November 4th, 2023]
- Former Astronaut Discusses Space Travel and Its Future With ... - Duke Today - November 4th, 2023 [November 4th, 2023]
- Returning astronauts to the moon is NASA's biggest challenge, but ... - Space.com - November 4th, 2023 [November 4th, 2023]
- Australias IPSEC Conference Shows Synergies Between the Space ... - Via Satellite - November 4th, 2023 [November 4th, 2023]
- Mice embryos successfully grown in space, a promising milestone ... - Salon - November 4th, 2023 [November 4th, 2023]
- Dava Newman talks Mars exploration and comunication - CMU The Tartan Online - November 4th, 2023 [November 4th, 2023]
- Science Fact or Fiction: Leveraging Space to Transform Medicine - Kennedy Space Center - November 4th, 2023 [November 4th, 2023]
- Now astronauts will not get lost in space - SAMAA - November 4th, 2023 [November 4th, 2023]
- Sci-fi inspired tractor beams are real, and could solve a major space ... - Livescience.com - November 4th, 2023 [November 4th, 2023]
- Mining Meets Space: Revolutionizing Industry Innovation with Cross ... - AZoMining - November 4th, 2023 [November 4th, 2023]
- Surf's up: Catch an atmospheric wave as ASU research team ... - ASU News Now - November 4th, 2023 [November 4th, 2023]
- Ron Baron says Tesla's valuation can hit $4 trillion, but 'SpaceX has ... - Morningstar - November 4th, 2023 [November 4th, 2023]