(wanpatsorn/Shutterstock)
Only the most advanced companies have overcome the technical complexity involved with processing streaming data in real time. One of the vendors aiming to reduce this complexity and make stream data processing available to the masses is RisingWave Labs, which today announced $36 million in financing.
The early days of stream data processing brought us stand-alone systems that were capable of acting upon vast streams of data, and doing so with low latency and reliability. Stream processing frameworks like Apache Storm made headway in addressing these challenges and led the way to more sophisticated frameworks like Apache Flink and others.
Things got significantly more complex when companies realized they needed to know something about the past to take the best action on the newest data, which necessitated the integration of stream processing frameworks with databases or data lakes, where the historical record lived as persisted data. Architectural blueprints, such as the Lambda and Kappa architectures, were proposed to address this unique challenge, but the technical complexity in keeping these dual-path systems running are immense.
Today were seeing the emergence of a new category of productthe streaming databaseaimed at solving this problem. Instead of running data through a dedicated stream processing framework like Storm or Flink, the backers of streaming databases think that all the data processingincluding the business end of a streaming big data pipeline like Kafka, Kinesis, or Pulsarcan be handled by the SQL query engine contained in a relational database.
RisingWave is a Postgres-compatible database developed to process data streams in the cloud (Image courtesy RisingWave Labs)
Thats the approach taken with RisingWave, a new open source streaming database that emerged just over a year ago. Yingjun Wu, a former AWS and IBM engineer, created RisingWave as a cloud-native database with the goal of providing the bernefits of stream processing without the technical complexity inherent with stream processing frameworks.
Existing open-source systems are very costly to deploy, maintain, and use in the modern cloud environment, Wu, who is the CEO of RisingWave Labs, says in a press release today. Our goal is not to build yet another streaming system that is 10X faster than existing systems, but to deliver a simple and cost-effective system that allows everyone to benefit from stream processing.
Developed in Rust, RisingWave is a Postgres-compatible database can do many of the things that stream processing frameworks do, but within the context and control of a familiar relational database running in the cloud and the SQL language, according to Wu, who has a PhD from National University of Singapore and was also a visiting PhD at Carnegie Mellon University.
[RisingWave] consumes streaming data, performs continuous queries, and maintains results dynamically in the form of a materialized view, Wu says in a blog post earlier this year. Processing data streams inside a database is quite different from that inside a stream computation engine: streaming data are instantly ingested into data tables; queries over streaming and historical data are simply modeled as table joins; query results are directly maintained and updated inside the database, without pushing into a downstream system.
The open source project, which available on GitHub via an Apache 2.0 license, is being adopted by organizations for a range of uses, including real-time analytics and alerting; IoT device tracking; monitoring user activity; and online application data serving. The company, which changed its name from Singularity Data three weeks ago, recently unveiled the beta of a hosted commercial version of RisingWave; its slated to become generally available next year.
The $36 million in Series A funding announced today brings the San Francisco companys total funding to $40 million. That funding will help RisingWave tackle the real-time processing opportunities available in both legacy and green-field applications, says Yu Chen, a partner with Yunqi Partners, which was one of the venture firms that led the Series A.
There is no lack of tools to process data streams, Chen states in a press release, but RisingWave is one of the few designed as a database and can be easily plugged into a modern data stack to make real-time data intelligence a reality.
Related Items:
Is Real-Time Streaming Finally Taking Off?
Developing Kafka Data Pipelines Just Got Easier
Can Streaming Graphs Clean Up the Data Pipeline Mess?
The rest is here:
RisingWave Emerges to Tackle Tsunami of Real-Time Data - Datanami
- Downloads - Singularity Viewer - December 25th, 2016 [December 25th, 2016]
- What is Singularity (the)? - Definition from WhatIs.com - January 5th, 2017 [January 5th, 2017]
- When Electronic Witnesses Are Everywhere, No Secret's Safe - Singularity Hub - February 7th, 2017 [February 7th, 2017]
- Report: AMD Ryzen Performance in Ashes of the Singularity Benchmark - PC Perspective - February 7th, 2017 [February 7th, 2017]
- Do you believe in the Singularity? - Patheos (blog) - February 7th, 2017 [February 7th, 2017]
- Editorial Note From the Singularity Hub Team - Singularity Hub - February 7th, 2017 [February 7th, 2017]
- Discover the Most Advanced Industrial Technologies at Exponential Manufacturing - Singularity Hub - February 7th, 2017 [February 7th, 2017]
- 10th Letter looks at nature in the time of the Singularity - Creative Loafing Atlanta - February 7th, 2017 [February 7th, 2017]
- Donald Trump Is the Singularity - Bloomberg View - Bloomberg.com - Bloomberg - February 7th, 2017 [February 7th, 2017]
- Wearable Devices Can Actually Tell When You're About to Get Sick - Singularity Hub - February 7th, 2017 [February 7th, 2017]
- AMD 8-core Ryzen benchmark show up on Ashes Of The Singularity ... - VR-Zone - February 8th, 2017 [February 8th, 2017]
- Robot Cars Can Teach Themselves How to Drive in Virtual Worlds - Singularity Hub - February 8th, 2017 [February 8th, 2017]
- Physicists Unveil Blueprint for a Quantum Computer the Size of a Soccer Field - Singularity Hub - February 10th, 2017 [February 10th, 2017]
- How Robots Helped Create 100000 Jobs at Amazon - Singularity Hub - February 10th, 2017 [February 10th, 2017]
- Ready to Change the World? Apply Now for Singularity University's 2017 Global Solutions Program - Singularity Hub - February 10th, 2017 [February 10th, 2017]
- Singularity Containers for Science, Reproducibility, and HPC - Linux.com (blog) - February 10th, 2017 [February 10th, 2017]
- Families Finally Hear From Completely Paralyzed Patients Via New Mind-Reading Device - Singularity Hub - February 12th, 2017 [February 12th, 2017]
- artificial intelligence: the fear of a technological singularity ... - ETtech.com - February 13th, 2017 [February 13th, 2017]
- Holograms Aren't The Stuff of Science Fiction Anymore - Singularity Hub - February 15th, 2017 [February 15th, 2017]
- How the World Has Changed From 1917 to 2017 - Singularity Hub - February 16th, 2017 [February 16th, 2017]
- Preparing for the Singularity - Inverse - February 16th, 2017 [February 16th, 2017]
- Our Health Data Can Save Lives, But We Have to Be Willing to Share - Singularity Hub - February 17th, 2017 [February 17th, 2017]
- Ashes of the Singularity merges with standalone expansion Escalation, no upgrade fee - PCGamesN - February 17th, 2017 [February 17th, 2017]
- Just Stand Inside this Room and it Will Wirelessly Charge Your Phone - Singularity Hub - February 18th, 2017 [February 18th, 2017]
- AMD bundles Ashes of the Singularity with FX processors ahead of Ryzen's launch - PCWorld - February 18th, 2017 [February 18th, 2017]
- Ashes of the Singularity: Escalation being merged with the original game - PC Invasion (blog) - February 18th, 2017 [February 18th, 2017]
- Singularity - GameSpot - February 20th, 2017 [February 20th, 2017]
- The roots of technological singularity can be traced backed to the Stone Age - Wired.co.uk - February 20th, 2017 [February 20th, 2017]
- Jide's new OS is like an Android version of Windows 10's Continuum - The Verge - February 22nd, 2017 [February 22nd, 2017]
- Jide Announces Remix Singularity: The Continuum Alternative for Android - XDA Developers (blog) - February 22nd, 2017 [February 22nd, 2017]
- New Tech Makes Brain Implants Safer and Super Precise - Singularity Hub - February 23rd, 2017 [February 23rd, 2017]
- One Android company wants to use smartphones to make PCs truly dead - BGR - February 23rd, 2017 [February 23rd, 2017]
- Remix tries its hand at the mobile-desktop hybrid OS with Singularity - Android Police - February 23rd, 2017 [February 23rd, 2017]
- Financial Leaders: Make Your Mark on the Future at Exponential Finance - Singularity Hub - February 23rd, 2017 [February 23rd, 2017]
- Remix Singularity is Jide's Android answer to Windows Continuum - SlashGear - February 24th, 2017 [February 24th, 2017]
- AMD Radeon RX 580 Ashes of the Singularity Benchmarks Leaked 4K, Ryzen Combo, CrossFire and More! - Wccftech - February 24th, 2017 [February 24th, 2017]
- Damon Wayans Jr. Joins FX Sci-Fi Comedy Singularity - Den of Geek US - February 24th, 2017 [February 24th, 2017]
- After Man? From Singularity to Specificity - Peace Research Institute Oslo (PRIO) (press release) (blog) - February 24th, 2017 [February 24th, 2017]
- Why the Potential of Augmented Reality Is Greater Than You Think - Singularity Hub - February 24th, 2017 [February 24th, 2017]
- Damon Wayans Jr In Evan Goldberg & Seth Rogen AI comedy - /FILM - February 24th, 2017 [February 24th, 2017]
- Ashes of Singularity: Escalation Gets an Update - CGMagazine - February 24th, 2017 [February 24th, 2017]
- Google Updates: Scuba, Singularity, SMS and suing - The INQUIRER - February 24th, 2017 [February 24th, 2017]
- Singularity Art Show Tonight In San Francisco! - February 25th, 2017 [February 25th, 2017]
- Stardock celebrate v2.1 of Ashes of the Singularity: Escalation with a ... - PCGamesN - February 27th, 2017 [February 27th, 2017]
- Video: AI Is Getting Smarter, Says Singularity University's Neil ... - Wall Street Journal (subscription) (blog) - February 28th, 2017 [February 28th, 2017]
- This Neural Probe Is So Thin, The Brain Doesn't Know It's There - Singularity Hub - March 1st, 2017 [March 1st, 2017]
- Citizen Science Means Anyone Could Discover Planet NineEven You - Singularity Hub - March 1st, 2017 [March 1st, 2017]
- Singularity University establishes new organisation in Denmark - Ministry of Foreign Affairs of Denmark - March 1st, 2017 [March 1st, 2017]
- Singularity University opening organisation in Denmark - The Copenhagen Post - Danish news in english - March 1st, 2017 [March 1st, 2017]
- Does Zapping Your Brain Actually Help You Learn Faster? - Singularity Hub - March 2nd, 2017 [March 2nd, 2017]
- What You Need to Know About Elon Musk's Plan to Fly People to the Moon - Singularity Hub - March 2nd, 2017 [March 2nd, 2017]
- Singularity: Explain It to Me Like I'm 5-Years-Old - Futurism - Futurism - March 3rd, 2017 [March 3rd, 2017]
- Singularity for PC Reviews - Metacritic - March 4th, 2017 [March 4th, 2017]
- Singularity (mathematics) - Wikipedia - March 4th, 2017 [March 4th, 2017]
- See How This House Was 3D Printed in Just 24 Hours - Singularity Hub - March 6th, 2017 [March 6th, 2017]
- NYC's Metrograph theater is running a sci-fi film series featuring Blade Runner, Ex Machina, and Metropolis - The Verge - March 8th, 2017 [March 8th, 2017]
- 3 Exciting Biotech Trends to Watch Closely in 2017 - Singularity Hub - March 9th, 2017 [March 9th, 2017]
- New Burger Robot Will Take Command of the Grill in 50 Fast Food Restaurants - Singularity Hub - March 9th, 2017 [March 9th, 2017]
- Are These Giant Neurons the Seat Of Consciousness in the Brain? - Singularity Hub - March 10th, 2017 [March 10th, 2017]
- How Fully Synthetic Complex Life Just Got a Lot Closer - Singularity Hub - March 12th, 2017 [March 12th, 2017]
- Singularity University launches inaugural Canada Summit | BetaKit - BetaKit - April 8th, 2017 [April 8th, 2017]
- Singularity - Everything2.com - April 8th, 2017 [April 8th, 2017]
- Singularity (Game) - Giant Bomb - April 8th, 2017 [April 8th, 2017]
- Ashes of the Singularity: Escalation on Steam - April 8th, 2017 [April 8th, 2017]
- Approaching the World of Collaboration Singularity - CommsTrader - June 6th, 2017 [June 6th, 2017]
- Berkeley Lab's Open-Source Spinoff Serves Science | Berkeley Lab - Lawrence Berkeley National Laboratory - June 7th, 2017 [June 7th, 2017]
- Beyond Politics: Innovating for a Sustainable Future - Singularity Hub - June 7th, 2017 [June 7th, 2017]
- Tune Into the Future of Fintech at Exponential Finance This Week - Singularity Hub - June 7th, 2017 [June 7th, 2017]
- Experts Weigh in on AI and the Singularity - Futurism - June 7th, 2017 [June 7th, 2017]
- Singularity | Mass Effect Wiki | Fandom powered by Wikia - June 7th, 2017 [June 7th, 2017]
- Quantum Computers Will Analyze Every Financial Model at Once - Singularity Hub - June 8th, 2017 [June 8th, 2017]
- Deloitte and Singularity University Extend Their Relationship To ... - PR Newswire (press release) - June 8th, 2017 [June 8th, 2017]
- Ashes of the Singularity: Escalation 2.3 update adds a new campaign today - PC Gamer - June 8th, 2017 [June 8th, 2017]
- Singularity and Docker | Singularity - June 8th, 2017 [June 8th, 2017]
- Ashes of the Singularity gets a new fully-voiced campaign - PCGamesN - June 9th, 2017 [June 9th, 2017]
- At Exponential Finance, the Singularity University Explores Visionary Applications of Blockchains - Crypto Insider (press release) (blog) - June 9th, 2017 [June 9th, 2017]
- Get It While It's Hot: Why Fintech Is a Goldmine for Investors - Singularity Hub - June 10th, 2017 [June 10th, 2017]
- Forget Police Sketches: Researchers Perfectly Reconstruct Faces by Reading Brainwaves - Singularity Hub - June 14th, 2017 [June 14th, 2017]
- Singularity Summit comes to SA | IT-Online - IT-Online - June 16th, 2017 [June 16th, 2017]
- These 7 Disruptive Technologies Could Be Worth Trillions of Dollars - Singularity Hub - June 17th, 2017 [June 17th, 2017]