The data storage landscape is continually changing and in the background, there are a few shifts driving that evolution.
One of those is culture, Shaun Bierweiler, vice president of public sector for Hortonworks, says in an interview with FedScoop Radio. We like to say that every agency is a data agency, and that stems from the evolution and the significance that data has taken in the lives and in the missions of our customers.
With traditional data warehouses in the past, Bierweiler explains, data was used in a very transactional way. But now its at the center of every decision, he says.
To start with, the structure of big data has evolved. Previously, you knew what was going in and what was coming out. Today, now you have data from an infinite number of sources. You have images, you have videos, you have data encrypted within those items, Bierweiler says in the interview. The data itself has become very much more complex in terms of structure.
The volume is, perhaps, the biggest change.
Agencies are drowning in data because theres so much of it, he says. You have to be able to store it, you have to be able to process it. You have to be able to extrapolate the value from that data. And so thats become much more complicated and complex.
Finally, to top that all off, expectations for the use of that data has changed drastically, Bierweiler explains.
Not only do you have more data that has more information that varies much more greatly, but now users expect to do more with it. And they not only expect to do valuable things with their data, but they expect to extrapolate information and sharing data from other users data. What used to be very traditionally stove-piped and siloed now is a mesh of data thats expected to be shared.
With such an array of data types, sizes and uses, Bierweiler advocates for enterprise open source platforms to address users many needs.
If you look at a traditional proprietary technology, the lifecycle for them tends to be much longer, and the development cycle even longer, Bierweiler says. When you get a new release of a proprietary solution, its often with very old or antiquated solutions and its solving the problems that existed when the technologys development model started.
Youre also locked-in to the vendors roadmap, he says.
An enterprise open source platform like Hortonworks harnesses the development model of community people that arent paid by Hortonworks. What you get then is a very open solution that not only solves what people are trying to address today, but problems they foresee for tomorrow, Bierweiler tells FedScoop Radio. And because there arent barriers or proprietary interfaces, it lends itself to a true best-of-breed solution.
Consider everything as possible, he recommends to agencies and offices considering open source. Its often difficult to make that cultural shift from something that youve always done and you convince yourself that thats the only way. Technology has come a very long way and there are creative ways to do things better, cheaper, faster, smarter. So oftentimes, the biggest challenge we have is not a technical hurdle its a cultural shift.
See more about how Hortonworks open source solutionscan help you manage your data.
Go here to read the rest:
The rapid evolution of big data storage - FedScoop
- History of Evolution | Internet Encyclopedia of Philosophy - December 9th, 2016 [December 9th, 2016]
- Evolution - Bulbapedia, the community-driven Pokmon encyclopedia - December 12th, 2016 [December 12th, 2016]
- What is Evolution - explanation and definitions - December 21st, 2016 [December 21st, 2016]
- Evolution (2001 film) - Wikipedia - January 28th, 2017 [January 28th, 2017]
- EvolutionM.net - Mitsubishi Lancer Evolution | Reviews, News ... - February 1st, 2017 [February 1st, 2017]
- YMCA evolution continues at lake - Gaston Gazette - February 7th, 2017 [February 7th, 2017]
- Ivanka Trump's Beauty Evolution, From 1998 to Today Watch - Us Weekly - February 7th, 2017 [February 7th, 2017]
- Lumpy, hairy, toe-like fossil could reveal the evolution of molluscs - The Guardian - February 7th, 2017 [February 7th, 2017]
- How Evolution Alters Biological Invasions - ScienceBlog.com (blog) - February 7th, 2017 [February 7th, 2017]
- Cultural evolution and the mutilation of women - The Economist - February 7th, 2017 [February 7th, 2017]
- Late-night hosts on the evolution of Trump: 'Dickish to dictatorish' - The Guardian - February 7th, 2017 [February 7th, 2017]
- Gold's Gym Regina rebrands to become Evolution Fitness - Regina Leader-Post - February 7th, 2017 [February 7th, 2017]
- Incremental Versus Radical Innovation: A Response to Josh Swamidass on Evolution and Cancer - Discovery Institute - February 7th, 2017 [February 7th, 2017]
- Blockchain: Investment (R)Evolution For Developing Markets - Forbes - February 7th, 2017 [February 7th, 2017]
- See the Evolution of the Famed Porsche 911 in 7 Photos - WIRED - February 7th, 2017 [February 7th, 2017]
- Exhibition charts 500 years of evolution of robots - Phys.Org - February 7th, 2017 [February 7th, 2017]
- How evolution turned ordinary plants into ravenous meat-eaters - Wired.co.uk - February 7th, 2017 [February 7th, 2017]
- Are Evolution Fresh Drinks 'Poison'? - snopes.com - February 7th, 2017 [February 7th, 2017]
- Non-Chromosomal DNA Drives Tumor Evolution - The Scientist - February 8th, 2017 [February 8th, 2017]
- Chimpanzee feet allow scientists a new grasp on human foot evolution - Phys.Org - February 8th, 2017 [February 8th, 2017]
- 'Goldilocks' genes that tell the tale of human evolution hold clues to variety of diseases - Science Daily - February 8th, 2017 [February 8th, 2017]
- Pac-Man is Coming to 'The Sandbox Evolution' Next Week - Touch Arcade - February 9th, 2017 [February 9th, 2017]
- Chimpanzee feet allow scientists a new grasp on human foot ... - Science Daily - February 9th, 2017 [February 9th, 2017]
- Bacteria sleep, then rapidly evolve, to survive antibiotic treatments - Phys.Org - February 9th, 2017 [February 9th, 2017]
- Orangutan squeaks reveal language evolution, says study - BBC ... - BBC News - February 9th, 2017 [February 9th, 2017]
- Evolution gives rhyme its reason - Aurora News Register - February 9th, 2017 [February 9th, 2017]
- Deeper origin of gill evolution suggests 'active lifestyle' link in early vertebrates - Science Daily - February 9th, 2017 [February 9th, 2017]
- From Tara Palmer-Tomkinson to Cara Delevingne: the evolution of the It girl - The Guardian - February 10th, 2017 [February 10th, 2017]
- Banned TED Talk: Rupert Sheldrake The Science Delusion - Collective Evolution - February 10th, 2017 [February 10th, 2017]
- VOTD: Watch the Evolution of Keanu Reeves' Acting Career - /FILM - February 10th, 2017 [February 10th, 2017]
- Pokmon Go Eevee evolution: How to evolve Eevee into Vaporeon, Jolteon and Flareon with new names - Eurogamer.net - February 10th, 2017 [February 10th, 2017]
- Horse evolution bucks evolutionary theory - Science News - February 10th, 2017 [February 10th, 2017]
- Samsung's Chromebook Pro highlights the category's continued evolution - TechCrunch - February 10th, 2017 [February 10th, 2017]
- Scientists solve fish evolution mystery - Phys.Org - February 10th, 2017 [February 10th, 2017]
- Wildfire evolution forces Forest Service into new thinking - The Daily Progress - February 11th, 2017 [February 11th, 2017]
- How the horse can help us answer one of evolution's biggest questions - Raw Story - February 11th, 2017 [February 11th, 2017]
- A primer on Darwin Day: Some religious groups embrace 'Theistic evolution' - LancasterOnline - February 11th, 2017 [February 11th, 2017]
- Apple: Evolution of in-car audio tech moving at 'speed of sound ... - Times of India - February 11th, 2017 [February 11th, 2017]
- Mariska Hargitay's Evolution from '80s Glam to Law & Order: Special Victims Unit - TVOvermind - February 12th, 2017 [February 12th, 2017]
- Evolution of baseball from power to speed has left SBs behind ... - Chicago Sun-Times - February 12th, 2017 [February 12th, 2017]
- More order with less judgment: An optimal theory of the evolution of cooperation - Science Daily - February 12th, 2017 [February 12th, 2017]
- J. Albert C. Uy speaks on evolution, biodiversity in bellied flycatcher population - The College Reporter - February 12th, 2017 [February 12th, 2017]
- See the Evolution of Movie Magic With Every Oscar Winner for Visual Effects in History - Gizmodo - February 12th, 2017 [February 12th, 2017]
- Numerology: Here's What Your Name Says About You - Collective Evolution - February 13th, 2017 [February 13th, 2017]
- The Evolution of Valentine's Day - Inside Science News Service - February 13th, 2017 [February 13th, 2017]
- Why evolution may be tech billionaires' biggest enemy - The Week Magazine - February 13th, 2017 [February 13th, 2017]
- Community Viewpoint: Evolution, like gravity, is much more than theory it is a fact - Kdminer - February 13th, 2017 [February 13th, 2017]
- How the horse can help us answer one of evolution's biggest questions - Phys.Org - February 13th, 2017 [February 13th, 2017]
- How evolution alters biological invasions - Science Daily - February 13th, 2017 [February 13th, 2017]
- Cockeyed squid shines light on deep sea evolution - Christian Science Monitor - February 13th, 2017 [February 13th, 2017]
- Eye Evolution: A Closer Look - Discovery Institute - February 14th, 2017 [February 14th, 2017]
- Evolution always wins: University of Idaho video game uses mutating aliens to teach science concepts - The Spokesman-Review - February 14th, 2017 [February 14th, 2017]
- Geneticists track the evolution of parenting - Phys.Org - February 14th, 2017 [February 14th, 2017]
- How this cockeyed squid shines a light on deep sea evolution - Christian Science Monitor - February 14th, 2017 [February 14th, 2017]
- 4 Possible Roadmaps For macOS and iOS Evolution - The Mac Observer (blog) - February 15th, 2017 [February 15th, 2017]
- The Evolution of the Energy Capital of the World - Texas Monthly - February 15th, 2017 [February 15th, 2017]
- Humons presents an atypical dance evolution - Detroit Metro Times - February 15th, 2017 [February 15th, 2017]
- Pokemon Go Adds 80 Generation 2 Pokemon, New Evolution Items This Week - IGN - February 15th, 2017 [February 15th, 2017]
- Fossil discovery rewrites understanding of reproductive evolution ... - Science Daily - February 15th, 2017 [February 15th, 2017]
- 'X-Men: Evolution' Is the Gateway Drug of Comic Book Shows - Geek - February 16th, 2017 [February 16th, 2017]
- A cultural catch: Evolution of wooden halibut hooks carved by native ... - Science Daily - February 16th, 2017 [February 16th, 2017]
- Bremerton's Fitness Evolution now Planet Fitness - Kitsap Sun (blog) - February 16th, 2017 [February 16th, 2017]
- Eye Evolution: The Waiting Is the Hardest Part - Discovery Institute - February 16th, 2017 [February 16th, 2017]
- Evolution Of The Yeezy: 2009-2017 - HotNewHipHop - February 16th, 2017 [February 16th, 2017]
- Prebiotic evolution: Hairpins help each other out - Science Daily - February 16th, 2017 [February 16th, 2017]
- This 'Live Birth' Fossil Could Change Humanity's Understanding Of Evolution - Daily Caller - February 16th, 2017 [February 16th, 2017]
- Mysterious Ancient Stonehenge-Like Circles Found in Amazon Rainforest - Collective Evolution - February 16th, 2017 [February 16th, 2017]
- 'Pokemon Go': How to Evolve Poliwhirl Into Politoed - Heavy.com - February 17th, 2017 [February 17th, 2017]
- 'Pokemon Go': How to Evolve Slowpoke Into Slowbro or Slowking - Heavy.com - February 17th, 2017 [February 17th, 2017]
- 'Pokemon Go': How to Evolve Gloom Into Bellossom - Heavy.com - February 17th, 2017 [February 17th, 2017]
- Pokmon Go Dragon Scale - how to evolve Seadra into Kingdra and how to get the Dragon Scale - Eurogamer.net - February 17th, 2017 [February 17th, 2017]
- Pokmon Go Eevee evolution: How to evolve Eevee into Umbreon, Espeon, Vaporeon, Jolteon and Flareon with new ... - Eurogamer.net - February 17th, 2017 [February 17th, 2017]
- University of Pittsburgh guest speaker discloses evolution findings - UTA The Shorthorn - February 17th, 2017 [February 17th, 2017]
- 'Pokemon Go' Special Items: Drop Rates for Evolution Items & Berries at Pokestops - Heavy.com - February 17th, 2017 [February 17th, 2017]
- How Vedic Philosophy Influenced Nikola Tesla's Idea of 'Free Energy' - Collective Evolution - February 18th, 2017 [February 18th, 2017]
- Migration to America took long enough for evolution to happen on the way - Ars Technica - February 18th, 2017 [February 18th, 2017]
- How To Choose Your Eevee Evolution In 'Pokmon GO:' Umbreon And Espeon Edition - Forbes - February 18th, 2017 [February 18th, 2017]
- Evolution Items - IGN - February 18th, 2017 [February 18th, 2017]
- Congo River fish evolution shaped by intense rapids: Genomic study ... - Science Daily - February 18th, 2017 [February 18th, 2017]
- Pokmon Go - How to evolve, use Special Items, when to evolve or Power Up your Pokmon - Eurogamer.net - February 18th, 2017 [February 18th, 2017]