JAXenter: Which issues do database management and monitoring currently have? In what ways can they profit from cloud technologies and automation?
John:One of the biggest challenges DBAs have is keeping up with the growing number and variety of platforms they have to manage. In fact, according to a survey carried out by Unisphere Research, more than two thirds (70 per cent) of DBAs are now managing more than 11 or more databases, and incredibly, 10 per cent were found to actually be managing more than 100! So, all this complexity combined with the astronomic growth of, and the need to protect data means DBAs are spending a disproportionate time dealing with tasks related to keeping the lights on and less time thinking more strategically. Automation, when used properly, can save DBAs many hours of time according to many estimates, as much of 80% of their daily/weekly routine tasks could be automated.
Migration of databases to the cloud is one way to reduce the administration workload, but there is a trade-off. As a DBA, do you go for IaaS or DBaaS? With DBaaS, the cloud services provider manages your databases backups, patching, security, etc, and you have some database monitoring capability for that specific database, but the extent to which you can manage other things like performance tuning, etc. are restricted. Unlike IaaS, where you manage the database, therefore the administrative workload is the same as on-premises, although the business costs (CapEx) will be lower.
An effective monitoring solution that works across all these different databases and environments is a must if you want to lower the administrative footprint. Added complexity means that your MTTR, in the event of a performance issue, will suffer without an effective way to detect, diagnose and resolve problems in a timely manner.
JAXenter: Aside from the positive effects, do you see any downsides in using cloud technologies for database administration?
One reason why we wont see the role of the DBA go away with autonomous databases is because of the importance they play in ensuring the safety of data.
John:The downsides of moving databases to the cloud depend on the type of cloud service the company subscribes to. With DBaaS, the DBA stands the risk of a database being taken down at any time as the service provider performs a backup or applies a security patch (or worse still, the cloud provider suffers an outage). Also, the level of service the company chooses ultimately dictates the monthly subscription cost and many companies over-subscribe because they didnt effectively right size the service ahead of time. Its really important to choose the service tier that is most appropriate for acceptable application performance and that is sometimes a challenge because cloud database behave differently than in a data center.
Another ongoing concern is security and the protection of personal or sensitive data. Having personal data in the cloud does not obviate the companys responsibility to identify and protect it in order to be compliant with data privacy regulations like GDPR and CCPA.
Vendor lock-in is another concern and there is a growing adoption of multi-cloud strategies where companies may choose different cloud providers according to application requirements, cost and risk balance, regional dependencies (e.g. EU provider if having to comply with GDPR).
JAXenter: In your opinion, what impact will autonomous databases have on DBA in the short and long term?
John:Some believe that autonomous databases will impact DBAs to the point that theyll be out of a job. While I dont agree with this, I do believe that the role of the DBA will certainly shift as AI and adaptive machine learning enable organizations to automatically self-patch, self-tune, detect anomalies, and optimize indexes much more quickly and efficiently than manual hands-on processing. DBAs, now free from many of their mundane tasks, will have to take on more strategic roles in developing new business initiatives and focusing on finding new areas where they can provide value, such as DevOps.
One reason why we wont see the role of the DBA go away with autonomous databases is because of the importance they play in ensuring the safety of data. DBAs are responsible for implementing data privacy regulations, ensuring compliance, and as DevSecOps grows, theyll begin to enable things like proper testing in production environments.
In fact, DBAs should consider reinventing themselves as data administrators, since the value of data to the company is huge and the DBA is a key stakeholder who can help drive the business forward. They can be the thought leaders in what database technologies are most appropriate for their applications and help shape company strategy.
JAXenter: NoSQL has been on the rise as well. Do you believe we will keep heading in that direction over the next year?
The other benefit of using NoSQL that simplifies the DBAs job is scalability.
John:Yes, in fact, 75 percent of companies are already using both SQL and NoSQL databases with MongoDB and Cassandra being among the most popular, according to the cloud database trends report from DeveloperWeek 2019.
NoSQL hasnt seen a huge amount of movement in recent years, but I believe well see it pick up more next year, especially as people move towards fresher and newer data needs. While relational databases are good for traditional workloads like OLTP applications and business analytics (OLAP), for more complex OLTP workloads that include low-latency applications, NoSQL is better (versatility, agility, scalability). Ultimately, its a matter of getting the right database to suit the workloads of the organization, especially with the variety of structured and unstructured data in use. I also think well also see adoption of cloud NoSQL databases (such as Amazons DynamoDB and Googles Cloud Datastore).
JAXenter: Which implications will the increased use of NoSQL have, e.g. regarding the way DevOps and DBA interact?
John:Depending on the type of application, NoSQL databases offer some advantages in a DevOps CI/CD pipeline that can hinder the use of relational databases. Synchronizing relational database changes with an object-oriented application can be a challenge (called impedance mismatch) and requires application developers to leverage Object Relational Mapping (ORM) classes in their application code to relate to the database schema structure and any changes that might occur (e.g. change a column, add a table). This is something DBAs and the application team must manage to ensure things dont break.
With the growth of the use of NoSQL document databases such as MongoDB and CouchDB, this problem goes away since there is no schema in the traditional sense, meaning application developers can arrange their data (structured, semi-structured, unstructured) how they want and remove the impedance mismatch that ORM was designed to resolve.
The other benefit of using NoSQL that simplifies the DBAs job is scalability. NoSQL databases leverage commodity hardware and therefore are far easier to scale out compared with relational databases.
Thanks very much!
Read the original here:
NoSQL and automated databases "DBAs can be the thought leaders" - JAXenter
- The Automation Conference - December 9th, 2016 [December 9th, 2016]
- The Best Home Automation Systems of 2016 | Top Ten Reviews - December 24th, 2016 [December 24th, 2016]
- Compact Automation - Actuators, Hydraulic Cylinders, Linear ... - December 24th, 2016 [December 24th, 2016]
- What is Home Automation? | Home Automation Systems - December 24th, 2016 [December 24th, 2016]
- Job Seekers - Automation Personnel Services - December 24th, 2016 [December 24th, 2016]
- iAutomation - December 25th, 2016 [December 25th, 2016]
- Beyond Automation - hbr.org - December 25th, 2016 [December 25th, 2016]
- Automation The Car Company Tycoon Game on Steam - December 25th, 2016 [December 25th, 2016]
- Automation - Wikipedia - December 25th, 2016 [December 25th, 2016]
- Build automation - Wikipedia - December 26th, 2016 [December 26th, 2016]
- Home - Enerwave Home Automation - December 27th, 2016 [December 27th, 2016]
- Automation | Technologies | Systems | Integrator ... - December 27th, 2016 [December 27th, 2016]
- Automation - DESHAZO - December 27th, 2016 [December 27th, 2016]
- Custom Automation & Machine Design | Automation GT - December 27th, 2016 [December 27th, 2016]
- IT Automation - BMC - December 27th, 2016 [December 27th, 2016]
- Werner Electric | Automation - January 28th, 2017 [January 28th, 2017]
- Automationtechies | Automation Engineering Recruiting - January 28th, 2017 [January 28th, 2017]
- Automation - Mazak Corporation - January 28th, 2017 [January 28th, 2017]
- Automation | Food Engineering - January 28th, 2017 [January 28th, 2017]
- Test Automation Services for Development of Regression ... - January 28th, 2017 [January 28th, 2017]
- UI Automation Overview - msdn.microsoft.com - February 5th, 2017 [February 5th, 2017]
- The Evolution of Automation and What It Means for the Integration Industry - Commercial Integrator - February 7th, 2017 [February 7th, 2017]
- Automation, robots could replace 250000 public sector workers in the next 15 years - Computer Business Review - February 7th, 2017 [February 7th, 2017]
- New telecom transformation goals require service automation - TechTarget - February 7th, 2017 [February 7th, 2017]
- Automation expected to displace insurance underwriters, real estate brokers - CIO Dive - February 7th, 2017 [February 7th, 2017]
- The Perks Of Automation And The Risks: Why To Think Twice About Getting Into That Driverless Uber - Forbes - February 7th, 2017 [February 7th, 2017]
- Voices Reinventing enterprise finance by overhauling AP automation - Accounting Today - February 7th, 2017 [February 7th, 2017]
- DFLabs Launches the First Security Automation and Orchestration Platform based Upon Supervised Active Intelligence - Business Wire (press release) - February 7th, 2017 [February 7th, 2017]
- VIDEO: Going Big on Automation in a Small Footprint Facility - ENGINEERING.com - February 7th, 2017 [February 7th, 2017]
- Building a better model of human-automation interaction - Phys.org - Phys.Org - February 7th, 2017 [February 7th, 2017]
- Cruise Automation Is Testing an App For Hailing Self-Driving Cars - Fortune - February 8th, 2017 [February 8th, 2017]
- AlixPartners examines automation in manufacturing and logistics management - Logistics Management - February 8th, 2017 [February 8th, 2017]
- Women need to look out for each other in automated workplaces - The Guardian - February 8th, 2017 [February 8th, 2017]
- Automation vs. the H-1B visa program: Which matters to employees? - TechTarget - February 8th, 2017 [February 8th, 2017]
- Automation is the unavoidable future of the economy - The Daily Cougar - February 8th, 2017 [February 8th, 2017]
- Speeders beware: Legislation would allow automation crackdown ... - SFGate - February 9th, 2017 [February 9th, 2017]
- Robots versus bureaucrats: Why public sector work is ripe for automation - Financial Post - February 9th, 2017 [February 9th, 2017]
- Rockwell Automation Surged 10% in January as Growth Picked Up Steam - Motley Fool - February 9th, 2017 [February 9th, 2017]
- Global Medical Automation Market to Reach Approximately $75.6 Billion by 2025 - By End User, Application ... - PR Newswire (press release) - February 10th, 2017 [February 10th, 2017]
- Automation 'key' to advancing Thai production - The Nation - February 10th, 2017 [February 10th, 2017]
- WorkWave Releases New Lead Management And Marketing ... - PR Newswire (press release) - February 10th, 2017 [February 10th, 2017]
- 'We employ insane levels of automation' Kris Canekeratne - Times of India - February 10th, 2017 [February 10th, 2017]
- Most people are optimistic about workplace automation, social data suggests - ZDNet - February 10th, 2017 [February 10th, 2017]
- Yes, there's a job creation argument for automation and technology ... - The Hill (blog) - February 10th, 2017 [February 10th, 2017]
- Technobabble: Automation and the modern worker - CIO Dive - February 10th, 2017 [February 10th, 2017]
- Improving Behavior Through Automation of Vehicle Systems - School Transportation News (blog) - February 11th, 2017 [February 11th, 2017]
- Automation Nightmare: Philosopher Warns We Are Creating a World Without Consciousness - Big Think - February 11th, 2017 [February 11th, 2017]
- Why Don't We See More Automation in Federal Networks? - Nextgov - February 11th, 2017 [February 11th, 2017]
- Automation can revitalize the US workforce - Fox News - February 11th, 2017 [February 11th, 2017]
- Readers Write (Feb. 12): The moose population; jobs, start-ups and automation; diversity in the funny pages - Minneapolis Star Tribune - February 12th, 2017 [February 12th, 2017]
- Automation can replace bureaucrats and save taxpayers money - Hot Air - February 12th, 2017 [February 12th, 2017]
- TigerStop hopes to ride automation to new heights - The Columbian - February 12th, 2017 [February 12th, 2017]
- Your Most Valuable Resource is Time Get More of it through Automation - CMS Critic (press release) (blog) - February 13th, 2017 [February 13th, 2017]
- What Does Device Automation Mean for Users? - Medical Device and Diagnostics Industry (blog) - February 13th, 2017 [February 13th, 2017]
- How To Beat Automation And Not Lose Your Job - Forbes - February 13th, 2017 [February 13th, 2017]
- Logistics firm gets automation boost - The Straits Times - February 14th, 2017 [February 14th, 2017]
- PP Control & Automation launch new video to kick-start exciting plans for 2017 - Manufacturer.com - February 14th, 2017 [February 14th, 2017]
- Automation's Impace on Data Center Monitoring Alerts - The Data Center Journal - February 14th, 2017 [February 14th, 2017]
- Hollysys Automation Technologies Reports Unaudited Financial Results for the First Half Year and the Second Quarter ... - PR Newswire (press release) - February 15th, 2017 [February 15th, 2017]
- 4 Automation Hacks to Save You Money and Manpower - Yahoo Finance - February 15th, 2017 [February 15th, 2017]
- Istuary Innovation Group and Bluewrist Partner to Bring Robotics and Automation into China's Manufacturing Sector - Yahoo Finance - February 15th, 2017 [February 15th, 2017]
- Redwood Software Named a Strong Performer in Independent Robotic Process Automation (RPA) Report - Yahoo Finance - February 15th, 2017 [February 15th, 2017]
- Boeing ramps up automation, innovation as it readies 737MAX | The ... - The Seattle Times - February 15th, 2017 [February 15th, 2017]
- Robots and AI are coming for our jobs, but can augmentation save us from automation? - Digital Trends - February 15th, 2017 [February 15th, 2017]
- The Impact of Bad Data in Automation: Why Quality Management is Critical - R & D Magazine - February 16th, 2017 [February 16th, 2017]
- Automation: Are We Empowering Human Interaction Or Displacing It? - Business 2 Community - February 16th, 2017 [February 16th, 2017]
- Life in the Fast LaneAutomation with Software-Defined Intelligence - InfoWorld - February 16th, 2017 [February 16th, 2017]
- Luddite Lefty Journalists Apparently Think Workplace Automation is Conservatives' Fault [VIDEO] - Daily Caller - February 16th, 2017 [February 16th, 2017]
- Will automation define the future of network technology? - TechTarget - February 16th, 2017 [February 16th, 2017]
- Editorial: Improving automation - The Motorship - February 17th, 2017 [February 17th, 2017]
- TigerText Unveils Role-based Scheduling Automation, Amazon Alexa integration - HIT Consultant - February 17th, 2017 [February 17th, 2017]
- 89% people want automation at workplace: Adobe - Economic Times - February 18th, 2017 [February 18th, 2017]
- Delta veers to EV parts, automation - Bangkok Post - February 18th, 2017 [February 18th, 2017]
- Robotic process automation makes nearshore outsourcing more ... - CIO - February 18th, 2017 [February 18th, 2017]
- The working-class job that Trump could save from automation - Washington Post - February 18th, 2017 [February 18th, 2017]
- China must be ready for automation - Basic Income News - February 18th, 2017 [February 18th, 2017]
- Bill Gates Says Robots Should Be Taxed Like Workers - Fortune - February 18th, 2017 [February 18th, 2017]
- Trump and automation challenge India's IT industry - VentureBeat - February 18th, 2017 [February 18th, 2017]
- Both Trump and Automation Are Challenging India's IT Industry - Fortune - February 20th, 2017 [February 20th, 2017]
- 89% people want automation at workplace: Adobe - ETCIO.com - February 20th, 2017 [February 20th, 2017]