IT Brief Australia logo
Technology news for Australia's largest enterprises
Story image

A look at how DataOps can drive significant business value

By Patrick Martlew
Thu 5 Apr 2018
FYI, this story is more than a year old

Article written by MapR VP of technology strategy Dr Crystal Valentine 

In 2018, big data analytics will become a core competency within Australian enterprises rather than merely a nice-to-have. In today’s data-driven world, organisations are already being tasked with collecting and curating data on a massive scale to increase revenue and gain competitive advantage, as well as improve operational efficiency. Without this focus on data, businesses will fall behind.

According to Telyste, around a third of Australian CIOs are already are or looking to use big data analytics for sales and marketing applications. Moreover, IDC estimates that by 2020, data-as-a-service will generate 80% of revenue for large businesses in Australia.

As the importance of big data within the organisation increases, the role of data science and machine learning is also rapidly growing. This is because data science and machine learning techniques are playing an increasingly vital role in driving value for big data projects. For example, machine learning can be used to help identify credit card and insurance fraud, to determine the health of factory machinery and the likelihood of machine failure, as well as helping native advertising become more intelligent.

This intelligence will infiltrate all areas of business. According to IDC, by 2019, 85% of enterprise apps will use artificial intelligence (AI), 65% of consumers will interact with AI-driven chatbots, and half of all digital transformation initiatives will leverage AI.

What is DataOps and how does it drive value?

DataOps is an agile methodology for developing and deploying data-intensive applications, including data science and machine learning. A DataOps workflow supports cross-functional collaboration, with an emphasis on both people and processes, as well as the empowering platform technologies that underpin it. While DataOps focuses largely on people and processes, it also requires an enterprise-grade platform to enable collaboration and the sharing of data.

Rather than having teams work from siloed technology and data, a collaborative effort requires the use of a single, unified data platform. Using a single platform is key to agility, as it reduces the need to copy or move large data sets. With a unified data platform, organisational data access and privacy policies can be enforced holistically across organisations.

A DataOps methodology offers many benefits to data-driven organisations and specifically has a positive effect on business agility. With DataOps, data scientists can iterate rapidly to improve deployment models. With DataOps, data scientists also won’t get bogged down in doing the “plumbing” work of finding, copying, curating, and transforming data.

The agile approach to big data and data strategy

Despite businesses making increasing investments in data science and machine learning, many of them still grapple with how to deliver value due to the logistical challenges of managing big data. A key challenge is that extensive time and resources are required to work on data engineering and to create the “glue” code to put together data pipelines. As a result, many businesses are still struggling to adopt an agile approach to leveraging big data. While there are many factors contributing to this, one of the most critical is a lack of a unified, secure platform for data science and analytics.

An agile approach to big data is collaborative and creative, with changes and feedback an integral part of a project’s evolution. A successful agile data strategy combines all the elements of big data analysis and makes the data visible, shareable, reproducible and standardised.

Traditionally, raw data has been viewed as something to be extracted, transformed and loaded into warehouses before it can be analysed. Today leading organisations are instead looking to leverage enterprise-grade big data platforms for a cost-effective, flexible and fast way to access and secure multiple data types. When combined onto a platform, all of these elements can help create a more agile, creative, and collaborative environment.

Big data will not bring value to an organisation until it is leveraged to impact either top-line growth or profitability through increased operational efficiency. While DataOps is still emerging as an enterprise practice to organise the work of small teams, it represents a significant new trend that will serve to increase collaboration, agility and operational efficiency. The recognition that data-intensive applications have their own set of considerations and challenges when it comes to managing and securing large, complex data sets, - will mean a major a paradigm shift for Australian enterprises.

Related stories
Top stories
Story image
Tech job moves
Tech job moves - Adatree, Brother, Databricks, Nutanix & Rubrik
We round up all job appointments from May 20-26, 2022, in one place to keep you updated with the latest from across the tech industries.
Story image
Customer experience
The importance of service level management to customer experience
Staffing shortages have impacted site reliability engineers in particular since they are under extreme pressure to ensure that digital assets perform at optimum levels 24/7.
Story image
DevOps
Deloitte expands cloud observability practice with Dynatrace
Deloitte is expanding its cloud observability practice, including DevOps principles, AI/ML, cloud complexity management and software engineering.
Story image
Contact Centre
Leveraging technology in contact centres to reduce attrition rates
Many organisations worldwide have accelerated DX to better respond to changing market drivers and business environments after the disruption of the pandemic.
Story image
MEC
MEC spending for private cellular networks to reach $5.8b
A new ABI Research report finds the revenue for Multi Access Edge Compute (MEC) deployments for private cellular networks will reach USD$5.8 billion by 2030.
Story image
Check Point
Check Point and CCTV expert join forces to boost protection
The partnership will involve Check Point Quantum IoT Protect Nano Agent being embedded in Provision-ISR’s CCTV cameras for on-device runtime protection.
Story image
Cybersecurity
What every CISO must answer to enable a best-in-class security operations program
It has been widely reported recently that South Australian government employees have been the victims of a cyberattack.
Story image
Training
Infosec unveils role-guided cybersecurity training roadmaps
Infosec Skills Roles maps hands-on training and certifications to the 12 most in-demand cybersecurity roles to maximise training efficiency.
Story image
GapMaps
GapMaps Live to improve brand decisions on physical locations
GapMaps has released its latest service GapMaps Live, giving more insights and features to help brands make better decisions about physical locations.
Story image
BYOD / Bring Your Own Device
How zero trust can lead the battle against ransomware
SecOps teams champion a zero trust strategy to support the fight against the escalating risk of cybercrime and help monitor threat actors across a network.
Exabeam
Find out how a behavioural analytics-driven approach can transform security operations with the new Exabeam commissioned Forrester study.
Link image
Story image
Sustainability
Aligned Data Centers increases sustainability-linked loan
Aligned Data Centers has increased its sustainability-linked loan from $375 million to $1.75 billion to speed up the next phase of its strategic growth.
Story image
Phishing
MailGuard warns of new scam targeting Telstra customers
Telstra customers in Australia are being warned of a new scam involving "Unsuccessful Payment" messages.
Story image
Digital Signage
MAXHUB's Digital Signage range to bolster boardroom productivity
The new MAXHUB Digital Signage technology is purpose-built to make every kind of team meeting more effective.
Story image
Digital wallets
Australians lead the way in digital payment use - report
Australian consumers are at the forefront of mobile wallet use and adoption of digital banking tools, abandoning cash and physical payment experiences.
Story image
Ponemon Institute
Email revealed to be riskiest channel for data loss
More than half (60%) of organisations experienced data loss or exfiltration caused by an employee mistake on email in the last 12 months.
Story image
Symbio
Symbio consolidates TNZI business to support APAC expansion
Symbio has recently announced the consolidation of its international business (TNZI) under the Symbio brand to support its Asia Pacific expansion strategy.
Story image
Hybrid Cloud
Barracuda expands cloud-native SASE platform
"The expansion of Barracuda's cloud-native SASE platform for hybrid deployment models and IIoT environments solves a number of challenges."
Story image
Transport
Third-party automotive apps bear significant privacy risks
Mobile applications for connected cars provide various features to make life easier for motorists, but they can also be a source of risk.
Story image
Data Center
Preventing downtime costs and damage with Distributed Infrastructure Management
Distributed Infrastructure Management (DIM) can often be a lifeline for many enterprises that work with highly critical ICT infrastructure and power sources.
Story image
Boost Mobile
Boost Mobile now makes up over 7% of Aussie prepaid market
Boost Mobile has doubled its market share over the past four years and now has more than 7% of Australia's prepaid market, equivalent to over 700,000 people.
Story image
Cybersecurity
4/10 Australian SMEs fallen victim to cyber-attacks since pandemic
Almost four out of teb SMEs in Australia have fallen victim to cyber-attacks since the pandemic began, according to a new study.
Story image
Artificial Intelligence
Gartner reveals top three tech trends for banks this year
Gartner says generative artificial intelligence, autonomic systems and privacy-enhancing computation are gaining traction in banking and investment services.
Story image
Red Sift
Entrust expands strategic partnership with Red Sift
Entrust has expanded its strategic partnership with Red Sift to make it easier for businesses to adopt Brand Indicators for Message Identification (BIMI) standards for email identification and security.
Story image
Digital Transformation
Harnessing digital innovations to maximise loyalty programmes and improve CX
When it comes to the retail sector, merchants have never had access to so many different client touchpoints and data to understand their customers better.
Story image
Customer experience
Phone, internet complaints increase for first time in five quarters
Phone and internet complaints have increased for the first time in five quarters, according to a new telco report from the Ombudsman.
Story image
Identity and Access Management
The post-pandemic workforce requires secure IAM capabilities
HID Global discusses what identity and access management means for organisations in today's convoluted digital world.
Story image
VPN
The most common online scams in Australia
No one is safe from online scammers, and many of these scammers have capitalised on the pandemic, using this confusing time to attack more people than ever.
Story image
Infosys
Consumer relationships with digital services continues to change
Two years of pandemic-induced reliance on technology for work has altered our relationship with digital apps and services, new research has found.
Story image
Rackspace
Skills shortages hold orgs back from capitalising on cloud 2.0
Organisations are becoming more comfortable with sophisticated 'cloud 2.0' technologies, even as they confront difficulties in hiring and retaining IT talent.
Story image
Digital Transformation
Digital transformation increasing business complexities
A new survey suggests businesses must re-examine their digital transformation approach to better help employees adapt to change.
Story image
Malware
Fortinet introduces self-learning AI in latest offering
Fortinet is introducing self-learning AI capabilities in its new network detection and response offering, FortiNDR.
Story image
Data Protection
Information management capabilities to meet privacy requirements
Organisations with customers or operations across more than one country face a spate of new and proposed privacy and data protection laws.
Story image
Microsoft
Elevation of Privilege the top 2021 Microsoft vulnerability
BeyondTrust has released its 2022 Microsoft Vulnerabilities Report, finding that Elevation of Privilege is the top vulnerability category for the second consecutive year.
Story image
Informatica
Informatica, Oracle enter strategic global cloud partnership
Oracle named Informatica as a preferred partner for enterprise cloud data integration and data governance for data warehouse and lakehouse solutions on OCI. 
Story image
SaaS
MedCart achieves close to AUD$10 million in sales with help from Marketplacer tech
Australian health and medical start-up MedCart has achieved annual sales of close to AUD$10 million in less than 12 months, utilising Marketplacer marketplace technology to help achieve successful results.
Story image
Microsoft
Microsoft, Cloudian partnership offers data center flexibility
Cloudian’s HyperStore object storage platform is now integrated and validated to work with Microsoft SQ Server 2022, offering more flexible and scalable data centers.
Story image
Kubernetes
Sysdig unveils new Kubernetes troubleshooting and cloud innovations
Sysdig has introduced two new innovations that look to help bolster cloud services and simplify Kubernetes troubleshooting.
Story image
Managed service provider
Barracuda MSP Day 2022 highlights MSP opportunities
Barracuda Networks has released a report showing global services-related MSP revenue is set to increase by more than a third in 2022 compared to 2021.
Story image
Cybersecurity
Accenture - a collective security approach a driving factor for cyber resilience
With the approaching Davos World Economic Forum upon us, it is even more imperative to discuss the impact of cybersecurity on business operations leading into the future.
Story image
Silver Peak
The path to an adaptive, modern network
Managing and securing the network looks different than it did just two years ago—especially given that most of these networks are made up of multi-generations of infrastructure stitched together over time.
Story image
NVIDIA
NVIDIA announces a spate of new innovations at Computex 2022
NVIDIA has announced its latest innovations in data center, robotics, content creation, and gaming in a virtual keynote address on the opening day of Computex 2022 in Taipei.
Story image
Microsoft
Microsoft previews Power Platform website design offering
Microsoft has announced the preview of Power Pages, the fifth product in its Power Platform family, designed for low-code makers and professional developers.
Story image
APAC
Top data and tech challenges for APAC banks - report
InterSystems’ new report finds that 87% of A/NZ banks experience frustrations and concerns in using their data to drive decision-making.