IT Brief Australia logo
Technology news for Australia's largest enterprises
Story image

Logical data fabric: knitting together enterprise data

By Nick Forrester
Fri 3 Sep 2021

Article by Denodo senior vice president and chief marketing officer Ravi Shankar.
 

As the digital economy grows and organisations accelerate their plans for digital transformation, the capture and use of data becomes ever more critical. COVID-19 has accelerated the need for change as businesses pivot to hybrid working models and optimise their customer-facing assets, such as applications and other go-to-market tools.

However, with valuable data now being ingested from a vast array of points across the enterprise, the rise of data sprawl has posed a real challenge for many organisations. 

PricewaterhouseCoopers’ 22nd CEO Survey found that 95% of local CEOs see their company success ‘resting upon better use of customer and client data.’ A recent IDC report found that more than 80% of IT leaders reported data sprawl as one of the most critical problems they face today.

With such a deluge of potentially useful data, many struggle to make full use of it. The data is often stuck in disparate silos, making it difficult to find and govern, and time-consuming to include in traditional reports. Therefore, turning data into intelligible insights is often problematic at best.

Data management has evolved significantly since the 1970s when we first stored and accessed it via different spindles and punch cards. Through systems like Hadoop, data storage and retrieval have greatly enhanced – but the modern enterprise is still faced with an influx of data that makes even these modern systems obsolete. Logical data fabric can be the contemporary solution to data sprawl – a technique that enables data to be efficiently converted and used for business purposes.
 

Logical data fabric: knitting a virtual view of data

For decades, data has been captured and stored in central repositories, mainly so organisations can achieve a unified view of information across applications and databases.

Rather than consolidating data into a central physical repository, a new data management paradigm called logical data fabric has emerged. A logical data fabric knits a virtual view of data across applications by leaving it in its original sources while enabling a unified view of all enterprise data.

Data virtualisation forms its core technology, and many of its capabilities are automated through artificial intelligence (AI) and machine learning (ML).

Logical data fabric has increased in importance as organisations increasingly store data in multiple cloud-based platforms, adding to existing on-premises data-silo problems.
 

Stop collecting and start connecting: why logical data fabric is a better solution

Logical data fabric enables organisations to stop ‘collecting’ their data and placing it into a central repository but rather to start remotely ‘connecting’ to their data at its various sources through data virtualisation. Regardless of the data’s location, logical data fabric brings the data together in a virtual fashion for the benefits of data discovery, management, and governance.

In this way, logical data fabric greatly improves the efficacy of business data users. Without needing to move data from its source into a temporary repository, IT teams no longer need to program ETL scripts to convert data before loading it into target systems. Instead, data virtualisation can perform transformations on the fly, which saves on storage costs.

Also, data virtualisation’s low- to no-code approach significantly reduces the resources required to develop unified data views and intelligence.

More importantly, data virtualisation serves as a virtual catalogue for all data assets within the enterprise, including the lineage of all data sets from their points of origin to their final published state, the format of specific data, and the relationship between different data assets. Through this catalogue, users do not need to access different systems to perform actions such as data discovery or documenting business definitions for the purposes of data governance. The process is streamlined.

Logical data fabric also possesses powerful data preparation capabilities, normalising data formats and simplifying them for business consumption. Business users can then easily access the data within their favourite analytical, operational, web, or mobile applications.
 

The future of logical data fabric? embracing AI/ML

Logical data fabric already embraces AI and ML to automate routine tasks, which is set to intensify. AI and ML continuously analyse changing data patterns and automatically integrate new data for unified views, delivering them in the most appropriate formats to business users. 

The incorporation of AI and ML technologies enable organisations to better understand the data consumption behaviour of certain users.
 

Logical data fabric for today and tomorrow

Logical data fabric is no longer just a concept. Due largely to the benefits outlined above, the adoption of logical data fabric has been gaining speed. By providing business-friendly views of enterprise data in its entirety and automating key processes using AI and ML, logical data fabric will be one of the hottest data management trends in coming years.

Related stories
Top stories
Story image
LG Electronics
LG Electronics brings on Aussie AV distributor Alloys
LG Electronics Australia Business Solutions has appointed Australian AV distributor Alloys as a new distribution partner.
Story image
Energy
Sustainability huge factor for APAC data centre managers
A new report reveals that 85% of data centre managers in APAC believe that sustainability will significantly impact operations and decision making.
Story image
Pegasystems
Marketing technologies set to increase revenues - study
Marketing leaders say that investment in new marketing technologies (MarTech) will drive significantly increased revenues.
Story image
Equinix
Aussie businesses buckle down on digital tech investments
Australian businesses are planning major investments in digital technologies to support ambitious expansion plans.
Story image
Recruitment
Thales on recruitment hunt for next disruptive innovations
"Recruiting new talent is part of Thales's belief in the power of innovation and technological progress to build a safer, greener and more inclusive world."
Story image
Security Information and Event Management (SIEM)
LogRhythm updates SIEM Platform with latest innovations
LogRhythm has announced the launch of version 7.9 of the LogRhythm SIEM Platform and updates to LogRhythm NDR and LogRhythm UEBA.
Story image
Ransomware
Examining the future of ransomware threats with Vectra’s CTO
As customers' valuable data move to the cloud, so will ransomware. What is the current landscape and what do we need to know?
Story image
Sustainability
Honeywell named Frankston facility services provider
Honeywell has been named the joint facility services provider for Frankston Hospital’s AU$1.1 billion redevelopment.
Productivity
Discover the 5 ways your ERP may be letting you down. Is your current system outdated, difficult to manage, and costing you a fortune?
Link image
Story image
Airwallex
How Airwallex helps businesses achieve globalisation success
As markets continue to shift, businesses need to be able to provide the same quality of service for customers regardless of where they are located around the world.
Story image
Cybersecurity
Without trust, your security team is dead in the water
The rise of cyberattacks has increased the need for sound security that works across any type of business, but with any change, buy-in is essential. Airwallex explains why.
Story image
Apple
Jamf introduces new content filtering solution for education providers
Jamf has announced the launch of Jamf Safe Internet, a new offering that looks to deliver a safe online experience to students while offering better management options for admins.
Story image
Wiise
Four things wholesale distributors need to consider for FY2023
In a post-pandemic world, there are many things for a distribution business to juggle. ERP solutions company Wiise narrows down what companies should focus on.
Story image
Artificial Intelligence
Accenture shares the benefits of supply chain visibility
It's clear that gaining better visibility into the supply chain will help organisations avoid excess costs, inefficiencies, and complexity to ultimately improve their bottom line.
Story image
Document Management
Regaining digital trust and enhancing digitisation in Australian Government agencies
Having a digitised ecosystem of documents, tools and data can help bolster security, improve workflow and ultimately create better services.
Story image
Solutions
Progress launches latest version of network visibility solution
In Flowmon 12 network solution, Progress has expanded its support for public cloud provider flow log monitoring and launched new features.
Story image
Cybersecurity
Palo Alto Networks' cloud security platform receives IRAP assessment
"We provide help protect all forms of compute, cloud native services and access to data within public and private sectors."
PwC
PwC's Consulting Business and PwC's Indigenous Consulting are proud to play an important role in helping Australian Indigenous Mentoring Experience build IMAGI-NATION, a free online university for marginalised communities around the world.
Link image
Story image
AGVs
Bridgestone Australia uses Dematic's AGVs to optimise warehouse operations
Bridgestone Australia has deployed Dematic's Automated Guided Vehicle solution across its new Melbourne warehouse in Truganina.
Story image
Accounting
Four factors to consider when choosing the right job accounting solution
Progressive job-based businesses can achieve success by strengthening their ability to quantify every cost attributable to the delivery of an outcome for a customer.
Story image
Cybersecurity
How organisations can mitigate IoT and IIoT security risks
IoT and IIoT come with inherent risks because they are often deployed faster than they can be secured, putting organisations in danger of cyber threats. Here are tips on how to mitigate those risks.
Story image
Metaverse
How the metaverse will change the future of the supply chain
The metaverse is set to significantly change the way we live and work, so what problems can it solve in supply chain management?
Story image
Digital Transformation
Munro Footwear Group chooses Boomi to assist with digitisation strategy
Munro Footwear Group (MFG) has selected Boomi to assist with its eCommerce and digital transformation roadmap goals.
Story image
Management
MYOB snaps up Sydney-based management software specialists
MYOB has announced the acquisition of Sydney-based business management software and support specialists, GT Business Solutions.
Story image
Telecommunications
WiFi as a Service market to reach $26 billion through 2032
As a result of the easy management of wireless infrastructure over cloud services, WaaS is experiencing rapid growth.
Project management
Discover the 4 crucial factors for choosing the right job-costing solution. Is your team struggling to cost jobs and keep projects running on budget?
Link image
Story image
Payroll
How New South Wales state departments achieved cloud migration success
State departments in New South Wales are heading to the cloud to achieve better workflow solutions, and one company is paving the way for their success.
Digital Transformation
Discover the 5 signs your business is ready for a cloud-based ERP. Is your business being left behind as more of your competitors switch to the cloud?
Link image
Story image
SaaS
Ping Identity appoints Deloitte Australia as a partner
Ping Identity has appointed Deloitte Australia as a Consulting Technology Partner, uniting its offerings with the company's consulting services.
Story image
ABI Research
NaaS market expected to reach $150B by 2030 - research
"The market is immature and fragmented, but telco market revenue will exceed US$75 billion by 2030 if they act now and transform to align with requirements."
PwC
WSLHD and PwC’s Consulting Business came together to solve through the challenges of COVID-19. A model of care was developed to the NSW Health Agency for Clinical Innovation guidelines with new technology platforms and an entirely new workforce.
Link image
Story image
Samsung
Monitors are an excellent incentive for getting employees back
The pandemic has taught us that hybrid working is a lot easier than we would’ve thought, so how can the office be made to feel as comfortable as home? The answer could be staring you in the face right now.
Story image
Artificial Intelligence
Decision Inc. partners with provenio.ai to expand offering
Decision Inc. Australia has partnered with provenio.ai to expand its offering to clients in the retail, FMCG, manufacturing, supply chain and logistics sectors.
Story image
Capital
Rubber Monkey gears up for Aussie market with latest capital raise
Rubber Monkey is seeking to raise up to NZ$2.5 million of new capital through online investment platform, Snowball Effect.
Story image
Enterprise Resource Planning / ERP
Five ways your ERP is letting you down and why it's time for a change
Wiise explains while moving to a new system may seem daunting, the truth is that legacy systems could be holding your business back.
Story image
Cybersecurity
Tech and data’s role in the changing face of compliance
Accenture's study found that 93% of respondents agree or strongly agree new technologies such as AI and cloud make compliance easier.
Story image
CSG
To win at 5G, telcos must tame their quoting chaos
The catalogs of CSP (communication service providers) market offerings are set to explode as new digital services emerge, powered by B2B2X business models.
Story image
Amazon
What brands can expect from Amazon Prime Day in Australia
Amazon Prime Day is the annual two-day shopping event, kicking off this year from July 12-13 and is the global online shopping platform's biggest sales event. 
Story image
Low-code
Appian unveils low-code certification program in Australia
Appian has announced a program to provide the next generation of low-code developers with access to education on the subject and certification to foster career opportunities.
Story image
Remote Working
RDP attacks on the rise, Kaspersky experts offer advice
"Given that remote work is here to stay, we urge companies to seriously look into securing their remote and hybrid workforce to protect their data."
Supply chain
Discover the 4 critical priorities for wholesale distribution businesses in FY23. Are you worried about how supply chain issues may affect your business in 2023?
Link image
Story image
Media
Registrations for the W.Media Sydney Cloud and Datacenter Convention 2022 now open
Are you a C-Level executive looking to enhance your knowledge in the cloud and data center space in order to get the best results for your company?
Story image
Cybersecurity
Delinea’s Joseph Carson recognised with OnCon Icon Award
Delinea chief security scientist and advisory CISO Joseph Carson has been recognised as a Top 50 Information Security Professional in the 2022 OnCon Icon Awards.
Story image
Data Protection
Five signs your business is ready to move to the cloud
Many organisations are thinking about moving to the cloud. But what are the signs you are ready, and what are the reasons to move?