IT Brief Australia logo
Technology news for Australia's largest enterprises
Story image

Three mistakes to avoid when building a business intelligence solution

By Contributor
Tue 2 Mar 2021
FYI, this story is more than a year old

Article by Denodo.
 

Business intelligence (BI) projects are a high priority for companies seeking to empower better, faster, data-driven decisions and actions based on high-quality, high-value reports.

However, new BI implementations are complex and inherently risky, and BI team leads must identify all associated data quality risks upfront while engaging all stakeholders from the top down. 

He or she has to ensure that executive-level buy-in filters through all departments involved in the project, that there is sufficient infrastructure to support the multiplicity of data sources available to an enterprise in modern times, and that there is sufficient support in place to incorporate real-time analytics.

Taking the time to plan a BI project and create a clear roadmap carefully will lead to a better, more functional BI deployment.

Here, we address three common mistakes that companies should avoid making so that the implementation process is smooth, and the project is ultimately successful.
 

Holding onto inadequate technology

Many companies try to modernise their BI solutions while holding onto core solutions that are dated and may no longer be fit for the task. The challenge is that companies often have different tolerance levels for retiring ageing solutions. Deciding on when to phase out or replace solutions can depend on critical infrastructure, data sources, how integrated they are with legacy systems, and so on.

Also, certain solutions stay viable for longer than others. BI implementations designed to be more reporting-centric or built around batch-oriented extract, transform, and load (ETL) processes built around data warehouses tend to age fast, as they do not support many modern data types. 

ETL based data integration is also resource and time-intensive, limiting data ingestion and delivery to scheduled batches. This approach will not be able to support many modern use cases like mobile dashboards or live web applications.

Traditional BI solutions that are embedded in ERP systems, as well as some simpler, disparate reporting tools that support limited uses, also have shorter lifespans.

Some companies may simply use a spreadsheet tool to perform fundamental data analysis and manual cutting and pasting between files stored on different computers or emailed back and forth to perform some rudimentary data integration. Companies should look at supporting or replacing these tools with integrated modern analytics technologies if this is the case.

Modern data architecture enables companies to streamline interoperability on data models and data integration. This speeds up business processes and reporting, which increases efficiency.

For instance, in data preparation, data that was created or prepared in one specific product can be further extended to support various other functions using data virtualisation, enabling the organisation to share a virtual view of the data without actually moving the source data. Once this virtual data source is created, it can be shared with other parts of the analytics workflow, including emerging augmented analytics tools.

Such tools leverage machine learning (ML) and natural language processing (NLP) technologies to generate business-friendly intuitive insights. Advanced data architecture provides the foundation for business users to leverage real-time information for timely decision making.
 

Attempting to collect all possible data in a single place

Businesses today are ingesting data from many varied sources to gain deeper insights into customer behaviour, market opportunities, and competition. BI infrastructures can incorporate a wide variety of data sources and data ingestion points. 

These can include databases, social media sources, and streaming video sources, and other sources that can come in both structured and unstructured formats. Companies must account for all these data sources and plan for various possible sources in their BI strategy.

However, they must not attempt to collect all of this data into a single repository. Even a modern ETL-based system will be built around collecting all available data and loading it into a data warehouse. Such an attempt will fail because traditional data warehouses cannot support modern data types, such as unstructured data.  

Companies may attempt to work around such issues with data adapters or connectors, which establish point-to-point integrations between one source and one or more targets. However, these solutions expose other shortcomings. Like ETL processes, point-to-point integrations are also challenging to manage; they add more complexity to the data-integration problem than reduce complexity.

For a modern BI platform to work, companies need to ensure connectivity with a diverse range of data sources, including structured or unstructured data, relational or nonrelational, or on-premises or in the cloud.
 

Not preparing for real-time analytics

The rapid growth of data generates challenges beyond data volume. Before companies can harness the data, they need to deal with the variety of the data, the time it takes the data to move around the organisation, and data generation speed.

The current data growth is mainly in unstructured data. That is, data that is often characterised as ‘human-generated-information,’ such as high-definition images and videos, social media posts, and phone and chat logs.

This increase in data ingestion points highlights the need for a more agile way to integrate data in real-time so that analysis can be performed at the speed of origination. To make this possible, companies will need modern data architectures that allow for agility and real-time access to a broad base of data sources.

The problem is that most companies are stuck with older IT infrastructures, including backend systems that are not set up for real-time data access. These companies have to first replicate data from all their disparate sources into yet another repository, such as a data lake.

This means that companies take more time than necessary to integrate and process data, making it impossible for them to perform real-time analytics. This approach can also lead to data duplication, loss of data context, and added latency. Worse, the replicated data is always, at least slightly, out of sync with the original sources because data is continuously created and collected as the business runs.

The best solution is to enable each BI reporting solution to interface directly with each applicable data source, so there is no latency in data access, analysis, and reporting. With data virtualisation, companies can establish an intermediate data access layer that can source a wide variety of data while abstracting away all data access complexities from the consuming applications, enabling real-time analytics. Data virtualisation provides a holistic, real-time view of the integrated data without replicating any source data.
 

Getting BI projects right

BI solutions empower decision-makers with data-driven insights. In today’s highly competitive landscapes, making informed decisions promptly can make a critical difference between success and failure.

However, BI projects can be costly and hard to predict, so organisations must get it right with BI early in the process. By considering data virtualisation at the beginning of a BI project, companies will be well on their way to doing so.

Related stories
Top stories
Story image
Employment
Tech job moves - Forcepoint, Malwarebytes, SolarWinds & VMware
We round up all job appointments from May 13-20, 2022, in one place to keep you updated with the latest from across the tech industries.
Story image
Migration
Let’s clear the cloud visibility haze with app awareness
Increasingly, organisations are heading for the cloud, initiating new born-in-the-cloud architectures and migrating existing applications via ‘lift and shift’ or refactoring.
Story image
Remote Working
Successful digital transformation in the hybrid work era is about embracing shifting goalposts
As organisations embraced remote working, many discovered they lacked the infrastructure needed to support history’s first global load test of remote work capabilities.
Story image
Vectra AI
Understanding the weight on security leader’s shoulders, and how to shift it
Millions of dollars of government funding and internal budgets are being funnelled into cybersecurity to build resilience against sophisticated threats, indicating how serious this issue has become.
Story image
Supply chain
Jetstack promotes better security with supply chain toolkit
The web-based resource is designed to help organisations evaluate and plan the crucial steps they need to establish effective software supply chain security.
Story image
trust
9/10 Aussies to stop spending if personal data compromised
"Based on the patterns we are seeing among Australian consumers, it is evident that trust in a brand is exceptionally important."
Story image
Artificial Intelligence
How to ensure ethical deployment of AI implementations
The increase in automation and machine technology such as AI and machine learning has unlocked a whole new level of scale and service to organisations. 
Story image
SaaS
Rubrik Security Cloud marks 'next frontier' in cybersecurity
"The next frontier in cybersecurity pairs the investments in infrastructure security with data security giving companies security from the point of data."
Story image
Artificial Intelligence
AI-based email security platform Abnormal Security valued at $4B
"A new breed of cybersecurity solutions that leverage AI is required to change the game and stop the rising threat of sophisticated and targeted email attacks."
Story image
Artificial Intelligence
SAS announces new products amid cloud portfolio success
Analytics and AI company SAS is deepening its broad industry portfolio with offerings that support life sciences, energy, and martech.
Story image
Qualys
Qualys updates Cloud Platform solution with rapid remediation
The new update is designed to enable organisations to fix asset misconfigurations, patch OS and third-party applications, and deploy custom software.
Story image
Malware
New vulnerabilities found in Nuspire’s Q1 2022 Threat Report
“Threat actors are quickly adjusting their tactics and these exploits tend to get industry attention, but the threat posed by older and attacks still persists."
Story image
Customer experience
Research unveils precarious customer loyalty for retailers
New research has found customers are reassessing established brand loyalties as their priorities and behaviours shift.
Story image
Amazon Web Services / AWS
RedShield leverages AWS to scale cybersecurity services
"Working with AWS gives RedShield the ability to mitigate significant application layer DDoS attacks, helping leaders adopt best practices and security architectures."
Darktrace
Threat actors are exploiting weaknesses in interconnected IT/OT ecosystems. Darktrace illuminates your entire business and takes targeted action to stop emerging attacks.
Link image
Story image
Sift
Sift shares crucial advice for preventing serious ATO breaches
Are you or your business struggling with Account Takeover Fraud (ATO)? One of the latest ebooks from Sift can provide readers with the tools and expertise to help launch them into the new era of account security.
Story image
Infrastructure
Nutanix study reveals financial services sector lagging with multicloud adoption
Nutanix has released new research that reveals the financial services sector is lagging behind when it comes to multicloud adoption.
Softiron
For every 10PB of storage run on HyperDrive vs. comparable alternatives, an estimated 6,656 tonnes of CO₂ are saved by reduced energy consumption alone over its lifespan. That’s the equivalent of taking nearly 1,500 cars off the road for a year.
Link image
Story image
Sustainability
Legrand unveils Nexpand, a data center cabinet platform
Legrand has unveiled a new data center cabinet platform, Nexpand, to offer the necessary scalability and future-proof architecture for digital transformation.
Story image
Attain
Revenue operations is taking centre stage
As the business world continues to evolve, new demands need to be met to keep up with the ever-changing landscape. 
Story image
Cybersecurity
Infoblox's State of Security Report spotlights Australian remote work hazards
Attackers exploit weak WiFi, remote endpoints, and the cloud, costing 50% of organisations over $1.3 million in breach damages.
Story image
Digital Transformation
Trading up: It's time to swap core systems for flexible digital applications
This year will see more oranisations planning and commencing high tech renovations that will shake up the way they operate.
Exabeam
Find out how a behavioural analytics-driven approach can transform security operations with the new Exabeam commissioned Forrester study.
Link image
Story image
Data Protection
Barracuda launches new capabilities for API Protection
"Every business needs this type of critical protection against API vulnerabilities and automated bot attacks," Barracuda says.
Story image
Ransomware
A third of companies paying ransom don’t recover data - report
Veeam's report finds 76% of businesses who are victims of cyberattacks paid the ransom to recover data, but a third were still unable to get their information back.
Story image
Ransomware
Cybersecurity starts with education
In 2021, 80% of Australian organisations responding to the Sophos State of Ransomware study reported being hit by ransomware. 
Story image
Customer experience
Gartner recognises Okta for abilities in Access Management
Okta has announced it has been recognised as a Customers' Choice for the fourth time in a row in the Gartner Peer Insights "Voice of the Customer" report.
Story image
Sustainability
Grasping the opportunity to rethink the metrics of a sustainable data centre
A data centre traditionally has two distinct operations teams: the Facility Operations team, and the IT Operations team. Collaboration between them is the key to defining, measuring, and delivering long-term efficiency and sustainability improvements.
Story image
Manufacturing
HINDSITE wins Aerospace Xelerated Pitch Challenge with solution to support Boeing
Brisbane-based startup HINDSITE was the winner of the first ever Pitch Challenge organised by Aerospace Xelerated in partnership with Queensland XR Hub. 
Story image
Cybersecurity
A10 Networks finds over 15 million DDoS weapons in 2021
A10 Networks notes that in the 2H 2021 reporting period, its security research team tracked more than 15.4 million Distributed Denial-of-Service (DDoS) weapons.
Story image
Digital Transformation
Pluralsight and Ingram Micro Cloud team up on cloud initiative
Pluralsight has teamed with Ingram Micro Cloud to build upon cloud competence and maturity internally, and externally support partners’ capabilities.
Story image
Digital Transformation
How to modernise legacy apps without compromising security
At a time when digital transformation has become central to business, even the most important applications come with a ‘use-by’ date.
Story image
Data Center
Preventing downtime costs and damage with Distributed Infrastructure Management
Distributed Infrastructure Management (DIM) can often be a lifeline for many enterprises that work with highly critical ICT infrastructure and power sources.
Story image
Application Security
What are the DDoS attack trend predictions for 2022?
Mitigation and recovery are vital to ensuring brand reputation remains solid in the face of a Distributed Denial of Service (DDoS) attack and that business growth and innovation can continue.
Story image
CRM
Zendesk announces new conversational CRM solutions
“The last few years have made it obvious that digital is the front door, convenience is paramount and relationships are anchored in conversations."
Story image
Artificial Intelligence
CFOs using digital workers and AI to prevent unnecessary loss
New technology is now allowing CFOs to use digital workers to automate their accounting processes, making it easier for them to avoid unnecessary losses.
Story image
Ransomware
Alarming surge in Conti Ransomware Group activity - report
A new report has identified a 7.6 per cent increase in the number of vulnerabilities tied to ransomware in Q1 2022.
Story image
Broadband
Telstra enters into new RSP agreement with Opticomm
Telstra has entered into an RSP agreement with Opticomm (A Uniti Group Limited subsidiary) to provide network fibre services to customers.
Story image
Digital Transformation
The Huawei APAC conference kicks off with digital transformation
More than 1500 people from across APAC have gathered for the Huawei APAC Digital Innovation Congress to explore the future of digital innovation.
Story image
Sustainability
Power at the edge: the role of data centers in sustainability
The Singaporean moratorium on new data center projects was recently lifted, with one of the conditions being an increased focus on power efficiency and sustainability.
Story image
Remote Working
Australia’s remote workers face connectivity and security issues
SOTI's new report finds better video conferencing technology and improved security measures are top concerns for remote workers in Australia.
Story image
Wireless
Cradlepoint expands its Cellular Intelligence capabilities
Cradlepoint has announced additional Cellular Intelligence capabilities with its NetCloud service.
Story image
Cloud Security
Aqua Security createa unified scanner for cloud native security
“By integrating more cloud native scanning targets into Trivy, such as Kubernetes, we are simplifying cloud native security."
Story image
Excel
Could your Excel practices be harming your business?
While Excel has been the de-facto standard for budgeting, planning, and forecasting, is it alone, enough to support organisations in the global marketplace that’s facing rapid changes due to digital transformation?