Exclusive: How Cloudera drives businesses with Big Data and AI

Cloudera, an organisation that has revolutionised big data analytics over the past 15 years, is now driving businesses to latch on to the power of data.

Vini Cardoso, the customer-facing Chief Technology Officer (CTO) for Cloudera in Australia and New Zealand, recently shared insights into how the company is driving innovation and supporting enterprises on their AI journey, during an exclusive interview with TechDay.

"Fifteen years ago, we made it possible for enterprises to leverage big data and bring analytics at scale to things that were never done before," Cardoso explained.

"We provide an enterprise data analytics platform with security and governance to help organisations leverage the best of open-source technologies in a governed and secure way."

Cardoso's role involves aiding organisations in designing, improving, and evolving their data strategies, and identifying critical AI use cases that deliver business value. This approach is "crucial" in a landscape where AI adoption is skyrocketing.

It comes as Australia alone is projected to spend $6.5 billion on AI by 2026 - with 50% of organisations at least in the early stages of AI adoption.

However, many businesses find themselves overwhelmed by the sheer volume of data generated - and that is where Cloudera steps. The company makes it easier for these enterprises to take control of their data analytics.

"We deliver a true hybrid data analytics platform that helps transform data into actionable business insights in real-time," Cardoso explained. "Deakin University, for instance, uses Cloudera to manage 8.8 million events per day, enhancing teaching and learning experiences across its campuses."

However, the benefits of Cloudera's technology are not limited to academia. Bank Negara Indonesia (BNI) uses Cloudera's platform to transform enterprise data into innovative business services.

"BNI was able to elevate customer experience and increase operational efficiency through AI inference services," Cardoso said.

Another notable example is OCBC Bank in Singapore, which utilises Cloudera's AI technology to "improve efficiency and customer interaction".

"They've seen massive improvements in producing code for IT teams and customer interactions through AI chatbots, reducing time and effort significantly," said Cardoso. This even extends to text summarisation, helping the bank navigate regulatory compliance more efficiently.

Ethical AI is a key focus for Cloudera, especially given the rapid advancements in generative AI and other technologies.

Cardoso emphasised the importance of balancing AI's benefits with ethical considerations. "Low trust in data and AI continues to impact adoption. We need a joint effort from the private and public sectors to develop ethics and regulations for AI," he said.

He is advocating for an intentional AI strategy, starting with a clear data strategy.

"A data strategy involves people, processes, and technology to acquire, organise, and utilise data to support business objectives," Cardoso explained. "Organisations must understand what they aim to achieve with AI to avoid missing out on its benefits or, worse, damaging their reputation and customer trust."

He introduced two crucial acronyms for an intentional AI strategy: KYD (Know Your Data) and KYI (Know Your Intent).

"Accurate, consistent, and bias-free data is the foundation for trustworthy AI," Cardoso said. "Intentional design ensures AI systems produce fair and unbiased results reflecting the company's mission and values."

Cloudera's approach also includes the use of a unified data platform. "A recent IDG study found that 90% of IT leaders believe that unifying the data lifecycle on a single platform is critical for AI. This provides common security and governance, simplifying the data analytics pipeline," Cardoso explained. This unification allows organisations to create and train AI models with proprietary data securely.

Cardoso highlighted some common challenges organisations face with AI projects, such as balancing the desire to reap AI benefits quickly with addressing concerns like bias mitigation and data privacy.

He stressed the importance of trusted data and intentional design in overcoming these challenges. "United Overseas Bank, for example, achieved higher revenues and productivity by 20% by leveraging Cloudera's modern data platform," he said.

To accelerate time to value and achieve business outcomes faster, organisations must invest in scalable, secure, and resilient data architectures.

Cardoso pointed out the necessity of real-time data processing and integration to fully unlock AI's benefits. "OCBC Bank in Indonesia used Cloudera's hybrid data strategy to integrate their data, delivering AI models and personalised recommendations in real time," he said.

Ethical AI systems require core principles of accountability, transparency, and explainability. "Integrating these principles strengthens trust in AI and improves decision-making," Cardoso noted. "Organisations should focus on intent and ensure solid security and compliance throughout the process."

Cloudera is also hosting the Evolve 24 conference in multiple locations worldwide, including Singapore, Dubai, São Paulo, New York, Milan, Paris, and Madrid.

"Evolve 24 will bring together industry leaders and customers to share their AI and analytics experiences," Cardoso said. "It's a great opportunity for anyone to learn how AI can enhance their organisation."

Cloudera’s global presence is marked by its headquarters in Santa Clara, California, with offices worldwide, including Sydney, Australia, where Cardoso is based. 

Cardoso summarised what sets Cloudera apart from its competitors.

"Our passion is to help organisations transform complex data challenges into reality through our platform. We provide a comprehensive data lifecycle platform that can be deployed on-premises, in the cloud, or a hybrid of both," he explained.

"Our open-source technology and enterprise-grade support ensure our clients can innovate with confidence."