itb-au logo
Story image

How Cloudera aims to accelerate the industrialisation of AI

06 Dec 2018

Cloudera announced a preview of a new cloud-native machine learning platform powered by Kubernetes. The upcoming Cloudera Machine Learning expands Cloudera’s offerings for enterprise self-service data science. 

It delivers provisioning and autoscaling as well as containerised, distributed processing on heterogeneous compute. Cloudera Machine Learning also aims to ensure secure data access with a unified experience across on-premises, public cloud, and hybrid environments.

It aims to combine data engineering and data science, on any data, anywhere. In addition, it breaks down data silos to accelerate the end-to-end machine learning workflow. 

Containers and the Kubernetes ecosystem are enabling the agility of cloud across diverse environments with a consistent experience, unlocking scalable service delivery for IT across hybrid and multi-cloud deployments. 

At the same time, enterprises are looking to operationalise and scale end-to-end machine learning workflows. 

Cloudera Machine Learning supposedly enables enterprises to accelerate machine learning from research to production – empowering users to easily provision environments and scale resources so they can spend less time on infrastructure and more time on innovation.

“Making teams more productive is essential to scaling machine learning capabilities in the enterprise. This requires a new kind of platform to consistently build and deploy models across highly scalable, transparent infrastructure, tapping into data anywhere,” said Hilary Mason, general manager, Machine Learning at Cloudera. 

“Cloudera Machine Learning brings together the critical capabilities of data engineering, collaborative exploration, model training, and model deployment in a cloud-native platform that runs where you need it – all with the built-in security, governance, and management capabilities our customers require.”

To help customers leverage AI, Cloudera’s applied research team recently introduced Federated Learning for deploying machine learning models from the cloud to the network edge while ensuring data privacy and reducing network communications overhead. 

The report offers a detailed, technical explanation of the approach along with practical engineering recommendations that address use cases across mobile, healthcare and manufacturing, including IoT-driven predictive maintenance.

Capabilities include:

  • Portability across private cloud, public cloud, and hybrid cloud powered by Kubernetes.
  • Cloud provisioning and autoscaling.
  • Scale-out data engineering and machine learning with dependency management provided by containerised Python and Spark-on-Kubernetes.
  • High velocity deep learning powered by distributed GPU scheduling and training.
  • Secure data access across HDFS, cloud object stores, and external databases.
Link image
Why performance monitoring is essential to keep cloud costs down
Cloud comes with many different associated costs, which can sneak up on organisations and drive down efficiency. Here's how to reduce costs by up to 50%.More
Link image
Webinar: How to leverage the process automation trend
COVID-19 has accelerated migration towards process automation, and now low-code development and embracing the cloud at scale an integral part of many business strategies. More
Story image
Case study: MECCA has HCM makeover with Workday
The phased HCM makeover began in 2017, when the company made the decision to launch a three to five-year program to digitalise its human capital management technology so that it could simplify everyday requirements for its team members and enable them to self-serve. More
Link image
Data is an organisation's most significant asset - here's how to protect it
Data resilience strategies are becoming more crucial as more value is ascribed to a company's data. If it's not stored securely and cost-effectively, expect problems.More
Story image
Three ways cloud can contribute to a transformation goal
Cloud technology plays a pivotal role in successful transformations and can see businesses thrive and grow; however, this depends on the business mindset and approach to cloud, writes Thomas Duryea Logicalis CTO Toby Alcock.More
Story image
IDC unveils Digital Transformation Awards A/NZ finalists
The awards recognise the achievements of organisations that have successfully digitised one or multiple areas of their business through the application of digital and disruptive technologies.More