IBM integrates NVIDIA's RAPIDS for machine learning

Nvidia is keen to exploit the potential of GPUs for compute-intensive workloads

To bring additional machine learning libraries and capabilities to RAPIDS, NVIDIA is collaborating with such open-source ecosystem contributors as Anaconda, BlazingDB, Databricks, Quansight and scikit-learn, as well as Wes McKinney, head of Ursa Labs and creator of Apache Arrow and pandas, the fastest-growing Python data science library. These encompass such mission-critical applications as credit card fraud detection, retail inventory forecasts, and customer purchasing prediction, each one of these represents billions of dollars to the economy.

"The compute world today requires powerful processing to handle complex workloads like data science and analytics - it's a job for NVIDIA GPUs". NVIDIA announced RAPIDS from their GTC Europe 2018 conference happening this week in Munich.

"IBM and NVIDIA's close collaboration over the years has helped leading enterprises and organisations around the world tackle some of the world's largest problems", says NVIDIA accelerated computing vice president and general manager Ian Buck. "But we're hitting a brick wall in our ability to use data".

The main component of the open-source RAPIDS platform is a suite of CUDA-accelerated libraries for GPU-based analytics, machine learning and data visualization.

For the first time, it gives scientists the tools they need to run the entire data science pipeline on GPUs. Initial RAPIDS benchmarking, using the XGBoost machine learning algorithm for training on an NVIDIA DGX-2 system, shows 50 times speedups compared with CPU-only systems.

Nvidia's claims are given credence by a slew of big tech companies that have thrown their weight behind the RAPIDS platform.

IBM, HPE, Dell EMC, Oracle, Cisco, and Lenovo also stand to benefit, although perhaps not to the same extent as NVIDIA, inasmuch as they can also sell CPU-only systems for their big data customers.

To facilitate broad adoption, NVIDIA is integrating RAPIDS into Apache Spark, the open-source framework for analytics and data science.

PowerAI is IBM's software layer that optimizes how today's data science and AI workloads run on heterogeneous computing systems, and our goal is for this improved performance trajectory for GPU accelerated workloads on POWER9 to continue with RAPIDS.

RAPIDS also focuses on common data preparation tasks for analytics and data science. Python all-star Anaconda and technology giants like IBM, Hewlett Packard Enterprise and Oracle are in on the action too.

Analyst Patrick Moorhead of Moor Insights & Strategy said RAPIDS was all about Nvidia trying to make its GPUs more accessible to enterprises interested in running AI workloads.

"Nvidia has had lots of success getting hyperscalers like AWS and Azure to integrate deep learning and machine learning into their workflows", Moorhead said.

MapR Technologies, provider of the industrys leading data platform for AI and Analytics, enables enterprises to inject analytics into their business processes to increase revenue, reduce costs, and mitigate risks.

"For Nvidia, coming from the hardware side, it is clear that it has to win the hearts and minds of developers and data scientists and create a widely adopted software platform", Mueller said. RAPIDS is aimed at the data science crowd, that is, researchers, engineers, and other developers looking to make the most out of their datasets - both literally and figuratively.

Related News:



Most liked

Comcast takes majority control of broadcaster Sky UK News
Brian L Roberts, chairman and CEO of Comcast , said he was pleased to become the majority owner of Sky today. In light of the news, James Murdoch has stepped down from Sky's board alongside six other directors.

Facebook Rolls Out 3D Photos with AI-Simulated Depth for Portrait Shots
And no, your Samsung Galaxy Note 9 or LG V35 ThinQ will not work either, despite also offering dual cameras. There's no mention of support for Google's dual-pixel Portrait mode photos captured with the Pixel line.

Taylor Swift makes history at American Music Awards
Underwood went into tonight's show, airing live on ABC , a 12-time American Music Award-winning artist. His album 17 was recognised in the soul/R&B category, seeing off competition from Khalid and SZA.

Tilda Swinton posed as an old man in elaborate hoax for Suspiria
At the film's premiere at the Venice Film Festival in September, she told reporters: "Dr Klemperer is played by Lutz Ebersdorf ". During filming it was rumoured that Swinton was going to be playing an old man, but Guadagnino insisted that it was "fake news".

Russian Website Names Third Person Allegedly Involved In Skripal Poisoning
Mr Poroshin said he heard that Mishkin received Russia's highest medal for saving the life of his commanding officer during fighting with Islamist rebels in Chechnya.

Crocodile 'takes' Aboriginal ranger in Arnhem Land community, sparking police search
Officers from Lake Evella and Nhulunbuy worked with local rangers and community members to search nearby waterways for the woman. Due to the remoteness of the location the circumstances surrounding the incident have not been confirmed.

Coping with global warming, rising mental issues
It gives them evidence that hotter temperatures across the United States of America worsen mental health of residents. However, "there are many other place-specific factors that may moderate the effect".

Women-only motor racing series to start in 2019
Indy Lights series and who has competed six times in the Indianapolis 500, declared the latest move "a sad day for motorsport". However, reaction among existing female drivers, who have spent their careers to date racing against men, has been mixed.

Learn More About Mental Health Awareness in Teens with NAMI Sarasota
Kufre gave the advice in an interview with the News Agency of Nigeria (NAN) in Abuja to commemorate the World Mental Health Day . It offloads, it releases, it provides a space for the intense feelings of stress and panic that can overwhelm and debilitate.

Usain Bolt scores two goals for Central Coast Mariners in trial game
If the keeper was disappointed to let in Bolt's first strike, the second goal was embarrassing for him and his centre-back.

A Whole New 'Aladdin'
A blue Will Smith is ready and raring to dazzle audiences as the new Genie in Disney's upcoming live-action remake of " Aladdin ". The movie, directed by Guy Ritchie , also stars Naomi Scott as Jasmine, Will Smith as Genie and Marwan Kenzari as Jafar.

Former Clemson QB Kelly Bryant reportedly set to visit Arkansas
Bryant had made over 18 starts over the last two seasons, with Clemson going 16-2 over those games. Quick Update: Bryant will visit Arkansas the following weekend (Oct. 20), too.

Hurricane Michael reaches Category 2, threatens southern US
The storm is now moving north, crossing into the Gulf of Mexico, and will likely curve to the east after its coastal impact. What the Hurricane Center has been predicting has come to pass - Hurricane Michael has strengthened into a major hurricane.

Air India Flight Hit Trichy Airport Wall During Take-Off, 136 On Board
Tamil Nadu Tourism Minister Vellamandi N Natarajan visited Tiruchirappalli airport and inspected the accident spot. After the incident internal inquiry has been set up, pilot&co-pilot derostered till investigation is done.

6 extremely surreal moments from Kanye West's meeting with President Trump
Trump and West previously appeared together shortly after Trump's 2016 election in the lobby of Trump Tower in NY . West also argued that Mr Trump deserved more respect, saying, "If he don't look good, we don't look good".