IBM integrates NVIDIA's RAPIDS for machine learning

IBM integrates NVIDIA's RAPIDS for machine learning

To bring additional machine learning libraries and capabilities to RAPIDS, NVIDIA is collaborating with such open-source ecosystem contributors as Anaconda, BlazingDB, Databricks, Quansight and scikit-learn, as well as Wes McKinney, head of Ursa Labs and creator of Apache Arrow and pandas, the fastest-growing Python data science library. These encompass such mission-critical applications as credit card fraud detection, retail inventory forecasts, and customer purchasing prediction, each one of these represents billions of dollars to the economy.

"The compute world today requires powerful processing to handle complex workloads like data science and analytics - it's a job for NVIDIA GPUs". NVIDIA announced RAPIDS from their GTC Europe 2018 conference happening this week in Munich.

"IBM and NVIDIA's close collaboration over the years has helped leading enterprises and organisations around the world tackle some of the world's largest problems", says NVIDIA accelerated computing vice president and general manager Ian Buck. "But we're hitting a brick wall in our ability to use data".

The main component of the open-source RAPIDS platform is a suite of CUDA-accelerated libraries for GPU-based analytics, machine learning and data visualization.

For the first time, it gives scientists the tools they need to run the entire data science pipeline on GPUs. Initial RAPIDS benchmarking, using the XGBoost machine learning algorithm for training on an NVIDIA DGX-2 system, shows 50 times speedups compared with CPU-only systems.

Nvidia's claims are given credence by a slew of big tech companies that have thrown their weight behind the RAPIDS platform.

IBM, HPE, Dell EMC, Oracle, Cisco, and Lenovo also stand to benefit, although perhaps not to the same extent as NVIDIA, inasmuch as they can also sell CPU-only systems for their big data customers.

To facilitate broad adoption, NVIDIA is integrating RAPIDS into Apache Spark, the open-source framework for analytics and data science.

PowerAI is IBM's software layer that optimizes how today's data science and AI workloads run on heterogeneous computing systems, and our goal is for this improved performance trajectory for GPU accelerated workloads on POWER9 to continue with RAPIDS.

RAPIDS also focuses on common data preparation tasks for analytics and data science. Python all-star Anaconda and technology giants like IBM, Hewlett Packard Enterprise and Oracle are in on the action too.

Analyst Patrick Moorhead of Moor Insights & Strategy said RAPIDS was all about Nvidia trying to make its GPUs more accessible to enterprises interested in running AI workloads.

"Nvidia has had lots of success getting hyperscalers like AWS and Azure to integrate deep learning and machine learning into their workflows", Moorhead said.

MapR Technologies, provider of the industrys leading data platform for AI and Analytics, enables enterprises to inject analytics into their business processes to increase revenue, reduce costs, and mitigate risks.

"For Nvidia, coming from the hardware side, it is clear that it has to win the hearts and minds of developers and data scientists and create a widely adopted software platform", Mueller said. RAPIDS is aimed at the data science crowd, that is, researchers, engineers, and other developers looking to make the most out of their datasets - both literally and figuratively.

Related News:



Most liked

Comcast takes majority control of broadcaster Sky UK News
Brian L Roberts, chairman and CEO of Comcast , said he was pleased to become the majority owner of Sky today. In light of the news, James Murdoch has stepped down from Sky's board alongside six other directors.

True Detective Season 3 Release Date, New Photos Unveiled
It's about a state police detective who finds that the more he investigates a particular crime, the more disturbing it becomes. HBO has announced that True Detective will be airing its season three premiere on Sunday, January 13 at 9:00 p.m.

Hazard takes Premier League Player of the Month prize
The Belgian ace, however, told SPORTbible in an interview that he has big hopes for the Blues this season. Eden Hazard has found himself amongst 29 other footballers vying for the 2018 Ballon d'Or.

Mental health appointment applauded by charity
Health minister Jackie Doyle-Price will be charged with ensuring mental health remains a top priority as the National Health Service receives new funding.

China's September trade surplus with U.S. widens to record $34.13B
Analysts say a sharp depreciation of the yuan has also helped China weather the tariffs by making its exports cheaper. The US dollar has strengthened against a range of currencies this year as American interest rates have risen.

Lindsey Buckingham sues Fleetwood Mac bandmates for sacking him
As much as I adore (and forever will) Lindsey and all his work with FM, I can't help but like what I'm hearing here. Lindsey Buckingham has finally revealed the details of why he was sacked from Fleetwood Mac .

Juventus set to make offer for Liverpool target Aaron Ramsey
Juventus have entered the race to sign Chelsea target Aaron Ramsey , according to the Daily Mail . He started Wales' global friendly against Spain at the Principality Stadium tonight.

William, Kate, Harry and Meghan arrive at Princess Eugenie's wedding
Unlike other royal weddings , the day will not be broadcast on BBC, with ITV's This Morning instead taking over the coverage. The presence of so many royals - and a number of celebrity guests - has prompted extra security measures to be put in place.

Women-only motor racing series to start in 2019
Indy Lights series and who has competed six times in the Indianapolis 500, declared the latest move "a sad day for motorsport". However, reaction among existing female drivers, who have spent their careers to date racing against men, has been mixed.

Former Clemson QB Kelly Bryant reportedly set to visit Arkansas
Bryant had made over 18 starts over the last two seasons, with Clemson going 16-2 over those games. Quick Update: Bryant will visit Arkansas the following weekend (Oct. 20), too.

Kremlin opposes possible autocephaly of Ukrainian Orthodox Church
Patriarch Filaret explained that those Ukrainian dioceses that do not join the united Ukrainian Orthodox Church "will not have the right to be called the "Ukrainian Church".

Ryan Coogler inks deal to write and direct ‘Black Panther’ sequel
The sequel, which has yet to be announced by Marvel, will reportedly commence production in late 2019 or early 2020. Chadwick Boseman is expected to return in the starring role, as are others in the A-list ensemble.

Man planned to bomb National Mall on Election Day
He bought large quantities black powder over the internet to build a large bomb in his basement, authorities said. Rosenfeld made his first appearance in NY federal court earlier Wednesday.

Johnny Depp Confirms His Return As Grindelwald In "Fantastic Beasts 3"
She claimed the couple had an explosive row and he threw an iPhone in her face, bruising her eye and cheek. When asked how he felt about the fallout, Depp's first thought went to the magical world's creator, J.K.

Washington state court throws out death penalty, calling it racially biased
Dozens of former state judges took the unusual step of urging the court to use Gregory's case to strike down capital punishment. Thirty states and the federal government provide for the imposition of death as a sentence for some homicides.