Facebook builds 'Rosetta' AI to understand text in images and videos

Facebook says that Rosetta has already been widely adopted within various teams at the company and with Instagram, and noted that the text extracted from images is also being used in various machine learning models, such as those to improve its photo searching features. As a large number of posts are being posted on the social media, Facebook's moderators aren't able to review the content of the memes while they are being posted, creating a lot of fuss related to offensive posts. First, it detects rectangular regions that potentially contain text, and then performs text recognition.

By its own admission, Facebook has been struggling to suppress the spread of inappropriate content - from hate speech and threats of violence to disinformation and "fake news" across its vast platform.

The technology is rooted in optical character recognition (OCR), only here it's been goal built to process images that get uploaded to Facebook on a daily basis.

Fb says text extraction and machine learning are being set up to exercise to "robotically identify squawk that violates our hate-speech coverage" and that it's doing so in just a few languages. To handle the task, the company has now designed a very sophisticated artificial intelligence which is known as Rosetta.

"Taking into account the sheer volume of photos shared each day on Facebook and Instagram, the number of languages supported on our global platform, and the variations of the text, the problem of understanding text in images is quite different from those solved by traditional optical character recognition (OCR) systems, which recognize the characters but don't understand the context of the associated image", Facebook said in a blog post. The AI tool will be effective enough to understand multiple languages.

For what its worth, Facebook and Twitter have constantly updated their policies, and put in place mechanisms to curb the spread of offensive content on their platforms. Rosetta is the most recent advancement.

For over a year now, Facebook has been under the scanner for the role its played in providing a platform for fake news and hate speech.

Related News:

Pokémon's Game Freak Announces New 'Town' RPG
The game takes place entirely in the village and it'll be up to you to help the villagers take on various monsters. The game is tentatively titled " Town ", and it is slated for 2019 on Nintendo Switch.

14 September 2018

IPhone XR: Apple unveils iPhone XR starting at £749
Apple CEO Tim Cook speaks at the company's event in Cupertino , at which updated iPhones and a new smartwatch were unveiled. It is also running on the new 7nm A12 Bionic Chip and it retains the same 12MP f/1.8 main camera that's assisted with OIS.

14 September 2018

Turkey ships arms to Idlib to help repel regime assault says rebels
The Idlib area forms part of an arc of territory in the northwest representing the last big area held by the opposition. Erdogan had called for a truce in an attempt to avoid a full-scale Syrian government assault on Idlib.
14 September 2018

'I'm not racist' - Aussie cartoonist on Serena Williams
The anger came thick and fast, and it quickly became less about Knight's cartoon and more about perceived racism in Australia. Knight, who deleted his own account after being inundated with complaints from around the world, has not commented on it.

14 September 2018

FCC pauses review of T-Mobile, Sprint merger
It also needs to review a new business model referred to as "Build 9". The FCC says that it didn't get Build 9 until September 5th.

14 September 2018

Marin Mazzie Dead - Broadway Star Dies at 57 | Marin Mazzie, RIP
In the second act, Rockford was plunged into a blackout and the actors needed flashlights to finish the show. In an email, Greenblatt said he knew Mazzie "would always be his friend and she was destined for greatness".
14 September 2018

Scientists in the Pacific Ocean discovered new sea creatures
Part of the Liparidae family, these snailfish look distinct from other deep sea creatures , albeit they're no less unusual . A massive global team consisting of 40 scientists launched an expedition to one of the deepest places on Earth.

14 September 2018

Jurgen Klopp On Top of Liverpool Midfield Battle - Former Reds Boss
Liverpool take on Tottenham Hotspur at Wembley at 12:30pm on Saturday and Jurgen Klopp was expected to reassess his key stars' fitness ahead of the fixture.

14 September 2018

MILES MORALES Gets a New Ongoing This December - With SALADIN AHMED
SPIDER-MAN, we will find our teenage Super Hero navigating his superpowered responsibilities as well as his personal ones. It's going to be hard! And Miles will be dealing with some dark realities of our modern world.
14 September 2018

Georgia Declares Emergency as Hurricane Florence Approaches
Florence remains to be a powerful category 3 hurricane with maximum sustained winds of 120 miles per hour . Most other beachgoers were long gone. "It's been really nice", Nicole Roland said.

Hurricane Florence from space: "A no-kidding nightmare"
But it's forecast to strengthen to near the level of a Category 5 storm - which has sustained winds of 157 miles per hour or more .

14 September 2018

Google denies left-wing bias after leaked clip of co-founder discussing Trump
During what was clearly an emotional and companywide meeting, Google executives also extolled democratic values. Parscale called for Congress to hold hearings and investigate the matter.