Facebook builds 'Rosetta' AI to understand text in images and videos

A figurine is seen in front of the Facebook logo in this illustration taken

Facebook says that Rosetta has already been widely adopted within various teams at the company and with Instagram, and noted that the text extracted from images is also being used in various machine learning models, such as those to improve its photo searching features. As a large number of posts are being posted on the social media, Facebook's moderators aren't able to review the content of the memes while they are being posted, creating a lot of fuss related to offensive posts. First, it detects rectangular regions that potentially contain text, and then performs text recognition.

By its own admission, Facebook has been struggling to suppress the spread of inappropriate content - from hate speech and threats of violence to disinformation and "fake news" across its vast platform.

The technology is rooted in optical character recognition (OCR), only here it's been goal built to process images that get uploaded to Facebook on a daily basis.

Fb says text extraction and machine learning are being set up to exercise to "robotically identify squawk that violates our hate-speech coverage" and that it's doing so in just a few languages. To handle the task, the company has now designed a very sophisticated artificial intelligence which is known as Rosetta.

"Taking into account the sheer volume of photos shared each day on Facebook and Instagram, the number of languages supported on our global platform, and the variations of the text, the problem of understanding text in images is quite different from those solved by traditional optical character recognition (OCR) systems, which recognize the characters but don't understand the context of the associated image", Facebook said in a blog post. The AI tool will be effective enough to understand multiple languages.

For what its worth, Facebook and Twitter have constantly updated their policies, and put in place mechanisms to curb the spread of offensive content on their platforms. Rosetta is the most recent advancement.

For over a year now, Facebook has been under the scanner for the role its played in providing a platform for fake news and hate speech.

Related News:

  • IPhone XR: Apple unveils iPhone XR starting at £749

    IPhone XR: Apple unveils iPhone XR starting at £749

    Apple CEO Tim Cook speaks at the company's event in Cupertino , at which updated iPhones and a new smartwatch were unveiled. It is also running on the new 7nm A12 Bionic Chip and it retains the same 12MP f/1.8 main camera that's assisted with OIS.

    Manchester City break 500 million pounds revenue barrier - Premier League 2018

    According to the report, City's income has increased six-fold in the past decade and they have risen from 20th to fifth in European clubs' revenues league table.

    Hurricane Florence from space: "A no-kidding nightmare"

    But it's forecast to strengthen to near the level of a Category 5 storm - which has sustained winds of 157 miles per hour or more .
  • Amazon's The Romanoffs Trailer

    Some of them relish in the fact that they come from royal blood, while others find it problematic. The cast is impeccable, and this trailer teases a variety of different stories on tap.
    Chelsea wrong to let Bakayoko go this summer says Fabinho

    Chelsea wrong to let Bakayoko go this summer says Fabinho

    AC Milan have again been linked with the Blues midfielder, having been linked with him during successive transfer windows. But this could be too early to discuss as Fabregas has a very very large chunk of the season to turn the fortunes.
    Tottenham vs Liverpool: Spurs without Alli and Lloris for Reds clash

    Tottenham vs Liverpool: Spurs without Alli and Lloris for Reds clash

    The court heard police in an unmarked auto spotted Lloris' Porsche Panamera driving at 15mph (24kph) in a 30mph (48kph) zone. Lloris apologised to his manager and team-mates after the incident. "I made a mistake and now I need to pay".
  • Hurricane Florence seen maintaining strength as it approaches coast: NHC

    People in the Carolinas had the daytime hours Thursday to complete their final preparations to ride out or escape the storm. Although the storm has weakened to a Category 2, it's still expected to bring some bad weather to the area this weekend.
    Here's all the big news from today's Nintendo Direct

    Here's all the big news from today's Nintendo Direct

    Ultimate, some more info about that new Yoshi game, and if you're feeling really lucky, an Animal Crossing Switch announcement. No word yet on what Luigi's Mansion 3 will be like, but I for one am excited to protect this poor plumber from further harm.
    Stewart, Storm surge past Mystics 98-82 for WNBA title

    Stewart, Storm surge past Mystics 98-82 for WNBA title

    It's not that my hunger for it went away or my motivation. "Even when she broke her nose she just never gave up", said Andrews. And we did that. "The talent has definitely improved", said Monique Currie, a 13-year veteran.
  • Oil nears $70 a barrel as concern grows over global supply

    Oil nears $70 a barrel as concern grows over global supply

    US crude inventories fell by 5.3 million barrels in the last week, the US Energy Information Administration said on Wednesday. Russian energy minister Alexander Novak on Wednesday warned of the impact of U.S. sanctions against Iran.
    Final Fantasy Is Being Well Represented On Switch

    Final Fantasy Is Being Well Represented On Switch

    When SquareEnix's Hajime Tabata joked that Final Fantasy XV might come to Nintendo's hybrid portable, fans bought into the hype. And so is World of Final Fantasy , as a new version called World of Final Fantasy Maxima (also coming to PC, PS4 and Xbox One).
    Unbeaten Cincinnati Bengals still searching for true identity

    Unbeaten Cincinnati Bengals still searching for true identity

    The 3 touchdown passes each went to newly added receivers for the team, Michael Crabtree , John Brown , and Willie Snead. Green climbed the ladder and ripped the ball out of Austin's hands, shrugged off his tackle and was gone for 32 yards .


Most liked

'I'm not racist' - Aussie cartoonist on Serena Williams
The anger came thick and fast, and it quickly became less about Knight's cartoon and more about perceived racism in Australia. Knight, who deleted his own account after being inundated with complaints from around the world, has not commented on it.

Apple 2018 Event Recap: iPhone Xs, Xs Max, Xr, Apple Watch
Arguably the most notable new product: the iPhone Xr delivers iPhone X style with a price cut and some caveats. If you're clinging to wired headphones, you might not like what Apple's doing with its new iPhones .

FCC pauses review of T-Mobile, Sprint merger
It also needs to review a new business model referred to as "Build 9". The FCC says that it didn't get Build 9 until September 5th.

Joyce Drifting Southwestward With No Change in Strength
Currently, tropical-storm-force winds have been recorded extending outward up to 160 miles (260 km) from the centre of the storm. However, Isaac is still predicted to trigger tropical-storm-force winds and life-threatening flash flooding.

Norwegian Dawn docks in Sydney for the day
As of 1:00 PM ET Monday, Florence was about 575 miles south-southeast of Bermuda and moving to the west at 13 miles per hour. The infographic below, provided by Statista, demonstrates the comparative cost of damage caused by recent hurricanes.

Scientists in the Pacific Ocean discovered new sea creatures
Part of the Liparidae family, these snailfish look distinct from other deep sea creatures , albeit they're no less unusual . A massive global team consisting of 40 scientists launched an expedition to one of the deepest places on Earth.

Trump Wants to Pay Mexico $20 Million to Help With Deportations
In a joint statement, Mexico's Interior and Foreign Ministries said they had not accepted the proposal in either a "verbal or written" way.

Marin Mazzie Dead - Broadway Star Dies at 57 | Marin Mazzie, RIP
In the second act, Rockford was plunged into a blackout and the actors needed flashlights to finish the show. In an email, Greenblatt said he knew Mazzie "would always be his friend and she was destined for greatness".

Pokémon's Game Freak Announces New 'Town' RPG
The game takes place entirely in the village and it'll be up to you to help the villagers take on various monsters. The game is tentatively titled " Town ", and it is slated for 2019 on Nintendo Switch.

Check out the official iPhone XS, XS Max and XR promo videos
In Poland, someone who wants that same iPhone XS Max will have to pay $1,956 (compared to $1,449 here in the U.S. , of course). Up until Wednesday, Apple was selling the iPhone 6s for $US450, and the iPhone 6s Plus for $US550.

Turkey ships arms to Idlib to help repel regime assault says rebels
The Idlib area forms part of an arc of territory in the northwest representing the last big area held by the opposition. Erdogan had called for a truce in an attempt to avoid a full-scale Syrian government assault on Idlib.

NASA posts incredible video of Hurricane Florence from space
Rainfall of over 20 inches within the next week is projected, with some pockets possibly getting 35 inches or more. A state of emergency has also been declared in Maryland, North Carolina, South Carolina, Virginia and Washington.

Google denies left-wing bias after leaked clip of co-founder discussing Trump
During what was clearly an emotional and companywide meeting, Google executives also extolled democratic values. Parscale called for Congress to hold hearings and investigate the matter.

Hurricane Florence weakens slightly as it moves toward US coast: NHC
The Carolinas will likely bear the brunt of Florence's wrath. "If there is a question in your heart, just leave", Malphrus said. McMaster had ordered evacuations for all coastal SC counties on Monday. "Now it might be time for the exam", he said.

I Believe In Maurizio Sarri's Philosophy, Chelsea Defender Insists
And with no Champions League football to contend with this season, Sarri can possibly put all of his eggs into the Premier League basket.