Facebook builds 'Rosetta' AI to understand text in images and videos

A figurine is seen in front of the Facebook logo in this illustration taken

Facebook says that Rosetta has already been widely adopted within various teams at the company and with Instagram, and noted that the text extracted from images is also being used in various machine learning models, such as those to improve its photo searching features. As a large number of posts are being posted on the social media, Facebook's moderators aren't able to review the content of the memes while they are being posted, creating a lot of fuss related to offensive posts. First, it detects rectangular regions that potentially contain text, and then performs text recognition.

By its own admission, Facebook has been struggling to suppress the spread of inappropriate content - from hate speech and threats of violence to disinformation and "fake news" across its vast platform.

The technology is rooted in optical character recognition (OCR), only here it's been goal built to process images that get uploaded to Facebook on a daily basis.

Fb says text extraction and machine learning are being set up to exercise to "robotically identify squawk that violates our hate-speech coverage" and that it's doing so in just a few languages. To handle the task, the company has now designed a very sophisticated artificial intelligence which is known as Rosetta.

"Taking into account the sheer volume of photos shared each day on Facebook and Instagram, the number of languages supported on our global platform, and the variations of the text, the problem of understanding text in images is quite different from those solved by traditional optical character recognition (OCR) systems, which recognize the characters but don't understand the context of the associated image", Facebook said in a blog post. The AI tool will be effective enough to understand multiple languages.

For what its worth, Facebook and Twitter have constantly updated their policies, and put in place mechanisms to curb the spread of offensive content on their platforms. Rosetta is the most recent advancement.

For over a year now, Facebook has been under the scanner for the role its played in providing a platform for fake news and hate speech.

Related News:

  • Pokémon's Game Freak Announces New 'Town' RPG

    The game takes place entirely in the village and it'll be up to you to help the villagers take on various monsters. The game is tentatively titled " Town ", and it is slated for 2019 on Nintendo Switch.
    IPhone XR: Apple unveils iPhone XR starting at £749

    IPhone XR: Apple unveils iPhone XR starting at £749

    Apple CEO Tim Cook speaks at the company's event in Cupertino , at which updated iPhones and a new smartwatch were unveiled. It is also running on the new 7nm A12 Bionic Chip and it retains the same 12MP f/1.8 main camera that's assisted with OIS.
    Turkey ships arms to Idlib to help repel regime assault says rebels

    Turkey ships arms to Idlib to help repel regime assault says rebels

    The Idlib area forms part of an arc of territory in the northwest representing the last big area held by the opposition. Erdogan had called for a truce in an attempt to avoid a full-scale Syrian government assault on Idlib.
  • 'I'm not racist' - Aussie cartoonist on Serena Williams

    'I'm not racist' - Aussie cartoonist on Serena Williams

    The anger came thick and fast, and it quickly became less about Knight's cartoon and more about perceived racism in Australia. Knight, who deleted his own account after being inundated with complaints from around the world, has not commented on it.
    FCC pauses review of T-Mobile, Sprint merger

    FCC pauses review of T-Mobile, Sprint merger

    It also needs to review a new business model referred to as "Build 9". The FCC says that it didn't get Build 9 until September 5th.
    Marin Mazzie Dead - Broadway Star Dies at 57 | Marin Mazzie, RIP

    Marin Mazzie Dead - Broadway Star Dies at 57 | Marin Mazzie, RIP

    In the second act, Rockford was plunged into a blackout and the actors needed flashlights to finish the show. In an email, Greenblatt said he knew Mazzie "would always be his friend and she was destined for greatness".
  • Scientists in the Pacific Ocean discovered new sea creatures

    Scientists in the Pacific Ocean discovered new sea creatures

    Part of the Liparidae family, these snailfish look distinct from other deep sea creatures , albeit they're no less unusual . A massive global team consisting of 40 scientists launched an expedition to one of the deepest places on Earth.
    Jurgen Klopp On Top of Liverpool Midfield Battle - Former Reds Boss

    Jurgen Klopp On Top of Liverpool Midfield Battle - Former Reds Boss

    Liverpool take on Tottenham Hotspur at Wembley at 12:30pm on Saturday and Jurgen Klopp was expected to reassess his key stars' fitness ahead of the fixture.
    MILES MORALES Gets a New Ongoing This December - With SALADIN AHMED

    MILES MORALES Gets a New Ongoing This December - With SALADIN AHMED

    SPIDER-MAN, we will find our teenage Super Hero navigating his superpowered responsibilities as well as his personal ones. It's going to be hard! And Miles will be dealing with some dark realities of our modern world.
  • Georgia Declares Emergency as Hurricane Florence Approaches

    Georgia Declares Emergency as Hurricane Florence Approaches

    Florence remains to be a powerful category 3 hurricane with maximum sustained winds of 120 miles per hour . Most other beachgoers were long gone. "It's been really nice", Nicole Roland said.

    Hurricane Florence from space: "A no-kidding nightmare"

    But it's forecast to strengthen to near the level of a Category 5 storm - which has sustained winds of 157 miles per hour or more .
    Google denies left-wing bias after leaked clip of co-founder discussing Trump

    Google denies left-wing bias after leaked clip of co-founder discussing Trump

    During what was clearly an emotional and companywide meeting, Google executives also extolled democratic values. Parscale called for Congress to hold hearings and investigate the matter.


Most liked

Oil nears $70 a barrel as concern grows over global supply
US crude inventories fell by 5.3 million barrels in the last week, the US Energy Information Administration said on Wednesday. Russian energy minister Alexander Novak on Wednesday warned of the impact of U.S. sanctions against Iran.

Final Fantasy Is Being Well Represented On Switch
When SquareEnix's Hajime Tabata joked that Final Fantasy XV might come to Nintendo's hybrid portable, fans bought into the hype. And so is World of Final Fantasy , as a new version called World of Final Fantasy Maxima (also coming to PC, PS4 and Xbox One).

Apple 2018 Event Recap: iPhone Xs, Xs Max, Xr, Apple Watch
Arguably the most notable new product: the iPhone Xr delivers iPhone X style with a price cut and some caveats. If you're clinging to wired headphones, you might not like what Apple's doing with its new iPhones .

Britain to publish more 'no deal' Brexit advice papers
AA president Edmund King said: "This will be an extra burden for United Kingdom drivers wanting to take a holiday overseas ". They may be turned away at borders or face enforcement action if they have not obtained the correct documents.

Norwegian Dawn docks in Sydney for the day
As of 1:00 PM ET Monday, Florence was about 575 miles south-southeast of Bermuda and moving to the west at 13 miles per hour. The infographic below, provided by Statista, demonstrates the comparative cost of damage caused by recent hurricanes.

Hurricane Florence seen maintaining strength as it approaches coast: NHC
People in the Carolinas had the daytime hours Thursday to complete their final preparations to ride out or escape the storm. Although the storm has weakened to a Category 2, it's still expected to bring some bad weather to the area this weekend.

Here's all the big news from today's Nintendo Direct
Ultimate, some more info about that new Yoshi game, and if you're feeling really lucky, an Animal Crossing Switch announcement. No word yet on what Luigi's Mansion 3 will be like, but I for one am excited to protect this poor plumber from further harm.

Wind approaches outer banks of North Carolina
This storm surge can be deadly and then the flooding that will come thereafter with rain being measured in feet instead of inches. People look out over the surf before Hurricane Florence comes ashore on Carolina Beach, North Carolina, Sept. 13, 2018.

Chelsea wrong to let Bakayoko go this summer says Fabinho
AC Milan have again been linked with the Blues midfielder, having been linked with him during successive transfer windows. But this could be too early to discuss as Fabregas has a very very large chunk of the season to turn the fortunes.

Stewart, Storm surge past Mystics 98-82 for WNBA title
It's not that my hunger for it went away or my motivation. "Even when she broke her nose she just never gave up", said Andrews. And we did that. "The talent has definitely improved", said Monique Currie, a 13-year veteran.

Manchester City break 500 million pounds revenue barrier - Premier League 2018
According to the report, City's income has increased six-fold in the past decade and they have risen from 20th to fifth in European clubs' revenues league table.

NASA posts incredible video of Hurricane Florence from space
Rainfall of over 20 inches within the next week is projected, with some pockets possibly getting 35 inches or more. A state of emergency has also been declared in Maryland, North Carolina, South Carolina, Virginia and Washington.

Hurricane Florence weakens slightly as it moves toward US coast: NHC
The Carolinas will likely bear the brunt of Florence's wrath. "If there is a question in your heart, just leave", Malphrus said. McMaster had ordered evacuations for all coastal SC counties on Monday. "Now it might be time for the exam", he said.

Ladies and gentlemen, start your engines: Forza Horizon 4 demo available now
The best part about this story - only available for the USA and Canada, unfortunately - is the Forza Horizon 4 Demo Sweepstakes. Microsoft is now offering a deal that'll snag players 12-months of the subscription service plus two Forza games for just $99.

I Believe In Maurizio Sarri's Philosophy, Chelsea Defender Insists
And with no Champions League football to contend with this season, Sarri can possibly put all of his eggs into the Premier League basket.