Facebook builds 'Rosetta' AI to understand text in images and videos

5 Must Have Biking Gears For An Urban Rider

Facebook says that Rosetta has already been widely adopted within various teams at the company and with Instagram, and noted that the text extracted from images is also being used in various machine learning models, such as those to improve its photo searching features. As a large number of posts are being posted on the social media, Facebook's moderators aren't able to review the content of the memes while they are being posted, creating a lot of fuss related to offensive posts. First, it detects rectangular regions that potentially contain text, and then performs text recognition.

By its own admission, Facebook has been struggling to suppress the spread of inappropriate content - from hate speech and threats of violence to disinformation and "fake news" across its vast platform.

The technology is rooted in optical character recognition (OCR), only here it's been goal built to process images that get uploaded to Facebook on a daily basis.

Fb says text extraction and machine learning are being set up to exercise to "robotically identify squawk that violates our hate-speech coverage" and that it's doing so in just a few languages. To handle the task, the company has now designed a very sophisticated artificial intelligence which is known as Rosetta.

"Taking into account the sheer volume of photos shared each day on Facebook and Instagram, the number of languages supported on our global platform, and the variations of the text, the problem of understanding text in images is quite different from those solved by traditional optical character recognition (OCR) systems, which recognize the characters but don't understand the context of the associated image", Facebook said in a blog post. The AI tool will be effective enough to understand multiple languages.

For what its worth, Facebook and Twitter have constantly updated their policies, and put in place mechanisms to curb the spread of offensive content on their platforms. Rosetta is the most recent advancement.

For over a year now, Facebook has been under the scanner for the role its played in providing a platform for fake news and hate speech.

Related News:

  • Afghan bombing death toll rises to 68

    Afghan bombing death toll rises to 68

    Provincial governor's spokesman said at least five people were killed and more than 30 others were wounded in the explosion. Afghan president Ashraf Ghani strongly condemned the suicide attack against the demonstrators in Nangarhar .

    Stunning Weather Channel Video Shows Why Storm Surges Are So Dangerous

    South Carolina's state capital Columbia is at only 89m (292ft). "We are totally prepared", Trump said at the White House. Screaming winds bent trees and raindrops flew sideways as Florence's leading edge battered the Carolina coast Thursday.
    I Believe In Maurizio Sarri's Philosophy, Chelsea Defender Insists

    I Believe In Maurizio Sarri's Philosophy, Chelsea Defender Insists

    And with no Champions League football to contend with this season, Sarri can possibly put all of his eggs into the Premier League basket.
  • Check out the official iPhone XS, XS Max and XR promo videos

    Check out the official iPhone XS, XS Max and XR promo videos

    In Poland, someone who wants that same iPhone XS Max will have to pay $1,956 (compared to $1,449 here in the U.S. , of course). Up until Wednesday, Apple was selling the iPhone 6s for $US450, and the iPhone 6s Plus for $US550.
    Tottenham vs Liverpool: Spurs without Alli and Lloris for Reds clash

    Tottenham vs Liverpool: Spurs without Alli and Lloris for Reds clash

    The court heard police in an unmarked auto spotted Lloris' Porsche Panamera driving at 15mph (24kph) in a 30mph (48kph) zone. Lloris apologised to his manager and team-mates after the incident. "I made a mistake and now I need to pay".
    Google denies left-wing bias after leaked clip of co-founder discussing Trump

    Google denies left-wing bias after leaked clip of co-founder discussing Trump

    During what was clearly an emotional and companywide meeting, Google executives also extolled democratic values. Parscale called for Congress to hold hearings and investigate the matter.
  • Joyce Drifting Southwestward With No Change in Strength

    Currently, tropical-storm-force winds have been recorded extending outward up to 160 miles (260 km) from the centre of the storm. However, Isaac is still predicted to trigger tropical-storm-force winds and life-threatening flash flooding.
    Marin Mazzie Dead - Broadway Star Dies at 57 | Marin Mazzie, RIP

    Marin Mazzie Dead - Broadway Star Dies at 57 | Marin Mazzie, RIP

    In the second act, Rockford was plunged into a blackout and the actors needed flashlights to finish the show. In an email, Greenblatt said he knew Mazzie "would always be his friend and she was destined for greatness".
    Chelsea wrong to let Bakayoko go this summer says Fabinho

    Chelsea wrong to let Bakayoko go this summer says Fabinho

    AC Milan have again been linked with the Blues midfielder, having been linked with him during successive transfer windows. But this could be too early to discuss as Fabregas has a very very large chunk of the season to turn the fortunes.
  • Trump Wants to Pay Mexico $20 Million to Help With Deportations

    Trump Wants to Pay Mexico $20 Million to Help With Deportations

    In a joint statement, Mexico's Interior and Foreign Ministries said they had not accepted the proposal in either a "verbal or written" way.
    IPhone XR: Apple unveils iPhone XR starting at £749

    IPhone XR: Apple unveils iPhone XR starting at £749

    Apple CEO Tim Cook speaks at the company's event in Cupertino , at which updated iPhones and a new smartwatch were unveiled. It is also running on the new 7nm A12 Bionic Chip and it retains the same 12MP f/1.8 main camera that's assisted with OIS.

    NASA posts incredible video of Hurricane Florence from space

    Rainfall of over 20 inches within the next week is projected, with some pockets possibly getting 35 inches or more. A state of emergency has also been declared in Maryland, North Carolina, South Carolina, Virginia and Washington.


Most liked

Oil nears $70 a barrel as concern grows over global supply
US crude inventories fell by 5.3 million barrels in the last week, the US Energy Information Administration said on Wednesday. Russian energy minister Alexander Novak on Wednesday warned of the impact of U.S. sanctions against Iran.

Final Fantasy Is Being Well Represented On Switch
When SquareEnix's Hajime Tabata joked that Final Fantasy XV might come to Nintendo's hybrid portable, fans bought into the hype. And so is World of Final Fantasy , as a new version called World of Final Fantasy Maxima (also coming to PC, PS4 and Xbox One).

Apple 2018 Event Recap: iPhone Xs, Xs Max, Xr, Apple Watch
Arguably the most notable new product: the iPhone Xr delivers iPhone X style with a price cut and some caveats. If you're clinging to wired headphones, you might not like what Apple's doing with its new iPhones .

FCC pauses review of T-Mobile, Sprint merger
It also needs to review a new business model referred to as "Build 9". The FCC says that it didn't get Build 9 until September 5th.

Norwegian Dawn docks in Sydney for the day
As of 1:00 PM ET Monday, Florence was about 575 miles south-southeast of Bermuda and moving to the west at 13 miles per hour. The infographic below, provided by Statista, demonstrates the comparative cost of damage caused by recent hurricanes.

Jurgen Klopp On Top of Liverpool Midfield Battle - Former Reds Boss
Liverpool take on Tottenham Hotspur at Wembley at 12:30pm on Saturday and Jurgen Klopp was expected to reassess his key stars' fitness ahead of the fixture.

Georgia Declares Emergency as Hurricane Florence Approaches
Florence remains to be a powerful category 3 hurricane with maximum sustained winds of 120 miles per hour . Most other beachgoers were long gone. "It's been really nice", Nicole Roland said.

Pokémon's Game Freak Announces New 'Town' RPG
The game takes place entirely in the village and it'll be up to you to help the villagers take on various monsters. The game is tentatively titled " Town ", and it is slated for 2019 on Nintendo Switch.

Unbeaten Cincinnati Bengals still searching for true identity
The 3 touchdown passes each went to newly added receivers for the team, Michael Crabtree , John Brown , and Willie Snead. Green climbed the ladder and ripped the ball out of Austin's hands, shrugged off his tackle and was gone for 32 yards .

Here's all the big news from today's Nintendo Direct
Ultimate, some more info about that new Yoshi game, and if you're feeling really lucky, an Animal Crossing Switch announcement. No word yet on what Luigi's Mansion 3 will be like, but I for one am excited to protect this poor plumber from further harm.

Tropical Storm Joyce forms in Atlantic, Gulf disturbance still unnamed
Issac has been downgraded to a tropical storm and Hurricane Helene is still no threat to land. The current path has it making landfall somewhere between Brownsville and Corpus Christi.

Stewart, Storm surge past Mystics 98-82 for WNBA title
It's not that my hunger for it went away or my motivation. "Even when she broke her nose she just never gave up", said Andrews. And we did that. "The talent has definitely improved", said Monique Currie, a 13-year veteran.

Manchester City break 500 million pounds revenue barrier - Premier League 2018
According to the report, City's income has increased six-fold in the past decade and they have risen from 20th to fifth in European clubs' revenues league table.

Hurricane Florence from space: "A no-kidding nightmare"
But it's forecast to strengthen to near the level of a Category 5 storm - which has sustained winds of 157 miles per hour or more .

Karius denies making comments about female fans
Reds players stood by Karius after his calamitous performance in the Champions League final defeat to Real Madrid . But Karius, who has made a single appearance for Besiktas , posted on social media to deny making the comments.