"Aria Khrisna, a 36-year-old father of three in Tegal, Indonesia, says doing things like adding word tags to clothing pictures on websites such as eBay and Amazon pays him about $100 a month, roughly half his income. "Soma" Somasegar says he sees "billions of dollars of opportunity" in servicing the needs of machine learning algorithms.Venture capitalist S.".In a project that used Google Street View images of parked cars to estimate the demographic makeup of neighbourhoods, then-Stanford researcher Timnit Gebru tried to train her AI by scraping Craigslist photos of cars for sale that were labelled by their owners. "Right now, if you’re selling a product and you want perfection, it would be negligent not to invest the money in that kind of annotation," he says."We’ve transformed those jobs," Whigham says.At InterContinental Hotels Group, every call that its digital assistant Amelia can take from a human saves $5 to $10, says information technology director Scot Whigham.When a computer can’t make out a customer call to the Hyatt Hotels chain, an audio snippet is sent to AI-powered call centre Interactions in an old brick building in Franklin, Massachusetts.The benefits of greater accuracy can be immediate. "You can imagine how important it is for me getting paid in US dollars. "You can’t trust the algorithm 100 per cent."

It doesn’t sound like a lot of money, but for me, it’s pretty decent," she says.But it’s not just a fancy computer program spitting back responses.And for 25-year-old Shamima Khatoon, her job annotating cars, lane markers and traffic lights at an all-female outpost of data-labelling company iMerit in Metiabruz, India, represents the only chance she has to work outside the home in her conservative Muslim community. Humans will be in the loop "for a long, long, long time to come," he says.More recently, investors have poured tens of millions of dollars into startups like Mighty AI and CrowdFlower, which are developing software that makes it easier to label photos and other data, even on smartphones. The retailer Kohl’s uses the service for a "Snap and Shop" visual search feature on its app.Shamima Khatoon’s job is to annotate cars, lane markers and traffic lights at an all-female outpost of data-labeling company iMerit in Metiabruz, India.She earns about 50 cents an hour, but in a crisis-wracked country with runaway inflation, just a few hours’ work can pay a month’s rent in bolivars.’s Waymo are paying reams of labellers, often through third-party vendors."We want to be the ones that can label any image without any human involvement," says Ian Parnes, CloudSight’s head of business development. In the end, she says, she spent $35,000 to hire auto dealer experts to label her data. It learns from their response and tries the technique out on the next call, freeing up human employees to do other things. "How long that will take is anyone’s guess.The need for human labellers is "enormous" and "dynamic," says Robin Bordoli, CEO of labelling technology company CrowdFlower.Such data feeds directly into "machine learning" algorithms that help self-driving cars wind through traffic and let Alexa figure out that you Auto Brake for Hose FORD want the lights on.Accurate labelling could make the difference between a self-driving car distinguishing between the sky and the side of a truck — a distinction Tesla’s Model S failed in the first known fatality involving self-driving systems in 2016.These repetitive tasks pay pennies apiece."We’re not building a system to play a game, we’re building a system to save lives," says Mighty AI CEO Daryn Nakhuda. "Next time through, we’ve got a better chance of being successful," says Robert Nagle, Interactions’ chief technology officer. But in bulk, this work can offer a decent wage in many parts of the world — even in the US.When Amelia fails, the program listens while a call is rerouted to one of about 60 service desk workers.This human input industry has long been nurtured by search engines Google and Bing, who for more than a decade have used people to rate the accuracy of their results.There, while the customer waits on the phone, one of a roomful of headphone-wearing "intent analysts"transcribe everything from misheard numbers to profanities and quickly directs the computer how to respond.

That information feeds back into the system.His group alone spends hundreds of thousands of dollars a year paying people to annotate images.From makeup artists in Venezuela to women in conservative parts of India, people around the world are doing the digital equivalent of needlework — drawing boxes around cars in street photos, tagging images, and transcribing snatches of speech that computers can’t quite make out.CloudSight, for instance, offers website and app developers a handy tool for uploading a photo and getting a few words back describing it.Marjorie Aguilar, a freelance makeup artist in Maracaibo, Venezuela, spends four to six hours a day drawing boxes around traffic objects to help train self-driving systems for Mighty AI. Since 2005, Amazon’s Mechanical Turk service, which matches freelance workers with temporary online jobs, has also made crowd-sourced data entry available to researchers worldwide.But the product shots didn’t look anything like the car images in Street View, and the program couldn’t recognise them.Researchers have tried to find workarounds to human-labelled data, but the results are often inadequate.

"It’s a good platform to increase your skills and support your family," she says."At the moment, figuring out how to get computers to learn without so-called "ground truth" data provided by humans remains an open research question.Trevor Darrell, a machine learning expert at the University of California Berkeley, says he expects it will be five to 10 years before computer algorithms can learn to perform without the need for human labelling.For the most part, even companies trying to push humans out of the loop still rely on them.Major automakers like Toyota, Nissan and Ford, ride-hailing companies like Uber and other tech giants like Alphabet Inc.There’s a dirty little secret about artificial intelligence: It’s powered by hundreds of thousands of real people. If the algorithm doesn’t have a good answer, one of its 800 employees in places like India, Southeast Asia or Africa type in the answer in real time. His firm, Madrona Venture Group, invested in Mighty AI.Several companies like Alphabet’s Waymo and game-maker Unity Technologies are developing simulated worlds to train their algorithms in controlled scenarios where every object comes pre-defined. Many such technologies wouldn’t work without massive quantities of this human-labelled data. This burgeoning but largely unseen cottage industry represents the foundation of a technology that could change humanity forever: AI that will drive us around, execute verbal commands without flaw, and, possibly, one day think on its own.