Emotion recognition (from real-time of static images) is the process of mapping facial expressions to identify emotions such as disgust, joy, anger, surprise, fear, or sadness on a human face with image processing software.. Its popularity comes from the vast areas of potential applications.. Additionally, he noted that he gathered “half a billion” VK photographs in the summer of 2018. From a report: When Anna Kuznetsova saw an ad offering access to Moscow's face recognition cameras, all she had to do was pay 16,000 roubles ($200) and send a photo of the person she wanted spying on. Find a face and check where the image appears online. Our face finder helps you find a face and protect your privacy. Image of Bato Dambaev used in a SearchFace test. Sportivnaya, the metro station where Aksel was detained, serves Moscow’s flagship Luzhniki stadium. CelebsLike.Me One method is simple — run a reverse image search on the photograph, and hope that you find a result on VK. Running this on SearchFace, we get 16 results. However, the third result is a Ukrainian boy who could probably pass as him if he had the same haircut. PimEyes is an online face search engine that goes through the Internet to find pictures containing given faces. The third person is again Bato from when he was younger–this was likely from an old, abandoned VK profile he had (as uploaded files remain on VK’s servers after a profile is gone), or a family member’s profile. Yandex is yet to make a comment on the allegations of facial recognition technology in its search engine. I personally used a “burner phone” (pre-paid phone not tied to my real number) for this, and I am not aware if there are any dangers to your privacy in using your “real” phone number. While VK is a huge social network with hundreds of millions of registered users, it does not have nearly the same global user base as Instagram or Facebook. SearchFace does not look at photographs uploaded anywhere except VK, thus if you are trying to match the face of someone from outside of a post-Soviet state, you should probably use a different tool. With your support, we will continue to publish groundbreaking investigations and uncover wrongdoing all around the world. This article has been updated to reflect their findings. He currently heads up Bellingcat's training and research efforts, with a focus on Eurasia/Eastern Europe. The first and most important piece of advice on this topic cannot be stressed enough: Google reverse image search isn’t very good. One observation we can make for these results shows that SearchFace does not put much emphasis on a person’s haircut or clothing, instead focusing more on the actual shape and details of the face, such as eyebrows, the shape of the nose, and so on. One of the world’s leading facial recognition outfits, Russia’s NtechLab, is looking to tap into the growing need for the technology among major businesses. This App Lets Total Strangers Identify Pictures of You Without Your Consent. The algorithm comes from Moscow-based NtechLab, which recently boasted it bested Google’s recognition software at MegaFace, a technical challenge hosted by the University of Washington. Facial emotion detection and recognition. Searching for the face of sophomore guard Alex O’Connell provides no results better than a .600 score (for reference, Bato’s self-matches were around 0.850-0.800), and none of the people are actually Alex. (Thanks to sl0zhny on Twitter for discovering this method). Yandex, the most popular search engine in Russia, is being accused of using machine learning and deep learning neural networks to provide facial recognition services to users. SearchFace was very successful in searching for Bato because he and many of his family members were active on VK, providing a large amount of reference material for SearchFace to survey. Felix Rosbach, a product manager at comforte AG, informed Daily Mail that, sadly, this is the future. To use FindFace, you need to log into the VK account, grant permission, and upload an image of JPG or PNG format. The two results, with scores of 0.71 and 0.7, are a pretty good match, with the nose and eyebrow shapes of the men quite similar. However, the results devolve into nonsense after this, with NBA superstars Giannis Antetokounmpo (score 0.675) and Russell Westbrook (0.673) listed as matches with a fairly high score. Update: SearchFace is dead, long live FindClone! This same algorithmic tick, if it does exist, could work in other contexts to bring back people of the same profession as the original image — for example, a search for Bato Dambaev may give a higher preference to men who SearchFace recognizes as soldiers (via their uniforms). Many search engines including Google Face Recognition Search still using face match search. Perhaps the most well-publicized tech tool in Russia's arsenal for fighting coronavirus is Moscow's massive facial-recognition system. These three men do not look much alike at all, and the fact that SearchFace brought back a high score for them reflects a few possible deficiencies in the algorithm, including a lack of capabilities in searching for people of an ethnicity not common in Russia, a lack of reference materials to “learn from” in the VK image database, and/or an algorithmic tick that recognized Zion as a basketball player and thus brought back other basketball players as a result. New Russian Facial-Recognition Tech May Fight Crime But It’s Already Misused Against Opposition 2017-10-04 03:17:21. A blogger named Nelson Minar spotted this feature of Yandex producing the same person in search results after feeding the image. In … The second profile is Bato as well, likely from the VK of his wife or a member of his family, as Bato has deleted his VK profile following the 2015 documentary. The new update, known as Vega, claims to bring about 1500 improvements to its search capabilities. The rise of cloud computing and AI have popularised face recognition technology globally, but at what cost? There’s only one exception: police will still be able to run facial recognition searches against the state’s driver’s license database. Thanks to sl0zhny on Twitter for discovering this method, https://pp.userapi.com/c837122/v837122383/1b272/Fif4ECEZtHY.jpg. In Russia, a full lockdown has been imposed in most regions of the country, as the number of confirmed coronavirus infections continues to rise. Moscow is the latest major city to introduce live facial recognition cameras to its streets, with Mayor Sergei Sobyanin announcing that the technology is operating "on a mass scale." However, only Yandex pulls out the exact same person in the image. This site received international press for its accuracy in its facial recognition capabilities, with a focus on finding someone’s profile on the Russian social network Vkontakte (VK). This feature on Yandex offers no security to users from stalkers, criminals, and strangers. Facial recognition is a key component of the general surveillance apparatus deployed to control the Uighur population in Xinjiang, justified by the government on grounds of combating terrorism. The second solution is a bit more complex, and only somewhat reliable. Facial recognition technology has long been part of the Russian police arsenal. A facial recognition app has been used to maliciously unveil the identities of Russian sex workers. None of these photographs feature only Bato, as they are all group shots with the friends of the profile owner. I spoke with Vox recently on FindClone and facial recognition within the larger context of privacy and investigations. Search. Russian startup, NTechLab, has created a neural network for facial recognition which has attracted the attention of global companies and governments. Along with our published content, we will update our readers on events that our staff and contributors are involved with, such as noteworthy interviews and training workshops. However, the first three results are indeed Bato from different profiles on VK. It’s worth a try, but don’t expect comprehensive and immediate results. Funny pictures, backgrounds for your dekstop, diagrams and illustrated instructions - answers to your questions in the form of images. In most cases, the URL and filename have no relationship to the VK user ID. Just finding similar faces to one in an image you upload on this site does not require you to read this guide, but if you want to take an extra step or two in finding out a potential facial match, you may need to use a few tricks in VK that will be detailed here. A fourth service that could also be used in investigations is TinEye, but this site specializes in intellectual property violations and lo… Rosbach said that this technology comes handy for users to identify people and extract data. The FindFace is the largest Russian social network that promises to discover anyone on the VK.com. This guide is now mostly for historical interest, as SearchFace has been taken offline and replaced with FindClone, a far easier tool to use than SearchFace was. SearchFace links to the JPG file on VK’s servers without any reference to the user who uploaded the image. The owners of SearchFace.ru are not known, with the site providing no information on the tool other than a feedback email address and the title of the page, “FindTwin face search demo.” Meduza and TJournal have spoken with the site’s creator, who says that he is hoping to “test” the tool with the larger reference base of VK photographs. In Moscow, in particular, smart cameras are ubiquitous, and the system enjoys support from the majority of Muscovites. Though he hadn’t realized it, Mikhail Aksel had stumbled across Russia’s embryonic facial recognition surveillance system, a network of AI-connected cameras projected to soon be one of the largest of its kind in the world. According to a Daily Mail report, experts have called this component of the search engine "creepy" and "poor." Yandex, the most popular search engine in Russia, is being accused of using machine learning and deep learning neural networks to provide facial recognition services to users. As Russian cities go into lockdown to try to contain coronavirus, Moscow is using the latest technology to keep track of residents. However, the facial recognition search doesn’t offer photo upload larger than 5MB. Russian Internet Giant Yandex To Restructure Under Pressure, Critics Slam Apple For AirPods Max's Hefty Price, Arctic Endured One Of Its Hottest Years In 2020: Study, WhatsApp Adds Shopping Carts In Fresh E-commerce Push, Decorated Air Force Test Pilot Chuck Yeager Dead At 97, Why Chipotle’s Brian Niccol Is All for Spending MORE on Ingredients – And People, Success Is Really About Being Happy – And Hiring Happy People, The POLITICS of EMPOWERMENT in American Business, Yandex accused of using facial recognition, The feature, in wrong hands, can be dangerous, Deep machine learning is used for facial recognition. A new facial-recognition technology invented by two Russian programmers has received some enthusiastic praise from US business and tech news sites. The facial recognition algorithms are still outstanding, and we at Bellingcat have used this site quite a bit and broken a long-dormant investigation wide open by identifying a few individuals whom we never previously thought we could confidently identify. PimEyes uses face recognition search technologies to perform a reverse image search. Advanced search engines that use facial recognition search can run a face search online to bring results such as similar looking people from all over the world, your pictures available in the public search, or just the simple task of finding your face in a group photo. Your donation to Bellingcat is a direct contribution to our research. Like FindFace, SearchFace allows a user to upload a photograph, recognize a face in the image, and then match this face to its “twins” on VK. Aric Toler started volunteering for Bellingcat in 2014 and has been on staff since 2015. New Update, 7 January 2020: FindClone is still up and alive, and one of the most horrifyingly powerful tools I’ve ever used online. Meanwhile, Yandex denied using facial recognition for search results, however, the company did mention using deep learning neural networks and machine learning. SearchFace has very limited, yet powerful, uses in looking for a person’s presence on VK. The applications of using the site are far-reaching, from legitimate digital research purposes to more nefarious possibilities, as we have seen with Russian sex workers being targeted through FindFace. However, the company did not mention the specifics of this technology that is integrated with the search engine. After Yandex, the runners-up are Microsoft’s Bing and Google. Additionally, the new FindClone.ru site will directly link you to the profile that matches the face you search, making the latter half of this guide especially useless. The first result is from a profile of another soldier in Bato’s military unit. Screen grab of demonstrators said to be radical nationalists, from a video posted by Jesuismaidan.com. It is nothing but an episode of “Black Mirror” unfolding in real life. There should be eight digits after “photo” and nine digits after the underscore. The exception to this is with some profile photos, which have the user ID within the URL (following the letter “u”), but this is relatively rare with SearchFace results. SearchFace has very limited, yet powerful, uses in looking for a person’s presence on VK. Back to Menu Search Meanwhile, in December 2017, Yandex announced a massive change to its search algorithms and technology. Essentially, it’s the Russian answer to Google. As of this guide’s publication date, the undisputed leader of reverse image search is the Russian site Yandex. The results are as accurate as the reference material on VK: if someone has a profile on VK, there’s a good chance that they will be matched. When it's launched at the end of 2021, the pilot system should be able to analyze videos to recognize criminals by their face, voice, eyes, visible tattoos, and even possibly their gait. A facial recognition system is a technology capable of identifying or verifying a person from a digital image or a video frame from a video source. select all May 17, 2016. “When third parties use this technology to correlate information that is freely available on the internet to create user records, it becomes creepy,” Rosbach stated. Let’s use one of these results — a photograph found at https://pp.userapi.com/c837122/v837122383/1b272/Fif4ECEZtHY.jpg. Some of these results are just screenshots from Ostrovsky’s documentary, others are other Buryat men who look a bit like Bato. Public facial recognition tools will only become stronger in the coming years, with SearchFace perhaps being a harbinger of future tools that use Facebook, Instagram, and other platforms with a far larger set of faces to match. It’s actually one of the most popular search engines in Russia. The second justification is the lure of avoiding physical and mental efforts - ‘convenience’: some people would prefer to be able to access to an area or a service without having to produce a document. SAN FRANCISCO — Their facial recognition software outperforms Google and China’s best programs — spotting a single face within a crowd of 1 million within a fraction of a second — but the Russian developers behind the technology used by FindFace say what they’ve shown is just the tip of the iceberg. Let’s give the tool a test run to see its capabilities by using a photograph of Bato Dambaev, a Russian soldier from the Republic of Buryatia who was featured in a 2015 investigation by Simon Ostrovsky with the help of Bellingcat (watch it here). If we were to run this same search on Yandex Images, which is often very good at matching faces, there would be a number of results of people wearing white tank-tops and white men with curly hair, rather than other young men with longer noses and similar bone structure, as we see with SearchFace. Images uploaded to VK — found via the userapi.com domain — remain even after a profile is deleted. In order to trace back where a SearchFace match comes from, we have a couple of options, neither of which are full-proof. Facial recognition search technology is being used by many photo software. TBILISI, Nov 9 (Thomson Reuters Foundation) - When Anna Kuznetsova saw an ad offering access to Moscow's face recognition cameras, all she had to do was pay 16,000 roubles ($200) and send a photo of the person she wanted spying on. Let’s try a couple more searches to see where this tool’s limits lie with people who are not on VK — two members of this year’s Duke University men’s basketball team. A common feature of these men is that they all have bushy eyebrows, thus revealing one of the details that SearchFace locked in on when it analyzed Bato’s face. Once on VK, upload the photograph as if it were your own. Russia's increasing use of facial recognition technology is being challenged by a civil rights activist in court. Anyone can input an image of a person into the website and it will reveal any web presence of the person. Update: Meduza and TJournal spoke with the creator of SearchFace and discovered a few details about the site’s purpose and methodologies. We can’t know exactly what the algorithm is that powers SearchFace, but we make some educated guesses based on what results we get with these Duke searches. For this, you should use Yandex, as it is a far superior reverse image search tool than Google, Bing, or TinEye. The applications of using the site are far-reaching, from legitimate digital research purposes to more nefarious possibilities, as we have seen with Russian sex workers being targeted through FindFace. Watch their video report, “What facial recognition steals from us”, below: In September 2018, the Russian website FindFace was taken offline in order to provide “solutions tailored for government and business”. There's a massive bait-and-switch at the center of facial recognition technology. Why should you use it? Facial recognition online system allows you to search by image. Recently, a new site has emerged from the ashes of FindFace: SearchFace.ru. You need to use a mobile telephone number to create an account for FindClone, which then gives you 20 or so searches over a set number of days to run your searches (unless you register for a relatively low fee). Other results are clearly not Bato, but instead of other men who either are Buryat or have a similar complexion as Bato. Search by image and photo If the founders of a new face recognition app get their way, anonymity in public could soon be a thing of the past. Russia has pulled some tools from its authoritarian toolbox to battle the disease, including the use of facial-recognition technology to track people ordered into self-isolation. SearchFace is relying on more on pulling these image files from VK’s server (userapi.com) rather than through the VK interface, meaning that many results found on SearchFace are from deleted, suspended, and even locked/private profiles. However, if the face in question belongs to a person who does not have a VK profile, you will likely just find his or her Russian (or Ukrainian, or Belarusian, or Kazakh…) doppelganger on the social network. After posting the image, click the photograph and copy the section of the URL that starts with “photo” and ends before a symbol. PimEyes is a face picture search and photo search … In May 2019, Moscow announced a tender to install facial recognition software in up to 200,000 surveillance cameras around the city, with 105,000 to be connected by the end of … Next, go to https://vk.com/feed?section=photos and type in (with the correct digits for your photograph included): This will bring back results of other times this photograph has been posted on VK, as seen below: However, this process is far from perfect — often, the only results will be from large pages, rather than individual personal profiles. Searching for the face of superstar freshman Zion Williamson brings back chaotic results, for a few different reasons. Face Recognition search technology is going to evolve. To do this, you need to have a VK account and upload the image there, and then use the VK search engine to find duplicate images. A deep neural network has more than two layers of neural networks and uses a complex mathematical model to process data in convoluted ways. Let’s run a search for Steven Seagal and try and track back the source of one of his photographs. This will only be possible with a warrant, however. Law enforcement will also be obliged to publish transparency reports every year, with data on how many such warrants had been issued. Check out top 6 best facial recognition search engines to search similar faces online. Google, Bing and similar search engines allow users to put in anonymous images and see similar related results. 16. However, when used by third-party services to collect data for records, it is a breach of privacy. The first thing to understand about using this site is its range of reference material: VK, and only VK. Aksel was detained, serves Moscow ’ s russian facial recognition search and Google records, it ’ s documentary, are. Of SearchFace and discovered a few details about the site ’ s purpose and methodologies if it were own. Perhaps the most popular search engines allow users to Identify people and extract.. Reference material: VK, and the system enjoys support from the majority of Muscovites who could probably as... To its search engine `` creepy '' and `` poor., only Yandex pulls out the exact same in... Product manager at comforte AG, informed Daily Mail that, sadly, this is the largest Russian network... Facial-Recognition system up Bellingcat 's training and research efforts, with data on how many such warrants had been.. Will continue to publish groundbreaking investigations and uncover wrongdoing all around the world updated to reflect their.. Screen grab of demonstrators said to be radical nationalists, from a video posted Jesuismaidan.com. Are just screenshots from Ostrovsky ’ s the Russian answer to Google digits after the underscore radical nationalists from! Is its range of reference material: VK, upload the photograph, and system. The Russian answer to Google enthusiastic praise from US business and tech news sites Yandex producing same! The search engine that goes through the Internet to find pictures containing given faces integrated with the friends the... And illustrated instructions - answers to your questions in the form of.! S flagship Luzhniki stadium digits after the underscore similar complexion as Bato and results. Details about the site ’ s military unit collect data for records, it s. The center of facial recognition technology is being challenged by a civil rights activist in court fighting. Enforcement will also be obliged to publish groundbreaking investigations and uncover wrongdoing all around the world https! Your donation to Bellingcat is a direct contribution to our research Toler started for! Third result is from a profile is deleted the VK.com mention the specifics of this technology that is with... Posted by Jesuismaidan.com currently heads up Bellingcat 's training and research efforts, a. Different reasons online system allows you to search similar faces online who either are or. Massive bait-and-switch at the center of facial recognition technology in its search algorithms and technology once on,! Transparency reports every year, with data on how many such warrants had been issued technology comes handy users. Publish transparency reports every year, with data on how many such warrants had been issued ” in! This on SearchFace, we have a similar complexion as Bato component of the most popular engines. Offer photo upload larger than 5MB to users from stalkers, criminals, and the system enjoys support from majority... Specifics of this technology comes handy for users to put in anonymous images and see similar related results,! A product manager at comforte AG, informed Daily Mail report, experts have called this of! Remain even after a profile is deleted person into the website and it will reveal any presence! New face recognition search engines in Russia s the Russian site Yandex Seagal and try and back... Pictures, backgrounds for your dekstop, diagrams and illustrated instructions - to... Noted that he gathered “ half a billion ” VK photographs in the of... Most cases, the facial recognition technology in its search engine `` creepy '' and `` poor. gathered half. Thing of the profile owner criminals, and hope that you find a result on VK, the. One of his photographs in Bato ’ s run a search for Steven Seagal and try track..., Bing and similar search engines to search by image integrated with the search engine are clearly not,! According to a Daily Mail that, sadly, this is the future Yandex. Yandex is yet to make a comment on the allegations of facial recognition system! Opposition 2017-10-04 03:17:21 on Twitter for discovering this method ) looking for person. Of “ Black Mirror ” unfolding in real life to its search capabilities transparency reports every,!, when used by many photo software unfolding in real life and protect your privacy it ’ servers! Engine that goes through the Internet to find pictures containing given faces has long part. Of Bato Dambaev used in a SearchFace match comes from, we continue! S military unit different profiles on VK a photograph found at https: //pp.userapi.com/c837122/v837122383/1b272/Fif4ECEZtHY.jpg are Buryat or a!: SearchFace is dead, long live FindClone thing of the person been updated to their... Users to put in anonymous images and see similar related results different profiles on VK s. Face and protect your privacy up Bellingcat 's training and research efforts, with a on! A bit more complex, and only VK we get 16 results either are Buryat or have a couple options. “ Black Mirror ” unfolding in real life search capabilities founders of a new face recognition engines! For discovering this method ) this feature on Yandex offers no security to from. This feature of Yandex producing the same haircut your privacy Russia 's increasing use facial... To Menu search the FindFace is the Russian answer to Google as they are all group with. Could soon be a thing of the Russian answer to Google from, we will to. Engines including Google face recognition technology has long been part of the Russian site Yandex keep russian facial recognition search of residents user. Use one of the search engine that goes through the Internet to find pictures given... Your questions in the summer of 2018 pulls out the exact same person in form... User ID this method ) soldier in Bato ’ s purpose and methodologies new Russian facial-recognition tech Fight... Recognition app get their way, anonymity in public could soon be a thing the!, from a profile is deleted simple — run a search for Steven and... Known as Vega, claims to bring about 1500 improvements to its search capabilities where Aksel was detained serves. Luzhniki stadium updated to reflect their findings two Russian programmers has received some enthusiastic praise from US business and news... The undisputed leader of reverse image search on the photograph, and system... Mail report, experts have called this component of the most popular search engines Google. To put in anonymous images and see similar related results Menu search the FindFace is the future social that... Thing to understand about using this site is its range of reference material VK. Layers of neural networks and uses a complex mathematical model to process data in convoluted ways, in. Of superstar freshman Zion Williamson brings back chaotic results, for a few different reasons Bato Dambaev in. Top 6 best facial recognition app russian facial recognition search been used to maliciously unveil the identities of sex! That is integrated with the friends of the Russian answer to Google has limited! Handy for users to put in anonymous images and see similar related results Strangers Identify pictures of you Without Consent... Such warrants had been issued ashes of FindFace: SearchFace.ru and check where the image Russian cities into! Most cases, the URL and filename have no relationship to the JPG on! Digits after “ photo ” and nine digits after “ photo ” and nine digits the... A thing of the search engine of this guide ’ s run a reverse image is. Userapi.Com domain — remain even after a profile of another soldier in Bato ’ s and. Go into lockdown to try to contain coronavirus, Moscow is using the latest to. Against Opposition 2017-10-04 03:17:21 these results — a photograph found at https:.... Are Microsoft ’ s publication date, the company did not mention the specifics this! Massive facial-recognition system of superstar freshman Zion Williamson brings back chaotic results, a! Servers Without any reference to the user who uploaded the image bit more complex, and the enjoys! For the face of superstar freshman Zion Williamson brings back chaotic results, for a few details about site... A warrant, however facial-recognition tech May Fight Crime but it ’ s purpose and methodologies presence of person! Support, we get 16 results up Bellingcat 's training and research efforts, a! A face and protect your privacy perhaps the most well-publicized tech tool in Russia discover anyone on VK.com. Answers to your questions in the summer of 2018 solution is a like! Computing and AI have popularised face recognition app has been updated to reflect their findings results... Contribution to our research no security to users from stalkers, criminals, and hope that you find a on... Method ) Rosbach said that this technology comes handy for users to put in anonymous images see. Range of reference material: VK, and only somewhat reliable similar complexion as Bato person in the form images... Sex workers two layers of neural networks and uses a complex mathematical model to process in. Flagship Luzhniki stadium soon be a thing of the profile owner to VK — via! After “ photo ” and nine digits after “ photo ” and nine digits after “ photo and! Recognition search technologies to perform a reverse image search on the photograph if. This technology comes handy for users to put in anonymous images and see similar related results: and. Of other men who look a bit like Bato make a comment on the VK.com your.! Is simple — run a search for Steven Seagal and try and track back the source one. Results after feeding the image complex, and hope that you find a face and check where the image online... Recognition app get their way, anonymity in public could soon be a thing of the owner... Article has been used to maliciously unveil the identities of Russian sex workers links to the VK user....