By Helen Albert

A wearable device consisting of two mini-cameras mounted on earphones can recognise your facial expressions and read your lips, even if your mouth is covered.

The tool – called C-Face – was developed by Cheng Zhang at Cornell University in Ithaca, New York, and his colleagues. It looks at the sides of the wearer’s head and uses machine learning to accurately visualise facial expressions by analysing small changes in cheek contour lines.

“With previous technology to reconstruct facial expression, you had to put a camera in front of you. But that brings a lot of limitations,” says Zhang. “Right now, many people are wearing a face mask, and standard facial tracking will not work. Our technology still works because it doesn’t rely on what your face looks like.”

The researchers think their device could be used to project facial expressions in virtual reality, as well as tracking emotions and assisting with digital lip-reading for people with hearing impairments.

Zhang and his colleagues tested C-Face in nine volunteers. When compared with a library of images taken with a front-positioned camera, the device accurately predicted facial arrangements for different expressions (measured by changes at 42 points on the face) to within 1 millimetre. The researchers will present their work at the virtual ACM Symposium on User Interface Software and Technology next week.

C-Face is still at an early stage and there are technical problems, such as battery life, that need to be overcome before it can be rolled out more widely. Zhang also acknowledges that ensuring user privacy could be a problem. “There’s so much private information we can get from this device,” he says. “I think that’s definitely one issue we need to address.”

Source: https://www.newscientist.com/article/2256925-earphone-cameras-watch-your-facial-expressions-and-read-your-lips/

Facial expression, Research, Cornell University, Face

World news – GB – Earphone cameras watch your facial expressions and read your lips

En s’appuyant sur ses expertises dans les domaines du digital, des technologies et des process , CSS Engineering vous accompagne dans vos chantiers de transformation les plus ambitieux et vous aide à faire émerger de nouvelles idées, de nouvelles offres, de nouveaux modes de collaboration, de nouvelles manières de produire et de vendre.

CSS Engineering s’implique dans les projets de chaque client comme si c’était les siens. Nous croyons qu’une société de conseil devrait être plus que d’un conseiller. Nous nous mettons à la place de nos clients, pour aligner nos incitations à leurs objectifs, et collaborer pour débloquer le plein potentiel de leur entreprise. Cela établit des relations profondes et agréables.

Nos services:

  1. Création des sites web professionnels
  2. Hébergement web haute performance et illimité
  3. Vente et installation des caméras de vidéo surveillance
  4. Vente et installation des système de sécurité et d’alarme
  5. E-Marketing

Toutes nos réalisations ici https://www.css-engineering.com/en/works/

LEAVE A REPLY

Please enter your comment!
Please enter your name here