Live Portrait App
Live portrait app is a ground breaking AI driven application that takes an image of a person and brings them to life using your movements on camera. It utilizes AI to map your real-time facial features on a camera such as a webcam and super imposes their movements onto mapped features of a static image.
The secret to this working is many hours of training of the AI before the software is shipped to the user. A database table of features such as eyes, noses and the rest are inputted into a ‘neural net’ or statistical weighted decision matrix with layers filtering the features according to different algorithms.
If the result after assessing the known image is wrong the weighting is adjusted and the process repeated with thousands of just one feature in different orientations. Over time and in collaboration with assessing all the other features the AI can assess where the features are on both the real-time camera and the static picture provided to the system.
The software makes a digital copy of the image and manipulates it according to the virtual 3D head it has created from you features, using calculated distances between features to define the face. This means the static image is updates at the same rate as your camera refresh providing high quality and accurate movement of something that appears static.
The iterative process of changing each weighting on each matrix node during the learning process eventually stops when the software can guess the feature to a predefined error value. This is interesting as it means potentially that it could get a feature wrong however as it has other features, and feature distances already calculated it is unlikely to cause a challenge.
Interestingly, when you turn your head on an image that is facing the front the software needs to use its distance values to define a missing area, decide what is missing such as an ear and map an ear to the space including an generated texture. Filters post process to finish the color gradients and color matching. It is these ‘small’ details that make a live portrait app realistic and interesting to look at.
Why We Need to Remember
People are social animals and missing someone you had a connection with can be devastating especially if that person has been with you the course of your life. Live portrait app can help people remember those who are no longer around such as loved ones. This may be because of passing on or the viewer having an issue with remembering. Even without any health challenges it can be especially difficult to remember a person from a photo, and if that’s all you got then this can stunt your recollection.
Forgetting people is a natural process to help us adapt to current challenges, unfortunately it can cause distress to loved ones; this software can help keep memories alive. You could create a photograph book of living pictures that you have recorded reflecting the persons own mannerisms to help the person remember. Living memorials for famous people that died years ago may help keep them in the spotlight.
Live Portrait
A live portrait may not necessary be used for more solemn occasions, it could be used for marketing of products, electronic vacation cards and social media viral marketing. The great thing is that now people can use a 5 second sound bite of a person to create a convincing AI voice; combine together for fun video conferencing calls, hilarity on social media between friends and family, or any other idea that you can imagine!
