Get Free Demo
Wanna give our technologies a whirl?
  • It takes 7 min to install our SDK demo kit. Support documentation and guides provided!
  • Have other questions? Need more info or consultancy? Email us! We'd love to hear from you.

How To Create Face Beauty Filter With Effect Constructor Tool

Share
final face beautification filter

Face beauty filter is a great add-on to any camera app like virtual try ons, live streaming, social networking, dating apps or video chats. You can use it as a standalone filter to enhance the user camera experience or as part of face filters adding animation, virtual accessories or entertainment masks.

This post will tell you how to create your face beauty filter and configure it with the our Effect Constructor. The filter we feature as an example includes the following beautification options:

  • Skin smoothing
  • Skin tone enhancement
  • Face morphing
  • Teeth whitening
  • Expressive eyes effect
  • Eye makeup
  • Color improvement

If you are new to Banuba and you’d like to test Beauty AR SDK, drop us a line via the website contact form, and we’ll be happy to share the trial.

Explore Beauty AR SDK

1. Prepare source files

To create a face beauty filter, you will need 3 types of source files:

  • FBX file with morphing

  • Three textures as PNG files for Makeup, Softlight and Highlight.

  • Three LUT files in PNG format for eyes and teeth whitening and general color correction.

FBX file with morphing

Morphing allows for modifying the size of the face and its facial features by moving the vertices of the 3D model of the face. You can slim down or enlarge the face, change the shape of the nose, eyes, lips, chin, or produce any other deformations.

morphing face filterTo change the face of the user, you need to create an FBX with a morphed base mask using any 3D editor. Those that have tools for sculpting will be especially useful.

You can use the FaceDefault.FBX file with default face as a base model to create your morphed meshes. In our example, we’ll use slight morphing that slims down the face and the nose to make the user facial features more delicate.

The images below show the base mask and the morphing effect (green mask) added to the base mask (pink mask). The morphing effect will be applied to the recognized face of the user, while the UV coordinates should remain unchanged.morphing face beauty filter

Textures: Makeup, Softlight and Highlight

Now we will make three textures as PNG files according to the UV scan grid. These textures make up the core of our face beautification filter.

Makeup textureShot_Makeup

The makeup texture is displayed on the face in normal blending mode using transparency. You can add tattoos, eyebrow color, shadows thrown by other objects (such as glasses), or, as in our case, eye shadow, lashes and eyeliner.

Softlight textureShot_Soft

The Softlight texture is displayed on the face in softlight blending mode. It can be used to correct the skin tone, make it lighter or darker. For a skin-smoothing effect, the Softlight texture highlights the prominent areas of the face like the forehead, nose, cheekbones and chin. We also add a rosy tint to the cheeks.

Highlight textureShot_Highlight

The Highlight texture is displayed on the face in blend mode. In our example, this texture adds glare to the eyes to produce an “expressive eyes” effect.

LUT (Look Up Table)

The LUT files enable the color correction of the entire beauty filter in full screen mode. This way beautification will look organic, and the user will enjoy an enhanced, more vivid image. Also, we can whiten the user's eyes and teeth.lut_normal

You can make your LUT file by making color correction of the image in Photoshop using adjustment layers without masks, and applying these layers to the neutral LUT file.

Please note, files for eyes and teeth whitening should be without an alpha channel, and the file name should begin with the lut3d_ prefix.

lut 2

2. Construct beauty filter with Effect Constructor

Now, as you have all the resources in place, we can construct and configure the beauty filter.

  1. Create a folder named as your effect (“Beautification”).

  2. Create src folder inside for your source files and put the FBX file with morphing there.

  3. Launch the Effects Constructor, click the Open button and specify the path to the "Beautification" root folder. This action will generate a new folder with the configured effect.

    open effect constructor
  4. Add source files to this new folder: three LUT files and three PNG files with textures (Softlight, Makeup and Highlight).

     

    effectFolder

     

3. Configure face beautification filter

Step 1. Basic settings

In the Effect Constructor, go to the Rendering tab

  1. Turn on the retouch layer. We’ll set it up a bit later.

  2. In the warp_mesh option, point to the file with morphing.

  3. Disable the mat_morph layer with the morph geometry material as it’s not needed in our face beautification filter.

Click the Construct or Save buttons to save the settings.

warp_mesh

Step 2. Setting up up the retouch layer

To set up the retouch layer, specify the necessary options for the files.

  1. LUT file for teeth whitening

  2. LUT file for eye whitening

  3. PNG file with the glare in the eyes

  4. Softlight PNG file

  5. Makeup PNG File

Click on the Construct button.

retouch_setup

Step 3. Adding color correction

At the final step, we apply the color correction to the entire image to add consistency to our face beauty filter.

Save the finalColorFilter.fsh file to the folder with your constructed effect and insert this code into the config.json file to enable it. In the code, we indicate the name of the LUT file nashville.png saved earlier in the folder with the constructed effect.

 

"final" : {

"type" : "FILTER",

"filter" : {

"fragmentCode" : "finalColorFilter.fsh",

"textures" : [{

"file" : "nashville.png",

"sampler" : "lookupTexture",

"magFilter" : "LINEAR",

"minFilter" : "LINEAR"

}]

}

}
code example color correction for beauty effect

 

Summing up

The example of the beauty filter described above can be used as a real-time effect or for photo post-processing in selfie editors. You can see more of Banuba video face beautification and retouch features from the video.

Face beauty filter makes the users feel more comfortable about their selfie camera experience, increases engagement with the app and inspires content creation in users. 

You can adjust beautification features and levels creating either the effect of natural beautification with slight use face modifications or produce Snapchat-like retouch and beauty filters.

Tags
Share
Next up for you
Augmented Reality Video Editing: 12 Features For Developing Your Next TikTok App
February 24, 2020

The term ‘influencer’ has been a buzzword just a few years ago, but now many young people consider it as a career. As the demand i...  

#AR Video Editing
How To Create Face Masks in Unity Face AR Plugin. Part 1
February 18, 2020

Banuba Face AR plugin for Unity is an easy-to-use tool allowing developers to create realistic Snapchat-like lens, AR face filters...  

Face Filters Unity
Introducing Unity Face Tracking Plugin to Create Snapchat-like Filters in Unity
February 18, 2020

Our Face AR extension for Unity brings Banuba’s 3D face tracking technology cross-platform and allows developers to create realist...  

Face Filters Unity
Join the conversation