Face AR SDK Release v0.36: Nail Polish Try-on, Updated Background Segmentation, and QOL Changes
Check out the new and updated version of Banuba Face AR SDK. It has multiple updates and new features across all platforms. The most notable of them is the official release of nail polish try-on functionality. However, there are more interesting features, bug fixes, and quality-of-life updates.
With the Face AR SDK v0.36 update, any beauty company can use the nail polish try-on functionality to let their customers test different products and their shades on a smartphone screen. It allows precise recognition of both natural and artificial fingernails, displays a lot of colors, and realistically interacts with lighting.
Lips Segmentation for Web and Windows
Previously, lip segmentation features (e.g. virtual lipstick try-on) worked only on Mac, Android, and iOS versions of our Face AR SDK. This was already helpful for many beauty brands that used it in their mobile apps. Now, this feature is supported by the web and desktop versions as well, giving our customers more choice in how they want to approach their users.
Unity Face Morphing Support
Now Unity developers can use face morphing (changing shape of face and its features) in their projects too. If you have been wanting to develop a game where the winner can grow their nose or ears, your time has come.
Offscreen Effect Player for iOS and Android
An extended API above SDK that makes working with Banuba Face AR SDK more comfortable. Thanks to the OEP, you can get an image from a camera or phone gallery and automatically change it to get one with the needed orientation and applied effects. Now you don’t have to get into the nuances of image processing yourself, the SDK does it for you.
GIF Textures Support
GIF images can now be used to create animated background effects. The SDK can automatically “cut out” the person on screen and replace everything else with the moving image you’ve supplied.
Expanded Makeup API
Makeup API makes it easy to apply virtual cosmetics to a user’s face. This includes a lot of products:
Eyeshadow
Eyeliner
Foundation
Highlighter
Blush
Contour
Lipstick/Lip gloss
The effects can be added separately or used as a group.
The WebAR portion of our SDK received a few other notable additions.
Background segmentation feature now has much better performance, giving more FPS. In addition, the memory usage has been optimized.
Web developers would enjoy having compatibility with SSR. Now you don’t have to create workarounds if your application employs server-side rendering, the SDK will work out-of-the-box.
Another valuable addition is optional SIMD. This technology has great potential, as it can add 20%-100% to FPS. We couldn’t let an opportunity like that pass by and added it to our SDK. And if your platform doesn’t support SIMD, the SDK would work with its default setting.
WebAR now also has human-readable exception messages for easier debugging.
Miscellaneous
Besides the most notable features, the 0.36 update features many extras:
WebAR: Speed up frames obtaining
WebAR: Improved memory usage
WebAR: Throw if an effect has zero-length
Windows: SDK DLLs come signed
Invalidate texture cache in case of file change
Mac: Build SDK as macOS framework
iOS: Remove ARKit dependency if ARKit face search is disabled