Unleash your inner gnome at GDC 2018

Imagination is of course at GDC this week, and this year, with a nod to the current excitement around augmented reality, we’re having some fun with gnomes and emoji. We’ve given our face detection demo a (virtual) face-lift – turning the faces of visitors to our booth into gnomes!

So what exactly is going on here? Well, we’re taking a live camera feed, then per-frame and in real time we’re detecting the regions of that feed which contain faces. We’re then rendering garden gnome hats and facial hair on top of those regions.
Why? Well, why not?
On the technical side, the demo is running on a Google Nexus Player (featuring our PowerVR G6430 GPU), which has been modified to support passing a live webcam feed through to OpenCL for GPU-based face detection, with the results rendered to the screen using OpenGL ES. The algorithm doesn’t use neural networks, which have become popular in recent years. Instead, the basis of the detector in the demo is a local binary pattern (LBP) classifier, which examines the neighbourhood of individual pixels and gives a result based on thresholding the difference between the centre pixel and each of its neighbours.
In this setup, the LBPs are the weak classifier, and the outputs of groups of those weak classifiers are combined into cascades of strong classifiers. The strong classifier decides whether the combined evaluation of the LBPs should be rejected or if it is indeed a face. Alongside this core algorithm are some other heuristics such as accurately extracting regions containing skin colours, and handling rotated faces. Click on the link if you’re interested in a deep-dive on traditional computer vision on PowerVR, including a look at face detection,
Our neural-net-based face detection demo showcases not only face detection but identification, where previously registered faces are remembered after disappearing from view and coming back into view. Both of these demos run on the GPU, but by using our new PowerVR 2NX neural-network accelerator, face detection can be off-loaded to dedicated hardware which has been tuned for that kind of workload, enabling much greater performance, while freeing up the GPU for other work (perhaps for rendering physically-based gnomes or emoji). Read this blog post for more detail on the benefits of the dedicated neural network accelerator.
So if you’re at GDC this week come find us at booth 102  and see how you look after gnomeification! Why not get someone to take a pic and let us know on Twitter using #IMG_GDC18. We look forward to seeing your new look!
 

Leave a Comment

Search by Tag

Search for posts by tag.

Search by Author

Search for posts by one of our authors.

Featured posts
Popular posts

Blog Contact

If you have any enquiries regarding any of our blog posts, please contact:

United Kingdom

benny.har-even@imgtec.com
Tel: +44 (0)1923 260 511

Related blog articles

What is PowerVR Automotive? Register NOW to hear our webinar.

The automotive industry is going through many changes and that is having a huge impact on the semiconductor IP industry. The vehicle will move from being predominantly mechanical to primarily a computer on wheels enabling a future of self-driving cars,

Image-based lighting

PowerVR Tools and SDK 2018 Release 2 now available

Here’s an early Christmas present for graphics developers – the release of the latest version of our PowerVR Tools and SDK! The headline features for this release include some exciting new examples demonstrating new techniques in our SDK, and some very

on stage in China

PVRIC4 a hit at ICCAD 2018 in China

Imagination’s PVRIC4 image compression tech garnered plenty of attention at the recent ICCAD China 2018 symposium, which took place on 29th and 30th November at the Zhuhai International Convention & Exhibition Centre, China. The annual event focusses on integrated circuit

The ultimate embedded GPUs for the latest applications

Introducing PowerVR Series9XEP, Series9XMP, and Series9XTP As Benjamin Franklin once said, only three things in life are certain: death, taxes and the ongoing rapid advancement of GPUs for embedded applications*. Proving his point, this week, Imagination has once again pushed

Stay up-to-date with Imagination

Sign up to receive the latest news and product updates from Imagination straight to your inbox.

  • This field is for validation purposes and should be left unchanged.