Taking the HyperLane with IMG A-Series

Share on linkedin
Share on twitter
Share on facebook
Share on reddit
Share on digg
Share on email

A few months back we introduced the IMG-A-Series, our latest GPU IP, packed with so much scalable, low-power graphics and compute performance we think it’s the ideal solution for a wide range of markets, from mobile, tablet and gaming to automotive, DTV and server. That’s why we called it the “GPU of Everything.”

a-series

A-Series is a significant leap forward for GPU-kind and will provide the basis for future generations of devices. To give some perspective, The Helio P95 SoC, just been announced by our friends at MediaTek is a strong mid-range chipset, featuring a PowerVR GM9446 GPU and will soon lie at the heart of some excellent, affordable devices. However, as always at Imagination, we’re looking to the future and compared to the P95, the A-Series will deliver around 2.5x the graphics performance, 8x faster AI processing or up to 60% lower power. Impressive stuff.

Originally GPUs were all about one thing, 3D graphics, and specifically fill-rate. Creating 3D triangles, calculating their position, colouring them in, processing the right ones (thank you tile-based deferred rending), and outputting them to the screen. Nowadays GPUs need to do more – it’s called “compute”. Indeed, we’ve been talking about running this on low-power GPUs for a long time.

In other words, the modern GPU needs to multi-task. To enable this, in an efficient and secure manner, we have created HyperLane Technology. Inside every A-Series, from the smallest to the very largest are eight individual hardware control lanes, each isolated in memory, enabling different tasks to be submitted to the GPU simultaneously, for fully secure GPU multitasking. It means we can have eight completely different workloads and run them simultaneously; it’s a feature that’s unique in the market.

HyperLane

Dedicated hardware to maximise utilisation

Thanks to what we call Dynamic Performance Control, we can ensure that the GPU spreads its performance across these multiple tasks, executing them all while maximising GPU utilisation. It’s a concept that’s been well explored in the desktop processor space, with one physical core appearing as multiple logical cores, with multiple tasks in flight to improve hardware utilisation and multitasking performance.

Our unique solution accelerates this with our firmware processor, which ensures that multiple graphics or compute tasks are scheduled and prioritised by the hardware with no overhead, this ensures that the GPU is fully utilised at all times, increasing real-world performance.

HyperLane for graphics and AI

Now let’s focus on some use cases to see how it might be deployed in the real world. We’ll start with the classic mobile use case in a smartphone or a tablet.

You might want to sort or categorise the images on your phone – (yes, all 14,984 of them). While half of them might be food, family, friends and pets, the other half will probably be of your face, so your device might use that GPU compute power to apply that perfect filter. Again, thanks to HyperLanes it can conduct all these tasks in the background, even if your browsing the web or using an app, with no loss of performance.

Or you might have an augmented reality game, where the physics required to locate objects in 3D space is done using GPU compute at the same time as rending the graphics, making for a much smoother user experience.

HyperLanes for security

DTV

Another great use for HyperLanes in the consumer space is the digital television market and here the advantage it brings is security. A key issue that concerns content providers is ensuring their valuable IP, be it video or audio, is secure through digital rights management, something that is vital to secure licensing agreements. While competitive GPUs offer a “TrustZone”, this is an “all your eggs in one basket” approach, with all applications residing in the single secure area. With HyperLane Technology and memory isolation, each service or application can be placed in an entirely separate, secure container, so if one application is compromised by a hack, it does not provide a back door to the content.

Surveillance

While it is a topic of some debate over privacy concerns there’s no getting away from the fact that AI is increasingly being used in surveillance. Neural networks are being used for analytics to identify suspicious body movements using models such a pose estimation. Whether its airport security or just your home doorbell, AI can cut down on a lot of false positives, by not alerting you to everything – just things such as concerning behaviour or someone coming right up to your door, rather than just walking past your house. Or AI could be used to perform image unwarping, at the same time as image analysis.

Data centre

The GPU’s ability as a highly parallel mathematical co-processor makes it is ideal for accelerating many tasks other than 3D graphics alone. Imagination GPUs today are designed to meet the requirements of compute and graphics in the cloud. A-Series GPUs will be powering cloud-based AI training and inferencing as well as the cloud gaming experiences of tomorrow. Data centres are power efficiency sensitive, so the low-power design of the A-Series makes it a great fit for such scenarios. HyperLane Technology ensures further power savings by enabling multiple tasks to be run on a single GPU instance while maximising utilisation for even greater efficiencies.

Automotive

The best modern cars use all-digital dashboards, powered by a single Imagination high-performance GPU. The main cluster delivers information that is vital for the driver, so it is critical performance is always maintained. For efficiency, other tasks, such as infotainment, or sat-nav, also run on the same GPU but at a lower priority. Imagination’s hardware virtualization technology is our industry-proven automotive solution to enable a single GPU to run all these tasks and meet quality of service requirements. We integrate our HyperLane Technology with multi-operating system virtualization to enable all these tasks from different OSs to be run on the same GPU simultaneously, using prioritisation techniques to ensure the quality of service for the main task. This means our virtualization with HyperLane Technology solution provides full isolation, for example protecting cluster data from being affected in the event of issues with other workloads.

AI Synergy

HyperLane Technology is also the basis of a new feature called AI Synergy. This powerful, flexible AI solution turns SoCs containing an Imagination A-Series GPU and our dedicated neural network accelerator into AI powerhouses. It enables AI workloads to be run on the GPU at the same time as graphics while offloading fixed-function AI to a dedicated neural network accelerator for ultimate AI performance. Look out for a blog post covering AI Synergy in more depth in the near future!

Conclusion

As we can see from all these use cases, HyperLane Technology in IMG A-Series provides SoC designs and application developers with a whole new range of options that are unique in the market. Thanks to dynamic performance control, the technology can ensure maximum GPU utilisation, along with workload prioritisation to ensure quality of service (QoS) for the prioritised task. It also delivers full hardware-based isolation, to ensure security and robustness. This makes A-Series ideal for all the markets discussed above, which is why we have called it, “The GPU of Everything”. HyperLane Technology sets it apart from other competing solutions in the market, so talk to us now to find out how it can make a difference to your next project.

Benny Har-Even

Benny Har-Even

With a background in technology journalism stretching back to the late 90s, Benny Har-Even has written for many of the top UK technology publications, across both consumer and B2B and has appeared as an expert on BBC World Business News and BBC Radio Five Live. He is now Content Manager at Imagination Technologies.

Please leave a comment below

Comment policy: We love comments and appreciate the time that readers spend to share ideas and give feedback. However, all comments are manually moderated and those deemed to be spam or solely promotional will be deleted. We respect your privacy and will not publish your personal details.

Blog Contact

If you have any enquiries regarding any of our blog posts, please contact:

United Kingdom

benny.har-even@imgtec.com
Tel: +44 (0)1923 260 511

Search by Tag

Search by Author

Related blog articles

kynisys blog

Making Kynisys: how we’re building the future of AI

Kynisys is a new AI marketplace for edge compute that offered toolsets and all the building blocks that an edge AI system integrator needs. It’s an easy-to-use platform to create, test and deploy edge AI in less than a day; putting the power in the hands of those who have to solve “edge problems”.

Read More »
Samsung Ballie CES 2020 woman

CES 2020: The robots are coming…

Coming away from CES this year one thought filled my head: the robots are coming! Having walked around the floor of this enormous show I saw enough to convince me that the 1950s vision of the robot in your house ready to do the chores isn’t quite as far-fetched as it once was. That’s not to say we’ll have C3PO or Kryten available to order next year of course; things will start a little smaller and rounder.

Read More »
CES 2020 image

CES 2020: Giant 8K screens: AI and cameras everywhere

If you’re looking for a single example of jaw-dropping tech at CES then it was hard to see past “The Wall” at the Samsung booth. I mean that quite literally. It’s so big, it’s very difficult to see past it. It’s not called “The Wall” for nothing. The Wall is Samsung’s Micro-LED display that’s 292in tall – or 3.6m high – as big as a small cinema.

Read More »

Connect

Sign up to receive the latest news and product updates from Imagination straight to your inbox.