We are very happy to announce two invited presentations from distinguished professors in the field of Radar-Based Human-Computer Interaction. Prof. Moeness Amin from Villanova College of Engineering and Director of the Center for Advanced Communications and prof. Aaron Quigley from the School of Computer Science in UNSW Engineering and a Science Director and Deputy Director of CSIRO’s Data61.
A Hand Air-Writing System using MIMO Radar and Deep Learning by prof. Moeness Amin
Recently, radar-based hand gesture recognition (HGR) has gained increased attention in several applications involving contactless human-machine interaction (HMI). Air-writing, as a definite HGR, requires the real-time target positioning and trajectory tracking, followed by alphanumerical recognition via deep learning. Benefiting from the large virtual array provided by Multiple-Input Multiple-Output (MIMO) radar, this work first proposes an interferometry-based processing method to acquire the subtle range and azimuth displacements of finger motions, thus fulfilling the tracking of the alphanumerical trajectory. A ResNet50 convolution neural network (CNN) trained with the trajectory is used to recognize the correct writings. Additionally, spatial interferometry is exploited to identify multiple strokes when writing complicated characters, punctuations or words. This is achieved by utilizing the subtle elevation change induced by hand lifts among different strokes. Experimental results show that the proposed air-writing system performs rather well in sensing and tracking hand movements, achieving an averaged recognition accuracy of over 95% for different kinds of air-writings.
Radar and Camera Based Fine-grained Surface Context Awareness by prof. Aaron Quigley
The exploration of novel sensing to facilitate new interaction modalities is an active research topic in Human-Computer Interaction. Across the breadth of HCI, we can see the development of new forms of interaction underpinned by the appropriation or adaptation of sensing techniques based on the measurement of sound, light, electric fields, radio waves, biosignals etc. In this talk, Professor Quigley will delve into a range of novel radar based interactions with people use footwear for walking, running, or exercise.