On the 27th of July, Ara Institute of Canterbury Ltd announced the launch of a formal collaboration and research
partnership with global brands Bosch, Jade Software and Regensburg University.
Lead Researcher Amit Sarkar, a senior tutor within the Enterprise and Digital Innovation Department at Ara, formed the
common link between all of the global organizations.
“I wanted to look at how ‘digital assistant’ technologies can be developed for and made use of by big companies,” says
Amit, who was working at Jade while on sabbatical from Ara. He then reached out to a contact at Bosch with a video
compiled with Jade colleagues and a case study for a ‘digital barista’ that had been previously developed at Ara with
Jade. This convinced the global appliance behemoth to team up with Ara, Christchurch-based software company Jade and
another academic partner, Professor Markus Westner from OTH Regensburg .
“It’s all about collaboration and innovation; Ara has a strong partnership with OTH Regensburg, and they have a working
relationship with Bosch, while Ara also has an exceptional working relationship with Jade. During my sabbatical there, I
was tasked with finding innovative opportunities and implementing them.
So I reached out to my associate in Germany - I have previously worked with them on various projects including teaching
- so they knew our research capability, and Bosch came back almost immediately, saying “yes, we’re already working on
computer vision, text-to-speech, AI and augmented reality – but not from the concept you’re showing us!”
The concept at the heart of ‘the Internet of Things’ is the way in which humans interact with electronic systems and
objects. The Applied University of Regensburg is already offering courses in Human Computer Interaction and IoT from
within its vast Faculty of Mathematics and Computer Science, and Bosch is “constantly developing new ways of applying
connectivity that will make all aspects of life easier.” The multinational company also now offers the ‘Bosch IoT
Suite’, a software platform which has the capability to connect more than 10 million devices including vehicles,
accessways and environmental sensors, as well as being home to Bosch Software Innovations, which has created more than
250 international IoT projects.
Not to be outdone, the School of Enterprise & Digital Innovation at Ara has an impressive track record of technological inventiveness, often working with start-up
tech businesses based out of Te Õhaka, an innovation partnership based at the Christchurch city campus. In 2019, Amit
and Eduard Liebenberger, then Director of Technology at Jade Software, managed to interest second-year Bachelor of
Information and Communication Technology student Chris Wordsworth in the idea of a ‘digital barista’. The project saw
Chris and some similarly-intrigued local industry partners taking an ordinary coffee machine and turning into an
internet-enabled ‘smart’ coffee-making maestro, able to respond to individualised voice-activated orders.
During the following summer break in 2019-2020, Chris and three other students with help from Amit, Jade and Callaghan
Innovation Grants, worked with Jade to further develop ‘Bella’ the digital barista’s capabilities and also create
intelligent car parking solutions. “When my classmates came on board for the summer, we developed the augmented
intelligence side of things and the user interface, which involved working with computer vision and AI chatbots” said
Chris.
After these experiences, it was perhaps inevitable that Jade Software’s Chief Innovation Officer John Ascroft would
become a champion for the creation of the wider partnership, with Jade taking the lead in technology development while
Bosch focuses on integrating it with appliances from their product line – “waiting to see the magic” as Amit terms it.
Nick Leslie, who worked on the ‘Bella’ project, is one of the students tapped by Ara to take part in the BARJ
initiative, along with Johanna Bartko, a Master's students from OTH Regensburg. As the technology development will be
undertaken in Christchurch, Johanna will be joining the Ara team virtually.
“She will be shadowing and collaborating with us, doing some development, testing, and some UX interfacing work,” says
Amit, who notes that three students have already visited Ara from Regensburg during last semester as part of the ongoing
student exchange relationship which dates from 2017, when Amit was in Regensburg both teaching and researching.
Amit is hoping to eventually develop a working digital assistant, imagined as a LCD screen that will incorporate an
avatar with whom the customer can interact. “The technology will change speech to text, then translate that into the
hardware’s language. Users can therefore tell the device, ‘I want to increase brightness by 50% or find a recipe of
tandoori chicken’ for instance, which would be helpful when working with kitchen appliances as your hands can get pretty
messy!”
Amit sees a no-hands capability An important in a number of ways. “I think the contactless regime, begun under COVID-19,
helped to raise interest in this kind of technology - it could be used in restaurants and within homes – anywhere people
don’t want to unnecessarily touch too many surfaces. And it is also going to revolutionize the disability market space
because if someone can't manually control the device, they can easily use this by talking to them.”
He goes to say that “The larger scope of this project is to ultimately create a kind of a centralised connection hub,
where multiple appliances in households can all be controlled through the hub, via a mobile phone or other means. But
the immediate focus is creating digital interaction capabilities for individual devices or appliances, which will act as
the embodiment of the Bosch brand—a presence that will live and breathe Bosch and help countless people.”
For Ara students, the BARJ collaboration represents yet another means by which they can access professional work
experiences while studying. “For every iteration of the project, students will be involved, doing work-integrated
learning. All of our future students will be able to take advantage of stronger industry partner relationships, through
having Bosch working with us as well as Jade. Plus our academic relationship with the Applied University of Regensburg
will also be enhanced.”
The New Zealand Government recognizes the value of international collaborations such as BARJ, identifying Germany as a
key research and innovation partner, and Amit has already been approached to document existing relationships and
research with German institutions and organizations.