Bob Greenberg, the founder of R/GA has a new exhibit at the Cooper Hewitt Museum of Design that opened on February 23rd 2018 and runs until September 2018.
I led a team of developers in Buenos Aires. We built an Android and iOS app that gave users more information about each item on display. It uses machine learning to detect what object the user’s phone camera was pointed at and they could tap to listen to audio tours or get more information.
As you can see from this video I took the machine learning worked REALLY well in this environment.
I was also responsible for the AV setup where we had 3 portrait displays showing video content. With two of those videos you could listen to the audio via the app which was sync’ed by a sub-audible Lisnr tone.
The app is currently in the app store and available for download although you really need to be in the exhibit to use it.