The Quantified Artist: Biometric Augmented Reality
Riding the wave of connecting sensors, devices, and people, digitally augmenting live music performances can enhance the audience experience and deliver more entertainment value while generating new interest in and preserving the positive cultural impact of the performing arts. This session will introduce the "Gigitizer" concept bringing an array of multimedia capture, analysis, visualization, and interactivity enabled by emerging DIY sensor hardware and software to bear on a live in-house musical performance providing an augmented and quantified "digital backstage" view including artist biometrics, gesture tracking, live audio analytics, video reproduction, performance stats, and interactive services for a BYOD audience. Interaction design and creative technology topics will be explored in depth while opening up the hood on raw sensor processing, networking, and data visualization techniques from both biometric and environmental sources to provide a more immersive concert experience.
Additional Supporting Materials
- What interaction design and data visualization patterns become feasible and practical when instrumenting the human body with the surrounding environment?
- What new design and technology skills are necessary to effectively choreograph the interplay between physical and digital inputs and outputs?
- How to structure and combine both active and passive sensor data streams to efficiently design and build immersive experiences?
- How to prioritize and optimize sensor data for rendering an appropriate level of granularity for meaningful consumption in a real-time context?
- How to preserve and enhance the natural artistic appeal and emotional connection in digitally augmented experiences?
- Robert Tuttle frog
Robert Tuttle frog
Show me another