This hands-on course will guide participants through an innovative creative workflow referred to as data materialization. The workflow begins by collecting meaningful data and culminates in the production of a designed data object. Participants will be introduced to computational design fundamentals and the foundational elements and principles of art and design. A suite of software tools will be used to realize this workflow including Processing, Inkscape, Rhino 3D and Autodesk Fusion 360.
We explore the notion of dataflow programming in realtime graphics artistic practice. We complement the previous editions of the course at SIGGRAPH Asia (2015, 2016, 2018) and SIGGRAPH (2017, 2019) to include OpenISS and PureData/GEM. First, we explore a rapid prototyping of interactive graphical applications for stage and beyond using Jitter/Max and Processing with OpenGL, shaders, and featuring connectivity with RGBD cameras. Such rapid prototyping environment is ideal for entertainment computing, as well as for artists and live performances using real-time interactive graphics on stage. We share the expertise we developed in connecting the real-time graphics with on-stage performance with the Illimitable Space System (ISS) v2 and its OpenISS core framework for creative near-realtime broadcasting, and the use of AI and HCI techniques in art.
Magnets are very useful for the rapid prototyping of haptic interactions. However, it is difficult to arrange fine and complex magnetic fields rapidly. This project presents a method for fabricating complex geometric magnetic patterns by overlaying magnetic rubber sheets. By layering multiple magnetic sheets that have proper thicknesses and simple magnetic patterns, various types of magnetic lattice patterns can be generated on the top surface. Furthermore, the superposed magnetic fields can be changed dynamically by rotating the layered magnetic sheets. We demonstrate several tactile interactions by applying the superposed magnetic fields.
2D perspective sketching is an essential tool for designers during the early stage of design. However, for products that have moving parts and take different poses during usage, 2D perspective sketching can be painstaking and time-consuming. In this interactive showcase, we present a 3D sketching system for multi-pose products. Our system lets designers easily sketch 3D curves, and part, rig, and pose them. We showcase that, with interactions that closely resemble traditional 2D perspective sketching and the physical manipulation of an articulated object, designers can quickly try many different form and movement ideas in 3D during the early stage of design.
Unlike large and dangerous industrial robots on production lines in factories that are strictly fenced off, collaborative robots are smaller and safer, and can be installed adjacent to human workers and collaborate with them. However, controlling and teaching new moves to collaborative robots can be difficult and time-consuming when using existing methods such as pressing buttons on a teaching pendant or directly grabbing and moving the robot by force (direct teaching). We present Robot Telekinesis, a novel robot-interaction technique that allows the user to remotely control the movement of the end effector of a robot arm with unimanual and bimanual hand gestures that closely resemble handling a physical object. Robot Telekinesis is as intuitive and fast as direct teaching, without the physical demands of direct teaching.