gesture controller

9 posts / 0 new
Last post
brendon bussy
brendon bussy's picture
Joined: June 26, 2009

hi

Long time since last post, partly because I'm been struggling with rsi and related issues (long story), so have needed to curtail software time.

So, I'm now seriously researching adapting my setup for much less mouse based sound making.

Does anyone have ideas re: gesture based systems, incorporating substantial body movement that could work with AM (or similar software)? I'm particularly interested in systems which are beyond alpha development i.e. I'd like to get down to music making as soon as possible with the mimimum of fiddling (isn't good for my body).

brendon

drlids
drlids's picture
Joined: December 28, 2009

Hi Brendon, sorry to hear about the rsi. Must be painful and frustrating.

There were a couple of articles on alternate controllers in Sound on Sound recently that might be of interest, if you haven't seen them yet:

http://www.soundonsound.com/sos/dec12/articles/assistive-tech-1.htm

http://www.soundonsound.com/sos/jan13/articles/special-needs-2.htm

dl

Winstontaneous
Winstontaneous's picture
Joined: October 25, 2011

As someone who has experienced RSI I can feel your pain. Taking a number of Alexander Technique lessons and watching myself do common activities in a mirror worked wonders.

As you mention, using the larger muscle groups involved is the way to go. I also imagine a MIDI footpedal system could do a lot of tasks. Voice commands maybe?

Hope you get it sorted soon! 

brendon bussy
brendon bussy's picture
Joined: June 26, 2009

Hi dl

Wow - brilliant articles. I'm very interested in working with assistive technologies especially in an educational environment (and ironically because of my own physical issues). In fact I've been in touch with the Drake organisation in the UK (http://www.drakemusic.org/) which does inspiring work. And tied to my interest in industrial design I'd love to specialise in this kind of work. I'd imagine it to be very rewarding to assist someone who's keen to make music but physically frustrated (I can attest to some of that frustration myself!).

brendon

brendon bussy
brendon bussy's picture
Joined: June 26, 2009

Hi Winstontaneous

Appreciate the empathy. i've had issues most of my life (since teens at least) with muscle and joint issues. Have always soldiered through and done much, but getting very frustrated with it. But a positive is that I've always been forced to be innovative.

Mirror: I used a web camera for a while (image of myself in the corner of the screen) to keep track of my posture. Was useful.

Alexander: Good approach.

Large muscle groups: absolutely the way to go. In my day job I teach art and music to large groups of kids and movement has become a big part of my teaching. I want to bring that into my own performance. Have been looking at the Keith McMillen SoftStep system.

At the moment I'm making a one of these. An Xth Sense muscle sensor system. Getting finicky with linux and pd (not good for my mouse hand), but hopefully will suggest possibilities).

b

brendon bussy
brendon bussy's picture
Joined: June 26, 2009

A few interesting links from those Sound on Sound articles.

Skoog

Brain fingers

Apollo Ensemble

Mostly expensive kits but some developers are hacking mainstream devices (wii etc).

 

Ross B.
Ross B.'s picture
Joined: April 11, 2009

Hi Brendon,

I guess you saw the stuff I did with AM and wiimotes a while back (click on the images for video):

http://www.rossbencina.com/static/music/gesturesound/

Pretty much alpha stage though. Wiimotes went via max.msp => OSC => custom scripts => AudioMulch. Recenlty I've been thinking about updating the scripting system and embedding it in a releaseable AM.

Ross

Winstontaneous
Winstontaneous's picture
Joined: October 25, 2011

Interesting links, Brendon!

Ross - are you saying future versions of AM may be scriptable?

If so what language(s) are you considering?

Ross B.
Ross B.'s picture
Joined: April 11, 2009

> Ross - are you saying future versions of AM may be scriptable?

It is something I have been considering. But "scriptable" is maybe too strong. It would be a system for implementing more complex parameter mappings (MIDI and OSC)  using scripts, not a system for scripting the application.

> If so what language(s) are you considering?

Lua is the only real option. I would have liked to be able to consider JavaScript but there is nothing approaching a real-time capable JavaScript and I don't have the resources to implement a script engine from scratch.