{"id":329,"date":"2010-03-15T22:42:26","date_gmt":"2010-03-16T03:42:26","guid":{"rendered":"http:\/\/www.tigoe.net\/blog\/?p=329"},"modified":"2010-03-15T23:14:15","modified_gmt":"2010-03-16T04:14:15","slug":"random-thoughts-on-consciousness-and-physical-experience-coming-together","status":"publish","type":"post","link":"https:\/\/www.tigoe.com\/blog\/category\/physicalcomputing\/329\/","title":{"rendered":"Random thoughts on consciousness and physical experience, coming together"},"content":{"rendered":"<p>I just had one of those <a title=\"I think the term is &quot;epiphany&quot;\" href=\"#\">wonderful moments<\/a> where a bunch of ideas that had been floating around in my head for a number of years came together and made sense, thanks to a section of Alva No\u00c3\u00ab&#8217;s book <em><a href=\"http:\/\/www.amazon.com\/gp\/product\/0809016486?ie=UTF8&amp;tag=physicalcompu-20&amp;linkCode=as2&amp;camp=1789&amp;creative=9325&amp;creativeASIN=0809016486\">Out of Our Heads: Why You Are Not Your Brain, and Other Lessons from the Biology of Consciousness<\/a><\/em>. In Chapter 4, he challenges the common metaphor for the brain as the &#8220;Mission Control&#8221; \u00c2\u00a0of the body &#8212; the place where all stimulation comes in and is noted, processed, and responded to. Instead, he says, our perception, and even our reaction, is distributed throughout our body and even through our environment. \u00c2\u00a0To counter this, he offers the example of a snail&#8217;s response to being touched. At first touch, the snail will recoil, but with repeated touches, the snail becomes habituated to the touch, and doesn&#8217;t recoil. The sensory neurons in the snail&#8217;s nervous system are linked to the motor neurons, and the response to the initial touch is to cue the motor neurons to move the snail away. \u00c2\u00a0As repeated touches occur, the snail&#8217;s nervous system learns the pattern as &#8220;normal&#8221; and the connection between the motor neurons and the sensory stimulus is lessened over time. \u00c2\u00a0There&#8217;s no central brain managing this &#8212; the change is a result of the connection between the neurons and the patterns of action in the environment in which the snail is embedded, argues No\u00c3\u00ab. It&#8217;s not just about the changing in the coupling between the sensory neurons and the motor neurons, because that change would not occur without the repeated pattern of touch that the snail encounters. \u00c2\u00a0It all happens without a &#8220;mission control&#8221; brain to process it.<\/p>\n<p><!--more--><\/p>\n<p>This idea reminded me of an argument from Tor N\u00c3\u00b8rretrander&#8217;s book <em><a href=\"http:\/\/www.amazon.com\/gp\/product\/0140230122?ie=UTF8&amp;tag=physicalcompu-20&amp;linkCode=as2&amp;camp=1789&amp;creative=9325&amp;creativeASIN=0140230122\">The User Illusion<\/a><\/em><em>.<\/em> N\u00c3\u00b8rretanders argues that we can&#8217;t possibly be conscious of all the information our sensory receptors can take in. \u00c2\u00a0 The amount of information that we can take in per second (which he derives by calculating the number of bits per neural receptor in our eyes, ears, skin, etc) is far greater than the amount of information that our consciousness can process (which he cites from psychological experiments). Instead, he argues, that all of the information we aren&#8217;t consciously aware of is <em>exformation<\/em>, and that brain filters out all of that exformation, summarizing the important details in the bits that make it to consciousness. \u00c2\u00a0Most of what we sense, he argues, we deal with outside our consciousness.<\/p>\n<p>N\u00c3\u00b8rretranders&#8217; argument has always been really interesting to me, and made a certain amount of sense, but I could never quite figure out what &#8220;outside our consciousness&#8221; meant. \u00c2\u00a0No\u00c3\u00ab&#8217;s argument finally clarifies it for me. It&#8217;s not that we are not conscious of all that sensation, it&#8217;s that our consciousness is more than the deliberative process that N\u00c3\u00b8rretranders is referring to as consciousness. No\u00c3\u00ab describes it this way:<\/p>\n<p style=\"padding-left: 30px;\">&#8220;The real problem with the intellectualist picture [of consciousness] \u00c2\u00a0is that it takes rational deliberation to be the most basic kind of cognitive operation when in fact thinking and deliberating themselves are the exercise of more basic capabilities for skillful expertise&#8221; (No\u00c3\u00ab, 2009, p.99)<\/p>\n<p>What he&#8217;s getting at is that we&#8217;ve come to believe that there&#8217;s thinking and reasoning, and then there are skill-based things that rely on &#8220;muscle memory&#8221;, like playing the guitar or riding a bike. \u00c2\u00a0But here&#8217;s the kicker: \u00c2\u00a0<strong>thinking isn&#8217;t different from any other form of practice<\/strong>. It&#8217;s something we learn to do by habit, by doing it over and over again until we&#8217;re good at it. \u00c2\u00a0We practice it if we enjoy the rewards it offers, and we don&#8217;t practice it if we find it difficult or painful with no reward.<\/p>\n<p>I don&#8217;t have a lot of physical talents. I can&#8217;t play a musical instrument, and I suck at most sports. \u00c2\u00a0I never even learned to ride a bike. \u00c2\u00a0Growing up, the rewards of physical activities never came as easily or as quickly as the rewards of practicing thinking. I get a thrill from seeing a pattern come together, and it&#8217;s not just a mental one, there&#8217;s a sense of physical well-being that I get when ideas snap into focus. \u00c2\u00a0It&#8217;s not always just mental patterns: I&#8217;ve had the same feeling when I could see a visual pattern fall into place, like a perfectly composed photo or a perfectly timed dance or movement routine. I&#8217;ve always wondered what gave other people that same feeling.<\/p>\n<p><a href=\"http:\/\/farm4.static.flickr.com\/3214\/3046949026_ff3d9317bb_b.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft\" style=\"margin: 5px;\" src=\"http:\/\/farm4.static.flickr.com\/3214\/3046949026_ff3d9317bb_m.jpg\" alt=\"\" width=\"144\" height=\"96\" \/><\/a>In recent years, I&#8217;ve developed an <a title=\"some would say obsession, others would say fetish\" href=\"#\">interest<\/a> in <a title=\"Come on, you knew I was going to get to derby, cats, or monkeys, right?\" href=\"http:\/\/www.gothamgirlsrollerderby.com\">women&#8217;s flat track roller derby<\/a>. One of the things that interests me about it is comparing my perceptions of different skaters&#8217; habits with their talk about the bout from their perspective. \u00c2\u00a0Like any athletes, they&#8217;re not deliberatively aware of all the things they do, but they are definitely conscious of what&#8217;s going on around them. It&#8217;s clear from watching, then listening to skaters, that some of the decisions they make on the track actually go through their minds, but it&#8217;s never as deliberative as, for example, \u00c2\u00a0&#8220;I&#8217;ve got to fake her out, make her block left, then pass on the right&#8221; until after the bout is over and they analyze their actions. \u00c2\u00a0Many times, I&#8217;ve heard a skate watch \u00c2\u00a0footage of herself and say, &#8220;Oh yeah, I was trying to&#8230;&#8221; (fill in the blank). \u00c2\u00a0The &#8220;Oh, yeah&#8221; is the interesting part. It comes out as if she&#8217;s experiencing the moment for the first time, but it&#8217;s not that &#8212; it&#8217;s the first time she&#8217;s thought about the moment in an abstract, rather than an embodied, way. \u00c2\u00a0What I&#8217;m arguing, and I think No\u00c3\u00ab would argue too, is that these two forms of experiencing the moment &#8212; being in it and reacting with muscle memory, and seeing it later and rationalizing the action &#8212; are both conscious experiences, but are reflections of one another. \u00c2\u00a0It&#8217;s a way of understanding consciousness that I hadn&#8217;t picked up from N\u00c3\u00b8rretranders, but makes his argument much clearer to me now.<\/p>\n<p>This makes much more sense of how we develop physical talents, for me. &#8220;Muscle memory&#8221; is a simple way of describing the neural and environmental associations that No\u00c3\u00ab describes in his illustration with the snail. It&#8217;s another take on Pavlovian association. We develop neural connections through physical repetition, and those connections are as much a part of our consciousness as the neural connections that we think of as reflection or memory. \u00c2\u00a0They&#8217;re probably not even that different physiologically, except that they might reside in the neurons distributed throughout the body instead of just in the brain.<\/p>\n<p>Interaction designers need to learn to use this, just as designers of any high-performance equipment do. \u00c2\u00a0Musical instruments are designed so that the controls are accessible and memorizable. Sports equipment is designed to be reliably graspable, and, like tools, allows players to extend their muscle power through the levers of rackets, clubs, gloves, and so forth. \u00c2\u00a0All of these things are designed to be learned by the body and used by it, with a fast transition from intellectual understanding to physical use. We don&#8217;t do this as well in interaction design, because we often get caught up in the intellectual meaning of what we&#8217;re designing. \u00c2\u00a0Perhaps we could let go of that from time to time, and think first about the physical actions people will perform when using what we make.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignleft\" src=\"http:\/\/a248.e.akamai.net\/7\/248\/2041\/1668\/as-images.apple.com\/is\/image\/AppleInc\/MB829?wid=185&amp;hei=185&amp;fmt=jpeg&amp;qlt=95&amp;op_sharpen=0&amp;resMode=bicub&amp;op_usm=0.5,0.5,0,0&amp;iccEmbed=0&amp;layer=comp\" alt=\"It's a mighty pretty mouse, alright.\" width=\"111\" height=\"111\" \/>Case in point: \u00c2\u00a0I really enjoy the scrolling on Apple&#8217;s\u00c2\u00a0<a title=\"Why is it always Apple who gets these design nuances first?  We've got to end that.\" href=\"http:\/\/store.apple.com\/us\/product\/MB829LL\/A?fnode=MTY1NDA1Mg&amp;mco=MTcyMTgwNDY\">magic mouse<\/a>. If you&#8217;ve used an iPhone, you know the way it works. Flicking your fingers up or down the mouse doesn&#8217;t just mirror your action and stop when your fingers stop. \u00c2\u00a0The scrolling has momentum, as if you&#8217;d thrown a ball. Scrolling continues for a moment after you let go, and stops immediately if you tap lightly as it&#8217;s still moving. At first it&#8217;s fun to play with, and with practice you learn to give the scroll the right amount of force to allow you to scan, and catch it where you want to end up. It&#8217;s viscerally satisfying to &#8220;throw&#8221; the scroll, and catch it right where you want it to be. \u00c2\u00a0 It&#8217;s a great example of what Don Norman talks about in <em><a href=\"http:\/\/www.amazon.com\/gp\/product\/0465051367?ie=UTF8&amp;tag=physicalcompu-20&amp;linkCode=as2&amp;camp=1789&amp;creative=9325&amp;creativeASIN=0465051367\">Emotional Design,<\/a><\/em> applied to a performance. \u00c2\u00a0Apple \u00c2\u00a0takes advantage of the pleasure that comes from learning to do an act well, and gives you the opportunity to use your new talent in a range of different devices.<\/p>\n<p><a href=\"https:\/\/tigoe.com\/blog\/wp-content\/uploads\/2010\/03\/shot1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-thumbnail wp-image-336 alignright\" style=\"margin: 5px;\" title=\"shot\" src=\"https:\/\/tigoe.com\/blog\/wp-content\/uploads\/2010\/03\/shot1-150x150.png\" alt=\"\" width=\"120\" height=\"120\" \/><\/a>This doesn&#8217;t just have to apply to hardware design. \u00c2\u00a0<a href=\"http:\/\/www.panic.com\">Panic<\/a> does this well in software design too. Like many code editors, their <a href=\"http:\/\/www.panic.com\/coda\/\">Coda<\/a> programming editor highlights matching parentheses and brackets, but Coda does so with a pleasant ripple animation that catches your eye at first, and blends into the background eventually. It&#8217;s more noticeable than a static highlight, but not so noticeable that you focus on it. \u00c2\u00a0It works in the periphery. You&#8217;re conscious of it, but with the sensory part of your consciousness, not the deliberative part. \u00c2\u00a0You end up with a visual awareness of the edges of the block of code you&#8217;re working on that&#8217;s wider than where your attention may be.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignleft\" style=\"margin: 5px;\" src=\"http:\/\/www.inhabitat.com\/wp-content\/uploads\/bklyndesigns2009_51.jpg\" alt=\"\" width=\"322\" height=\"186\" \/>Lately, I&#8217;ve been working on a stool or standing up, because it&#8217;s easier for me to think while moving my body more. I haven&#8217;t seen any design outside <a title=\"I love this stool by Evan Dewhirst.  Wish I could afford it.\" href=\"http:\/\/www.inhabitat.com\/2009\/05\/11\/bklyn-designs-best-student-design\/\">furniture design<\/a> that takes advantage of this for knowledge workers, but I&#8217;d like to. If you see any, please let me know.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I just had one of those wonderful moments where a bunch of ideas that had been floating around in my head for a number of<\/p>\n<div class=\"more-link-wrapper\"><a class=\"more-link\" href=\"https:\/\/www.tigoe.com\/blog\/category\/physicalcomputing\/329\/\">Continue reading<span class=\"screen-reader-text\">Random thoughts on consciousness and physical experience, coming together<\/span><\/a><\/div>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14,10,3],"tags":[69,71,70],"class_list":["post-329","post","type-post","status-publish","format-standard","hentry","category-books","category-interactiondesign","category-physicalcomputing","tag-embodied-cognition","tag-furniture","tag-roller-derby","entry"],"_links":{"self":[{"href":"https:\/\/www.tigoe.com\/blog\/wp-json\/wp\/v2\/posts\/329"}],"collection":[{"href":"https:\/\/www.tigoe.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tigoe.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tigoe.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tigoe.com\/blog\/wp-json\/wp\/v2\/comments?post=329"}],"version-history":[{"count":11,"href":"https:\/\/www.tigoe.com\/blog\/wp-json\/wp\/v2\/posts\/329\/revisions"}],"predecessor-version":[{"id":342,"href":"https:\/\/www.tigoe.com\/blog\/wp-json\/wp\/v2\/posts\/329\/revisions\/342"}],"wp:attachment":[{"href":"https:\/\/www.tigoe.com\/blog\/wp-json\/wp\/v2\/media?parent=329"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tigoe.com\/blog\/wp-json\/wp\/v2\/categories?post=329"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tigoe.com\/blog\/wp-json\/wp\/v2\/tags?post=329"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}