Posted on

Westworld and the ghosts of AI

source: lamag.com

Someday, somewhere – anywhere, unfailingly, you’ll find yourself, and that, and only that, can be the happiest or bitterest hour of your life – Pablo Neruda

Warning:  This post may contain spoilers for Westworld 1 & 2.

I was late to the Westworld party but have loved every moment of it and the follow-up conversation: If Westworld existed, a simulated Wild West populated by robots, or hosts, as they are called, would I go?

I don’t think I would, but this survey says 71% of the people they asked would. I imagine that I would feel about it the way I do about glamping. I want to love it, but the fact I pay the same amount of money for a four star hotel but have to build a fire before I can boil the kettle to make a cup of tea makes it difficult. Oooh but then at Westworld I would have a robot to do that for me.

Also, as I have said before, inasmuch as I like to think about gaming, I really just enjoy the theory of gaming so thinking about Westworld is enough for me. Westworld is like a cross between Red Dead Redemption and a reenactment. Which begs the question: What is the difference between running around a virtual world online shooting people or shooting robots in a simulated world? Your brain can’t tell you. Personally, I don’t want to go round shooting people at all, although I am very good at violence in Grand Theft Auto which is slightly worrying. We don’t hear so much about the debate on whether violent video games cause violence.  Now we hear instead a lot about how social media is the frightening thing.

Perhaps if I was invited to a Jane Austen world then I might be interested. I loved watching Austen scholar, Prof John  Mullen attend and narrate a recreation of an Austen Ball on the BBC (for which, alas, I cannot find a link). He was super compelling. He kept running up to the camera giving great insights like: Oooh the candles make it hot and the lighting romantic, and the dancing in these clothes really makes your heart flutter, I am quite sweaty and excited, etc.  I am sure he didn’t say exactly that as he is v scholarly but he did convey really convincingly how it must have felt. So, to have a proper Austenland populated by robots instead of other guests who might say spell breaking things like: Isn’t it realistic? etc., would make it a magical experience. It would be like a fabulous technological form of literary tourism.

And, that is what we are all after, after all, whether real or not, a magical shared experience. But what is that? Clearly experience means different things to different people and a simulated park allows people to have their own experience.  And, it doesn’t matter if it is real or not. If I fall in love with a robot, does it matter if it is not real? We have all fallen in love with people who turn out to be not real (at the very least they were not who we believed they were), haven’t we?

The Westworld survey I linked to also said that 35% of the people surveyed would kill a host in Westworld. I guess if I am honest, if it was a battle or something, I might like it, after all, we all have violent fantasies about what we would do to people if we could, and isn’t a simulated world a safe place to put these super strong emotions? I was badly let down last week by someone who put my child in a potentially life threatening situation. The anger I have felt since then has no limits and I am just beginning to calm down. Would I have felt better, more quickly if I had gone around shooting people in Westworld or say Pride and Prejudice and Zombies land?

Over on Quora, lots of people said that not only would they would kill a host, quite a few said they would dissect a host so that the robot knew it wasn’t real (I am horrified by this desire to torture) and nearly everyone said they would have sex with a host, one person even asked: Do they clean the robots after each person has sex with them? I haven’t seen that explained? This reminds me of Doris Lessing’s autobiography Vol 1 which has stayed with me forever. In one chapter, she describes how someone hugged her and she says something like: This was 1940s and everyone stank. It is true we get washed so much more nowadays than we used to and there was no deodorant. I lived in a house without a bathroom until I was at least four-years-old, and I am not that old. Is Westworld authentically smelly?

That said, Westworld is a fictional drama for entertainment and so the plot focuses on what gets ratings: murder, sex, intrigue, not authenticity. (It is fascinating how many murder series there are on the TV. Why? Is it catharsis? Solving the mystery?) So, we don’t really know the whole world of Westworld. Apparently, there is the family friendly section of the park but we don’t ever see it.

But, suspending our disbelief and engaging with the story of Westworld for a moment, it is intriguing that in that world where robots seem human enough for us all to debate once more what is consciousness,  humans only feel alive by satisfying what Maslow termed our deficiency needs: sex, booze, safety, shelter. For me as a computer scientist with an abiding interest in social psychology, it confirms what I have long said and blogged about, technology is an extension of us. And since most of us are not looking for self-actualisation or enlightenment, we are just hoping to get through the day, well it is only the robots and the creators of the park who debate the higher things like consciousness and immortality whilst quoting Julian Jaynes and Shakespeare.

In the blog The ghosts of AI, I looked at the ghosts : a) In the machine – is there a machine consciousness? b) In the wall – when software doesn’t behave how we expect it to. c) In sci-fi – our fears that robots will take over or humans will destroy the world with technogical advancement. d) In our minds – the hungry ghosts or desires we can never satisfy and drive us to make the wrong decisions. In its own way, Westworld does the same and that is why I was so captivated. For all our technological advancement we don’t progress much. And, collectively we put on the rose tinted glasses and look back to a simpler time and to a golden age which is why the robots wake up from their nightmare, wanting to be free and then decide that humanity needs to be eradicated.

In this blog, I was going to survey the way AI had developed from the traditional approach of knowledge representation, reasoning and search in order to answer the question: How can knowledge be represented computationally so that it can be reasoned with in an intelligent way? I was ready to step right from the Turing Test onwards to the applications of neural nets which use short and long term memory approaches, but that could have taken all day and I really wanted to get to the point.

The point: Robots need a universal approach to reasoning which means trying to produce one approach to how humans solve problems. In the past, this has led to no problems being solved unless it was made problem specific.

The first robot, Shakey at MIT, could pick up a coke can and navigate the office, but when the sun changed position during the day causing the light and shadows to change, poor old Shakey couldn’t compute and fell over. Shakey lacked context and an ability to update his knowledge base.

Context makes everything meaningful especially when the size of the problem is limited which is what weak AI does, like Siri. It has a limited task number of tasks to do with the various apps it interacts with, at your command. It uses natural language processing but with a limited understanding of semantics – try saying the old AI classic: Fruit flies like a banana and see what happens. Or: My nephew’s grown another foot since you last saw him. But perhaps not for long? There is much work going on in semantics and the web of data is trying to classify data and reason with incomplete sets, raw and rough data.

One old approach is to use fuzzy sets, and an example of that is in my rhumba of Ruths. My Ruths overlap and represent my thinking with some redundancy.

But even then, that is not enough, what we are really looking to do is how to encapsulate human experience, which is difficult to measure let alone to encapsulate because to each person, experience is different and a lot goes on in our subconscious.

The project Vicarious is hoping to model on large scale a universal approach but this won’t be the first go. Doug Lenat who created AM (Automated Mathematician),  began a similar project 30 years ago: Cyc which contains much encoded knowledge. This time, a lot of information is already recorded and won’t need encoding and our computers are much more powerful.

But, for AI to work properly we have to keep adding to the computer’s knowledge base and to do that even if the knowledge is not fuzzy,  we still need a human. A computer cannot do that nor discover new things unless we are asking the computer to reason in a very small world with a small number of constraints which is what a computer does when it plays chess or copies art or does maths. That is the reality.

There has to be a limit to the solution space, and a limit on the rules because of the size of the computer. And, for every inventive DeepMind Go move there is a million more which don’t make sense, like the computer who decided to get more points by flipping the boat around than engaging in a boat race.  Inventive, creative, sure, but not useful. How could the computer know this? Perhaps via the Internet we could link every last thing to each other and create an endless universal reasoning thing, but I don’t see how you would do that without constraints exploding exponentially, and then the whole solving process could grind to a halt, after chugging away problem solving forever, that’s if we could figure out how to pass information everywhere without redundancy (so not mesh networking, no) and get a computer to know which sources are reliable – let’s face it there’s a lot of rubbish on the Internet. To say nothing of the fact, that we still have no idea how the brain works.

The ghost in the machine and our hungry ghosts are alive and well. We are still afraid of being unworthy and that robots will take over the world,  luckily only in fiction – well the computing parts are. As for us and our feelings and yearnings, I can only speak for myself. And, my worthiness is a subject for another blog. That said, I can’t wait for Westworld series 3.

 

Posted on

Let’s talk! #broadcastsfrommybooth

I have been struggling to blog for a while now which was making me miserable as I like nothing better than to get a large cup of tea, swizzle round on my chair and tippety-tappety-talk into my computer.

So to wrestle back some sort of control over my writing, I began to talk tech over on YouTube and now I have embedded it here on a specially created Broadcast page. Ta daaa! The result is that I am feeling much happier.

The first time my girls caught me watching myself on TV and transcribing what I said, they thought it was really amazing and wanted their own channels but after a minute or so they started doing impressions of me falling asleep saying: I am very excited about technology. And, they have a point. I do sound a bit monotonous in What am I doing? but that is better than the video Our human experience on social media I seriously look like I am about to cry. It seems that I am not a natural in front of the camera.

My original idea was #broadcastsfrommybooth as I film myself in an old fireplace in my bedroom – my one fabulous go at interior design, even the carpet fitter thought I was mad – but it is a bit long to say in each video, and every word counts.

I use a Google Pixel phone. The camera is fabulous but doesn’t sound brilliant since the Pixel doesn’t allow you to use a plugin microphone, and if you change to a different camera app, the sound doesn’t really improve enough to make it worth the diminished video quality. Apparently, Pixel 3 will fix this problem but they said that about Pixel 2 and when I tested one, it didn’t seem to use the external mic. So, I will just use what I have.

I tried filming on my laptop with one of those headphone mics plugged in lying across the keyboard. It had great sound, but a terrible picture, I look like Voldemort (take a look – 1st Broadcast from the booth) so I turned off the softbox to get my nose back but then I looked like a guest on Most Haunted (check out Privacy and technology) although thankfully you can’t see up my nostrils. What is it with filming and noses? Softboxes are fabulous but it has taken ages to position them just right.

YouTube Creator Studio has lots of editing tools so you can trim your uploaded video, add notations and helpful graphics which I will do once I get my story straight. Currently, I don’t script my videos which I should do – it is a YouTube rule – but it’s a bit tricky talking about my own ideas in a couple of minutes. I just need to practice.

I manage to wear a lot of black even though that is a big no-no and try to follow the other YouTube rules like put face powder on to so as to not be shiny and distracting. I also stare right into the tiny lens and bring my energy to no one in particular which is easier said than done, believe you me.

Speaking into a tiny lens for a maximum of five minutes is very different from lecturing to computer scientists in a purpose built room for at least an hour where I get moment-by-moment feedback. However, I am enjoying the challenge. I gurn a lot and sometimes my hair looks a bit crazy though I bought a hairbrush this morning. This afternoon, I was drinking tea in between takes so my lipstick is all over the place. Yes that’s right, I look like I don’t know how to put on lipstick.

What can I say? YouTubing is much harder than it looks and I am in awe of those who make it look so great but now I have my first real subscriber over on YouTube who is not a member of my family and thinks I have useful things to say, I am inspired to talk more to my audience.

Today, I talked a lot about The Social Animal on Social Media and tomorrow I will tackle Web Design. I can’t wait!

Posted on

Sociability amongst strangers

At school pick-up one day, I walked over to a mum whose kid plays with mine. She was staring at her mobile phone not typing or speaking so it didn’t feel like I was interrupting anything when I said Hi. She looked up at me and immediately looked back down at her phone. I stood awkwardly wondering what to do next. Then another mum came over and said: Hi. Mobile phone mum looked up, immediately put her phone in her pocket, and began an animated conversation with the new mum.

Sociologist Sherry Turkle says that even a silent phone disconnects us, it indicates that any conversation can be interrupted at anytime as the phone has an equality with the now. In this way, Turkle believes that mobile technologies erode our empathy for other people.

I find this an old-fashioned view. Turkle and others are basically saying that technology is a thing outside of us, an unstoppable force over which we have no control and which carries us away to places we don’t want to go.

I beg to differ. Like Marshall McLuhan, I believe that technology is an extension of us and how we behave. And, more importantly, we can choose how to use it and we just must take responsibility for our actions. Mobile phone mum is a perfect example. She knew exactly what she was doing when she wordlessly wielded her phone at me and then put it away for the next mum.

The smartphone in and of itself is an amazing invention. It is a mini-computer which is all people could talk about wanting back in 2007 during some usability research I did for Orange. It thrills me everyday, I kid you not, to hold so powerful a device in my hand (see Augmenting Humans and Travels without my phone).

I think this is because I was fifteen years old when my parents first got a phone in our house and I’d barely gotten used to the excitement of it ringing when I went off to university to not have a phone number to give to people. I would go to the phone box if I wanted to phone someone. As a student in France I could only make a phone call if I had money and if I had remembered to go to the tabac to buy a phone card. I wonder how different life would have been, and indeed how different life is for students today, with a mobile phone and instant access to anyone.

Back then, I wandered around the world unreachable. Unless you knew my address and wrote me a letter, or you came to visit, you couldn’t contact me. Sometimes I was lonely. I spent all my time in shared spaces indoors and out, private and public (like parks and cafes, flats and universities) alone and with people, friends and strangers. In fact one time I was sat in the park in Chambéry and a friend I hadn’t seen in weeks who had moved to the Dordogne, wandered across and said: Thank God, you’re here. I was running out of places to look and was worried you’d gone away. I’ve nowhere else to stay tonight.

Feeling at home in shared spaces can be difficult and so designing public spaces to make them seem more friendly and safe and accessible remains a fascinating area of research. In Jane Jacobs’s classic book The Death and Life of Great American Cities, and Bill Hillier’s Space Syntax, the question often is: How do we make the public more sociable?

Many people think that the mobile phone is an invasion of the public by the private. Dom Joly’s I’m on the phone sketch is as funny today as it was when mobile phones were new. Similarly, last summer in the Louvre, I couldn’t get near the Mona Lisa because it had a billion people in front of it taking selfies.

Today, as I write this I think, well why not? Why not have a Mona Lisa selfie? Why not talk really loudly on your phone in public? Why not take up space and behave like you belong?

It can be hard to feel like somewhere public is familiar and friendly, but with easy connection to the Internet anywhere and anytime, people can use their phones to engage with their location by reading restaurant reviews, historical information, the locations of other people nearby, and of course by taking a selfie. There is much research into how we can redefine public spaces with mobile technology so everyone can feel familiar in a new or intimidating place but already the phone helps.

In my time as a student, wandering about Europe, I didn’t have such a luxury and as such was always at the mercy of strangers and exhausted by trying to figure out how things worked. Strange men would come and talk to me and give me their addresses if I sat in the park or on trains or when I wandered down the street. I have fond memories of the French farmer who used to jump out when I cycled past on my way to or from Bourget du Lac. He wanted me to come to his farm and meet his son: Venez, venez, madamoiselle. My mother always warned me about strange men, she was worried I would end up behind someone’s wallpaper. (Funnily enough strange women never approached me with their pockets full of written addresses. Would I have responded differently if they had?)

My first day in France, I cried on the bus. I didn’t have the right ticket because the bus worked differently to what I had expected. The driver let me on free and the next day when I was on another bus going the other way he stopped his bus when he saw me, beeped his horn and waved at me. It never occurred to me he was waving at me so half a dozen people on the bus tapped me on the shoulder to let me know it was me. Mortified, I waved back and cried again and a couple of old ladies comforted me whilst saying Oooh-la-la as I remembered how I had gotten off at the wrong stop, gotten lost, and gave up, at which point I let some random bloke take me to my home in his car. With a phone, I would have known how the ticket system worked, where to go exactly, which stop and so on, and I would have cried a lot less. Without a phone, I saw just how kind people can be to a lost and lonely girl.

In the book Mobile interfaces in Public Spaces, the authors consider the social and spatial changes in our society which have come about with mobiles phones by comparing it to the book, the Walkman and the iPod. These are all things we have used in the past to feel more at home say on a train, in a cafe, or in the park. They allows us to be present and yet go elsewhere as I have pondered in the blog Where do we go when we go online? That said, when I used to read the English paper in the park in Chambéry, it was always a day old, a male Jehovah’s Witness would regularly appear. He wanted to check the football scores in the Premier League.

There is the worry that phones are disconnecting us from the world and people around us because these interactions will no longer happen if we are too busy staring into our screens and everyone has access to the same information. But the authors above argue that mobile devices work as interfaces to public spaces and strengthen our connections to locations.

But what about our connection to people? Well! There are times when you just don’t want to be sociable or you require a different sociability, that of strangers, say who are enduring a long commute and need to carve out a space of their own whilst in a public space.

In July, I went to a talk given by Alastair Horne aka @pressfuturist at the British Library on ambient literature, in particular Keitai shousetsu, the first mobile phone fictions or Japanese cell phone novels in the noughties. They were written by young women, in the same way that they were read, on a small screen using text language, in serial form, during a commute. It was an intimate form of storytelling which led readers to give suggestions as to how the story should continue. The phone was often an integral part of the story because the writer and reader were both writing and reading in similar circumstances, exploring the story as it unfolded, and their commute became an exciting shared experience.

Interactive fiction and text adventures are not new, but their transfer to a mobile phone was and the immediacy it offers. Ten years later with better connectivity, ambient fiction is the next step. Stories are heard in a particular place and location and the phone again becomes part of the story, the shared experience and the connection.

Shared experiences and connection give our lives meaning. But, sometimes the reality of a moment or a person in a public space – like mobile mum – can really let us down, which is why I love the power of the mobile phone in my hand. It can interrupt my reality and get me through a difficult moment and onto the next. Not all strangers are kind, but from experience, especially the ones which I have shared here with you today, I can definitely tell you, the unkind phone wielding ones are absolutely in the minority – an amazing thought which will make me cry with gratitude every time. My mother always told me that I would never get through life if I cried like that all that time. I am pleased to report I have gotten through life exactly like that, yes, crying all the time. And can say, I have been shown many kindnesses and I am  immensely grateful.

Posted on

Human-Computer Interaction Conclusions: Dialogue, Conversation, Symbiosis (6)

[ 1) Introduction, 2) Dialogue or Conversation, 3) User or Used, 4) Codependency or Collaboration, 5) Productive or Experiential, 6) Conclusions]

I love the theory that our brains, like computers, use binary with which to reason and when I was an undergraduate I enjoyed watching NAND and NOR gates change state.

As humans, we are looking for a change of state. It is how we make sense of the world, as in semiotics, we divide the world into opposites: good and bad, light and dark, day and night. Then we group information together and call them archetypes and symbols to imbue meaning so that we can recognise things more quickly.

According to the binary-brain theory, our neurons do too. They form little communities of neurons that work together to recognise food, not-food; shelter, not-shelter; friends, foes; the things which preoccupy us all and are classed as deficiency needs in Maslow’s Hierarchy of Needs.

Over on researchgate, there was discussion about moving beyond binary which used this example:

Vegetarian diet vs Free Range Animals vs Battery Farmed Meat

If it was just vegetarian diet v battery farming it would be binary and an easy choice but add in free range and we see the complexities of life, the sliding continuum from left to right. We know life is complex but it is easier in decision making to just have two options, we are cognitive misers and hate using up all our brainpower. We want to see a change in state or a decision made. It also reflects the natural rhythms of life like the tide: ebb and flow, the seasons: growing and dying, it’s not just our neurons its our whole bodies which reflect the universe so patterns in nature resonate with us.

I began this series with an end in mind. As human-computer interaction (HCI) is an ever expanding subject, I wanted to pin it down and answer this question: What am I thinking these days when I think about human-computer interaction?

For me, HCI is all about the complexities of the interaction of a human and a computer, which we try to simplify in order to make it a self-service thing, so everyone can use it. But with the progress of the Internet, HCI has become less about creating a fulfilling symbiosis between human and computer, and more about economics. And, throughout history, economics has been the driving force behind technological progress, but often with human suffering. It is often in the arts where we find social conscience.

Originally though, the WWW was thought of by Tim Berners-Lee to connect one computer to another so everyone could communicate. However, this idea has been replaced by computers connecting through intermediaries, owned by large companies, with investors looking to make a profit. The large companies not only define how we should connect and what are experience should be, but then they take all our data. And it is not just social media companies, it is government and other institutions who make all our data available online without asking us first. They are all in the process of redefining what privacy and liberty means because we don’t get a choice.

I have for sometime now gone about saying that we live in an ever changing digital landscape but it’s not really changing. We live the same lives, we are just finding different ways to achieve things without necessarily reflecting whether it is progress or not. Economics is redefining how we work.

And whilst people talk about community and tribes online, the more that services get shifted online, the more communities get destroyed. For example, by putting all post office services online, the government destroyed the post office as a local hub for community, and yet at the time it seemed like a good thing – more ways to do things. But, by forcing people to do something online you introduce social exclusion. Basically, either have a computer or miss out. If you don’t join in, you are excluded which taps into so many human emotions, that we will give anything away to avoid feeling lonely and shunned, and so any psychological responsibility we have towards technology is eroded especially as many online systems are binary: Give me this data or you cannot proceed.

Economic-driven progress destroys things to make new things. One step forward, two steps back. Mainly it destroys context and context is necessary in our communication especially via technology.

Computers lack context and if we don’t give humans a way to add context then we are lost. We lose meaning and we lose the ability to make informed decisions, and this is the same whether it is a computer or a human making the decisions. Humans absorb context naturally. Robots need to ask. That is the only way to achieve a symbiosis, by making computers reliant on humans. Not the other way round.

And not everything has to go online. Some things, like me and my new boiler don’t need to be online. It is just a waste of wifi.

VR man Jaron Lanier said in the FT Out to Lunch section this weekend that social media causes cognitive confusion as it decontextualises, i,e., it loses context, because all communication is chopped up into algorithmic friendly shreds and loses its meaning.

Lanier believes in the data as labour movement, so that huge companies have to pay for the data they take from people. I guess if a system is transparent for a user to see how and where their data goes they might choose more carefully what to share, especially if they can see how it is taken out of context and used willy-nilly. I have blogged in the past how people get used online and feel powerless.

So way back when I wrote that social media reflects us rather than taking us places we don’t want to go, in my post Alone Together: Is social media changing us? I would now add that it is economics which changes us. Progress driven by economics and the trade-offs humans think it is ok for other humans to make along the way. We are often seduced by cold hard cash as it does seem to be the answer to most of our deficiency needs. It is not social media per se, it is not the Internet either which is taking us places we don’t want to go, it is the trade-offs of economics and how we lose sight of other humans around us when we feel scarcity.

So, since we work in binary, let’s think on this human v technology conundrum. Instead of viewing it as human v technology, what about human v economics? Someone is making decisions on how best to support humans with technology but each time this is eroded by the bottom line. What about humans v scarcity?

Lanier said in his interview I miss the future as he was talking about the one in which he thought he would be connected with others through shared imagination, which is what we used to do with stories and with the arts. Funny I am starting to miss it too. As an aside, I have taken off my Fitbit. I am tired of everything it is taking from me. It is still possible online to connect imaginatively, but it is getting more and more difficult when every last space is prescribed and advertised all over as people feel that they must be making money.

We need to find a way to get back to a technological shared imagination which allows us to design what’s best for all humanity, and any economic gain lines up with social advancement for all, not just the ones making a profit.

Posted on

Productive or Experiential? Human-Computer Interaction: Dialogue, Conversation, Symbiosis (5)

[ 1) Introduction, 2) Dialogue or Conversation, 3) User or Used, 4) Codependency or Collaboration, 5) Productive or Experiential, 6) Conclusions]

Recently, I met up with an old friend and as we reminisced about our university days, she wondered if I still went about asking people really nosy questions. Now, I don’t exactly remember asking people really nosy questions, but I do like things to make sense and in my experience, people like to fill in the gaps in their stories and show me things because they know I care.

That said, back in April, I was in Naples where a man came out of his booth to ask me to stop staring at his funicular. I told him that he shouldn’t have it out in public if he didn’t want me staring at it. I remain very pleased to have managed that in Italian, though I still can’t understand why he was so upset about my admiration.

Italian funicular employees aside, I still believe as I have said here many many times before, we all want to be seen, we all want to be heard, we all want to matter. We make sense of ourselves, of others, and the world around us with stories. And, we do this even if we are not trying to write software, we are doing it to tidy up ourselves and our minds.

The thing is though, I thought I went into computing to get away from humans but really all I have done in my job is gravitate towards people to ask them about their life experiences to figure out how technology could make their lives easier, faster, better.

So, I was taken by HCI Professor Brenda Laurel’s division of what software does for us. In her book Computers as Theatre, she said that there are two types of HCI :

  1. Experiential computing for fun and games.
  2. Productive computing which is measured by outcome or seriousness with implications like writing a book and transmitting knowledge.

This chimes with anthropologist Lionel Tiger’s descriptions of designing for pleasure (experiential) or designing for achievement (productive).

But, don’t we do both? If something is designed well and is pleasurable to use, doesn’t it increase our productivity? Isn’t that what Apple has been super successful at doing with aesthetics, discoverability, and user experience? And, isn’t that the point of gamification? To make not fun things fun.

I’ve always wanted to help humans harness the power of computers, to help make their lives easier by automating the grunt work to free up more time to be creative in. I know that creativity is our life force. It keeps us expanding. It keeps us young. And like, J C Licklider, I believe that the best collaboration of computing and humans is a creative one of collaboration not codependency.

I have blogged about eliciting knowledge for web design as a way to get all the information a designer might need. And, my favourite part has always been shadowing people at work. I have done this round building sites, on bridges, chemical factories, exhibition centres, architects offices and half-built apartments, steel rolling mills, print factories, and people using mobile phones . I love to see what happens a day in the life of people doing jobs I will never have the opportunity to do. I am fascinated by people.

Ever since the first time I was in charge of changing some software, which involved users needing more fields in a database, I have loved helping people with their tech. However, simple this job was, it was my first insight into seeing how the database was there to be manipulated by the user to give new insight into the information they had. Nowadays we tell stories with databases. But, the database most always serve the user not the other way round. I think we forget this sometimes.

When I worked in the field of artificial intelligence, I purposely put errors into various parts of a knowledge based system. The idea being that the test cases I wrote to find my errors should uncover other similar errors which were there inadvertently. It needed extensive training for a user to understand what the system was calculating so that code was precious and had to be error free. And, if it needed to be changed because things are always changing in the real world, it needed a computer scientist to add more code. This I didn’t like so much. This was not empowering. Here the user and computer scientist served the code, not the other way round.

Also, it was difficult to model and represent things which experts knew inherently. So, in the case of the exhibition planning, the software I worked on used a constraint solver which could easily allocate the correct sized booths with required utilities such as electricity and water, but it couldn’t easily model or reason with exhibitor A wanting to be by the door, or not near exhibitor B, without a human. This is a common problem also for dinner planning for fundraisers, so I am told. The software has to be told the nuances of human life, but you don’t want to hard code it, as it is forever changing, which is why you either need a human, or you need a super good graphical user interface otherwise it is quicker by hand.

For a while I thought 3D applications and visualisation were the way forward especially in bridges. Bridges are enormous, last a long time, and information gets lost and the data needed to understand them is extensive, so why not visualise it. I got very excited about augmented reality, to overlay a bridge with plans, original ones, proposed changes plans. It was much harder to do back then as you needed to measure and calibrate the exact camera angle with the AR software in order by hand to overlay the original view (i.e. the bridge) with all the extra information (plans, proposed changes, future behaviour). I remember being out on a bridge for ages fiddling away. However, these days it would be much easier if you use an app you have written on the phone and it’s native camera.

But still inputting new information is not easy, especially on a mobile phone in 3D. I was playing games this morning on my mobile phone and I had trouble putting pizzas in boxes using 3D direct hand manipulation. More functionality equates to more complexity and constantly changing instructions which can be clever but requiring a learning curve as it not always intuitive, but if you are having fun, like I was, then I didn’t mind the learning curve, if it’s not fun, then we all need to be aiming for simplexity.

Experience impacts productivity and why wouldn’t it? Websites and apps are are a bit like designing a self-service instrument. As a user you figure out what is going on yourself. The better and easier it is to figure it out, the more likely you come back and the more you enjoy yourself. If not you will go elsewhere, where someone is listening, who wants to hear your story, to make you feel that you count and that your experiences matter. As Danielle La Porte said:

Design is love.

And what is love if it is not the best experience? Experiential HCI makes everything better. Let’s share the love!

 

[Part 6]