Value Sensitive Design and Responsible Innovation | Jeroen van den Hoven, 2013
Introduction
Smart electricity meters and electronical patient dossier as Dutch examples of technical designs, with many great potential benefits, that stranded in final stages of development through political rejection due to privacy and security concerns.
"A real innovative design for an electronic patient record system or a truly smart electricity meter, would thus have anticipated or pre-empted moral concerns and accommodated them into its design, reconciling efficiency, privacy, sustainability, and safety. Value-focused thinking at the early stages of development at least might have helped engineers to do a better job in this respect." (76)
"Respect for privacy can be built in (Garcia and Jacobs, 2011; Jawurek, Johns, and Kerschbaum, 2011)." (Bart Jacobs publication)
Building in values. But what values? Objections:
1) Moralism 2) Relativism
Technology cannot be value free. Therefore we must take values into account in the design process explicitly, be transparent about them, and reflect upon them to potentially change our approach.
Innovation and Moral Overload
"One is morally overloaded when one is burdened by conflicting obligations or conflicting values, which cannot be realized at the same time." (77)
What is then required is innovation in the design that is sensitive to values, to allow for a mediation. E.g. national security vs privacy --> privacy enhancing technology.
E.g. Economic growth vs sustainability -> sustainability technology.
Are these mere technological "fixes" without addressing the real moral issue?
Hoven's position:
- If there is a current moral overload (a conflict of values related to the design)
- but we can innovate, such that at a later time we find a mediating design
- Then we have the moral obligation to innovate, even if right now we do not immediately solve the conflict.
Innovation is thus a second-order moral obligation:
It construes innovation as a second-order moral obligation: the obligation to bring about a change in the world that allows us to make more of our first-order moral obligations (e.g., for security and privacy, for economic growth and sustainability, safety and security) than we could have done without the innovation (78)
Usually the "ought" of a moral obligation implies a "can", but this does not always hold in the case of innovation.
In any case a shift in thinking is required, namely that values now need to be operationalized in the design.
Values and design / Value Sensitive Design (VSD)
We should "see to it that our world of technology and innovation is the best possible expression of our shared and public values." (78)
Value Sensitive Design (VSD):
- Values can be expressed and embedded in technology. Through this incorporation they influence the affordances and constraints of users.
- E.g. large walls force you to take detours
- Thinking about what values are embedded in our designs are morally significant.
- E.g. "Churchill: first we shape our dwellings and then our dwellings start to shape us."
- E.g. choice architecture: nudge men to pee correctly in the urinal by placing an image of a fly there.
- Moral considerations need to be made clear early on in the design process because then they can still make a difference.
- This desideratum runs into the Collingridge dilemma, that states that early in the process of development of a technology the degrees of freedom for design are significant, but information that could inform design is scarce, while later on in the development of the technology, as information starts to become available, the degrees of freedom in design have diminished.
How do we deal with epistemic uncertainty? When a new technology is designed, many possible moral complications are not visible yet.
Main position (which makes a lot of sense to me):
We cannot be held responsible for not knowing what is by its very nature epistemically inaccessible. We can, however, be held responsible for not thinking about the limits of what is epistemically accessible, and for obfuscating what we know about our epistemic limits. (80)
Responsible innovation
Innovation may lead to previously unknown designs pertaining either to
- The physical world
- The conceptual world
- The institutional world
- or combinations of these
whose implementation expands possible actions, physical or cognitive.
The word "responsible" primarily pertained to a person's responsibility for his or her actions. Now it can also be used w.r.t. to impersonal events and processes, of which "responsible innovation" is a similar phrase:
“Responsible innovation” is a truncated and indirect way of referring to contexts in which people who are the appropriate subjects of responsibility claims either feel responsible, or can be held or can be made responsible. “Responsible innovation” can thus be used to refer, in the realm of innovation, to whatever invites, accommodates, stimulates, enhances, fosters, implies, or incentivizes responsible action. (81)
Responsible innovation enables (81):
1) obtaining relevant knowledge on i) consequences of outcomes and ii) the range of options open to them 2) evaluation of these outcomes and options in terms of relevant moral values (e.g. privacy or safety)
And then a third and newly suggested aspect is that responsible innovation enables
3) the use of point 1 and 2 as requirements for designing new technology etc. for the sake of moral improvement
Final definition:
"I thus suggest a core conception of responsible innovation which refers to, among other things, a transition to a new situation, and which has as its defining characteristic that it allows us to meet more obligations and honor more duties than before." (82)
Responsible Innovation is an activity or process which may give rise to previously unknown designs pertaining either to the physical world (e.g., designs of buildings and infrastructure), the conceptual world (e.g., conceptual frameworks, mathematics, logic, theory, software), the institutional world (social and legal institutions, procedures, and organization) or combinations of these, which – when implemented – “expand the set of relevant feasible options regarding solving a set of moral problems.” (82)
This distinguishes responsible innovative from "regular" innovative that simply adds more functionality; this functionality does not necessarily remove any moral problem or dilemma and does not help us do more good (in a moral sense) than before.