Collingridge Dilemma

Seems to be defined (for the first time?) in the "Report on Ethical Issues Raised by Emerging Sciences and Technologies" by Roger Strand and Matthias Kaiser:

Research and innovation represent two sectors of society that are particularly difficult to govern. There are two reasons for this. First, competent governance of the societal implications of science and technology may require knowledge and understanding of the content of the same science and technology. As the research forefront moves with accelerating pace, such knowledge and understanding may be difficult to obtain. Secondly, these sectors are by their definition creators of novelty, surprise and unpredictability. A famous jazz musician, when asked by a journalist, is supposed to have responded “If I knew the jazz of the future, I’d play it”8. This paradox is equally applicable to science, research and innovation. In the regulation and governance of technology a variant of this paradox was called the “Collingridge dilemma”: The implementation of technology into society is a complex, open-ended and unpredictable process, and risks and side-effects cannot always be anticipated. When the risks and side-effects finally are known, they are known because they are being experienced; and by that time they may be virtually irreversible due to their magnitude or their entrenchment into societal infrastructures or human culture. The private car is an excellent example of the Collingridge dilemma. (12-13)

Essentially, the Collingridge dilemma states that you can only make good decisions and foresee the consequences of a technology when a technology is matured, but that at that point your ethical reflections are barely effective because the design process has already strongly converged or is even completed.

It addresses the difficulty of the question when ethical reflection in a design process is most effective.