Transcript Slide 1
Introduction to Scientific Knowledge, Risk and Decision Making
Dependence of Risk Evaluation and Management Upon Knowledge
The demand for knowledge: established by the uncertainty of life in the face of change Change is inevitable Therefore, situations inevitably arise in which there is no choice but to act Knowledge reduces uncertainty in taking action, and so enables more effective action
Categories of Knowledge
Differentiated by the ends to which they are put and the authentication process to which they are subject Religious or mystical knowledge Rationalistic knowledge Scientific knowledge There may be other categories of knowledge as well, but our primary interest is in scientific knowledge
A Characterization of Scientific Knowledge
A product of inquiry designed to gather and structure information in a logical form that reduces uncertainty about some segment of the world Enhances the potential of whoever possesses it to direct a course of events towards predetermined ends and goals A product of human thought
Some Minimum Requirements of Scientific Knowledge
Relevant and systematically gathered information from a content domain Foundational assumptions Imputation of a logical form or system to that information A rendering of that information in a language Organization or representation of that information in a fashion that others can recognize and understand
Risk Assessment and Risk Management: Some Preliminaries
Made coherent by high quality thought Events must be brought meaningfully within purview of the human mind Consistency with experience and reason The coherence criterion The basic tools of thought
“Tools of Thinking” About Risk Based Decision-Making: A First Cut
Our minds and our senses The conceptual apparatus of language Technology and instrumentation
Basic Tools of Thinking: The Modes of Production of Scientific Knowledge
Memory Association Pattern discernment and recognition Reason Experience Invention Experimentation Intuition
Memory
Without it, we would have to continually reinvent everything anew Necessary, but not really very dependable The magical number 7 (plus or minus two) Augmentation by documentation and computers
Association
Brain more than passive stimulus response mechanism AIso active control of the organism Control of association One of the most exciting developments in entire evolution of life on earth
Pattern Discernment and Recognition
Visual patterns (e.g. faces) Navigational patterns Cause and effect patterns Structural patterns Not always very reliable General recognition theory (Contact)
Reason
Tool for moving from one idea or belief to another, not merely by association but by “logical inference” Always begins with assumptions and/or presuppositions Requires content to process When reasoning about risk, one employs a mix of prior perceptual judgment, induction, deduction, analogy, correspondence, and/or dialectic (thesis, antithesis, synthesis) Often unreliable
Experience
Primary source of raw material from which inferences are drawn Sense experience (see, taste, smell, feel, hear) Secondhand (what we read, and are taught by parents, teachers, etc.) Imaginings, visions, dreams Not always very reliable
Invention
The venue of creativity (ideas as well as devices) Of particular importance in stipulating hypotheses, rendering interpretations, and proffering explanations.
Popper’s quote Capability for invention is rare and of extraordinary importance
Experimentation
Helps put constraints upon thought Basis for modern rational empiricism Logic stipulated in experimental design A method for selecting experience and gathering data When done well, very reliable Restricted range of application
Intuition
Basis for accepting self-evidently true propositions (e.g. Pythagorean theorem) Thoughts that appear immediately or necessarily true (e.g. we intuit the truth of a conclusion from a syllogism) Not as a rule reliable in risk evaluation
Scientific Knowledge and the Tools of Thought as the Basis for Purposive Action
Whereas a risk evaluation is an intellectual product used largely to inform a decision, risk management is about taking action (either individually, or collectively) to cope with risk “Action” is purposive behavior Scientific knowledge and the tools of thought are necessary for both risk evaluation and risk management
Action and Prediction
Human action demands prediction Prediction of the future is an operation on the past It “depends wholly upon the actual past and not in the least bit on the actual future” (Ross Ashby: “Induction, Prediction, and Decision Making in Cybernetic Systems”)
Prediction and Cognitive Fallibility
Human beings are lousy predictors, even under the best of circumstances There is always a degree of uncertainty connected with the future The weaker the data available upon which to make a prediction, the greater the precision that tends to be portrayed in order to give the data authenticity
Unanticipated Outcomes: A Partial Consequence of Cognitive Fallibility
Henry Ford, urban sprawl, the Iraq war, and global warming Guttenberg, libraries, literacy, and the cure for cancer Microchips, computer dating, computer terrorism, computer banking, and….?
The science of uncertainty
Statistics and Probability Theory
Enables assignment of different levels of confidence to predictions Prediction with large numbers of observations Prediction with sparse data General (speculative) rules about prediction
Elements of Risk/Decision Situations
Choice situations Outcomes and results The Idea of a Range of Outcomes Probabilities Hazards The dimension of time
Three Basic Categories of Choice
What to believe (e.g. the scientific evidence about global warming is worth reading) What to prefer (e.g. prefer to study Meteorology than Environmental Policy) How to act (e.g. commit to greenhouse gas reduction policy ‘A’ rather than ‘B’)
Do A 1 Do A 2 Do A 3 A Choice Situation: Three alternative feasible courses of action
The occurrence of a (hypothetical) outcome-event, with no value attached Action A ‘
O A
’ eventuates The occurrence of a (hypothetical) outcome event, evaluated (a “result”) Action A ‘O A ’ eventuates value
V A
results
The Idea of a Range of Outcomes A 1 A 2 A 3 A k O 11 Eventuates O 12 Eventuates O 13 Eventuates O 1j Eventuates O k1 Eventuates O km Eventuates
Hazards: Junctures of probabilistically conditioned uncertain outcome situations .7
‘
O
’ 1 eventuates .2
‘
O
’ 2 eventuates .1
‘
O
’ 3 eventuates
A simple risky choice (after Rescher, 1983) .01
Mishap occurs: $1000 stereo lost in shipment Buy insurance at a cost of $20 .99
All goes well: stereo arrives safely .01
Mishap occurs: $1000 stereo lost in shipment Do not insure .99
All goes well: stereo arrives safely Marginal loss: -$20 Marginal loss: -$20
Marginal loss: -$1000
Marginal loss: -$0
The Passage of Time in a Decision Situation Present (t 0 ) Future time (t 1 ) Future time (t 2 -t m ) Action A 1 The range of outcomes correlative with A 1 eventuate Deliberation of Alternatives Action A 2 The range of outcomes correlative with A 2 eventuate Action A k The range of outcomes correlative with A k eventuate |-------- Time interval 1 -----------------|----------- Time intervals 2 - m ---------|
A Warning: The Notion of a “Range of Choice”
Multiple interpretations (descriptive models) of the decision situation may be feasible Unless there are at least two feasible, actual alternatives, there is no real choice Distinction between “facing” a risk and “taking” a risk If there is no choice then risk evaluation, risk management, or any decision analysis is irrelevant
Deliberation of Alternatives (at t 0 ) : What is Necessary for Successful Action?
Deliberation (at t results 0 ) upon stipulated alternatives in terms of the range of anticipated correlative Knowledge is embedded in the system Specify all relevant alternative actions Correlate each alternative action with its range of outcomes Evaluate outcomes Success depends upon answers to four basic questions
Deliberation of Alternatives: Four Basic Questions
What are the alternative possible courses of action?
What are the outcomes that might follow from each such action?
What is the nature of the linkage between each action and the associated outcomes, and specifically what is the likelihood of each outcome given the action?
How satisfactory or agreeable is each set of outcomes specifically in terms of the objectives of the decision?
What are the Alternative Possible Courses of Action?
Invention (stipulation of alternative feasible actions) Association (e.g. of current decision situation with alternative possible actions) Experience (e.g. of “similar” situations in past) Reason (e.g. to infer that some ostensibly feasible actions are not actually feasible)
What Outcomes Might Follow from Each Such Action?
Requires prediction Heavy reliance upon pattern recognition, and especially cause and effect Memory Experience Association Intuition
What is the nature of the linkage between each action and the associated outcomes, and specifically what is the likelihood of each outcome given the action?
Requires reasoning through relationships These relationships may be physical, constitutive (definitive), comparative, influence, temporal, spatial, mathematical To thus reason explicitly one must render perceptual judgments, define terms, use different modes of inference, distinguish between true and false
How satisfactory or agreeable is each set of outcomes specifically in terms of the objectives of the decision?
Requires the assignment of value A value accepted only in the abstract, and not acted upon, will not persist In turn, action requires a knowledge base Thus, values depend upon the underlying knowledge base in society The “knowledge-dependence” of value
Brief Digression on the History of Value Theory
Classical view, value as intrinsic and substantive (Hobbes, Locke, Smith, Ricardo, Marx): “labor theory of value” Neoclassical view, value as preference (Jevons, Walrus, Menger, Marshall): “marginal utility theory” Most recent view, value as social choice: (Arrow, Hardin, Etzioni, Ostrom(s)): “game theory,” “institutional theory,” “communitarianism”
Society’s Knowledge Base
Has generic structure (same as structure of formal bodies of scientific knowledge) Obtained using same process as employed in formal bodies of scientific knowledge Deductive reasoning from foundational assumptions Foundational assumptions: Characterization of human nature, language, reasoning, and the storage and representation of information, facts, and knowledge
Characterization of Human Nature
Multiple characterizations are feasible Through roles: e.g. citizen; developer, evaluator, beneficiary (victim) of science Through attributes: competencies, limitations, cognitive burdens. e.g. homo economicus Through profiles of individual or group behavior Through constraints that limit human achievement (e.g. weak capability to form deep logic patterns, or store / process information)
Characterization of Language
Has been at heart of philosophy for over 2000 years Words are arbitrarily defined from within a culture and ordered according to a grammar and syntax that gives them meaning up and above their definitions Basic types: Prose, structural graphics, mathematics
Characterization of Reasoning Through Relationships
Deductive reasoning: from general to specific; syllogistic and non-syllogistic Inductive reasoning: from specific to general; qualitative, quantitative, crude Relations between cause (action) and effect (outcome)
Characterization of the Storage and Representation of Information, Fact, and Knowledge
History determined vs. state determined systems For a system to be history-determined, there must be a means by which past events can influence future events (physical traces of past events must be preserved in the system) Inasmuch as science may predict events in the future, there must be a way to represent and systematize related events in the past There must be data
Generic Structure of a Body of Scientific Knowledge: (Modified from Warfield, 1990) Hypothesis Methodology Theory Assumptions denotes a “steering” relationship Applications
An Implicit Postulate
Ad hoc representations of aspects of risky situations (those that cannot be embedded within some formal language from mathematics) invite errors in communication, promote vagueness and misunderstanding, severely inhibit the ability to work with large amounts of relevant information, and lead to the impression of a degree of precision that is apt to be misleading
A Definition of “Data” (Principia Cybernetica Web)
“A material unit representing information about a portion of the real world that can be processed by explicit procedures and maintains its characteristics during repeated use. (2) A fact or figure transcribed in a readable language and on a durable medium). E.g., a completed questionnaire, a taped interview, the recorded results of an experiment. Events that leave no physical marks cannot be traced through data and physical marks that can no longer be interpreted, e.g., because the code linking them to particular observations is unavailable, loose the status of data. Science typically processes large collections of data. In statistics each datum or a collection must contain the same kind of information.”
“Framing” of Decisions
Each decision maker’s cognitive processes contain propositions that are not doubted by that person: these, in part, “frame” the decision There is nothing that can be done to avoid this A “frame” heavily constrains a decision situation in a way that (hopefully) meets the needs inherent in that situation A “frame” is, in part, a model of the situation
An Environmental Frame for Risk-Based Decisions
U.S. Congress (Public law 91-516) set for the following definition of “environmental education”: “For the purposes of this Act, ‘environmental education’ means the educational process dealing with man’s relationship with his natural and manmade surroundings, and includes population, pollution, resource allocation and depletion, conservation, transportation, technology, and urban and rural planning to the total human environment.” In subsequent amendments, the topics of economics and energy were added.
An Inference from this Definition
An environmental frame for risk-based decision-making must be interdisciplinary and should aim to achieve a synthesis that stresses the interrelationships of the elements The objective is to place the learner in a position of being capable of making informed, major decisions that affect the world today
Keys to improved decision-making
Identify salient dimensions of the frames within which any given decision is being made Make these dimensions a part of the articulate repertoire of the decision-maker(s) Utilize systematic design methodology to improve the quality of thought, knowledge, and knowledge utilization Structure and utilize the interface between decision makers and computers in such a way as to enable people to better manage the way they deal with ideas.
Deliberation of Alternatives: What Models of the Decision Process are Available?
Benefit-Cost Models Multi-attribute Utility Models Multiple Criteria Models Analytical Hierarchy Process Models Interpretive Structural Models Psychological Models of Judgment and Thought (e.g. the Additive Model from Information Integration Theory, Multidimensional Scaling Models, Ideal Point Models)