Policy Analysis of Multi-Actor Systems - 2nd edition

Authors

Bert Enserink, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands; Wil Thissen, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands; Tineke Ruijgh, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands; Jan Kwakkel, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands; Joop Koppenjan, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands; Rens Kortmann, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands; Leon Hermans, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands; Els van Daalen, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands; Pieter Bots, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands; Jill Slinger, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands

Keywords:

problem structuring, systems analysis , actor analysis, uncertainty

Synopsis

Policy of Multi-Actor Systems is an introduction into the art of craft of problem exploration and problem structuring. It positions policy analysis as a scientific discipline focused on systems analysis in a multi-actor context to support better informed decision-making. The approach presented in this book is considered to be the cornerstone of the curricula of the Faculty of Technology, Policy and Management of Delft University of Technology and underlies the research on (the governance of) socio-technical systems. Systems thinking applied in a multi-actor environment and its inherent multi-disciplinary character is what makes this work stand out from traditional hard- and soft systems approaches. The core of the book is dedicated to systems analysis, actor- or stakeholder-analysis and discusses methods for dealing with uncertainty. These analytical activities combined lead to a rich problem description and to plans for further research. Due to the stepwise approach this book serves as a basis for any problem analysis both for our bachelor and master students, our alumni worldwide and any interested practitioners.

Downloads

Download data is not yet available.

Author Biographies

Leon Hermans, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands

Leon Hermans works as associate professor on water and environmental policy analysis at TU Delft, Faculty of Technology, Policy and Management, as well as with IHE Delft, an academic institute for water education and research under the auspices of UNESCO.

Research interests are monitoring, evaluation and learning to support adaptive delta management and water-related transformations to sustainability. This is combined with a longer-standing interest in the use of actor and strategy models for water governance and strategic planning. Leon is (co-)leading projects on transformative and adaptive planning in the water sector, nature-based solutions, evaluation of water partnerships, and water allocation and rights.

Teaching includes courses on policy analysis in multi-actor systems, actor and strategy models, and water policy and partnerships. In addition to on-campus courses, also online courses are an important part of teaching, including an online programme on Water Strategy and Planning jointly offered by TU Delft and IHE Delft.

Leon obtained a PhD degree in Policy Analysis from TU Delft. After his PhD, he worked for a few years for the Food and Agriculture Organization of the United Nations, before continuing his academic career in Delft.

Jill Slinger, Department of Multi Actor Systems, Faculty of Technology, Policy and Management, Delft University of Technology, The Netherlands

Jill Slinger is a transdisciplinary scientist and teacher in environmental systems modelling, engineering and policy analysis at Delft University of Technology. She also an honorary visiting professorship at Rhodes University, South Africa and is an office bearing member of the interational Scientific Committee for Problems of the Environment (SCOPE). Her research expertise rests on excellence in (i) field-based knowledge of aquatic systems, (ii) mathematical modelling, (iii) intervention methods and (iv) participatory engagement with communities, scientists, policy makers and the private sector. She publishes in water, coastal, environmental science, policy, planning and engineering journals, and holds the position of Editor in Chief of the transdisciplinary journal Environmental Development. Currently, her research activities focus on using ecosystem-based design knowledge in supporting transdisciplinary interactions between people, science and policy in river and coastal systems – a co-design approach to planning and management.

References

Ackoff, R. L. (1974). The Art of Problem Solving. New York: Wiley.

Ammenwerth, E., Iller, C. & Mansmann, U. (2003). Can Evaluation Studies Benefit from Triangulation? A Case Study. International Journal of Medical Informatics, 70(2-3), 237-248. https://doi.org/10.1016/S1386-5056(03)00059-5

Axelrod, R. (Ed.) (1976). Structure of Decision. The Cognitive Maps of Political Elites. Princeton: Princeton University Press.

Bardach, E. (2000). A Practical Guide for Policy Analysis: The Eightfold Path to More Effective Problem Solving. New York: Chatham House Publishers.

Barreteau, O., Bots, P. W. G. & Daniell, K. A. (2010). A Framework for Clarifying "Participation" in Participatory Research to Prevent Its Rejection for the Wrong Reasons. Ecology and Society, 15(2), 1-22. https://doi.org/10.5751/ES-03186-150201

Bartholomew, E. & Kwakkel, J. H. (2020). On Considering Robustness in the Search Phase of Robust Decision Making: A Comparison of Many-Objective Robust Decision Making, Multi-Scenario Many-Objective Robust Decision Making, and Many Objective Robust Optimization. Environmental Modelling & Software, 127, 104699. https://doi.org/10.1016/j.envsoft.2020.104699

Beers, P. J. & Bots, P. W. G. (2009). Eliciting Conceptual Models to Support Interdisciplinary Research. Journal of Information Science, 35(3), 259-278. https://doi.org/10.1177/0165551508099087

Bell, W. (1997). Foundations of Futures Studies: Human Science for a New Era. Volume 1, History, Purposes, and Knowledge. New Brunswick: Transaction Publishers.

Bennet, P., Cropper, S. & Huxham, C. (1989). Modelling Interactive Decisions: The Hypergame Focus. In: Rosenhead, J. (Ed.), Rational Analysis for a Problematic World (pp. 283-314). Chichester: John Wiley & Sons.

Binder, C. R., Hinkel, J., Bots, P. W. G. & Pahl-Wostl, C. (2013). Comparison of Frameworks for Analyzing Social-Ecological Systems. Ecology and Society, 18(4), 26. https://doi.org/10.5751/ES-05551-180426

Bots, P. & Van Daalen, E. (2007). Functional Design of Games to Support Natural Resource Management Policy Development. Simulation & Gaming, 38(4), 512-532. https://doi.org/10.1177/1046878107300674

Bots, P. W. G., van Twist, M. J. W. & van Duin, J. H. R. (2000). Automatic Pattern Detection in Stakeholder Networks. In J. F. Nunamaker & R. H. Sprague (Eds.), Proceedings HICSS-33.Los Alamitos: IEEE Press.

Bougon, M. G., Baird, N., Komocar, J. M. & Ross, W. 1990. Identifying Strategic Loops: The Self-Q Interviews. In: A. S. Huff (Ed.), Mapping Strategic Thought. Chichester: John Wiley & Sons.

Brewer, G. D. & DeLeon, P. (1983). The Foundations of Policy Analysis. Homewood: Dorsey Press.

Brill, J., Bishop, M. & Walker, A. (2006). An Investigation into the Competencies Required of an Effective Project Manager: A Web-based Delphi Study. Educational Technology Research & Development, 54(2), 115-140 https://doi.org/10.1007/s11423-006-8251-y

Bronk, K. C. (2012). The Exemplar Methodology: An Approach to Studying the Leading Edge of Development. Psychology of Well-Being: Theory, Research and Practice, 2(5). https://doi.org/10.1186/2211-1522-2-5

Brugha, R. & Varvasovszky, Z. (2000). Stakeholder Analysis: A Review. Health Policy and Planning, 15(3), 239-246. https://doi.org/10.1093/heapol/15.3.239

Bryson, J. M. (2004). What to Do When Stakeholders Matter. Stakeholder Identification and Analysis Techniques. Public Management Review, 6(1), 21-53. https://doi.org/10.1080/14719030410001675722

Checkland, P. (1985). A Development of Systems Thinking for the 1990s. Journal of the Operational Research Society, 36(9), 757-767. https://doi.org/10.1057/jors.1985.141

Checkland, P. (1985). From optimizing to learning: A Development of Systems Thinking for the 1990s. Journal of the Operational Research Society, 36(9), 757-767. https://doi.org/10.1057/jors.1985.141

Checkland, P. B. (1985). Formulating Problems for Systems Analysis. In H. J. Miser & E. S. Quade (Eds.), Handbook of Systems Analysis. Overview of Uses, Procedures, Applications, and Practice. Elsevier Science Ltd., ISBN: 9780444009180. pp.9-48

Churchman, C. W. (1971). The Design of Inquiring Systems: Basic Concepts of Systems and Organization. New York: Basic Books, Inc.

Cobb, R. W. & Elder, C. D. (1983). Participation in American Politics. The Dynamics of Agenda-Building. Baltimore: John Hopkins University Press.

Cohen, M. D., March, J. G. & Olsen, J. P. (1972). A Garbage Can Model of Organizational Choice. Administrative Science Quarterly, 17(1), 1-25. https://doi.org/10.2307/2392088

Cole, Z.D., Donohoe, H.M. & Stellefson, M.L. (2013) Internet-Based Delphi Research: Case Based Discussion. Environmental Management 51, 511-52 https://doi.org/10.1007/s00267-012-0005-5

Coleman, J. S. (1990). Foundations of Social Theory. Cambridge: Harvard University Press.

Colquhoun, H. L., Levac, D., O'Brien, K. K., Straus, S., Tricco, A. C., Perrier, L., Kastner, M. & Moher, D. (2014). Scoping Reviews: Time for Clarity in Definition, Methods, and Reporting. Journal of Clinical Epidemiology, 67(12), 1291-1294. https://doi.org/10.1016/j.jclinepi.2014.03.013

Daalen, C.E. van & Bots, P.W.G. (2010). Using a Systems Perspective to Design a Problem Solving Process. Journal of Design Research, 8, 301-316. https://doi.org/10.1504/JDR.2010.035674

de Bruijn, H. & Porter, A. L. (2004). The Education of a Technology Policy Analyst - to Process Management. Technology Analysis & Strategic Management, 16(2), 261-274. https://doi.org/10.1080/09537320410001682919

De Bruijn, H. & Porter, A. L. (2004). The Education of a Technology Policy Analyst - to Process Management. Technology Analysis & Strategic Management, 16(2), 261-274. https://doi.org/10.1080/09537320410001682919

de Bruijn, H. (2019) The Art of Political Framing How Politicians Convince Us That They Are Right. Amsterdam University Press, Amsterdam. https://doi.org/10.5117/9789463721127

de Bruijn, H., Heuvelhof, E. ten & Veld, R. in 't (2002). Process Management. Why Project Management Fails in Complex Decision Making Processes. Boston: Kluwer Academic Publishers. https://doi.org/10.1007/978-1-4613-0237-7

De Vaus, D. (2001). Research Design in Social Research. London: Sage. https://doi.org/10.4135/9781446263495

Douglas, M. & Wildavsky, A. (1982). Risk and Culture: An Essay on the Selection of Technical and Environmental Dangers. Berkeley: University of California Press. https://doi.org/10.1525/9780520907393

Dunn, W. N. (1981). Public Policy Analysis: An Introduction. New York: Prentice-Hall.

Dunn, W. N. (1994). Public Policy Analysis: An Introduction. Englewood Cliffs: Prentice Hall.

Durning, D. (1993). Participatory Policy Analysis in a Social Service Agency: A Case Study. In: Journal of Policy Analysis and Management v12 n2 (19930401): 297-322 https://doi.org/10.2307/3325237

Eckert, E. & Kovalevska, O. (2021). Sustainability in the European Union: Analyzing the Discourse of the European Green Deal. Journal of Risk and Financial Management, 14(2), 80. https://doi.org/10.3390/jrfm14020080

Eden, C., & Ackermann, F. (1998). Making Strategy: The Journey of Strategic Management. London: Sage Publications. https://doi.org/10.4135/9781446217153

Enserink, B. & Koppenjan, J. (2007). Public Participation in China: Sustainable Urbanization and Governance. Management of Environmental Quality: An International Journal, 18(4), 459-474. https://doi.org/10.1108/14777830710753848

Enserink, B. (1993). Influencing Military Technological Innovation. Delft: Eburon.

Enserink, B. (1993). Influencing Military Technological Innovation: Socio-Technical Networks and the Development of the Supersonic Bomber. Delft: Eburon.

Enserink, B. (2000). Building Scenarios for the University. International Transactions in Operational Research, 7(6), 569-584. https://doi.org/10.1111/j.1475-3995.2000.tb00217.x

Enserink, B. (2004). Thinking the Unthinkable - the End of the Dutch River Dike System? Exploring a New Safety Concept for the River Management. Journal of Risk Research,7(7-8), 745-758. https://doi.org/10.1080/13669870210166185

Enserink, B. (2005). Public Participation in Dutch Watermanagement: Pragmatism in Meeting EU Requirements. In P. H. Feindt & J. Newig (Eds.), Partizipation, Öffentlichkeitsbeteiligung, Nachhaltigkeit. Perspektiven der politischen Ökonomie(pp. 203-227) (Ökologie und Wirtschaftsforschung, Band 62). Marburg: Metropolis Verlag.

Enserink, B., Hermans, L., Kwakkel, J., Thissen, W., Koppenjan, J. & Bots, P. (2010). Policy Analysis of Multi-Actor Systems. Den Haag: Boom/Lemma.

Enserink, B., van Bemmelen, I. & Kuiper, O. (2000). RivierenLand Ex-ante evaluatie van het Transitieproces - een scenariostudie. Rapport aan de Dienst Weg- en Waterbouwkunde, Directoraat-Generaal Rijkswaterstaat, Ministerie van Verkeer en Waterstaat.

Epstein, J. M. & Axtell, R. L. (1996). Growing Artificial Societies: Social Science From the Bottom Up. Washington: Brookings Institution Press. https://doi.org/10.7551/mitpress/3374.001.0001

Fecher, B. & Hebing, M. (2021) How Do Researchers Approach Societal Impact? PLoS ONE,16(7), e0254006. https://doi.org/10.1371/journal.pone.0254006

Findeisen, W. & Quade, E. S. (1985). The Methodology of System Analysis: An Introduction and Overview. In H. J. E. Miser & E. S. Quade (Eds.), Handbook of Systems Analysis, part I. Overview of Uses, Procedures, Applications, and Practice(pp. 117-150). Amsterdam: Elsevier Science Publishing

Forrester, J. W. (1961). Industrial Dynamics. Cambridge, MA: MIT Press.

Fraser, N. M. & Hipel, K. W. (1984). Conflict Analysis: Models and Resolutions. New York: North-Holland.

Freeman, R. E. (1984). Strategic Management. A Stakeholder Approach. Boston: Pitman Publishing Inc.

Frost, P. A. (1979). Proxy Variables and Specification Bias. The Review of Economics and Statistics, 61(2), 323-325. https://doi.org/10.2307/1924606

Fujimura, J. H. (1987). Constructing 'Do-able' Problems in Cancer Research: Articulating Alignment. Social Studies of Science, 17(2), 257-293. https://doi.org/10.1177/030631287017002003

Funtowicz, S. O., & Ravetz, J. R. (1990). Uncertainty and quality in science for policy(Vol. 15). Springer Science & Business Media. https://doi.org/10.1007/978-94-009-0621-1

Garcia-Mata, C. & Schaffner, F. I. (1934). Solar and Economic Relationships: A Preliminary Report. Quarterly Journal of Economics, 49, 47. https://doi.org/10.2307/1883875

Ginsburgh, V. & Keyzer, M. (2002). The Structure of Applied General Equilibrium Models. Cambridge, MA: MIT Press.

Glaser, B. G. & Strauss, A. L. (1999) The Discovery of Grounded Theory: Strategies for Qualitative Research. New York: Routledge.

Glenn, J. C., Gordon, T. J., & Florescu, E. (2008). 2008 State of the Future. World Federation of United Nations Association., https://www.millennium-project.org/publications-2-3

Gold, R., Whitlock, E. P., Patnode, C. D., McGinnis, P. S., Buckley, D. I. & Morris, C. (2013). Prioritizing Research Needs Based on a Systematic Evidence Review: A Pilot Process for Engaging Stakeholders. Health Expectations, 16, 338-350. https://doi.org/10.1111/j.1369-7625.2011.00716.x

Goulet Coulombe, P. & Göbel, M. (2021). On Spurious Causality, CO2, and Global Temperature. Econometrics, 9, 33. https://doi.org/10.3390/econometrics9030033

Greenwood, R., Raynard, M., Kodeih, F., Micelotta E. R. & Lounsbury, R. (2011). Institutional Complexity and Organizational Responses. The Academy of Management Annals, 5(1), 317-371. https://doi.org/10.5465/19416520.2011.590299

Gregory, R. & Keeney, R. L. (1994). Creating Policy Alternatives using Stakeholder Values. Management Science, 40(8), 1035-1048. https://doi.org/10.1287/mnsc.40.8.1035

Grimble, R. & Chan, M. (1995). Stakeholder Analysis for Natural Resource Management in Developing Countries. Some Practical Guidelines for Making Management More Participatory and Effective. Natural Resources Forum, 19(2), 113-124. https://doi.org/10.1111/j.1477-8947.1995.tb00599.x

Guess, G. M. & Farnham, P. G. (2000). Cases in Public Policy Analysis. Washington: Georgetown University Press.

Haasnoot, M., Kwakkel, J. H., Walker, W. E. & Maat, J. (2013). Dynamic Adaptive Policy Pathways: A Method for Crafting Robust Decisions for a Deeply Uncertain World. Global Environmental Change, 23(2), 485-498. https://doi.org/10.1016/j.gloenvcha.2012.12.006

Haasnoot, M., Kwakkel, J. H., Walker, W. E. & Ter Maat, J. (2013). Dynamic Adaptive Policy Pathways: A Method for Crafting Robust Decisions for a Deeply Uncertain World. Global Environmental Change, 23(2), 485-498. https://doi.org/10.1016/j.gloenvcha.2012.12.006

Hanf, K. & Scharpf, F. W. (1978). Inter-Organizational Policy Making. Thousand Oaks: Sage Publications.

Hendriks, F. & Toonen, T. A. J. (Eds.) (2001). Polder Politics: The Re-Invention of Consensus Democracy in the Netherlands (reissued 2018 by Routledge, London). https://doi.org/10.4324/9781315203164

Hérivaux, C., Vinatier, F., Sabir, M., Guillot, F. & J. D. Rinaudo (2021). Combining Narrative Scenarios, Local Knowledge and Land-Use Change Modelling for Integrating Soil Erosion in a Global Perspective. Land Use Policy, 105, 105406. https://doi.org/10.1016/j.landusepol.2021.105406

Hermans, L. M. & Cunningham, S. W., with contributions by M. de Reuver and J. S. Timmermans (2018). Actor and Strategy Models. Practical Applications and Step-Wise Approaches. Hoboken, NJ: John Wiley & Sons. https://doi.org/10.1002/9781119284772

Hermans, L. M. & Thissen, W. A. H. (2009). Actor Analysis Methods and Their Use for Policy Analysts. European Journal of Operational Research, 196(2), 808-818. https://doi.org/10.1016/j.ejor.2008.03.040

Hermans, L. M. (2005). Actor Analysis for Water Resources Management. Putting the Promise into Practice. Delft: Eburon.

Hermans, L. M., Beroggi, G. E. G. & Loucks, D. P. (2003). Managing Water Quality in a New York City Watershed. Journal of Hydroinformatics, 5(3), 155-168. https://doi.org/10.2166/hydro.2003.0012

Hewson, C. J. (2003). What Is Animal Welfare? Common Definitions and Their Practical Consequences. The Canadian Veterinary Journal, 44(6), 496-499.

Hinkel, J., Bots, P. W. G. & Schlüter, M. (2014). Enhancing the Ostrom Social-Ecological System Framework Through Formalization. Ecology and Society,19(3), 51. https://doi.org/10.5751/ES-06475-190351

Hipel, K. W., Fang, L. & Kilgour, D. M. (2008). Decision Support Systems in Water Resources and Environmental Management. Journal of Hydrologic Engineering, 13(9), 761-7 70. https://doi.org/10.1061/(ASCE)1084-0699(2008)13:9(761)

Hogwood, B. W. & Gunn, L. A. (1984). Policy Analysis for the Real World. Oxford: Oxford University Press.

Hoogerwerf, A. (1987). De levensloop van problemen: definiëring, precisering en oplossing. Beleidswetenschap, 1, 159-181.

Hoogerwerf, A. (1987). De levensloop van problemen: definiëring, precisering en oplossing. Beleidswetenschap, 1, 159-181.

Hoogerwerf, A. (1992). Het ontwerpen van beleid. Een handleiding voor de praktijk en resultaten van onderzoek. Alphen a/d Rijn: Samsom HD Tjeenk Willink.

Hoogerwerf, A. (red.) (1998). Het ontwerpen van beleid. Een handleiding voor de praktijk en resultaten van onderzoek. Alphen a/d Rijn: Samsom H.D. Tjeenk Willink.

Howard, N. (1971). Paradoxes of Rationality: Theory of Metagames and Political Behavior.Cambridge, MA: The MIT Press.

Howard, N. (1989). The Manager as Politician and General: The Metagame Approach to Analysing Cooperation and Conflict. In Rosenhead, J. (Ed.), Rational Analysis for a Problematic World (pp. 239-261). Chichester: John Wiley & Sons.

Hsu, A. & Zomer, A. (2016). Environmental Performance Index. Wiley StatsRef: Statistics Reference Online, 1-5. https://doi.org/10.1002/9781118445112.stat03789.pub2

Jackson, M. C. (1992). Systems Methodology for the Management Sciences. Boston: Kluwer Academic Publishers.

Jann, W. & Wegrich, K. (2017). Theories of the Policy Cycle. In: F. Fischer, G. J. Miller & M. S. Sidney (Eds.), Handbook of Public Policy Analysis. Theory, Politics, and Methods. Boca Raton, FL. Taylor & Francis Group (pp. 43-62). https://doi.org/10.1201/9781420017007.pt2

Jaworski, J. (1996). Synchronicity. The Inner Path of Leadership. San Francisco: Berrett-Koehler Publishers.

Jobert, B. (1989). The Normative Frameworks of Public Policy. Political Studies, 37, 376-386. https://doi.org/10.1111/j.1467-9248.1989.tb00277.x

Johnson, G., Scholes, K. & Whittington, R. (2005). Exploring Corporate Strategy. Essex: Prentice Hall/Financial Times.

Keeney, R. (1992). Value-focused Thinking. A Path to Creative Decision Making. Cambridge, MA: Harvard University Press.

Keeney, R. L. & Raiffa, H. (1977). Conflicting Objectives in Decisions. Chichester: John Wiley & Sons.

Keeney, R.L. (1992). Value-Focused Thinking. A Path to Creative Decisionmaking. Cambridge, MA: Harvard University Press.

Kenis, P. & Schneider, V. (1991). Policy Networks and Policy Analysis: Scrutinizing a New Analytical Toolbox. In Marin, B., Mayntz, R. (Eds.), Policy Networks. Empirical Evidence and Theoretical Considerations. Frankfurt am Main: Campus Verlag.

Kim, Y. & Chung, E. S. (2014) An Index-Based Robust Decision Making Framework for Watershed Management in a Changing Climate. Science of the Total Environment, 473-474, 88-102 https://doi.org/10.1016/j.scitotenv.2013.12.002

Kingdon, J. W. (1984/1995). Agendas, Alternative and Public Policy. Boston: Little, Brown and Company.

Kingdon, J. W. (1984/1995). Agendas, Alternative and Public Policy. Boston: Little, Brown and Company.

Klijn, E. & Koppenjan, J. (2014) Complexity in Governance Network Theory. Complexity, Governance & Networks, 1(1). https://doi.org/10.7564/14-CGN8

Klijn, E. H. & Koppenjan, J. (2016). The Shift toward Network Governance: Drivers, Characteristics and Manifestations. In Klijn, E.H., & Koppenjan, J. (2016) Theory and Practice of Public Sector Reform (pp. 158-177). Routledge, London. https://doi.org/10.4324/9781315714141-11

Klijn, E. H. (1997). Policy Networks: An Overview. In W. J. M. Kickert, E. H. Klijn & J. F. M. Koppenjan (Eds.), Managing Complex Networks. Strategies for the Public Sector (pp. 14-34). Thousand Oaks: Sage. https://doi.org/10.4135/9781446217658.n2

Knight, F.H. (1921) Risk, Uncertainty and Profit. Boston and New York, Houghton Mifflin Company

Knott, J. & Wildavsky, A. (1980). If Dissemination Is the Solution, What Is the Problem? Knowledge: Creation, Diffusion, Utilization, 4, 537-578. https://doi.org/10.1177/107554708000100404

Kok, W. (1981). Signalering en Selectie. Achtergrondstudie nr. 3, uitgebracht aan de Commissie Hoofdstructuur Rijksdienst, Den Haag.

Koppenjan, J. & Klijn, E. (2004). Managing Uncertainties in Networks. New York and London: Routledge. https://doi.org/10.4324/9780203643457

Koppenjan, J. F. M. (1990). Definiëring van complexe problemen door de overheid: balanceren tussen ruim en precies. Beleidswetenschap, 4(1), 21-45.

Koppenjan, J. F. M. (1993). Management van de beleidsvorming. Een studie naar de totstandkoming van beleid op het terrein van het binnenlands bestuur. Den Haag: VUGA.

Korbee, D., Nguyen, H. Q., Hermans, L. M. & Phi, H. L. (2019). Navigating the Bureaucracy: An Analysis of Implementation Feasibility for the Mekong Delta Plan, Vietnam. Journal of Environmental Planning and Management, 62(9), 1545-1561. https://doi.org/10.1080/09640568.2019.1623014

Kwakkel, J. H. (2017). The Exploratory Modeling Workbench: An Open Source Toolkit for Exploratory Modeling, Scenario Discovery, and (Multi-objective) Robust Decision Making. Environmental Modelling & Software, 96, 239-250. https://doi.org/10.1016/j.envsoft.2017.06.054

Kwakkel, J. H., Haasnoot, M. & Walker, W. E. (2015). Developing Dynamic Adaptive Policy Pathways: A Computer-Assisted Approach for Developing Adaptive Strategies for a Deeply Uncertain World. Climatic Change, 132(3), 373-386. https://doi.org/10.1007/s10584-014-1210-4

Kwakkel, J. H., Haasnoot, M. & Walker, W. E. (2016). Comparing Robust Decision-Making and Dynamic Adaptive Policy Pathways for Model-based Decision Support under Deep Uncertainty. Environmental Modelling & Software, 86, 168-183. https://doi.org/10.1016/j.envsoft.2016.09.017

Kwakkel, J., Walker, W., Marchau, V. (2010) Classifying and communicating uncertainties in model-based policy analysis. International Journal of Technology Policy and Management 10(4):299 - 315. https://doi.org/10.1504/IJTPM.2010.036918

Lenz, R. C. Jr. (1962). Technological Forecasting. ASD-TDR-62-414, Aeronautical Systems Division, Air Force Systems Command (DDC Number AD 408 085). https://doi.org/10.21236/AD0408085

Lipinski, A. & Loveridge, D. (1982). Multiple Perspective: Concept, Application and User Guidelines. Systems Practice,2(3), 307-331. https://doi.org/10.1007/BF01059977

MacArthur, J. (1997). Stakeholder Analysis in Project Planning: Origins, Applications and Refinements of the Method. Project Appraisal, 12(4), 251-265. https://doi.org/10.1080/02688867.1997.9727068

Marchau, V. (2000). Technology Assessment Automated Vehicle Guidance. Future Prospects for Automated Driving Implementation (dissertatie). Delft: Delftse Universitaire Pers.

Marchau, V. A., Walker, W. E., Bloemen, P. J. & Popper, S. W. (2019). Decision Making under Deep Uncertainty: From Theory to Practice (p. 405). Springer Nature, DMDU OPEN https://doi.org/10.1007/978-3-030-05252-2

Marchetti, C. (1980). Society as a Learning System: Discovery, Invention, and Innovation Cycles Revisited. Technological Forecasting and Social Change, 18, 267-282. https://doi.org/10.1016/0040-1625(80)90090-6

Mayer, I. S., van Daalen, C. E. & Bots, P. W. G. (2004). Perspectives on Policy Analysis: A Framework for Understanding and Design. International Journal of Technology, Policy and Management, 4(2), 169-191. https://doi.org/10.1504/IJTPM.2004.004819

Mayer, I. S., van Daalen, C. E. & Bots, P. W. G. (2004). Perspectives on Policy Analyses: A Framework for Understanding and Design. International Journal on Technology, Policy and Management, 4(2), 169-191. https://doi.org/10.1504/IJTPM.2004.004819

Mayer, I. S., Van Daalen, C. E. & Bots, P. W. G. (2004). Perspectives on Policy Analysis: a Framework for Understanding and Design. International Journal of Technology, Policy and Management, 4(2), 169-191. https://doi.org/10.1504/IJTPM.2004.004819

Mayer, I. S., Van Daalen, C. E. & Bots, P. W. G. (2004). Perspectives on Policy Analysis: a Framework for Understanding and Design. International Journal of Technology, Policy and Management, 4(2), 169-191. https://doi.org/10.1504/IJTPM.2004.004819

Mayer, I., 1997. Debating Technologies: A Methodological Contribution to the Design and Evaluation of Participatory Policy Analysis (PhD thesis)

McDaniels, T. L., & Thomas, K. (1999). Eliciting Preferences for Land Use Alternatives: A Structured Value Referendum with Approval Voting. Journal of Policy Analysis and Management, 18(2), 264-280. https://doi.org/10.1002/(SICI)1520-6688(199921)18:2<264::AID-PAM4>3.0.CO;2-F

McKeown, B. & Thomas, D. (1988). Q-Methodology. Newbury Park: Sage. https://doi.org/10.4135/9781412985512

Meadows, D., Richardson, J. & Bruckmann, G. (1982). Groping in the Dark; the First Decade of Global Modeling. 6th IIASA symposium on global modeling, expanded proceedings. Chichester: Wiley.

Meijer, M. H. & Korving, H. (2001). Beslissen over het Riool onder Onzekerheid. H2O,34(20), 19-21.

Miser, H. J. & Quade, E. S. (Eds.) (1985). Handbook of Systems Analysis, Part I. Overview of Uses, Procedures, Applications, and Practice. Amsterdam: Elsevier Science Publishing.

Mitroff, I. I. (1983). Stakeholders of the Organizational Mind. Toward a New View of Organizational Policy Making. San Francisco: Jossey-Bass.

Moezzi, M., Janda, K. B. & Rotmann, S. (2017) Using Stories, Narratives, and Storytelling in Energy and Climate Change Research. Energy Research & Social Science, 31, 1-10. https://doi.org/10.1016/j.erss.2017.06.034

Monnikhof, R. (2006) Policy Analysis for Participatory Policy Making (PhD thesis TU Delft).

Montibeller, G. & Belton, V. (2006). Causal Maps and the Evaluation of Decision Options - A Review. Journal of the Operational Research Society, 57(7), 779-791. https://doi.org/10.1057/palgrave.jors.2602214

National Research Council (NRC). (2000). Watershed Management for Potable Water Supply: Assessing New York City's Approach. Washington, D.C.: National Academy Press.

New York Times. (2018). A Billion-Dollar Investment in New York's Water. By Winnie Hu. New York Times, 18 January 2018. www.nytimes.com/2018/01/18/nyregion/new-york-city-water-filtration.html

Nguyen, H. Q., Korbee, D., Ho, H. L., Weger, J., Thanh Hoa, P. T., Thanh Duyen, N. T., Manh Hong Luan, P. D., Luu, T. T., Phuong Thao, D. H., Thu Trang, N. T., Hermans, L., Evers, J., Wyatt, A., Chau Nguyen, X. Q. & Phi, H. L. (2019). Farmer Adoptability for Livelihood Transformations in the Mekong Delta: A Case in Ben Tre Province. Journal of Environmental Planning and Management, 62(9), 1603-1618. https://doi.org/10.1080/09640568.2019.1568768

North, D.C. (1994). Economic Performance Through Time. The American Economic Review, 84(3), 359-368.

Olson, R. (2019). Narrative Is Everything. The ABT Framework and Narrative Evolution. Independently Published ISBN: 9781072232575.

Onencan, A., Enserink, B., van de Walle, B. & Chelang, J. (2016). Coupling Nile Basin 2050 Scenarios with the IPCC 2100 Projections for Climate-induced Risk Reduction. Procedia Engineering,159, 357-365. https://doi.org/10.1016/j.proeng.2016.08.212

Ostrom, E. (2005). Understanding Institutional Diversity. Princeton: Princeton University Press.

Overseas Development Institute (ODI). (2010). The Alignment, Interest and Influence Matrix (AIIM) Guidance Note. Prepared by Enrique Mendizabal. Overseas Development Institute (ODI).

Patton, C. V., Sawicki, D. S. & Clark, J. J. (2012). Basic Methods of Policy Analysis and Planning. New York: Routledge.

Pauly, S. (2001). Ambiguïteit in het spel. De casus PolyVinylChloride (PhD thesis). Delft: Eburon.

Pearl, J. (2000). Causality: Models, Reasoning, and Inference. New York: Cambridge University Press.

Phi, H. L., Hermans, L. M., Douven, W. J. A. M., Van Halsema, G. E. & Khan, M. F. (2015). A Framework to Assess Plan Implementation Maturity with an Application to Flood Management in Vietnam. Water International, 40(7): 984-1003. https://doi.org/10.1080/02508060.2015.1101528

Piñeiro-Naval, V. & Serra, P. (2019). How Do Destinations Frame Cultural Heritage? Content Analysis of Portugal's Municipal Websites. Sustainability, 11(4), 947. https://doi.org/10.3390/su11040947

Planbureau voor de Leefomgeving (2012). Nieuwe steden in de Randstad. Verstedelijking en suburbaniteit. PBL Den Haag isbn 978-94-91506-14-7.

Porter, A.L., Roper, A.T., Mason, T.W., Rossini, F.A., Banks, J. (1991) Forecasting and Management of Technology. ETM Wiley Series in Engineering & Technology Management. John Wiley & Sons INc New York, Chichester, Brisbane, Toronto, Singapore

Pozo, D., Sauma, E. E. & Contreras, J. (2013). A Three-Level Static MILP Model for Generation and Transmission Expansion Planning. IEEE Transactions on Power Systems, 28(1), 202-210. https://doi.org/10.1109/TPWRS.2012.2204073

Qiu, Y., Chen, H., Sheng, Z. & Cheng, S. (2019) Governance of Institutional Complexity in Megaproject Organizations. International Journal of Project Management,37, 425-433. https://doi.org/10.1016/j.ijproman.2019.02.001

Quade, E. S. (1989). Analysis for Public Decisions. Amsterdam: North-Holland.

Quan, N. H., Patino Guerro, J. D., Korbee, D., Luan, P. D. M. H., Dung, T. D., Hung, D. Q, Loc, H. H. & Hermans, L. (2019). Manual for Application of the MOTA Framework. Centre of Water Management and Climate Change (WACC) Vietnam National University, Delft University of Technology and IHE Delft. https://strategic-delta-planning.un-ihe.org/sites/strategic-delta-planning.un-ihe.org/files/quan_mota_manual_-_version_1.pdf.

RAND Corporation. (n.d.). Issue Papers. www.rand.org/pubs/issue_papers.html.

Rein, M. & Schön, D. (1993). Reframing Policy Discourse. In F. Fischer & J. Forester (Eds.), The Argumentative Turn in Policy Analysis and Planning. Durham: Duke University Press. https://doi.org/10.1215/9780822381815-007

Rein, M., Schön, D. (1996) Frame-critical policy analysis and frame-reflective policy practice. Knowledge and Policy 9, 85-104. https://doi.org/10.1007/BF02832235

Rhodes, R. A. W. & Marsh, D. (1992). Policy Networks in British Government. Oxford: Oxford University Press. https://doi.org/10.1093/acprof:oso/9780198278528.003.0001

Riol, H. & Thuillier, D. (2015). Project Management for Academic Research Projects: Balancing Structure and Flexibility. International Journal of Project Organisation and Management, 7(3), 251-269. https://doi.org/10.1504/IJPOM.2015.070792

Rittel, H. W. J. & Webber, M. M. (1973). Dilemmas in a General Theory of Planning. Policy Sciences, 4, 155-169. https://doi.org/10.1007/BF01405730

Roe, E. (1994). Narrative Policy Analysis: Theory and Practice. Durham: Duke University Press. https://doi.org/10.1515/9780822381891

Rosenhead, J. (1989). Robustness Analysis; Keeping Your Options Open. In J. Rosenhead (Ed.), Rational Analysis for a Problematic World. Chichester, West Sussex: John Wiley and Sons Ltd.

Saaty, T. L. (1990). How to Make a Decision: The Analytic Hierarchy Process. European Journal of Operational Research, 48, 9-26. https://doi.org/10.1016/0377-2217(90)90057-I

Sabatier, P. A. & Jenkins-Smith, H. (1988). Policy Change and Policy-Oriented Learning: Exploring an Advocacy Coalition Framework. Dordrecht: Kluwer.

Sabatier, P. A. & Weible, C. M. (2007). The Advocacy Coalition Framework: Innovations and Clarifications. Theories of the Policy Process (pp. 189-220). Boulder: Westview Press. https://doi.org/10.4324/9780367274689-7

Sabatier, P. A. (1988). An Advocacy Coalition Framework of Policy Change and the Role of Policy-oriented Learning Therein. Policy Sciences, 21(2-3), 129-168. https://doi.org/10.1007/BF00136406

Sabatier, P. A. (1988). An Advocacy Coalition Framework of Policy Change and the Role of Policy-Oriented Learning Therein. Policy Sciences, 21, 129-168. https://doi.org/10.1007/BF00136406

Scharpf, F. W. (1997). Games Real Actor Play. Actor-centered Institutionalism in Policy Research. Boulder, CO: Westview Press.

Schattschneider, E. E. (1960). The Semisovereign People: A Realist's View of Democracy in America. New York: Holt, Reinhart and Winston.

Schnaars, S. P. (1989). Megamistakes: Forecasting and the Myth of Rapid Technological Change. New York: The Free Press.

Scholes, K. (1998). Stakeholder Mapping: A Practical Tool for Managers. In V. Ambrosini, G. Johnson & K. Scholes (Eds.), Exploring Techniques of Analysis and Evaluation in Strategic Management (pp. 152-168). Essex: Prentice Hall/Financial Times.

Schön, D. (1995). The Reflective Practitioner: How Professionals Think in Action. Farnham: Ashgate.

Schröder, T. & Kuckshinrichs, W. (2015). Value of Lost Load: An Efficient Economic Indicator for Power Supply Security? A Literature Review. Frontiers in Energy Research, 3. https://doi.org/10.3389/fenrg.2015.00055

Scott, J. (1991). Social Network Analysis: A Handbook. London: Sage.

Simon, H. A. (1973). The Structure of Ill-structured Problems. Artificial Intelligence, 4, 181-201. https://doi.org/10.1016/0004-3702(73)90011-8

Simon, H. A. (1977). The New Science of Management Decision. Upper Saddle River: Prentice Hall PTR.

Simon, H. A. (1977). The New Science of Management Decision. Upper Saddle River: Prentice Hall PTR.

Simon, H. A. (1991). Bounded Rationality and Organizational Learning. Organization Science, 2(1) (Special Issue: Organizational Learning: Papers in Honor of (and by) James G. March), 125-134. https://doi.org/10.1287/orsc.2.1.125

Simon, H. A. (1991). Organization Science, 2(1) (Special Issue: Organizational Learning: Papers in Honor of (and by) James G. March), 125-134. https://doi.org/10.1287/orsc.2.1.125

Simon, H. A. (1996). The Sciences of the Artificial (3rd ed.). Cambridge, MA: MIT Press.

Slinger, J. H., Taljaard, S. & d'Hont, F. (2020). Complex Coastal Systems. Transdisciplinary Learning on International Case Studies. Delft: Delft Academic Publishers.

Stokman, F. N. (1994). Besluitvormingsmodellen binnen beleidsnetwerken (Decision making models in policy networks, in Dutch). In Huberts, L. W. J. C. & Kleinnijenhuis, J. (Eds.), Methoden van Invloedsanalyse. Amsterdam: Boom uitgevers.

Tango, P. J. & Batiuk, R. A. (2013). Deriving Chesapeake Bay Water Quality Standards. Journal of the American Water Resources Association, 49(5), 1007-1024. https://doi.org/10.1111/jawr.12108

Teisman, G. (2000) Models For Research into Decision-MakingProcesses: On Phases, Streams and Decision-Making Rounds. Public Administration 78(4), 937 - 956. https://doi.org/10.1111/1467-9299.00238

Teisman, G. R. (1992/1995). Complexe besluitvorming. Een pluricentrisch perspectief op besluitvorming over ruimtelijke beslissingen. Den Haag: VUGA

The Futures Group International (1994). Scenarios. In J. C. Glenn (Ed.), 1999. Futures Research Methodology Version 1.0. American Council for the United Nations University. https://www.millennium-project.org

Thissen, W. (Ed.) & Walker, W. (2013). Public Policy Analysis: New Developments. (International Series in Operations Research & Management Science). Springer New York Heidelberg Dordrecht London. https://doi.org/10.1007/978-1-4614-4602-6

Thissen, W. A. H. & Walker, W. E. (Eds.) (2013). Public Policy Analysis: New Developments. Springer. https://doi.org/10.1007/978-1-4614-4602-6

Thissen, W. A. H. & Walker, W. E. (Eds.) (2013). Public Policy Analysis, Chapter 4.6. https://doi.org/10.1007/978-1-4614-4602-6

Thissen, W. A. H. (2000). Issue-Formulation in a Multi-actor Context: A Five Step Approach. Proceedings of the IEEE Conference on Systems, Man and Cybernetics, 301-306. https://doi.org/10.1109/ICSMC.2000.885007

Thissen, W. A. H. (2000). Issue-Formulation in a Multi-Actor Context: A Five Step Approach. Proceedings of the IEEE Conference on Systems, Man and Cybernetics (pp. 301-306). https://doi.org/10.1109/ICSMC.2000.885007

Thomson, R., Stokman, F. & Torenvliet, R. (2003). Models of Collective Decision-Making: Introduction. Rationality and Society, 15(1), 5-14. https://doi.org/10.1177/1043463103015001037

Timmermans, J. S. (2004). Purposive Interaction in Multi-Actor Decision Making. The Netherlands: Eburon, Delft.

Toulmin, S. E. (1958). The Uses of Argument. Cambridge: Cambridge University Press.

van Asselt, M.B.A., Rotmans, J. (2002) Uncertainty in Integrated Assessment Modelling. Climatic Change 54, 75-105 (2002). https://doi.org/10.1023/A:1015783803445

van Bueren, E. M., Klijn, E. & Koppenjan, J. F. M. (2003). Dealing with Wicked Problems in Networks: Analyzing an Environmental Debate from a Network Perspective. Journal of Public Administration Research and Theory, 13(2), 193-212. https://doi.org/10.1093/jopart/mug017

Van Daalen, C. E., Dresen, L. & Janssen, M. A. (2002). The Roles of Computer Models in the Environmental Policy Life Cycle. Environmental Science & Policy, 5(3), 221-231. https://doi.org/10.1016/S1462-9011(02)00040-0

van Daalen, C., Thissen, W. & Verbraeck, A. (1999). Methods for the Modeling and Analysis of Alternatives. In A. P. Sage & W. B. Rouse (Eds.), Handbook of Systems Engineering and Management (Chapter 26). pp. 1037-1076. New York: Wiley. ISBN 978-0471154051.

van de Graaf, H. & Hoppe, R. (1989). Beleid en politiek. Een inleiding tot de beleidswetenschap en de beleidskunde. Muiderberg: Coutinho.

van de Poel, I. & Royakkers, L. (2011). Ethics, Technology, and Engineering. Chichester: Wiley-Blackwell.

van der Lei, T. E., Enserink, B., Thissen, W. A. H. & Bekebrede, G. (2011). How to Use a Systems Diagram to Analyse and Structure Complex Problems for Policy Issue Papers. Journal of the Operational Research Society, 62(7), 1391-1402. https://doi.org/10.1057/jors.2010.28

van der Sluijs, J.P. (1997) Anchoring Amid Uncertainty: On the Management of Uncertainties in Risk Assessment of Antropogenic Climate Change. Universiteit Utrecht, PhD Thesis

van Eeten, M. J. G. (2006). Narrative Policy Analysis. In F. Fischer, G. J. Miller & M. S. Sidney (Eds.), Handbook of Public Policy Analysis: Theory, Methods, and Politics(pp. 251-269). Boca Raton: Taylor & Francis CRC Press. https://doi.org/10.1201/9781420017007.ch18

Vergragt, P. J. & Quist, J. (2011) Backcasting for Sustainability: Introduction to the Special Issue. Technological Forecasting and Social Change,78(5), 747-755. www.sciencedirect.com/science/article/pii/S004016251100062X. https://doi.org/10.1016/j.techfore.2011.03.010

Walker, W. E. (2000). Policy Analysis: A Systematic Approach to Supporting Policymaking in the Public Sector. Journal of Multi-Criteria Decision Analysis, 9, 11-27. https://doi.org/10.1002/1099-1360(200001/05)9:1/3<11::AID-MCDA264>3.0.CO;2-3

Walker, W. E. (2000). Policy Analysis: A Systematic Approach to Supporting Policymaking in the Public Sector. Journal of Multi-Criteria Decision Analysis, 9, 11-27. https://doi.org/10.1002/1099-1360(200001/05)9:1/3<11::AID-MCDA264>3.0.CO;2-3

Walker, W.E., Harremoës, P., Rotmans, J., van der Sluijs, J.P., van Asselt, M.B.A., Janssen P. & Krayer von Krauss, M.P. (2003) Defining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision Support, Integrated Assessment, https://doi.org/10.1076/iaij.4.1.5.16466

Walker, W.E., Marchau, V.A.W.J., Kwakkel, J.H. (2013). Uncertainty in the Framework of Policy Analysis. In: Thissen, W., Walker, W. (eds) Public Policy Analysis. International Series in Operations Research & Management Science, vol 179. Springer, Boston, MA https://doi.org/10.1007/978-1-4614-4602-6_9

Wasserman, S. & Faust, K. (1994). Social Network Analysis: Methods and Applications. Cambridge: Cambridge University Press.

https://doi.org/10.1017/CBO9780511815478

Wildavsky, A. (1979). The Art and Craft of Policy Analysis. Hampshire and London: MacMillan Press. https://doi.org/10.1007/978-1-349-04955-4

Wildavsky, A. (1979). The Art and Craft of Policy Analysis. Hampshire and London: MacMillan Press.WRR (Netherlands Policy Research Council) (1994). Besluiten over grote projecten (Report No. 46). The Hague: SDUB.

Wise, G. (1976). The Accuracy of Technological Forecasts: 1890-1940. Futures, 8(5), 411-419 https://doi.org/10.1016/0016-3287(76)90005-7

A glowing, digitally rendered Earth from space, symbolizing interconnected global systems and complex decision-making dynamics

Published

August 25, 2022

Details about the available publication format: View PDF

View PDF

ISBN-13 (15)

978-94-6366-575-9

Publication date (01)

2022-08-15

How to Cite

Enserink, B., Thissen, W., Ruijgh, T., Kwakkel, J., Koppenjan, J., Kortmann, R., Hermans, L., van Daalen, E., Bots, P., & Slinger, J. (Eds.). (2022). Policy Analysis of Multi-Actor Systems - 2nd edition. TU Delft OPEN Books. https://doi.org/10.5074/T.2022.004