Introduction

Recent years have witnessed increasing scholarly interest to the challenge of organizing policy integration to better govern societal problems that crosscut the boundaries of traditional government sectors and levels (e.g., Peters 2015; Candel and Biesbroek 2016; Cejudo and Michel 2017; Peters 2018), including ‘wicked problems’ such as climate change (Mickwitz et al. 2009; Adelle and Russel 2013; Runhaar et al. 2018), food insecurity (Candel and Biesbroek 2018), terrorism (May et al. 2011), and the instability of financial markets (Gieve and Provost 2012). The core assumption of this literature is that crosscutting problems can be governed most effectively by recognizing the polycentric nature of the governance regimes within which they are embedded, and by strengthening the coherence and consistency of policy efforts within and between these regimes (Howlett and Rayner 2007).

Although ‘integrated policy’ as a concept was already coined in the early 1980s (Underdal 1980), most early policy integration research focused on coordination between public sector organizations (e.g., Metcalfe 1994; Peters 1998; Jordan and Schout 2006). Rooted predominantly in public administration scholarship, this strand of research has shown that considerable challenges arise from (differences in) the properties of dominant administrative structures and cultures when organizing coordinative action across government, including tensions between bureaucratic specialization versus coordination and turf wars between departments. Consequently, it has resulted in widespread calls for more holistic and networked forms of governance, culminating in new governing paradigms such as ‘whole-of-government’ and ‘joined-up-governance’ (Bogdanor 2005; Christensen and Lægreid 2007).

A second strand of literature has started from a policy problem perspective, such as environmental concerns (environmental policy integration; EPI), climate change (climate policy integration; CPI) (e.g., Lafferty and Hovden 2003; Jacob et al. 2008; Jordan and Lenschow 2010; Adelle and Russel 2013; Runhaar et al. 2014), gender (Pollack and Hafner-Burton 2010), and nutrition (Harris et al. 2017). These policy scholars have been primarily concerned with the extent to which crosscutting concerns have been incorporated into policy outputs across sectors, the underlying assumption being that the inability to realize such integration results in partial and ineffective responses. One of the main insights of this body of literature is that political commitments to strengthen integrative efforts often do not proceed beyond discursive levels (Jacob et al. 2008; Candel 2017), largely due to the same factors that were found by research on coordination, such as conflicting interests and lacks of genuine commitment.

Recent contributions to the debate on policy integration have recognized some of the weaknesses of previous studies and essentially taken a step back to provide conceptual clarity about what policy integration is and how it can be studied empirically. Recent publications have, for example, discussed how policy integration relates to similar concepts, such as coordination and coherence (Cejudo and Michel 2017; Tosun and Lang 2017), conceptualized policy integration as a multilayered process with specific measurements (Candel and Biesbroek 2016), provided suggestions for what optimal policy integration would entail (Jochim and May 2010; Varone et al. 2013), and questioned the compatibility of pursuing different directions of policy integration (Egeberg and Trondal 2016; Howlett et al. 2017). Whereas these publications have contributed to a better understanding of what policy integration could be and how it can be studied, considerable conceptual and methodological questions remain to be addressed in order to study policy integration through a processual lens (Jordan and Lenschow 2010; Tosun and Lang 2017). Specifically, while processual frameworks allow us to better understand the dimensions of policy integration, there is limited conceptual and methodological advancement in addressing questions of why policy integration increases or decreases over time. Indeed, studies have shown that there are considerable barriers to pursuing policy integration (Peters 2015), but the causal model for explaining cause and effect remains unsatisfactory (cf. Biesbroek et al. 2015).

The aim of this paper is to propose a novel approach to explain policy (dis)integration processes across different crosscutting policy issues as well as over time. We build our approach on the social science ‘mechanisms’ literature, which is influenced by philosophy of science and the natural sciences (Bunge 1997; Elster 1989; Wellstead et al. 2018). The next section will elaborate our conceptual framework in more detail, explaining how mechanism-based analysis fits within a processual understanding of policy integration. In the remainder of the article, we use this approach to explain policy (dis)integration in the Netherlands in two crosscutting issues: food policy and climate change adaptation policy. These issues have recently entered the Dutch policy arena and offer illustrative examples of how a mechanism-based analysis can be used to explain patterns of policy (dis)integration over time. The paper ends with a discussion of how the insights can be applied in future research.

Explaining the process of policy integration: in search of causal mechanisms

Policy integration as a multi-dimensional process

In previous work, we proposed a processual and multi-dimensional conceptualization of policy integration (Candel and Biesbroek 2016). Starting from the observation that much of the earlier literature approached policy integration as a static outcome or governing principle rather than as an inherently dynamic process, we suggested an alternative perspective in which policy (dis)integration entails four distinct dimensions. These dimensions have specific indicators that can move at different paces or even in opposite directions, thereby allowing for a nuanced and comprehensive assessment of whether or not policy integration is taking place; see Table 1. In this processual view, policy integration can be defined as ‘an agency-driven process of asynchronous and multi-dimensional policy and institutional change within an existing or newly formed governance system that shapes the system’s and its subsystems’ ability to address a crosscutting policy problem in a more or less holistic manner’ (Candel and Biesbroek 2016, p 217). Applying the framework to EU, food governance has, for example, shown that the European Commission’s holistic framing of food security as a crosscutting problem that relates to many subsystems was only partially followed through in terms of concrete policy goals and instruments (Candel and Biesbroek 2018). However, whereas this framework allows for a more systematic way of assessing change over time, it does not help explaining why (dis)integration across the dimensions occurs.

Table 1 Dimensions of policy integration (adopted from Candel and Biesbroek 2016)

This lack of explanatory ambition can be extended to most of the literature on policy integration and coordination. Previous studies have identified a broad range of factors that may enable or impede successful integration: political will and entrepreneurship, policy capacity, belief systems, management styles, incentive structures, trust, political and administrative cultures, and issue attention, among many others (Rayner and Howlett 2009; Peters 2015; Vince 2015). However, what limits the explanatory value of these factors is that most of them remain ‘grey boxed’ with respect to the causal processes through which causes are linked to policy integration as either a process or outcome (Bunge 1997). In fact, particularly in policy problem-orientated studies, the tendency is to: (1) treat policy integration as a normative end goal, where more integration is generally seen as better; (2) describe rather than explain how integration takes place; and/or (3) adopt functionalist explanations in which the complexity and contingency of the policy process are overly simplified and reduced into static variables (cf. Candel and Biesbroek 2016).

Different examples of such ‘grey-box’ types of analyses exist (Bunge 1997). For example, Pollack and Hafner-Burton (2010) argue that the success of gender mainstreaming and environmental policy integration in international organizations is causally linked to the use of ‘hard’ incentives. Similarly, Schout and Jordan (2005) argued that the EU’s failure to make more progress in environmental policy integration could be explained by the Commission’s and member states’ (limited) administrative capacities. Drimie and Ruysenaar (2010: 330) pose that the South African government’s failure to implement most of its ambitious Integrated Food Security Strategy was due to ‘insufficient and inappropriate institutional arrangements’. Our argument here is not that these factors do not play a big role, on the contrary, but rather that they leave much of the precise processes that explain policy (dis)integration unaddressed. These analyses therefore lead to new questions (cf. Howlett 2019). For example, if ‘hard’ incentives are shown to be causally linked to policy integration outcomes, what are the processes through which these effects are mediated? To what extent is this relationship context-specific? How do these explanatory factors relate to each other? These questions are relevant because, as noted by Peters (2015), many factors listed in the literature have been shown to be able to explain both strengthened policy integration and disintegration, depending on specific processes and contexts. It is therefore vital to develop a better understanding of the causal mechanisms that are activated through the use of governing resources or as result of broader contextual changes (Capano and Howlett 2019).

Policy mechanisms to explain why (dis)integration takes place

Explaining why policy (dis)integration takes place requires uncovering the processes that are responsible for producing a certain effect. The mechanism-based approach we propose offers an alternative to the descriptive or correlational studies that have dominated the study of policy integration so far. It is rooted in the ontological stance that all social science research should be able to identify and provide sets of social mechanisms that can explain the link between causes and effects (Elster 1989).

Since the late 1990s, strands within the political sciences (e.g., Mayntz 2004; McAdam et al. 2008), sociology (Hedström and Ylikoski 2010), philosophy of science (Bunge 2004), and, more recently, public policy (Capano and Howlett 2019; Biesbroek et al. 2017; Kay and Bakker 2015; Steinberg 2007) have called for a more modest understanding of the nature of causality, searching for deeper explanatory connections between causes and effects. These calls built on the critique that regular associations between X – > Y ‘black box’ causality and result in sweeping theoretical arguments without actually demonstrating these empirically (Mayntz 2004; Pawson 2006; Gerring 2008; Mason et al. 2013). In essence, these arguments returned to earlier debates about middle-range theories in which social mechanisms form the ‘elementary building blocks’ of explaining social phenomena (Hedström and Swedberg 1998: 6).

Several conceptual models have been developed based on this ontology of causality (for an overview, see: Beach and Pedersen 2013). One frequently used model in the realist literature, which we also adopt in this article, is the CMO model; it assumes that observed patterns of (un)intended Outcomes can be explained by identifying the plausible causal set of Mechanisms within the situational Context of the process (Pawson and Tilley 1997; Falleti and Lynch 2009), see Fig. 1. What constitutes a mechanism has been heavily debated and numerous definitions exist (Hedström and Swedberg 1998; Steel 2004; Anderson et al. 2006; Oberthür and Gehring 2006; Weber 2007; Falleti and Lynch 2009). Hedström and Ylikoski (2010), for example, argue that mechanisms are contrived of actors (e.g., bureaucrats, politicians) with specific personal characteristics (e.g., norms, values, ideas) and the activities that these actors engage in with other actors. Their interactions bring about change (e.g., can result in more or less integration), whereby the type of change depends on the interactions of those actors and the contextual conditions in which the interactions take place (Bunge 1997). Contextual conditions play a decisive role as they determine which mechanisms are more likely to be activated, the magnitude of the causal force, and the effect it has on the outcome (Falleti and Lynch 2009). Following the observation of Peters (2015), the context–mechanism interactions shape the direction of the causal force of the mechanism. In other words, the same mechanism can be responsible for integration and disintegration, depending on contextual conditions.

Fig. 1
figure 1

CMO model of understanding how context influences mechanisms and outcome (Pawson and Tilley 1997, p 58)

Without adopting an explicit mechanism-based approach, the literature on policy integration has already identified several processes that come close to what we consider policy mechanisms (cf. Peters 2015), including social learning, coalition building, and policy entrepreneurship (Jochim and May 2010). Social learning for policy integration refers to the process where learning does not only take place within one or more subsystems, but across subsystems (Jones and Jenkins-Smith 2009). Learning then does not only follow from the emergence of new knowledge, information, and experiences, but, more importantly, from the recognition of mutual dependencies between subsystems involved and of an associated variety of frames and perspectives on problems and solutions (Nilsson and Nilsson 2005; Mickwitz et al. 2009; Termeer 2009). Learning across subsystems generally goes hand in hand with the mechanism of coalition building. Coalition building involves the alignment of powers within and between subsystems, which may result in new network configurations in the governance of a particular problem, possibly allowing for more integrative approaches (Jochim and May 2010). Opportunities for coalition building are enforced through the possible occurrence of a third mechanism: policy entrepreneurship. Policy entrepreneurship refers to the ability of individual actors to recognize windows of opportunity and to actively couple more integrative approaches to a perceived lack of integration (Dowd et al. 2014; Faling et al. 2019). By doing so, they may give way to new subsystem interactions and alliances.

Methodological approach: process tracing

We use the policy integration framework (Table 1) and the CMO model (Fig. 1) to uncover and explain the process of policy integration in the governance of two crosscutting societal problems that are high on the political agenda in many countries: (integrated) food policy and climate change adaptation. Empirically, we focus on the Netherlands, where debates on food policy (since 2014) and climate change adaptation (since 2005) have figured prominently on the national political agenda and have been accompanied by repeated political calls for policy integration. Food policy has been subject to diverse interpretations but is increasingly used to refer to attempts at moving toward more holistic governance of food systems (Lang et al. 2009). Global food systems are facing increasing pressures from a range of interrelated challenges, including global environmental change, changing diets, food insecurity, unstable farmer incomes, and public health concerns (Fresco 2009; Ingram et al. 2012). The assumption behind integrated food policy efforts is that these will be more effective in dealing with these interrelated challenges, ultimately resulting in a healthier, more sustainable, and/or equitable food system (Candel and Pereira 2017). Climate change adaptation policy refers to the intentional adjustments made by public organizations in socioeconomic and biophysical systems to deal with the current or projected impacts of climate change (IPCC 2014). Climate change is expected to impact almost all policy sectors, and therefore many calls for integrating or ‘mainstreaming’ adaptation have been proposed, including in the 2015 Paris Agreement (Lesnikowski et al. 2017) and the 2015 Sustainable Development Goals. In both of the cases, policy integration is pursued to manage under- and overreaction across subsystems, prevent negative trade-offs, and ensure coherency and consistency in implementing policy.

To explain the policy (dis)integration processes in the two cases, we use process tracing. Process tracing has become an umbrella term for the approaches, methods and techniques to unpack causality (X -- > Y), and ranges from inductive or theory-building process tracing, to deductive and theory-testing process tracing (Trampusch and Palier 2016; Beach and Pedersen 2016). Here, we use theory-building process tracing methodology to unearth a (set of) plausible mechanism(s) from the empirical cases that, with some level of confidence, is considered to be responsible for producing the observed outcome (Gerring 2008). Given the illustrative purpose of our cases and our theory-building process tracing approach, we use what Beach (2016) calls ‘minimalist process tracing’, which is particularly useful in cases where there are few theoretical priors on the mechanisms in place. Following Falleti and Lynch (2009), we adopt a probabilistic view on process tracing and argue that context and temporal sequencing of events matter when analyzing policy integration over time. To structure our analysis, we break down the policy process into episodes of changes in policy (dis)integration to allow for making stronger inferences about causal relationships, and the contextual conditions under which these are activated (Biesbroek et al. 2014a).

We use mechanistic evidence (Beach 2016)—observational within-case empirical evidence of the workings of the mechanisms—to characterize the causal pathways in the two cases, as such making inferences about the existence of mechanism(s) (Bennett and Checkel 2014). Primary data for both cases were collected in the form of: (1) key policy documents, minutes, meeting reports, and evaluations of the two cases; and (2) expert interviews with senior national-level policy-makers between 2009 and 2017 (n = 5 for the food policy case; n = 10 for the climate change adaptation case). Interviews were used to gain deeper understandings of the within-case key processes and contextual conditions, and, in later stages of the research, were used to assess the internal validity of our preliminary results.

Moreover, both authors participated in the policy process of the cases in various forms, most often in the role of knowledge broker and/or observer; ensuring detailed understandings of the cases before starting the analysis. We made use of secondary case analysis to reconstruct the main process of policy integration, building upon some of our earlier work in these fields (Biesbroek et al. 2011, 2014b; Candel 2018). The primary and secondary data allowed for a thick case reconstruction, which is generally considered to be an important first step in theory-building process tracing (Beach and Pedersen 2013). For both cases, we covered the time periods from their start until September 2017.

We analyzed our data by iterating between the empirical observations and relevant public policy theories—particularly policy integration literature—to generate the configurations of mechanisms (or causal pathways) that provide plausible causal explanations of how policy integration proceeded over time in both cases (Beach and Pedersen 2013). To determine causality, we used counter-factional reasoning by critically reflecting among the authors and selected interviewees on what would have happened if the mechanism(s) would not have occurred. Although this approach certainly has its limitations, it is an accepted and frequently used method in process tracing studies (Beach and Pedersen 2013). The two cases were analyzed independently, and findings were compared at the final stages of the research to identify recurring patterns across the two cases.

Developing integrated food policy in the Netherlands

Description of the policy (dis)integration process

The Dutch government’s attempts of moving toward strengthened food policy integration gained momentum after the publication of an unsolicited report, entitled ‘Towards a food policy’, by the Scientific Council for Government Policy (WRR) in October 2014. The WRR argued that the government’s ‘implicit’ food policy proved inadequate for coping with the rapid developments and associated challenges that characterize modern-day food systems, most notably (the lack of) ecological sustainability, public health, and robustness. The Council therefore argued that a shift toward ‘explicit’ and more holistic food policy, focused on these three challenges, would be needed (WRR 2014). ‘Implicit’ food policy referred to the existing state of fragmented policy-making in which various ministries (primarily those of (1) Economic Affairs, which covered the agri-food sector, (2) Public Health, (3) Foreign Affairs, and (4) Infrastructure and Environment) were responsible for specific food-related themes and steered these through sector-specific goals and instruments, between which very little coordination occurred (Table 2).

Table 2 Dimensions of policy (dis)integration in Dutch food policy-making

The subsequent process of policy integration can be characterized along two episodes. The 2 years immediately following on the WRR’s report witnessed a vivid public debate about the future of (the governance of) the Dutch food system. Within government, the Ministry of Economic Affairs took the lead in drafting a letter to Parliament by which the cabinet would respond to the WRR’s report, as required by law. For this purpose, a task force was set up within the ministry, consisting of civil servants from various relevant directorates. In addition, frequent coordination meetings took place with representatives of the other three ministries, at different hierarchical levels. The letter, which was also signed by the Minister of Health, was sent to Parliament in November 2015. In it, the government confirmed the three main food system challenges of ecological sustainability, public health, and robustness, and subscribed the integration of these concerns into national policy efforts and the EU’s Common Agricultural Policy (CAP). At the same time, the ministers argued that society already had started many initiatives around food, partly stimulated and facilitated by the government. In the letter, these initiatives are synthesized into a national ‘food agenda’.

The public debate as well as interdepartmental coordination regarding food policy continued in the following year. Various events, referred to as a ‘food dialogue’, were organized to facilitate exchanges of ideas between policy-makers and societal stakeholders. In addition, a hearing was organized by a committee of the House of Representatives and the State Secretary of Agriculture put the question of whether the EU’s CAP should transform toward a Common Food Policy on the agenda of the EU Council of Ministers (The Netherlands Presidency 2016). At the same time, the food policy agenda hardly resulted in the adoption of new policy instruments (de Krom and Muilwijk 2018). Instead, instruments remained organized at sectoral levels and linked to specific issues, whereby some got reframed in terms of food policy. In addition, the three generic objectives that were laid down in the letter to Parliament were not translated into more concrete targets or an implementation agenda. A second letter to Parliament in November 2016, in which the government reported about the progress made with respect to its Food Agenda, therefore largely read as a repetition of the first, although including a stronger emphasis on the international context.

The period from late 2016 through the first half of 2017 saw little changes in this respect. In fact, this period may be characterized as one of slight disintegration. Officials from the three non-leading ministries became disenchanted and less involved (for different reasons, see below), especially after a national ‘Food Summit’ was concluded in January 2017. In addition, no further changes occurred in terms of goals and instruments, apart from some innovation funds made available by the Ministry of Economic Affairs. At the same time, much of this standstill may be explained by the general elections of March 2017. Respondents indicated that the further development of the national food agenda would depend on the outcomes of the subsequent government coalition negotiations.

Key policy mechanisms

Scientific lobbying

The report of the Scientific Council for Government Policy (WRR) proved to be the impetus to the series of events described above. Through its relatively firm and far-reaching policy recommendations, the Council initiated a lasting public debate and essentially forced the government to formulate a response beyond ‘business-as-usual’. As such, the WRR not only synthesized scientific insights and arguments, but also propagated a specific course of governmental action. WRR researchers kept their argument on the political agenda in the period following the publication of the report by elucidating their conclusions in meetings with civil servants and at various public events. The WRR’s report found wide resonance, as it connected well to existing critiques in both academic and policy circles regarding the functioning of sectoral policy frameworks, such as the Common Agricultural Policy and the food safety regime. In the Netherlands, these critiques particularly concentrated on the dominant role of the Ministry of Economic Affairs (which absorbed the Ministry of Agriculture, Nature and Food Quality in 2010) vis-à-vis other ministries, arguing that economic and productionist interests too often prevailed over concerns about food safety, unhealthy diets, animal welfare, and ecological sustainability (cf. Termeer and Werkman 2011; Lelieveldt 2016). The report thus built forth and drew upon existing yet ignored calls for a change of Dutch food governance.

Although clearest at the start of the policy integration process, advisory bodies on the science–policy interface continued to play a role. The Netherlands Environmental Assessment Agency (PBL), Council for the Environment and Infrastructure (Rli), and the National Institute for Public Health and the Environment (RIVM), among others, started and published various studies that kept the debate on food policy alive. These studies were not just pushed for by these bodies themselves; various civil servants, who had come to recognize the need for policy change, strategically commissioned or tried to influence studies, so as to foster a favorable sociopolitical context for ministries’ or personal policy preferences.

We conceptualize the above process as the mechanism of scientific lobbying, which is well known in (science–)policy studies (Fig. 2). Scientific lobbying can be described as a ‘hybrid activity that combines elements of scientific evidence and reasoning with large doses of social and political judgment’ (Jasanoff 1990: 229). There is an extensive body of evidence from Science and Technology studies that shows that such lobbying processes are the rule rather than the exception (e.g., Jasanoff 2004; Grundmann 2009). As opposed to the image of scientific knowledge as neutral and objective, this literature recognizes that policy-relevant scientific knowledge is in itself informed by normative beliefs and values (Grundmann 2009; see also: Stone 2012). Similar insights emerge from the literature on the role of epistemic communities in policy processes (Haas 1992; Meijerink 2005). The WRR and other advisory bodies’ repeated appeal to scientific insights that were embedded within broader normative belief systems about the need for sustainability transitions and more holistic food systems governance connect well to such discussions of scientific lobbying processes.

Fig. 2
figure 2

CMO model of key policy mechanisms in the policy (dis)integration process of food policy in the Netherlands

Protecting turf

That the Ministry of Economic Affairs would respond favorably to the WRR’s report was not self-evident from the beginning; agricultural policy, on which most of the criticism was directed, had been known for its closed and stable configuration of actors and associated interests (Termeer and Werkman 2011; Roederer-Rynning 2015). Consequently, many policy-makers in the directorate general of agriculture, including its director general, had few warm feelings about opening up the policy process. At the same time, the emerging debate on food policy posed new risks to the ministry. Even though the ministry was formally responsible for drafting a response to the WRR’s report, increased recognition of the crosscutting nature of food (systems) resulted in questions about the potential roles other ministries could play. Respondents agreed that it was the fear of losing turf and political–strategic considerations, more than an intrinsic motivation, that made State Secretary of Agriculture Dijksma decide to push for an ambitious letter to Parliament and accompanying agenda within the ministry.

This mechanism of protecting turf has been frequently used in the public policy literature as mechanism to explain failures of attempts at improved policy integration (Bardach 1996; Peters 2015). Interestingly, in this case it initially enabled a strengthening of policy integration, as embracing the food policy agenda led Economic Affairs to also involve the other relevant ministries to some extent. At the same time, it may be argued that the lack of a genuine substantive drive explains why the Food Agenda has had only minimal effects on cross-sectoral goals and instruments. A similar observation applies to the involvement of the other ministries: at least part of the reason why they joined the interdepartmental food policy meetings had to do with protecting existing jurisdictions and resources. This was clearest for the Ministry of Foreign Affairs, which had been in a struggle with Economic Affairs about competencies over international food security efforts a couple of years before. Consequently, this mechanism does not only explain what enabled the first steps toward strengthened integration, but also why progress hampered at later stages. For Health and Environment, the relative lack of prioritization and personnel resources also played a role; as food-related issues were relatively marginal within these ministries under their then leaderships, respondents indicated a fear that Economic Affairs would use this moment to usurp their mandates.

Making one’s mark

Right after the first letter was sent to Parliament in November 2015, the State Secretary of Agriculture, Sharon Dijksma, was transferred to the Ministry of Infrastructure and Environment to clear up the political rubble in that department. She was replaced by her fellow party member Martijn van Dam. As the press conference about the letter had not been held yet, this gave Van Dam the chance to embrace the food policy agenda as his own during his first public appearances. Respondents indicated that Van Dam saw the agenda as a good way of making his mark and strengthening his profile during the remaining one and a half years in office. At the same time, he was also believed to have a stronger personal affiliation with the issue. Consequently, Van Dam continued to push for the food agenda, which explains why policy efforts were not ceded after the succession and initiatives such as the food dialogue and summit were initiated. The Dutch chairmanship of the EU Council of Ministers in the first half of 2016 helped Van Dam, who chaired the Agriculture and Fisheries Council, to find even wider resonance. At the EU level, Van Dam argued for a radical change of the Common Agricultural Policy toward a Common Food Policy. This proposal, which was discussed during an informal Council meeting in Amsterdam, received considerable publicity and support from various European NGOs and think tanks.

This mechanism of making one’s mark bears close similarities to the processes of office- and policy-seeking (Budge and Laver 1986) and, in this case, combines elements of both (cf. Martin 2016). On the one hand, the State Secretary’s push for the food policy agenda served to acquire recognition and respect, possibly to maximize his chances of prolongation or promotion (office-seeking) (cf. Andeweg 2000). As an MP Van Dam was considered a talent within the Labour Party (PvdA), even running for the party’s leadership in 2012, but according to various political commentators he still had to prove himself in a senior position. On the other hand, Van Dam seemed to genuinely believe in broadening up agricultural policy’s goals toward a broader range of public goods (policy-seeking), e.g., illustrated by the quote ‘I am not here just for the farmers’ in a major newspaper, which led to considerable controversy.

Climate change adaptation policy in the Netherlands

Description of the policy (dis)integration process

Although the Netherlands has a long-standing history of dealing with the impacts of climate variability on water, it was only in the late 1990s that the government started to consider the impacts of anthropogenic climate change through future flood risk management scenarios. In the early 2000s, several government-funded research programs investigated the impacts climate change is projected to have on issues other than water and flood risk. However, policy efforts remained very sector-based (Table 3).

Table 3 Dimensions of policy (dis)integration in four episodes of Dutch climate change adaptation policy

The first episode started with increased lobbying of scientists to the Dutch Senate, resulting in the motion ‘Lemstra’ that asked the Cabinet to consider the impacts of climate change in long-term investment projects (2005). The Cabinet installed an interdepartmental program (ARK) to draft a National Adaptation Strategy (NAS) in 2007 (VROM 2007). However, parallel to the ARK program, the Cabinet installed a State Commission in September 2007 to investigate the influence of anthropogenic climate change on long-term water safety. This so-called Delta Committee published their advice in 2008 and broadened the scope of the original question from the Cabinet: their integral vision included advice on large infrastructural measures as well as soft approaches to protect the Netherlands against future sea level rises, storm surges, changing river discharge and precipitation patterns, and fresh water availability (Deltacommittee 2008). The Delta Program, established in 2008 to ensure the implementation of the advice from the Delta Committee and coordinated by the Ministry of Transport, Public Works and Water management (V&W), was operational by the beginning of 2009. The Delta program received very strong institutional and political support.

This earmarks the start of the second episode: as a result of a change of government in 2010, the Ministry of V&W and parts of the ministry of Ministry of Housing, Spatial Planning and the Environment (VROM) merged into the new ministry of Infrastructure and the Environment (I&M), which became responsible for the Delta program as well as the ARK program. During this time, the Dutch government formulated new priorities to adapt to climate change. The new government decided to reframe ‘climate change adaptation’ in terms of more traditional and sectoral focused long-term water safety concerns. Integration of water safety into other domains became less important to the ministry. In 2012, the decision was made to dismantle the ARK program.

Several policy evaluation studies, most notably by the Dutch Court of Auditors (2012), concluded that the Dutch government paid considerable attention to long-term water management, but that the focus was too narrow for dealing with the broader impacts climate change is expected to have on society. The report concluded that there was very limited coordination within and between the ministries to address climate change holistically, noting that there were many negative trade-offs that might be overlooked. The newly installed State Secretary of Environment Mansveld (2012–2015) did not actively address these critiques, which changed after she was succeeded by Dijksma in 2015.

The third episode takes place in the context of the international negotiations on climate change in Paris (2015) as well as the push for more integrative approaches to climate change adaptation in the EU strategy package (2013). Dijksma concluded at the start of her term that a new comprehensive National Adaptation Strategy was needed and that the gaps identified by the Court of Auditors report would have to be explicitly addressed to create a more holistic and integrative adaptation policy. The ministry of I&M played a coordinating role, actively trying to involve other departments and ministries. The new project team was, in contrast to the previous ARK program, not interdepartmental, but involved only members of the ministry of I&M. The NAS was finished in December 2016, but was not discussed in Parliament because of the general elections in March 2017.

Key policy mechanisms

Scientific lobbying

In the early 2000s, scientific awareness grew that adapting to unavoidable climate change impacts was necessary in addition to ongoing efforts to reduce greenhouse gasses. Various research institutes and universities argued that while there had been political attention to mitigation, there was very limited attention to adaptation. Such attention was argued to be crucial to ‘climate proof’ the Netherlands and to allow for further governmental investments in climate change research (Kabat et al. 2005). Climatic extremes experienced during that period, including the 2003 European heatwave and the sustained period of drought that caused inland dikes to collapse, became powerful images for scientists to demonstrate the impacts climate change would have in the future. Leading scientists from various Dutch universities and research institutes started to lobby high-ranked civil servants and key political actors in both the House of Representatives and the Senate for more than 2 years to adopt a holistic view on climate change mitigation and adaptation. This scientific lobbying was successful: during the Senate meeting about the Dutch Long Term Vision for Spatial Planning in 2005, Senator Lemstra put forward a motion that climate change should be considered when making long-term investment decisions. Several scientists were present in the Senate when the motion was passed. Shortly thereafter, then minister Winsemius (VROM), who previously was a professor of sustainable development, responded by installing an interdepartmental program and invested heavily in several large research programs to explore how to climate-proof the Netherlands.

Similar to the food policy case, debates on integrating climate change adaptation started with the mechanism of scientific lobbying, as the climate epistemic community pushed for the inclusion of scientific evidence and reasoning into political decision-making processes (Fig. 3). Scientists framed climate change as a ‘holistic problem’ that required integrated approaches. The presence of extreme events and close ties between science, policy and politics in the Netherlands created favorable conditions that allowed this mechanism to occur.

Fig. 3
figure 3

CMO model of key policy mechanisms in the policy (dis)integration process of climate change adaptation in the Netherlands

Turf wars

Although the first part of the first episode demonstrated rapid progress by delivering reports, creating new institutions, and adopting a National Adaptation Strategy (NAS), the period after 2007 was characterized by struggles between the different ministries involved. Although all interdepartmental project team members were aware that they depended on each other for implementing the NAS, their different ideas about the problem and solution led to increasing tensions in the team. Civil servants from the Ministry of VROM had a strong integrative policy tradition and depended upon their power of persuasion, long-term vision, and linking of different sources of knowledge to develop and implement policy. They framed climate change adaptation as a crosscutting problem that concerns all sectors, levels, and societal actors, and therefore required a holistic approach. The Ministry of V&W, with a sectoral tradition that is orientated toward water management, had strong political and legislative instruments, with substantive resources to implement policies. Although the ministry of VROM was asked to lead the interdepartmental program, civil servants from the Ministry of V&W started to realize that climate change adaptation received increasing political attention and were increasingly of the opinion that adapting to climate change impacts is synonymous to long-term water management. Lacking substantive progress in moving beyond the NAS increased frustrations between the two ministries. This frustration deepened when the more sectoral orientated Delta committee was installed in 2008, which by some interviewees was framed as a strategic move orchestrated by V&W to claim the adaptation agenda.

The mechanisms of protecting one’s turf and (re)claiming the emerging issue of climate change adaptation resemble the pattern observed in the food policy case. Although initially placed in a ministry where the emphasis was on integration, the lacking progress, absence of dedicated instruments within the interdepartmental project team, and changing political orientation in the Netherlands meant that climate change adaptation moved from an integral spatial vision toward a sectoral focus on water safety and freshwater availability. Shortly thereafter, the interdepartmental program was dismantled. This mechanism continued to exist—although less prominent—when the ministry of VROM and V&W were partly merged in 2010.

Policy-seeking

The scientific lobbying mechanism that was triggered around 2012–2013 in itself is not enough to explain why climate change was reframed into a more integrative approach from 2015 onwards. Between 2010 and 2015, economic downturn meant that resources became scarcer. Combined with the emergence of a center-right cabinet, this resulted in decreased attention to environmental issues. The then State Secretary for Infrastructure and Environment of The Netherlands, Mansveld (2012–2015), was not interested in climate change adaptation and could not be persuaded by scientific advice and policy recommendations to make significant changes. Consequently, no policy change occurred. This changed after she was replaced by Dijksma. In preparation for the Conference of the Parties meeting in Paris, where the Paris Agreement (2015) would be signed, Dijksma concluded that drastic and additional efforts were needed to realize the ambitious targets and increase the resilience of the Netherlands. She installed a working group in the Ministry of Infrastructure and the Environment with the task of developing a new comprehensive climate change adaptation strategy for the Netherlands. Rather than forcing other ministries to become involved, the working group invited different ministries to participate voluntarily. Within a few months, a new comprehensive national adaptation strategy was published in December 2016. As one interviewee noted, Dijksma pushed for a quick publication of the strategy to ensure the resigning government would receive the credits still before the 2017 elections.

Dijksma’s role in the policy integration process is a clear example of policy-seeking (cf. Evans 2018). Interviewees noted that Dijksma’s efforts to tackle climate change were driven by genuine personal motives, which showed in her passionate speeches during the Conference of the Parties in Paris and subsequent meetings. They considered her political leadership critical to ensure that new adaptation policy was in place before elections started and, at the same time, get political recognition for this achievement.

Discussion and conclusions

Policy integration figures prominently on the agenda of many politicians and policy-makers and has been a key concern in the public policy literature. By adopting a processual perspective on policy integration, this article showed that policy integration is no linear process; particularly, the climate change adaptation case showed that policy integration is in constant flux and that contextual conditions, such as political orientation, economic conditions, and societal preferences, can trigger mechanisms that increase or decrease integration. Unpacking the dimensions of policy integration into measurable indicators proved an important step for tracking policy integration processes, but answering questions about why and how policy integration occurs requires further elaboration of this conceptual model. In this paper, we showed how connecting the policy integration literature with a mechanisms perspective provides us with a novel lens to uncover underlying configurations of plausible causal mechanisms that explain processes of (dis)integration. Our two illustrative cases demonstrated how such an approach could work. Before discussing the value of this approach, these cases also result in four observations that are worth mentioning.

First and contrary to what we expected, we see similar patterns between the two cases when it comes to the context and mechanisms observed. Both cases start with the scientific lobbying mechanism, experience some kind of struggle—‘turf war’ or competition between ministries causing some level of disintegration—and are followed by a political mechanism of individual leadership that pushes for more integration—‘making one’s mark’ and ‘policy seeking’. This empirical observation deserves further investigation beyond the environmental issues included in this article (food, climate) and in other contexts. If this is a pattern that holds across different contexts, it would allow for more specific hypotheses about the processes of policy (dis)integration. Next steps could include using a more rigorous systems understanding approach to process tracing (Beach 2017) and empirically investigate if the policy mechanisms identified here occur in cases with other contexts; see for example the work of Paz and Fontaine (2018) who use Bayesian statistics to apply several empirical tests to analyze how robust the theorized mechanism is for explaining the outcome.

Second, in both the food and climate change adaptation case we found an important role for science in advocating changes of the dominant policy framing toward strengthened integration. Although much of the policy integration literature focuses on policy-makers’ intrinsic motivations, we observed an important role for science in signaling the complexity and crosscutting character of both issues. This mechanism may have been enabled by broader societal processes, such as the co-production of science and increasing emphasis on impactful interdisciplinary research in the Netherlands and abroad. The climate change adaptation case shows that the scientific lobbying mechanism is not limited to pushing an issue on the political agenda just once; even when policies are showing signs of disintegration or policy failure, scientific and policy assessments can play a pivotal role in revitalizing the debates on the need for more integration.

Third, protecting turf also played an important role in both cases. Interestingly, whereas ‘turf’ is often mentioned as a barrier to policy integration in the literature (Peters 2015), our case studies show that it may, especially in initial phases, also contribute to strengthened integration. Protecting turf might indicate that a crosscutting issue is considered important and taken seriously, and therefore could be an important condition for progressing toward higher degrees of integration. This also shows the importance of context in determining the direction of the causal force to lead to certain outcomes, as is suggested by Falleti and Lynch (2009); different contextual conditions can activate the same mechanism (e.g., ‘protecting turf’), which may, however, have different effects on the outcome (integration or disintegration). This requires further empirical investigation, for example by using large(r)-n research methods such as qualitative comparative analysis (QCA), where the necessity and sufficiency of certain contextual conditions can be tested to identify causal pathways that produce a certain outcome (e.g., a direction of policy integration) (Rihoux et al. 2011).

Fourth, we analyzed two cases in which policy (dis)integration developed in an incremental manner. Although many integration processes are likely to follow such incremental patterns, it raises the question whether we would observe similar mechanisms in the case of more extreme and sudden forms of integration, as for example described by May et al. (2011) in the case of the US Homeland Security regime after 9/11, or in cases of abrupt policy disintegration due to regime changes.

To analyze policy (dis)integration processes, we made use of process tracing to identify the mechanisms that explain policy integration in two cases. Process tracing has been the subject of discussion about whether it adds new and more robust methodological tools to the portfolio of policy analysis, or whether it is merely old wine in new bottles (Hall 2013; Hay 2016). Clearly, process tracing is not a panacea for the methodological challenges to causally explain social phenomena. However, for our specific ambition of opening up the black box of causality in policy integration processes, it has proven to offer valuable methodological directions in empirically demonstrating credible policy mechanisms—and the conditions under which these emerge—for the two cases. Consequently, process tracing, both in inductive and deductive form, could play an important role in advancing debates about the processes of policy integration.

On a more policy substantive level, it remains to be seen whether the national policy efforts to pursue strengthened integration will be successful and will sustain in the implementation phase. For the case of climate change, it seems the new NAS (2016) is more ambitious compared to the previous NAS (2007). Recent developments suggest, however, that renewed focus on water safety, increased political attention on climate change mitigation, and the lack of substantive instruments for climate change adaptation policy that the push for integration started in episode 3 might not be durable. For Dutch food policy, it is perhaps too early to tell as the policy and polity are very much ‘under construction’ and little progress can be reported since September 2017. Recent publications have shown that although the new government re-emphasized the need for strengthening food policy integration, ambitions have remained largely symbolic so far (de Krom and Muilwijk 2018; Candel 2018). In addition, the adoption of ambitious sectoral programs for agriculture (‘Circular Agriculture Strategy’) and public health (‘National Prevention Agreement’) may result in a contextual change that disfavors the activation of mechanisms resulting in strengthened integration.

In practical terms, our mechanistic approach allows policy-makers to design appropriate policy responses for shaping policy (dis)integration where this is desired (Howlett 2019). By intervening in the context, policy-makers may create a more conducive environment for the occurrence of mechanisms that result in policy (dis)integration outcomes. Vice versa, recent literature has suggested that the adoption of procedural instruments can play an important role in (re)shaping contextual regimes (Howlett 2019). However, resulting from the equifinality and multifinality arguments discussed in “Methodological approach: process tracing”, there is no guarantee that such interventions will have the desired effects. This further underlines our argument to obtain a better understanding of the context–mechanism interactions to study processes of policy (dis)integration.