“Evidence-based policy and pragmatism”

Comment: The debates about evidence-based research, practice and policy appear to be never ending. This ongoing contestation is both necessary and predictable, given what is at stake. Basically under consideration are the roles researchers can expect to play in influencing governing practices. I have been interested in this topic for some time.

In 2008 I wrote an article examining debates in the 1970s about “research utilization” and attempts by researchers to influence policy making (Bacchi 2008). I traced the changing dynamics of these debates through to later discussions of the so-called “know-do gap” in relation to the social determinants of health (1990s, 2000s and continuing).  To summarize a rather complicated argument, I highlighted the institutional constraints on researchers – how the topics they investigated (the “problems” set for study) were linked to a large extent to their bases of support. I described a shift, from the 70s to today, to greater and greater reliance on government and other external forms of funding. My argument, put starkly, was that sources of funding influenced topics of research, shaping and limiting the research agenda.

This argument links directly to the evidence-based practice debates but in a way that is not immediately obvious. Current concerns around evidence tend to focus on questions about “whose evidence?”, challenging for example the “hierarchy of evidence” that privileges RCTs (Randomized Controlled Trials). I ask a question that precedes this concern. I ask: “evidence for what?

Put briefly, evidence-base policy enshrines a form of applied problem solving, based on a rational policy model (see Howlett 2010, p. 19). As in this model, what goes under-examined are the “problems” that are assumed to launch both the policy making and research exercises. In evidence-based practice, the focus is on “what works”, assuming that the goals – the research “problems” – set for testing research interventions are legitimate and non-prejudicial. Given the commitment in the “What’s the Problem Represented to be?” (WPR) approach to interrogate assumed policy “problems”, my concern at the willingness to accept and work within such constraints can be anticipated.

Some researchers (Biesta 2007; Sanderson 2003, 2009) who raise critical questions about the “what works” approach to research embrace a version of pragmatism, drawing on Dewey (see Research Hub entry, 30 April 2018). They make an extremely important point – that critical scrutiny needs to target not just the means of research but the ends as well. However, this goal is compromised, I believe, by the lack of attention to how a problem-solving mindset – which both authors are loath to abandon – continues to assume the existence of legitimate, predetermined “problems” as research foci.

In this vein Biesta (2007: 15, 18), drawing on Dewey, endorses a form of “reflective experimental problem solving” or “professional problem solving”, and continues to assert that the goal of policy is to “successfully solve problems” (Biesta, p. 19; emphasis added). Along similar lines, Sanderson (2009, p. 699; emphasis added) identifies as one intellectual pillar in thinking about evidence-based policy, “social scientific knowledge and its role in guiding action to address social problems”.[1]Drawing on Dewey, he asserts that “the foundation for the development of knowledge about the world lies in active engagement with concrete problems” (Sanderson 2009, p. 709; emphasis added). This engagement, says Sanderson (p 709), involves “commitment to the methods of scientific inquiry and to the principle of experimentation, subjecting hypotheses to empirical test in an active engagement with experience”.

Sanderson’s aspiration is to produce a modified (“neo-modern”) approach to policy making that incorporates “a broader perspective” based on dialogue and argumentation. He (p. 710) insists that “our knowledge is always fallible and open to further interpretation and criticism”. As a result he recommends that we “introduce pilots or trials, evaluate their success and move forward cautiously” (p. 714).

WPR intervenes in these debates by pointing to the non-innocence of the “problems” set for researchers. It argues that the failure to question the “problems” set for analysis – or for pilot studies! – limits severely the scope of any critique. Put simply, I argue that, in order to interrogate the ends of research – which both Biesta and Sanderson endorse strongly –, one needs to interrogate the beginnings– the “problems” set for investigation.

I want to ask, for example – just how many more studies of “obesity” do we need? How has “obesity” come to be constituted as a health “problem”? How does it function to shape health research practices? What fails to be attended to in such research? What is not being investigated? On the implications for researchers, I can do no better than quote Merton and Lerner’s 1951 (p 306) caution:

The scientist is called upon to contribute information useful to implement a given policy, but the policy itself is “given”, not open to question … So long as the social scientist continues to accept a role in which he (sic) does not question policies, state problems, and formulate alternatives, the more does he (sic) become routinized in the role of bureaucratic technician.

A first step toward challenging this designated and compromised role, I suggest, is to disrupt the problem-solving mindset that dominates the current intellectual and policy landscape. WPR aims to contribute to this goal.

References:

Bacchi, C. 2008. The politics of research management: Reflections on the gap between what we “know” [about SDH] and what we do.  Health Sociology Review, 17(2): 165-176.

Bacchi, C. 2016. Problematizations in Health Policy: Questioning how “Problems” are Constituted in Policies. Sage Open, April-June: 1-16.  Bacchi Problematizations Health Policy DOI: 10.11771/21582440/6653986.

Biesta, G. 2007. Why “What Works” Won’t Work: Evidence-based practice and the democratic deficit in educational research, Educational Theory, 57(1):

Howlett, M. 2010. Designing Public Policies:  Principles and Instruments. Routledge.

Merton, R. K. and Lerner, D. 1951. Social scientists and research policy. In D. Lerner and H.D. Lasswell (eds) The Policy Sciences: Recent Developments in Scope and Method. Stanford, California: Stanford University Press, pp. 282-363.

Sanderson, I. (2003). Is it “what works” that matters? Evaluation and evidence-based policy-making, Research Papers in Education, 18(4): 331-345.

Sanderson, I. (2009). Intelligent Policy Making for a Complex World: Pragmatism, Evidence & Leaning, Political Studies, 57: 699-719.

[1]Sanderson’s (2009, p 699) other intellectual pillar comprises “our developing knowledge about complex adaptive systems”. I have raised qualms about the “turn to complexity” in Bacchi 2016.

“Comparing WPR and critical discourse analysis”

Comment: I have been asked to clarify the distinction between WPR and critical discourse analysis. I should preface this brief elaboration by saying that, while I distance WPR from critical discourse analysis, I am not saying that such forms of analysis are not valid or worthwhile. Rather, my intent is to assist those who want to use WPR to have a clearer idea of its goals and its way of proceeding.

Basically, WPR is not a form of critical discourse analysis because it has a different understanding of discourse. In WPR, discourse refers, not to language or language use, but to knowledges, which Foucault (1994) describes as “unexamined ways of thinking”. In Analysing Policy (Bacchi 2009, p. 35) I describe discourses as “forms of social knowledge that make it difficult to speak outside the terms of reference they establish for thinking about people and social relations”. Hence, the focus of analysis is not on how people shape arguments, as in critical discourse analysis, but on the deep-seated ways of thinking that underpin political practices (see Bacchi and Bonham 2014).

It needs to be made clear that, in WPR, “knowledge” is not treated as a form of foundational wisdom to be acquired. Rather, “knowledge” is a contested political creation. The interest is not in discovering or producing “knowledge”, but in analysing how all forms of knowledge are linked to power and politics.

Elsewhere I (Bacchi 2005) have suggested that it is useful to draw a distinction between two analytic traditions, that involved in “discourse analysis” and that committed to “analysis of discourses (knowledges)”. The first tradition, which includes Norman Fairclough’s version of Critical Discourse Analysis (CDA) (2010), focuses primarily on the content and linguistic construction of a text.  By contrast, in the second tradition, exemplified in WPR, the task is “to identify, within a text, institutionally supported and culturally influenced interpretive and conceptual schemas (discourses) that produce particular understandings of issues and events” (Bacchi 2005).

The drawing of boundaries between theoretical stances is a fraught exercise. Siegfried Jäger and Florentine Maier (2009) agree that in Foucault discourses are knowledges but they locate him within Critical Discourse Analysis. In contrast, I believe it is useful to distinguish an “analysis of discourses” from the focus in critical discourse analysis on language use.

Question 2 in WPR (Bacchi WPR CHART) prompts such an “analysis of discourses”. The objective in this form of analysis is to better understand how governing takes place through knowledges (discourses), including psychiatry, behavioural economics and public health knowledges, among many others.

It follows from these contrasting foci that WPR is not intended as a tool for analyzing debates or forms of argumentation, which are studied in critical discourse analysis through identification of metaphors and other forms of language use. Nor is it intended to examine competing frames within arguments (Bacchi, 2016 Bacchi Problematizations Health Policy) or the “problem definitions” produced by policy actors (see Bacchi, 1999, p. 21; see Research Hub entry 2 April 2018). Rather it serves as a strategy for reflecting critically on deep-seated ontological and epistemological assumptions within “problem representations”.

Because “problem representations” are the starting point for a WPR analysis, it is important to clarify how we are to identify them. Clarity here is especially important since the language of representation can be misleading. To put it starkly, WPR does not examine how people represent an issue, which could form part of some CDA projects. Rather, problem representations are the implied “problems” in policy proposals – how a “problem” is characterized and conceptualised within a policy proposal or some other text (see Bacchi 2017; see also Research Hub entry, “Buildings as proposals”, 14 January 2018).

To gain access to “problem representations”, a WPR analysis begins by identifying the proposals for change (or proposed “solutions”) within governing texts. These proposed solutions may be stated directly or indirectly. For example, a government report that calls for social cohesion makes a form of proposal, creating lack of cohesion as the “problem”. Policies themselves are proposals for change and can be treated as such. If, for example, the government sends police and troops into outback Aboriginal communities in “response” to a report on child sexual abuse in those communities, the “problem” is constituted to be a matter of inadequate law enforcement (see Bacchi 2009, pp. 116-120).

Adopting a governmentality theoretical stance, governing in a WPR approach encompasses government in the narrow institutional sense, as in the above examples, alongside the full range of agencies and associated knowledges (discourses) that conduct conduct (Bacchi and Goodwin 2016, p. 5). By examining what is proposed, it is possible to grasp what is rendered problematic – what the “problem” is represented to be (Bacchi and Goodwin, p. 16). Hence it becomes possible to “read off” implicit problem representations from specific proposals.

This way of proceeding makes it possible to consider how “problems” are produced as problems of specific kinds within governing practices. There is no need to look outside the policy or other selected text to seek out starting points for analysis; these starting points (problem representations) are locatable within the material chosen for examination (hence the researcher is not imposing a schema upon the material). The argument in WPR is that, since governing takes place through these problem representations, it is important to reflect on where they come from and how they operate to shape “realities”. These tasks are undertaken in subsequent WPR questions (Bacchi WPR CHART).

The focus of analysis in WPR is therefore different from that within critical discourse analysis. The target is not linguistic devices or patterns of communication. Nor is it imposed frames or “problem definitions”. The goal is to tease out deep-seated “ways of thinking” in identified problem representations that play significant roles in how governing takes place. Due to researchers’ immersion within these “ways of thinking”, a practice of self-problematization – examining the problem representations in one’s own proposals – forms a central task in WPR (see Step 7, Chart).

References

Bacchi, C. 1999. Women, Policy and Politics: The construction of policy problems. London: Sage.

Bacchi, C. 2005. Discourse, Discourse Everywhere: Subject “Agency” in Feminist Discourse Methodology. NORA: Nordic Journal of Women’s Studies, 13(3), p. 199. Reproduced in C. Hughes (Ed.) (2012). Researching Gender. Sage Fundamentals of Applied Research Series.

Bacchi, C. 2009. Analysing Policy: What’s the Problem Represented to be?  Frenchs Forest, NSW: Pearson Education.

Bacchi, C. 2016. Problematizations in Health Policy: Questioning how “Problems” are Constituted in Policies. Sage Open,April-June: 1-16. DOI: 10.11771/21582440/6653986.

Bacchi, C. (2017). Drug Problematizations and Politics: Deploying a poststructural analytic strategy, Contemporary Drug Problems, 1-12. DOI: 10.1177/009/450917748760.

Bacchi, C. & Bonham, J. 2014. Reclaiming discursive practices as an analytic focus: Political implications. Foucault Studies, 17 (March): 173-192.

Bacchi, C. & Goodwin, S. 2016.  Poststructural Policy Analysis: A guide to practice. New York: Palgrave Macmillan.

Fairclough, N. 2010. Critical Discourse Analysis: The critical study of language, 2nd ed. Harlow: Longman.

Foucault, M. (1994) [1981]. So is it important to think? In J.D. Faubion, (Ed.), Power: Essential works of Foucault 1954–1984, vol. 3, Hurley, R. and others (trans.). London: Penguin).

Jäger, S. and Maier, F. 2009.  Chapter 2: Theoretical and Methodological Aspects of Foucauldian Critical Discourse Analysis and Dispositive Analysis. In R. Wodak and M. Meyer (eds) Methods of critical discourse analysis (2nd ed.). London, England: Sage.

“The (re)turn to pragmatism”

COMMENT:  This entry is prompted by the frequency with which I have encountered endorsements of pragmatism in recent research. My goal is to describe briefly reasons for this (re)turn to pragmatism and to consider connections with and/or disconnections from WPR.

I feel impelled to pursue this topic due mainly to the links I perceive between positions on pragmatism and conceptions of critique. I am also interested in and concerned by the ways in which a governmental problem-solving paradigm, targeting “what works”, is aligned with a kind of pragmatism (see Bacchi 2009, Chapter 10, pp. 238-241).

Pragmatism, like all concepts, has many meanings. There are versions described as “philosophical pragmatism”, “sociological pragmatism”, French “pragmatic sociology” (Boltanski and Thévenot 2006) and “classical pragmatism”, associated with the American philosophers William James, John Dewey and Charles Sanders Peirce.

Each version requires careful analysis that cannot be offered here. My major interest at this time is the association between some STS (Science, Technology and Society) theorists, connected with Actor-Network Theory, and pragmatism, with common invocations of John Dewey (Latour 2007a, 2007b; Marres 2007). Certain themes in classical pragmatism, specifically its anti-foundationalism and anti-dualism, explain these associations (Keulartz et al, 2002, pp. 14-15). On whether an affiliation with those themes makes one a pragmatist, I share Ian Hacking’s (2007, p. 48) repudiation: “those selfsame perspectives do not owe much to pragmatism, and do not define one as a pragmatist unless one so chooses”.

My major concern, perhaps unsurprisingly, is the pragmatist’s anti-skepticism, defended on the grounds that skepticism (questioning or problematizing) “forms an obstacle to a creative tackling of problems”: “Anyone who puts everything up for discussion will simply have no time left for the real problemsof the moment” (Keulartz 2002, p. 15; emphasis added). It is of course the very presumption in these statements that “real problems” exist as self-evident “things” or conditions that WPR sets out to challenge.

On similar grounds I am hesitant about Dewey’s defense of a problem-solving approach to education and public policy. Questioning in Dewey is restricted to occasions when you find yourself “in what Dewey called ‘a problematic situation’ – a situation in which you are no longer sure of what you are doing” (Rorty 1996, p. 44). It seems to be that this “problematic situation” is presumed to have a taken-for-granted existence that requires critical analysis through application of the WPR questions (see Bacchi 2016, p. 4 Bacchi The Turn to Problematization).

It is on this point that there appear to be connections between stances on pragmatism and approaches to critique. Latour’s (2004) classic piece addressed to why, in his view, critique has run out of steam,expresses disquiet with the tendency in contemporary critique, in his words, to “debunk” and a desire to replace that tendency with “assembling”. This stance affirms the link I have described between pragmatism, which Latour espouses, and anti-skepticism.

At one level I would want to challenge a dichotomy between “debunking” and “assembling” but, more seriously, I worry that such a dichotomy undermines a much-needed critical skepticism towards contemporary governing technologies. This need is particularly apparent in the trend over at least the last two decades (in western countries and in international organisations) to promote a “pragmatic” public policy focused on problem solving, evidence-based policy and “what works” (including “nudge theory”; see entry 26 November 2017).

I am pursuing links between this ubiquitous and influential paradigm and the endorsement of problem solving in John Dewey and other classical pragmatists. I want to ask – how are these positions compatible and perhaps even reinforcing? Bellman (2006) shows that Dewey is drawn upon in Germany to defendtechnocratic education reforms such as standardized testing, whereas in the United States, Dewey is put forward as a criticof these reforms. It seems important to ask how these contrasting positions came to be and how pragmatism can be invoked to support such divergent political projects. To this end I am currently involved in producing a genealogy of problem-solving models and theories. Such a project demands a healthy dose of skepticism!

REFERENCES

Bacchi, C. (2009).Analysing Policy: What’s the Problem Represented to be?  Frenchs Forest, NSW: Pearson Education.

Boltanski, L. and Thévenot, L. (2006) [1991]. On Justification: Economies of Worth. Princeton, NJ: Princeton University Press (translated by Catherine Porter).

Bellman, J. (2006). “The Reception of John Dewey in the Context of Contemporary Educational Reform – a German-American Comparison”, Studies in Educational Policy & Educational Philosophy,5(1): 1-15.

Hacking, I. (2007). “On Not Being a Pragmatist”, in C. J. Misak (ed.) New Pragmatists. Oxford: Oxford University Press.

Keulartz, J., Korthals, M., Schermer, M. and Swierstra, T. (2002) “Ethics in a Technological Culture: A Proposal for a Pragmatist Approach”, in J. Keulartz et al, (eds) Pragmatist Ethics for a Technological Culture. Dordrecht: Springer-Science+Business Media.

Latour, B. (2004). “Why Has Critique Run out of Steam? From Matters of Fact to Matters of Concern”, Critical Inquiry,30(2): 225-248.

Latour, B. (2007a). Reassembling the Social: An Introduction to Actor-Network-Theory. First published in 2005. Oxford: Oxford University Press.

Latour, B. (2007b). “Turning Around Politics: A Note on Gerard de Vries’ Paper”, Social Studies of Science, 37(5): 811-820.

Marres, N. (2007). “The Issues Deserve More Credit: Pragmatist Contributions to the Study of Public Involvement in Controversy”, Social Studies of Science, 37(5): 759-780.

Rorty, R. (1996). “Response to Simon Critchley”, in C. Mouffe (ed.) Deconstruction and Pragmatism. London: Routledge. pp. 41-47.

“Troubling ‘wicked problems'”

Comment: This entry is prompted by a stimulating article by Marlon Barbehön, entitled: “Ever more complex, uncertain and urging? ‘Wicked problems’ from the perspective of anti-naturalist conceptualizations of time” (Zeitschrift Diskurs, April 2018; accessed through academia.edu.au). I draw on this article in two ways: first, to indicate the usefulness of troubling wicked problems as supposedly self-evident, natural or objective entities; and second, to suggest that the analysis offered by Barbehön resonates with WPR even though there is no mention of the approach (nor need there be!).

On the first point, I have found “wicked problems” troubling for some time. In my 2016 paper on problematizations in health policy I suggest that “wicked problems” tend to refer to “problems” as fixed or self-evident, even though they are held to be “complex”. Hence, the term reinforces a problem-solving mindset – “the conventional, pervasive view of policy as reactingto problems that must be solved” (Bacchi The Turn to Problematization, p. 8).

Here I am not ignoring the way in which some researchers use the term to stress the importance of acknowledging that certain policy “issues” are multi-causal and require intersectoral interventions. However, treating such issues as given, as fixed in some way, I suggest, undermines attempts to understand the governing practices involved in their production. Think here of “obesity” and “climate change” as commonly “identified” wicked problems and what is left unsaid in their naming and characterization.

Barbehön (2018) supports my disquiet with the concept “wicked problems”. His particular target is the tendency to refer to “them” as pressing or urgent, as if this is a naturalcharacteristic of such “problems”. As he describes, “wicked problems” are generally characterized as naturally“complex” and “uncertain”. Barbehön links this view to the tendency in a good deal of contemporary social theory to characterize the present as “fundamentally risky” (think of Beck 1992), unpredictable or uncertain (think of Callon et al. 2009), due to the “speedup of economic and technological dynamics”. Counter to this assumption, Barbehön offers “anti-naturalist perspectives” on time drawn from phenomenology and systems theory. Put much too simply, if how we think about time affects our theorizing, clearly it is important to reflect on the political implications of specific conceptions (of time). The suggestion here is that it is inadequate to say that there are “problems” which naturally reflect the “speed up” of technology; rather, we want to ask how our problematizations reflect specific conceptualizations of time.

The more general point is the need to reflect on the political implications of characterizing policy “problems” either as “wicked” or indeed as “tame” – commonly set as the counterpoint to “wicked”. Barbehön is particularly helpful on this point. In specific cases, he shows, since “wicked problems” are deemed to be naturally “complex” and “urgent”, they operate as “things” that can never be solved but only managed “in a never-ending chain of decisions” (p. 4), supporting a managerial style of governing. The “politics of urgency” can also, in specific instances, be reflected in “quick solutions”, “sometimes at the cost of democratic procedures” (p. 13). On the flip side, “problems” designated “tame” become the stuff of routine, thereby avoiding critical analysis and possible contestation.

Barbehön’s intervention – and you do not need to accept all parts of his argument to recognize the usefulness of his main contention – leads to the need to rethink current research and writing on “wicked problems”. Instead of trying to characterize “them”, to say what they are, we need to ask what they are represented to be and to consider the political implications of specific representations.

Here I see Barbehön’s analysis as paralleling the thinking in WPR. In effect, he asks (without using the words): “what kind of ‘problem’ are ‘wicked problems’ represented to be?”  He details the characterization of “wicked problems” as “complex, uncertain and urgent”, and proceeds to explore the assumptions underpinning these representations (Question 2 of WPR; Bacchi WPR CHART). His analysis is particularly useful because it illustrates the type of deep-seated ontological and epistemological assumptions targeted in a WPR analysis – here, assumptions about conceptions of time. Further, he probes the political implications (Question 5) of such assumptions.

My point in signaling the parallels between Barbehön’s analysis and a WPR analytic strategy is to suggest that the WPR approach offers a way of thinking that has a long and fertile heritage in critical literature. It also signals the possible usefulness of applying WPR to forms of knowledge production, such as, in this instance, the theorizing of “wicked problems” (see entry 18 March 2018). The aim of systematizing the WPR approach in a list of questions (see Chart) is to facilitate its application and hence hopefully to encourage this way of thinking – a way of thinking that I believe we desperately need in the current intellectual climate of evidence-based policy and problem-solving models of thought.

Addendum: I am currently researching the ways in which ANT (Actor Network Theory) scholars turn to “issues” as the focus and starting point for political analysis (Marres 2007). On this topic Bruno Latour (2007) quotes Walter Lippman approvingly:

Yet it is controversies of this kind, the hardest controversies to disentangle, that the public is called in to judge. Where the facts are most obscure, where precedents are lacking, where novelty and confusion pervade everything, the public in all its unfitness is compelled to make its most important decisions. The hardest problems are those which institutions cannot handle. They are the public’s problems (Lippmann: 1927, 121; CB’s emphasis).

I have a long list of questions provoked by this quote – e.g. What are the implications of portraying the majority of political “issues” as able to be handled by institutions? How is the “public” unfit? What makes something a controversy? Are controversies unambiguous empirical objects or political creations?  For the entry today I draw attention to the invocation of “hard problems” as assumed givens that, in my view, require critical questioning along the lines of WPR. In a sense “hard problems” appear to be precursors of “wicked problems”, which I find troubling. I would be keen to hear from anyone who is pursing this or related topics.

References

Beck, U. (1992) Risk Society: Towards a New Modernity. First published in 1986. London: Sage.

Callon, M., Lascoumes, P. & Barthe, Y. (2009) Acting in an Uncertain World: An Essay on Technical Democracy. First published in 2001. Cambridge, Mass: MIT Press.

Latour, B. (2007) “Turning Around Politics: A Note on Gerard de Vries’ Paper”, Social Studies of Science, 37(5): 811-820.

Lippman, W. (1993 [1927]) The Phantom Public. New Brunswick: Transaction Publishers.

Marres, N. (2007) “The Issues Deserve More Credit: Pragmatist Contribution to the Study of Public Involvement in Controversy”, Social Studies of Science, 37(5): 759-780.

“Comparing framing, problem definition and WPR”

COMMENT:  I have been asked on several occasions how WPR is similar to or different from analyses that refer to framing and/or problem definition. I have written on this topic elsewhere and refer you to the sources at the end of this entry if you want to pursue the matter.

It seems important to locate this discussion in relation to views on the meanings of concepts. I argue, in good company, that concepts have no fixed meaning. They are never exogenous to (outside of) social and political practices. Therefore, we need to examine carefully specific uses of terms, including “discourse”, “reflexivity”, and our topics today, “framing” and “problem definition”. It is important to approach such theoretical languages as part of a terrain that needs to be mapped – see if you can identify something of the history of various usages (see Bacchi 2009) and try to ascertain the particular role or function served by the concept/s under investigation. That is, consider the meanings of concepts in terms of the specific projects to which they are attached. Following this thinking, you ought not to be surprised to see that “framing” and “problem definition” appear in many different theoretical projects, and with contrasting meanings.

In the main, “frames” are used by scholars who are interested in how social actors manage political arguments. Hence, in the main, they are interpretivists (see Bacchi 2015). As an illustration of this perspective, in the 1970s and 1980s an important group of American political scientists advocated training policy advocates in the skills of “framing” and “problem definition” (e.g. rhetoric). Dery (1984), for example, dedicates an entire book to “problem definition,” which in his view requires political scientists to be concerned “with the production of administratively workable and politically realistic ideas for solving social problems” (p. 38). A later development, within sociology, focuses on what is referred to as “strategic framing”, the marshaling of particular “problem definitions” to gain political support  (see Bacchi 2009).

In these approaches “problem definitions” and “frames” become competing interpretationsof an issue or problem, interpretations mounted by diverse social actors. By contrast, a WPR analysis interrogates how “problems” are conceptualised within policy texts. It starts from proposals within policies to see how they represent the “problem”, rather than examining how specific social actors mount their arguments. These contrasting starting points are tied to deep disagreements about the status of the political subject and the meaning of power, and have implications for political agendas (see Bacchi 2015).

A more recent development in health sociology draws on “discourse analysis” to examine how “problems” are conceptualized (or “framed”) within policy documents, suggesting a closer link with WPR than previous usages of frame theory (Bacchi 2016). However, the authors associated with this development locate themselves within “the linguistic turn”, whereas WPR offers a study of knowledges rather than of language use (see Bacchi and Bonham, 2014). The primary target of these frame theorists is the rhetorical distance between descriptions of “problems” within policies on the one hand and “recommendations” for change on the other hand, which are judged to be limited or disappointing. By contrast, in WPR, the target of analysis is not the rhetorical ploys of governments judged to be reluctant to deliver substantive change, but deep-seated “unexamined ways of thinking” (Foucault, 1981/1994, p. 456) that underpin specific policy proposals and shape “problems” as particular kinds of problems.

There is no doubt that the word “frame” is a useful term. At a very general level it means simply the shape or configuration of an argument or stance. For this reason I have occasionally used the term myself – though I now resist doing so to avoid confusion between WPR and frame theory. The emphasis on “problem representations” in WPR, as opposed to “problem definitions”, indicates the commitment to subject existing policies to critical interrogation.

I was reminded recently that no concept is “sacred” in some research I have been conducting on Herbert Simon, who wrote in the 1940s and 1950s primarily on administrative behaviour and decision-making (Bacchi 1999: 22-23). In later work Simon uses the concepts of framing and indeed “problem representations” (how disconcerting!). A closer look (Simon 1978: 275-276) clarified Simon’s usage of “problem representation”.  For Simon a “particular subject represents a task in order to work on it” and the “relative ease of solving a problem will depend on how successful the solver has been in representing critical features of the task environment in his problem space” (emphasis added). The focus in Simon’s perspective, therefore, is on social actors and their relative ability to produce “successful” representations – those that assist in “solving problems”. There is no interest in probing critically how “problems” are produced as particular sorts of problems. I hope the distance from WPR is clear, despite the overlap in theoretical terminology!

References

Bacchi, C. (1999) Women, Policy and Politics: The construction of policy problems, London: Sage. pp. 20, 21, 27,  34, 36-37.

Bacchi, C. (2009). “The issue of intentionality in frame theory: The need for reflexive framing,” in E. Lombardo, P. Meier and M. Verloo (eds) (2009) The Discursive Politics of Gender Equality: Stretching, bending and policymaking. NY: Routledge. pp. 19-35.

Bacchi, C. (2015). “The Turn to Problematization: Political implications of contrasting interpretive and poststructural adaptations”. Open Journal of Political Science, 5: 1-12. [Bacchi The Turn to Problematization]

Bacchi, C. (2016) “Problematizations in Health Policy: Questioning How “Problems” Are Constituted in Policies”, Sage Open, pp. 1-16 [Bacchi Problematizations Health Policy]

Bacchi, C. & Bonham, M. (2014). Reclaiming discursive practices as an analytic focus’. Foucault Studies, 17 (March): 173-192.

Dery, David (1984). Problem Definition in Policy Analysis.Foreword by Aaron Wildavsky. Lawrence, KS: University Press of Kansas.

Foucault, M. (1994). So is it important to think? (R. Hurley & others, Trans.). In J. D. Faubion (Ed.), Power: Essential works of Foucault 1954-1984(Vol. 3, pp. 454–458). London, England: Penguin. (Original work published 1981)

Simon, Herbert (1978). “Information-Processing Theory of Human Problem Solving”, in W.K. Estes (ed.) Handbook of Learning and Cognitive Processes, Vol. V. Hillsdale, NJ: Lawrence Erlbaum Associates, pp. 271-295.