The demand for greater public accountability is changing the nature of ex ante peer review at public science agencies worldwide. Based on a four year research project, this essay examines these changes through an analysis of the process of grant proposal review at two US public science agencies, the National Institutes of Health (NIH) and the National Science Foundation (NSF). Weaving historical and conceptual narratives with analytical accounts, we describe the ways in which these two agencies struggle with the question (...) of incorporating considerations of societal impact into the process of peer review. We use this comparative analysis to draw two main conclusions. First, evaluation of broader societal impacts is not different in kind from evaluation of intellectual merit. Second, the scientific community may actually bolster its autonomy by taking a broader range of considerations into its peer review processes. (shrink)

In recent times there has been a surge in interest on policy instruments to stimulate scientific and engineering research that is of greater consequence, advancing our knowledge in leaps rather than steps and is therefore more “creative” or, in the language of recent reports, “transformative.” Associated with the language of “transformative research” there appears to be much enthusiasm and conviction that the future of research is tied to it. However, there is very little clarity as to what exactly it is (...) and what criteria might be used to design policy instruments to make more of it happen. In this paper, we contribute to the construction of a framework within which some conceptual clarity might be gained. We develop four analogies, or metaphors, that are found in the discourse about “transformative research” and show what they imply for the meaning of the notion and, as a result, both the phenomena that might be associated with it and the levers that would be available to design policy instruments. The analogies serving as theoretical metaphors that we propose, and also document to be present either explicitly or implicitly in the discourse about “transformative research,” are the stock market highlighting risk; the process of evolution and its selection mechanisms; the process of popular culture and the power of “hot” events; and exploration of the frontier of the unknown. No single analogy covers all the relevant issues. Together they help identify a field of phenomena and the potential and challenges “transformative research” presents to policy. (shrink)

“Basic research” is often used in science policy. It is commonly thought to refer to research that is directed solely toward acquiring new knowledge rather than any more practical objective. Recently, there has been considerable concern about the future of basic research because of purported changes in the nature of knowledge production and increasing pressures on scientists to demonstrate the social and economic benefits of their work. But is there really something special about basic research? The author argues here that (...) “basic research” is a flexible and ambiguous concept that is drawn on by scientists to acquire prestige and resources. She shows that it is used for boundary work and gives examples of the work it does in different situations by drawing on interviews with scientists and policy makers on the category of basic research and the changes they have seen in it over time. (shrink)

Here we present the framework of a new approach to assessing the capacity of research programs to achieve social goals. Research evaluation has made great strides in addressing questions of scientific and economic impacts. It has largely avoided, however, a more important challenge: assessing (prospectively or retrospectively) the impacts of a given research endeavor on the non-scientific, non-economic goals—what we here term public values —that often are the core public rationale for the endeavor. Research programs are typically justified in terms (...) of their capacity to achieve public values, and that articulation of public values is pervasive in science policy-making. We outline the elements of a case-based approach to public value mapping of science policy, with a particular focus on developing useful criteria and methods for assessing public value failure, with an intent to provide an alternative to market failure thinking that has been so powerful in science policy-making. So long as research evaluation avoids the problem of public values, science policy decision makers will have little help from social science in making choices among competing paths to desired social outcomes. (shrink)

More Heat Than Light is a history of how physics has drawn some inspiration from economics and also how economics has sought to emulate physics, especially with regard to the theory of value. It traces the development of the energy concept in Western physics and its subsequent effect upon the invention and promulgation of neoclassical economics. Any discussion of the standing of economics as a science must include the historical symbiosis between the two disciplines. Starting with the philosopher Emile Meyerson's (...) discussion of the relationship between notions of invariance and causality in the history of science, the book surveys the history of conservation principles in the Western discussion of motion. Recourse to the metaphors of the economy are frequent in physics, and the concepts of value, motion, and body reinforced each other throughout the development of both disciplines, especially with regard to practices of mathematical formalisation. However, in economics subsequent misuse of conservation principles led to serious blunders in the mathematical formalisation of economic theory. The book attempts to provide the reader with sufficient background in the history of physics in order to appreciate its theses. The discussion is technically detailed and complex, and familiarity with calculus is required. (shrink)

Scrutinizes the fundamental myths that have guided the formulation of science policy for half a century myths that serve the professional and political interests of the scientific community, but often fail to advance the interests of society as a whole.