A broad-scale quantification of the measure of quality for scholarship is under way. This trend has fundamental implications for the future of academic publishing and employment. In this essay we want to raise questions about these burgeoning practices, particularly how they affect philosophy of education and similar sub-disciplines. First, details are given of how an ‘impact factor’ is calculated. The various meanings that can be attached to it are scrutinised. Second, we examine how impact factors are used to make various (...) ‘high stakes’ academic decisions, such as hiring and promotion, funding of research projects and how much money is to be awarded to a particular area. By focusing on a particular practice, problems with the application of the metric generally are outlined. Finally, we offer some general observations about the unintended consequences and other problems arising from the widespread use of this metric, including attempts to ‘game the system’. We argue that the use of impact factors increasingly shapes the kind of topics and issues scholars write on, their choices of methodology, and their choice of publication venues for their work. Technical measures and mechanisms tend to ‘colonise’ the qualitative and professional judgments that must also be part of the process of evaluation, and for which bibliometrics alone cannot offer a substitute. (shrink)

In many countries publications in Web of Knowledge journals are dominant in the evaluation of educational research. For various purposes comparisons are made between the output of philosophers of education in these journals and the publications of their colleagues in educational research generally, sometimes also including psychologists and/or social scientists. Taking its starting-point from Hayden’s article in this journal , this paper discusses the situation of educational research in three countries: The Netherlands, South Africa and Norway. In this paper an (...) alternative for comparing research output is offered by invoking comparisons with colleagues at the international level from within the same sub-discipline. It is argued that if one would do so a different picture would emerge, even if one were to limit oneself to particular kinds of publications. The case is then made that if comparisons are regarded as a necessary part of the evaluation of an individual scholar , it would be more fair to use a proxy system which is sub-discipline specific, or minimally contains some kind of correction factor in relation to the over-all quality assessment device. Debates about the relevance or irrelevance of philosophy of education in the context of educational sciences are now obscured, even poisoned by focusing almost exclusively on a particular kind of publication output. As the ‘reward’ system that is developed accordingly is possibly the most important driver of educational research, it puts the sub-discipline unduly under pressure to the extent that it possibly cannot survive. (shrink)