(This post is the result of a facebook debate started by Eric Schliesser)

 Given that what we are doing in philosophy might be footnotes to Plato all the way down, citation practices might not seem worth further discussion (that would be footnotes on footnotes in footnotes on Plato). But Kieran Healy’s data recently revealed the degree to which citation numbers cluster around certain big names. Citation practices seem to depend significantly on informal norms and expectations within the academic community. It is worth bringing these up for debate: more awareness of who is quoted, and why, could not only improve scholarship, but also help to make the hierarchies between the (perceived) centre and the (perceived) periphery of the academic community flatter.

When writing a scholarly text, one faces a combination of two constraints:

 1)    usually, you cannot quote everything that has been written on a topic. Some journals explicitly state that fewer references are more welcome

2)    there are some authors that you simply have to quote, otherwise it will seem as if you have not engaged with the literature at all

 So the rational thing to do is to quote the big names, and to leave out authors who seem to be minor figures in their fields. But by not citing an author, you deny your own readers a chance to get to know his or her thought; not to mention the issue of citation numbers being used in promotion dossiers etc. To cite or not to cite is a form of exercising power. And the combination of the two constraints means that this power is often exercise to the benefit of those who are (considered to be) in the centre of the academic community to the detriment of those who are (considered to be) at its periphery, not only in terms of gender and race, but also in terms of institutions and countries.

 Much of this is likely to happen on an unconscious level. But this does not make things better. It shapes the expectations of what one should read and what one is justified in dropping. Such expectations are social facts, created by formal and informal norms in the academic community. So when writing a text, most authors will be influenced by what they expect their colleagues/readers/referees to know. The unconscious version seems to be something like: Do I expect my colleagues/readers/referees to blame me for not having read or cited a certain author? The cynical version goes: can anything happen to me if I disregard a certain person’s work? Does he or she have powerful buddies? Am I going to run into them at conferences, or are they from countries or institutions where they don’t have travel money anyway? And then it’s easy to jump to a quick conclusion: if I won’t reference them, why should I bother reading them, if I have so little time for reading anyway!

 This might be just another instance of the Matthew effect in academia. It is likely to be more accentuated than for conferences, however, because of the sheer physical impossibility of being at several conferences at the same time, even if you are the most sought-after philosopher in your field. There are no physical constraints on how many times your name appears as a reference in a paper.

 But what is at stake here is not only justice. It’s also good scholarship. Authors at the periphery might have important objections to one’s claims, or they might have suggested ways of reconceptualising the problem in a better way. They might have drawn attention to historical debates that run in parallel, or they might have explored the problem at hand from an interdisciplinary perspective. Therefore, there needs to be space for including references to people from the periphery. The norm for who needs to be cited should be “what is relevant?”, not “whom do I have to quote in order to meet everyone else’s expectations?”

 As Eric Schliesser put it in the facebook discussion that triggered this post: “we constantly instantiate, extend, recreate, etc. the norms involved [in citation practices]. These are up for discussion and also available for subtle and more dramatic changes.“ One way to do this is to remind others of what seem obvious biases, e.g. the complete absence of women, as has been suggested at “Feminist philosophers”. For other groups, its more difficult to be aware of biases because there isn’t an equivalent to the information about gender contained in first names. Obviously, we can try to raise awareness, and emphasize the importance of thorough citation practices, e.g. through the use of databases and by asking around for information on who has written on a topic. Journals and presses might consider being more generous with how much space they allow for references. Eric also suggested review articles, in dissertations and later, and he emphasised the importance of good book reviews, and of keeping reading. What other practical changes could make a difference? 

Posted in ,

27 responses to “The Politics of Citation — guest post by Lisa Herzog”

  1. Matt Avatar

    In general I am not one to praise the citation practices of legal scholarship, as this practice has very serious vices of its own. But, at least in some cases, adopting a common citation practice from legal scholarship might be of some use. I have in mind the common “but see also…” citation. This is used in legal scholarship when you are arguing for position X, but want or need to note that some other people argue for Y, even if you are not going to directly engage with Y. Sometimes this is very annoying, especially when the position reduced to the “but see also” cite is really an important one! But it does allow an author to note that there are other positions in the area worth considering, even if she or he is going to focus on just a sub-set of problems. My impression is that philosophers want to, and are often expected to, address every serious objection to their positions. This encourages us to ignore views we don’t really want to address, and the “but see also” cite seems to me to be much less common in philosophical writing. If we ignore the positions we don’t want directly address, they can’t be important, the thought might go. But this will likely lead to papers on the “periphery”, at least in some senses, being ignored completely. Using a “but see also” cite, and then not necessarily expecting people to go on and directly deal with these arguments in every paper, could at least give some notice of competing views, allowing those who are interested to follow up. It’s far from a perfect solution, but might be useful in mitigating some of these problems.

    Like

  2. Heidi Howkins Lockwood Avatar
    Heidi Howkins Lockwood

    This is a fantastic post, Lisa — thank you! As I reflect on ways in which I might try to identify and read work by unknown authors (including unpublished unknown authors) in a given subfield, it occurs to me that the first thing to do might be to reach out to underrepresented philosophers working in that subfield, simply because, in my experience, they’re more likely to read and know of works that are not cited.
    I also realized, though, that I have no idea how to use the usual databases to identify works in a specific subfield that are the least cited. Google Scholar’s h5-index (http://scholar.google.com/citations?view_op=top_venues&hl=en&vq=hum_philosophy) just gives the articles with the largest number of citations.
    Does anyone know of a tool that would enable us to identify the least-cited articles?

    Like

  3. St. Matthew Avatar
    St. Matthew

    There is some debate about whether the Matthew Effect is a genuine effect. The hypothesis – “that characteristics other than the scientific
    work itself influence the evaluation of a new piece of scientific research” – has been tested by the sociologist of science Stephen Cole (this quotation is from the Cole article linked). He did not find support for the Matthew Effect.
    See:
    http://sss.sagepub.com/content/34/6/829.short
    A more complete account of Cole’s study of the Matthew Effect is presented in his book Making Science.

    Like

  4. Lisa Herzog Avatar
    Lisa Herzog

    Hi Matt, thanks for this suggestion. Ceteris paribus, it seems a good idea to have an opportunity to at least mention other references that one would not otherwise include. I guess a lot would depend on how it is used, but I don’t see how it would make things worse than they are without it – as you say, still better to be quoted as “but see also” than not to be quoted at all.

    Like

  5. Helen De Cruz Avatar

    Lisa, thank you for this important post. The practice of citation in philosophy may just be very atypical (as Matt already suggested). I recently co-wrote a paper with a developmental psychologist. It was a rather brief paper, but about 1/3 of it were citations. Trying to trim the paper somewhat, I suggested to trim some of the citations “Do we really need 6 references to substantiate the claim that X?” She responded “It’s customary to refer to what has been recently done about X, and so, yes, I think they are all important”. So we ended up citing a lot of bignames, but also some rather obscure, little-known work. Not all of this was formative in shaping our paper, but citations in developmental psychology are not only meant to acknowledge sources, but also to give the reader an overview of the scholarship on the topic of the paper (usually in the introduction, before the empirical work of the paper comes).
    This strikes me as a much healthier way of citing, and it would not surprise me that the citation dynamics in fields like this would be less skewed toward prominent males than in philosophy. If it’s OK if your paper has 50 or more citations, then citing become less of a power-game.
    Finally, I have also seen papers where someone did not mention a paper, almost always of a junior scholar, where it does seem plausible that the author did know about this work, and even, in some rare cases, that this work did play some role in writing the paper.

    Like

  6. Kenny Pearce Avatar

    I think it would be good for the discipline in a number of ways if there was a stronger norm in favor of including references to (and maybe even discussion of!) very recent work on the subject. I think this would have (at least) the following positive effects:
    1) It would create more ongoing discussion/give-and-take in journals.
    2) It would encourage people to read work not written by ‘big names’ (since one would have to read whatever was most recently published).
    3) It would (for the same reason) increase citations to and discussions of philosophers who might be marginalized in various ways for unjust reasons.
    4) It would cause citation counts in philosophy to increase faster, which I understand (mostly from posts on this blog) would help philosophy departments to convince faculty from other disciplines that their candidates should be tenured.
    Given that there is already some degree of recognition of the goodness of including citations to recent literature, the norm can easily be strengthened by referees pointing out lack of such citations where appropriate, and perhaps suggesting places authors might look.
    I don’t personally think philosophy would benefit from the kind of ‘laundry list’ citation practices which are the norm in some sciences (this gets your citation count up, but doesn’t result in anyone actually reading your paper!), but I do think many philosophy papers should include more citations than they do, and perhaps should even contain substantive discussion of more literature than they do.

    Like

  7. Trevor Avatar

    Word limits matter in all this as well, when they include citations/footnotes. For example, Journal of the History of Ideas has a strict 9000-word limit, and cutting out words often means cutting out the less ‘important’ references.

    Like

  8. Lisa Herzog Avatar
    Lisa Herzog

    Heidi, interesting question, I don’t have an answer (and I don’t know if it’s possible to provide a technical solution; the “least cited” articles would probably be a long list of never-cited articles; plus there is the problem of how to categorize them as belonging to different subfields, which might be really important for such a metric). But I think reaching down the list below the first few pages, and the usual suspects, might already be important. Although it’s impossible to quantify, one might use a sort of conversion factor: if a text is by a well-known author, from an established institution, you can attribute many of the times in which it was cited to this mere fact, so a text by a less well-known author, from a less prestigious institutions, should be upgraded by that factor.
    Asking underrepresented philosophers in a subfield also seems a good idea, although I wonder whether it can address the fact that there are different kinds of being underrepresented, and minorities in one dimension do not necessarily know more about minorities in another dimension than other members of the discipline (I’m thinking in particular about gender vs. institutions vs. countries).

    Like

  9. Lisa Herzog Avatar
    Lisa Herzog

    Hi St. Matthew, thanks for updating me on the effect! Can’t access this from here, but will try from my university network. The substance of what I’ve been saying relies on the Healy data, though.

    Like

  10. Lisa Herzog Avatar
    Lisa Herzog

    Helen, my experiences in co-authoring with someone from psychology is similar. On the other hand, the kind of reading there seems to be different, at least for the empirical papers: unless you really want to challenge the claims or methods of an author, you might only read the abstract, the introduction, and the discussion, and have a quick look at the tables with the empirical results. My partner, who works in science, told me that the first they he and his colleagues do is to look at the pictures in papers (and spend a huge amount of time producing these from raw data when publishing). So there seem to be different reading cultures at work, and there is also more co-authoring, which makes it easier to cover more material. I’m not sure I’d want philosophers to fall into a “read only abstracts” mode, and it might simply be impossible for complex papers. More co-authoring, on the other hand, could help, because more people can cover more of the literature.
    Your last point seems an even worse practice (hopefully it’s not a practice, but only exceptional cases – not sure), and almost a form of plagiarism. This is really dangerous, because if people have to worry that this might happen to their ideas, they might be less willing to share them. I’ve heard, from a friend, about an economics department in which there was a really awful situation: the more maths-savvy members would sometimes take ideas they had heard from the less maths-savvy members at departmental seminars, turn them into clever models, and publish them. So in self-defense, many people stopped presenting their most interesting ideas. I very much hope that what you describe is a rare exception!

    Like

  11. Lisa Herzog Avatar
    Lisa Herzog

    Kenny, fully agree: citation practices in other disciplines might have to do with different reading cultures. Also, having only recent references (which your post doesn’t imply, but which could be a result of pressures in this direction) wouldn’t be desirable either. I once heard the term “temporal provincialism” about some debate in philosophy in which anything written more than 30 years ago was considered outdated. This may be true for some debates, but I’d be very careful there. We are often asking the same questions as Plato and Aristotle and all the other guys (and forgotten girls!), and so some historical depth can enrich debates.
    The power dynamics between departments is something I hadn’t thought about, interesting point!

    Like

  12. Lisa Herzog Avatar
    Lisa Herzog

    Trevor, I agree, but on the other hand, given that people have so much time for reading, making articles substantially longer could result in them not being read, or being read less carefully. Maybe there could be two word limits: one for the main text, and a different one for footnotes or endnotes. That might help to make sure that one can include all references one wants to include.

    Like

  13. Elisa Freschi Avatar

    Lisa, thanks for raising the issue. Personally, I have been campaigning as much as I can in favour of reading more. This includes:
    less presumption in thinking that one is the first person to come to the idea X (someone else most probably thought about it already, and most probably another person thought of counter-arguments, go and check them!)
    taking time (and space) to acknowledge the status of research on a given topic (before boasting that one has found a “new solution to the conundrum of free will”, one should be sure to have read at least some of the relevant literature). I am in favour of adding such an introductory paragraph in all articles and books (in which case it would be an introductory chapter).
    taking time to be curious. We are not here to become rich and famous, but rather because we enjoy thinking. I cannot believe we cannot take the luxury of the time to read and be inspired.
    write book reviews. This is a generous exercise (because it helps authors and readers) and it is also helpful for ourselves (it enhances critical reading and it makes us aware of possible things to be done in a given field). But we often stop doing it as soon as we can (e.g., as soon as normal articles get also accepted in journals).
    (Just for fun, let me cite myself on this topic: http://elisafreschi.blogspot.co.at/2012/08/reviews-of-academic-books-on-amazon-or.html (on reviews); http://elisafreschi.blogspot.co.at/2011/03/methodological-manifesto.html; and http://elisafreschi.blogspot.co.at/2009/07/in-praise-of-reading.html (on reading)).

    Like

  14. Elisa Freschi Avatar

    (a comment by me is missing, perhaps too long?)

    Like

  15. Mark Lance Avatar

    That’s a good guess. there is a length limit in typepad. In any event, it isn’t showing up in my system, so I can’t help. Try publishing it in two parts.

    Like

  16. John Protevi Avatar

    I found it. There were too many links.

    Like

  17. Elisa Freschi Avatar

    it is hard to quote too many things, even on blogs:-D Thanks for the help!

    Like

  18. John Protevi Avatar

    Ha, yes, form matches content here at New APPS!

    Like

  19. Cindy Stark Avatar

    Perhaps rather than have a single word limit that includes both text and references, journals could have separate word limits for each portion of the paper and they could be generous with the word limit for citations. That would eliminate the strong temptation to get rid of references when one is trying to stay within the word limit.

    Like

  20. Euthyphro Avatar
    Euthyphro

    “But Kieran Healy’s data recently revealed the degree to which citation numbers cluster around certain big names.”
    This seems a bit like a Euthyphro problem. Are the big names those who get frequently cited, or are those who get cited frequently the big names (in virtue being cited)?
    Surely we do not expect citations to be spread evenly across all published articles. So much has been written about this by sociologists of science and those working in scientometrics.

    Like

  21. Elisa Freschi Avatar

    We cannot expect everyone to be quoted, but it would benefit ourselves, our readers and the discipline in general if one would read more and not just in order to show to the relevant authorities that one knows them (no matter what they write).

    Like

  22. Lisa Herzog Avatar
    Lisa Herzog

    Thanks for all these suggestions! Sometimes I wonder whether what is marring the humanities is a sort of production paradigm according to which the only thing that matters, in the end, is what you produce, i.e. which articles and books you end up publishing. There are, of course, external pressures in this direction, but we might also have internalized it to a certain degree. I should maybe reread what Plato had to say about why philosophers should not write…

    Like

  23. Euthyphro Avatar
    Euthyphro

    Elisa,
    The generally comment you make – “it would benefit ourselves, our readers and the discipline … if one would read more and not just in order to show the relevant authorities that one knows them” – is surely right. But I am curious who thinks people are just citing the relevant authorities to show them that we know them, and what evidence is there that this practice is prevalent? I certainly do not do it. Maybe on reflection you think you do it (I would not know, for I do not know you). But I do not see a lot of evidence that such a practice is common. What is common is that young and old scholars submit papers to journals that address the work of big names in philosophy. That is not surprising. But in itself it is no sign of some sort of dysfunctional academic system.

    Like

  24. Elisa Freschi Avatar

    Euthypro,
    I hope I do not (but thanks for pointing out the risk). However, I have noted several times, while doing peer reviews, that even within a small AOS some authors just do not feel the need to address the relevant literature before presenting their “new” views. I have also noted that many authors quote “Big names” (or thank them in the acknowledgement section) with perhaps the unconscious aim to strengthen their own theses (something like “I cannot be wrong, since Y has been my supervisor, X spoke with me during a coffee-break and I refer to Z’s studies”). (My verdict in these cases is R&R).

    Like

  25. Euthyphro Avatar
    Euthyphro

    Elisa,
    thanks for the clarification. I think authors really should remove the acknowledgements from papers when they are under review. It really does not matter who their supervisor is, or who they have coffee with. The paper needs to stand on its own strength.

    Like

  26. Elisa Freschi Avatar

    thanks. This was also my point.

    Like

  27. Sara L. Uckelman Avatar

    Indeed — journals that require anonymous submissions often explicitly state that acknowledgements should be removed. I’d be surprised to hear if there were journals which practice blind reviewing which would allow acknowledgements.

    Like

Leave a comment