‘Science Is Real’ Category Archive

Peer-to-peer review

I’m in my tenth year as an academic, which means that my view of how things worked in the world of research pre-2002 is based purely on output — that is, the papers and books I’ve read that were published before my time. As a result, I really don’t know if the phenomenon I’ve been noticing lately is new or not, but man, there are unpublished papers everywhere. Conference papers, working papers, executive reports, etc., are posted all over scholars’ web sites, their academia.edu profiles, departmental sites, and then frequently logged in Google Scholar and/or touted in news releases. They may or may not make an academic splash, though there are certainly a number of recent conference papers in political science and mass comm that used the web to gain a lot of notice, but news organizations and commentators don’t operate with the same filters as academics do. This University of Washington study (including one author who is a former colleague of mine at Wisconsin) is a good example. It was linked by Talking Points Memo, in a way that seems fairly typical of how unpublished work is disseminated through blogs and other online political commentary. Its conclusion makes the paper appealing, as it seems to inject some empirical evidence into the debate over whether “Twitter revolutions” really have anything to do with Twitter, which has already gone back and forth in the press.

At the same time, it’s a study that hasn’t gone through the peer review process. Maybe it’s applying theory in an unconventional way, or maybe there’s something odd about the data, or maybe it’s exactly right (and I should note I’m only highlighting this study because it’s the most recent example I’ve come across — there are dozens more). But the widespread availability of unreviewed research presents a twist to the science news cycle model, which relies on carefully considered and reviewed conclusions to be reined in. If we’re inserting more and more research from earlier stages of the process into our discussions of public policy, current events, etc., we could see major challenges to the peer review model.

Filed: Science Is Real || 14:16, September 27 || 1 Comment »

My country, right or wrong

Via Matthew Yglesias, the Washington Post seems to have come close to answering the question I asked in the last post:

17. Please tell me whether you agree or disagree with the following statement: Whatever its faults, the United States still has the best system of government in the world. Do you agree or disagree?

            Agree   Disagree   No opinion
9/8/11       77       21          2
10/3/10      77       21          2
12/19/07*    81       17          1
12/15/00     89       11          *
5/6/96**     83       15          2
4/9/95**     85       14          1
9/1/94**     84       13          3
*ABC News/Facebook; **ABC News

I’d quibble with the wording a bit (“Whatever its faults” seems like it would prime dismissal of those faults), and I think this is a question that’s being asked in the absence of much knowledge of other political systems among the American public, but still, we’re not getting rid of the Senate any time soon.

Filed: Science Is Real || 22:24, August 14 || No Comments »

MAPOR 2010 round-up

This year’s MAPOR conference was a little smaller than it’s been in years past, but it may have been the best and most intellectually cohesive of the half-dozen I’ve attended. Whereas recent years tended to have fairly broadly interpreted panel themes in order to get all the papers in, the panels I attended this year were often tightly focused on problems dealing with agenda-setting, knowledge acquisition, misinformation and the effects of news content on attitude formation. This was particularly excellent for me, because I’ve been working on a comprehensive model of information flow and partisan agenda-building in the mass media. The two days were kind of like an extended seminar or research group meeting, and it was reminiscent of the really insightful times I had in grad school.

The papers that really stuck out for me include:

Since MAPOR runs four concurrent sessions, there were a lot of great-looking papers I didn’t get a chance to check out but hopefully will get a chance to look at eventually.

Filed: Science Is Real || 16:52, November 23 || No Comments »