“Report Abuse”

One idea that I don’t want us to lose from yesterday was the idea that a fraud/plagarism/quakery check need not be the responsibility of any one person. Yes, there’s likely an automated step to check for plagarism, but, after that, having a preprint randomly sent to, say, 5-10 people with the option of clicking a “report abuse option” (and then enter what kind of abuse) may well prove to be as efficient at culling bad items out of a preprint literature as any.

That, and it allows for an alternative archive of bunk. Which can be fairly useful, particularly when one wants to cite that a certain “point” is actually garbage, as it were.

Plos value addons

I just saw this, interesting. Many journals/societies are discussing the enhancements they provide in addition to the papers themselves. Discussion etc. in the form of blogs about the papers, but hosted by the journal directly is compelling. No reason that libraries could not also get into this and be the place for online academic discussion, or at least a particular subset thereof.

An idea about a rough do-able now experiment

Area51.stackechange is a site for people to propose nascent mathoverflow-like sites. As a first pass experiment on open review and a reputation economy (while we develop or find a way to develop a more sophisticated model) could we get the community to support an Ecology Preprint stackechange? We could have NCEAS host preprint pdfs from validated authors (i.e., have a ecopreprint.stackechange user account) and an individual ‘question’ would concern people’s comments on a paper.

We’d ask the community to volunteer to post preprints there fore at least, say, 2 months for submission, and given them the option of including their ‘review’ trail, etc. when they submit their paper to a journal.

Users would shape things like tags, etc. as the do on any stackoverflow site.

Granted, ‘review’ would be public, with usernames revealed. But, it’s an experiment.

After running this for ~6 months, we survey participants about their experience.

Thoughts?

Comment from Dave: You’d need some journals and high profile people to buy-in before doing this.

The Pillars of “There”

If we are to go from here to there in scholarly publication, what is there? This was the question of the afternoon, and we ended up agreeing on four broad pillars. The details of some of these pillars is up for debate, but, there was general consensus on the Four Pillars of There, as it were.

1) More types of products than a narrative paper
2) Preprints must become part of our culture
    – We talked a lot about fraud/plagarism/quack detection. It could be handled by people, or by crowsourcing quick abuse reporting.
3) Public review
    – What this means was unclear. Anonymity, meta-review, etc. are all up for grabs. Experiments needed.
4) Public reputation for activity
    – A reputation economy of some sort with a number of different associated metrics for reviewing, meta-reviewing, authoring, etc.

Where are we now?

Before asking where we want to go from here, we asked ourselves, what is ‘here’ and how does the current publishing paradigm impact our scholarly activities. We agreed the current hallmarks of here are a closed peer review system; access to publication at a high price for an institution, individual reader, or an author; a privileged place for narrative accounts of science, often to the exclusion of other forms of scholarly production; and a lack of interactivity with scholarly products.

Many of these are changing – often in small ways. This is good, but it it enough?

How does this current system treat us as scientists and the different hats we wear?

The Five Hats we Wear and How the Current Publishing Paradigm Affects them:
1) Reader – readers are fine…if you’re reading papers at an R1. Although even then, there are cracks in the foundation. If they’re not at an R1, there may be severe problems in accessing materials you want to read.
2) Author – the current system works OK for authors, although it may waste time in the resubmission process.
3) Data producer – currently, there is no recognition for data and code production, although this is changing with data and methods journals – although they require an additional companion paper quite often.
4) Practitioner – As a practitioner, you want to interact with your peers and discuss the results from scholarly articles. There are currently no ways to do that without going outside of an article and writing on a blog or somesuch. This interaction is then decoupled from the original journal article.
5) Payer – As someone who pays for access, you lose. You are subject to the whim of the publication industry. The cost is always high.