wpe41.gif (23084 bytes)CIS5394: Decision Making and Expert Systems
(Current Issues in CIS)
Spring 2004

Rough Draft Refereeing

Return to Home Page

There are no hard-and-fast rules for refereeing a rough draft. We will follow essentially the same guidelines as we will follow for refereeing the final paper, but there will not be any recommendations to the editor section.

Each paper will be assigned two referees. Each referee will be required to read the paper and evaluate it in the eight areas given below.  Each area (Except for suggestions) requires a rating on a 9 point scale (see below) as well as a 2-3 sentence critique. All submissions are to be made from the submissions page.

{adapted from guidelines from Dr. Dan Robey, Georgia State University}

A critique of a conceptual article examines the logic of the arguments made by the authors. Both strengths and weaknesses should be identified in a critique. Explain and justify each of your critique points in at least 2-3 sentences.

Specific issues to address in a critique of a conceptual article include:

  1. LOGICAL CONSISTENCY: Does the article suffer from inner contradictions or logical errors that are not acknowledged by the authors?
  2. COHERENCE: Does the article develop an argument that follows a coherent line of reasoning? Are the boundaries of the argument reasonably well defined, and does the argument anticipate most, if not all, rival arguments?
  3. SUBSTANCE: Does the article provide an argument or a line of reasoning that offers insight into important issues, or does it merely summarize previous studies in a way that does not reflect depth of analysis? Does the article offer a model to guide future thinking about the issue the author is addressing?
  4. CONTRIBUTION: Do the authors clearly articulate an issue that is salient (relevant and current) to a particular scientific issue or managerial problem? Are the issues addressed introduced in a way that their relevance to practice is evident? Would answers to the questions raised in the article likely to be useful to researchers and managers?
  5. NOVELTY: Does the article make an original contribution?
  6. FOCUS: Is there a clear audience that the authors address? Was the article written at the appropriate level for this audience?

For each of the six areas above, each referee will rate the author's success in addressing the issue on a 1 - 9 scales as follows:

   Very                          Below                                                             Above                      Absolutely
   Poor                         Average                      Average                    Average                     Perfect!!!
   1        2        3        4        5        6        7        8        9

In addition to evaluating the paper based on the six areas above, each referee will submit:

  1. REFEREE'S SUGGESTIONS. Each referee will submit a paragraph or two of CONSTRUCTIVE criticism. In other words, what they would do to improve the paper.

The referee's Must submit their Reviews using the SUBMISSION FORM by the date given in the course schedule.

This page was last updated on 01/20/04