I. STATEMENT OF THE PROBLEM

    A. What is the problem that stimulated the research?  Explain in detail.

    B. Was it clearly and concisely stated?  Explain.

    C. Is it an important research problem?  Explain.

    D. Is the review of the literature relevant?  Useful?  Adequate?  (Consider the number of references, how current they are,
         whether they represent varying viewpoints, and focus on the problem.)

II. HYPOTHESIS CONSTRUCTION OR RESEARCH QUESTION FORMULATION

    A. What hypotheses were tested, or what research questions were explored?

    B. Were the hypotheses or research questions clearly stated?  Explain.

    C. Do the hypotheses or research questions relate directly to the statement of the problem?  Explain.

    D. Identify the following:
        1.  Most important variables
        2. Independent variables (when applicable)
        3. Dependent variables (when applicable)
        4. Known extraneous variables (indicate whether or not they were controlled for)

III. SAMPLING APPROACH (RESEARCH DESIGN)

    A. What sampling approach was used?  What was the specific sampling procedure?

    B. What are the limitations (if any) of the sampling approach used?  What are the likely effects of these limitations?

    C. Is the sample representative of the population of interest?  What is this population?  Can the findings be generalized with
        some degree of confidence to the population?

IV. DATA COLLECTION APPROACH (RESEARCH DESIGN)

    A. What data collection approach was used (E.G. participant-observation, survey, field experiment)?  More specifically,
         what procedures or steps were followed in collecting the data?

    B. What are the advantages and limitations of the data collection approach in relation to the problem researched?

V. RESEARCH INSTRUMENTS AND OTHER FORMS OF MEASUREMENT (RESEARCH DESIGN)

    A. Are operational definitions of the independent, dependent, and other central variables provided?  What are these
        operational definitions?  Do they have face validity - do they adequately reflect their counterparts on the conceptual
        level?
        What are their limitations?

    B. What research instruments, if any, were employed to measure independent and or dependent variables?  How reliable
        and valid are these instruments?  (be specific) What are the limitations of these instruments and what are the likely effects
        of these limitations?

VI. DATA ANALYSIS (RESEARCH DESIGN)

    A. What statistical techniques were used to analyze the data?  Do you think that appropriate statistical techniques were
        used?  Would other analyses have been more informative or useful?

VII. PRESENTATION OF FINDINGS

    A. What were the major findings?

    B. Were the findings presented clearly?  Were tables, graphs, etc., used to promote understanding of the findings?  How
        effective were they?

    C. For each table, identify the variables that are presented, and the forms in which the data is presented.

VIII. DISCUSSION, CONCLUSIONS, RECOMMENDATIONS

    A. Are the conclusions, recommendations and other interpretative statements consistent with the findings.  Answer this
        question for each interpretative statement.  Include interpretative statement, specific finding that it is based on, and your
        view of whether it is adequately supported by a finding.

    B. Do the conclusions address the initial research questions?

    C. Are limitations of the study discussed?  What are these limitations?  Are findings over-generalized?  How?

IX. OVERALL

    A. Was the description of the study adequately detailed so as to permit replication?  If not, what aspects were inadequately
          presented?