Posts

What did you find most problematic about the healthcare system issue?

Write a reflection paper based on what you learned about the Healthcare System Issue topic of your interest during your literature review. You can very well use your first paper, and change the perspective from author’s third person to first person. It is completely acceptable to just re-write your first paper, reflecting on your findings, adding your opinion, etc. You are not starting anything from scratch! If you did not do so on your first paper, do not forget to use the titles below

PLEASE REFER TO ID 2299485329

Describe the public health issue that you researched during your literature review. Use articles or pieces of information you found to justify and reference your statements. Try to answer the following questions:

What did you find most problematic about the healthcare system issue?
Is there a possible solution to the healthcare system issue? What recommendations can help solve the public health issue?
Should more people in your community care about the issue and why?
Overall how do you feel about what you have learned about the healthcare system

What is emotivism? Why does it make the apparent fact of moral disagreement so problematic?

Part One (25pts)

Answer one of the following two questions. The response should be clear, well-reasoned and developed, approximately 1-2 pages in length.

What is emotivism? Why does it make the apparent fact of moral disagreement so problematic? Discuss the pros and cons of viewing morality as emotivism does. Provide analysis and include appropriate citations.

If cultural relativism were really true, would social reformers (e.g., Martin Luther King or Gandhi, etc.) be justified in their disagreement with their culture “norms” and still be right, ethically speaking? Why or why not. Provide analysis and include appropriate citations.

Part Two (50pts)

Answer the following question. Response should be approximately 1-2 pages in length.

Compare and contrast utilitarianism and natural law theory in their analysis of a moral act. Include an analysis of the principle of double effect and apply both theories to a contemporary moral issue. Include appropriate citations and analysis.

Part Three (25pts)

Answer one of the following two questions. Again, responses should be clear, well-reasoned and developed, and approximately 1-2 pages in length.

What are the main similarities and differences between traditional ethical theories and virtue ethics? What are the most important questions in ethics as far as virtue ethics is concerned? Do you agree or disagree that those are the most important ethical questions? Analyze, explain, and cite.

Has your study of ethics in this course affected your ethical views in any significant respect? If so, in what significant respects have your views changed? What particular topics have we covered that have caused those changes in your views? Be specific and provide appropriate analysis and citations.

Why is the manner of your distribution important? What demographic data would be most appropriate to gather in the survey?

Develop questions for an employee survey to determine the views of department leadership and whether there is an inclusive workplace culture in PMC’s Lima plant, and make distribution recommendations on how the survey is sent and to who should receive it.

Demonstration of Proficiency

By successfully completing this assessment, you will demonstrate your proficiency in the course competencies through the following assessment scoring guide criteria:

  • Apply models that drive employee satisfaction. ◦Develop questions to evaluate PMC’s department leadership.

◦Develop questions to assess PMS’s inclusive workplace culture.

◦Recommend how and to whom the survey is distributed.

  • Communicate human resource management needs, opportunities, and strategies effectively with multiple stakeholders. ◦Communicate in a manner that is professional and consistent with expectations for human resource professionals.

Instructions

As part of the Power Manufacturing Company’s HR team, you have been asked to create a survey for PMC’s Lima plant employees. There are 600 workers at this location. The goal of this survey is to determine the employees’ view of department leadership and whether there is an inclusive workplace culture.

Requirements

Create a 10-question employee survey and include the following in your analysis:

  • Develop questions to evaluate PMC’s department leadership. Create 5 questions and a scale. Support your rationale for why these questions and scaling would be effective for collecting and analyzing data to draw valid conclusions.
  • Develop questions to assess PMS’s inclusive workplace culture. Create 5 questions and a scale. Support your rationale for why these questions and scaling would be effective for collecting and analyzing data to draw valid conclusions.
  • Recommend how and to whom the survey is distributed. Why is the manner of your distribution important? What demographic data would be most appropriate to gather in the survey? How many employees would make a good representative for the survey findings?

Your Leadership and Culture Survey and analysis should demonstrate writing skills through the accurate communication of thoughts that support a central idea and use of correct grammar and mechanics as expected of a human resources professional.

Additional Requirements

  • References: Support your analysis with at least 3 academic, scholarly, or professional resources from the Capella University Library.
  • Format: Resources and citations are formatted according to current APA style and format.
  • Length: 6 pages, not including the references list.
  • Font and font size: Times New Roman, 12 point.

Refer to the Leadership and Culture Survey Development scoring guide to ensure that you meet the grading criteria for this assessment before submission.

 

 

Is the selection of participants described and the sampling method identified?

Journal of Health, Social and Environmental Issues (2005) Vol 6, No 1
45
Abstract
A new framework for critiquing health-related research
is presented in this article. More commonly used existing
frameworks tend to have been formulated within the
quantitative research paradigm. While frameworks for
critiquing qualitative research exist, they are often
complex and more suited to the needs of students
engaged in advanced levels of study. The framework
presented in this article addresses both quantitative and
qualitative research within one list of questions. It is
argued that this assists the ‘novice’ student of nursing
and health-related research with learning about the two
approaches to research by giving consideration to aspects
of the research process that are common to both
approaches and also that differ between quantitative and
qualitative research.
Key words
Research critique; critique framework; heath research.
Introduction
When undertaking an undergraduate programme in
health related studies, as in many other academic
disciplines, students are required to demonstrate the
ability to read, understand and critique research reports.
Health research was at one time guided by the ‘medical
model’. However, though this model remains influential,
Polgar & Thomas (2000) suggest that there have been
changes in the role and status of other health
professionals that have brought different perspectives,
and require different approaches to research. A more
holistic approach now influences how health care is
conceptualized, and how research is conducted. The
methodology of social research has become an accepted
part of health research.
Green and Thorogood (2004) state that “health research
includes any study addressing understandings of
human health, health behaviour or health services,
whatever the disciplinary starting point” (p5). They
further suggest that health research may expand
knowledge of society and health, or address an existing
health care problem. Undergraduates of health related
studies therefore have to consider health research in its
broadest sense.
A common method of assessing understanding both of
the subject area and the research methodologies utilized
within that subject area is the presentation of a detailed
critique of a piece of published research. Our experience
in teaching students across a range of programmes in
Nursing, Health Sciences/Studies, Health Promotion
and Health Policy programmes has taught us how
difficult many of our students find this task. With the
help of funding from the Learning Development Unit we
undertook a project to develop, implement and evaluate
a research critique framework that students could use as
a guide.
This article analyses the content of frameworks that are
commonly used to critique quantitative research and
frameworks that are commonly used to critique
qualitative research and then presents a single
framework that addresses both research approaches.
This new framework is currently being used to assist
teaching and learning activities relating to the critical
appraisal of published research. As such, it is still in the
developmental stage and as teachers we continue to
reflect on the application of this framework to our
teaching. Feedback from students is essential to this
development and the article presents evaluations from
students who have been involved in learning activities
during the early developmental stage of the framework.
This evaluation is continuing and we would also welcome
comments from our colleagues.
The need for a research critique
framework
The need for able and competent health care
practitioners is self-evident. One way of ensuring
competence is through evidence based practice and
health professionals are expected to be intelligent
consumers of research, and this entails the ability to
read, understand and apply published research
(Murdaugh et al, 1981).A change of culture arose
Developing a framework for critiquing health research
BSc, PhD, RN, RNT, PGCHE, ILTM, Head of the Institute of Nursing and Midwifery,
School of Health and Social Sciences, Middlesex University
BA, MPhil, RN, RGN, RNT, CertED, Senior Lecturer in Nursing, School of Health and
Social Sciences, Middlesex University
BA, MSc, PGDip, RN, DN, CertED (FE), Senior Lecturer in Health Studies, School of
Health and Social Sciences, Middlesex University
Kay Caldwell,
Lynne Henshaw,
Gina Taylor,
following the move of colleges of nursing into the further
and higher education sector, resulting in an educational
culture where critical enquiry and evidence-based
practice is accorded greater priority (Benton, 1999). Most
students are introduced to research methods and critical
appraisal during their undergraduate education, or
preparation for professional practice. Yet McCaughan et
al (2002) report that qualified nurses reported problems
in interpreting and using research. MacAuley et al (1998)
highlighted how GPs who had been introduced to a
model of critical reading were shown to have applied a
more appropriate appraisal to studies than those who
relied on critical appraisal skills acquired previously.
Whilst literature in relation to the ability to critically
appraise research is abundant in relation to nursing and
to a lesser degree in medicine, there is an emerging body
of evidence in relation to other health care professionals.
Chalen et al (1996) identified several barriers to
research-mindedness in radiographers, including a lack
of knowledge of research methodologies. Domholdt et al
(1994) noted that this group had particular difficulty in
identifying concerns with construct validity.
Work in the field of health and health care is multidisciplinary
and involves a variety of approaches to
research. Further the range of such research is wide,
from concerns with the relationship between the health
needs of a population to aspects of the provision of health
services (Bowling, 2002). Government policy and
professional guidance insist that professional practice
should be based on evidence (Gomm & Davies, 2000).
While Pearson & Craig (2002) elaborate on the need for
nursing practice to be evidence-based, the need for
evidence-based health promotion has been highlighted
by Perkins, Simnett & Wright (1999), who also point out
that the achievement of the targets of ‘Our Healthier
Nation’ depend on the commissioning and
implementation of effective health promotion
programmes.
Given the primacy placed on the use of evidence in the
field of health and health care, it is important that
students are enabled to critique published research in
order to determine the usefulness of that research in
their chosen field of work. By ‘critique’ we mean the
ability to critically appraise published research by
identifying the strengths and weaknesses of the research
and forming judgements concerning its overall quality
and applicability.
Research in the fields of nursing, health studies, health
promotion and health policy can be of a quantitative or
qualitative nature: both research approaches provide
valuable information for the disciplines and often
complement each other. As such, students are required
to read and critically review quantitative and qualitative
studies. However, many of the available frameworks for
conducting a critical review are written within the
quantitative paradigm (e.g. Benton & Cormack, 2000;
Polgar & Thomas, 2000). There has been a tendency to
evaluate qualitative research against criteria appropriate
to quantitative research (Sandelowski, 1986). This can
result in students attempting to analyse qualitative
research within a quantitative framework and thus can
lead to unjustified criticism, for example, quantitative
frameworks for critique will direct students to raise
questions concerning reliability and validity, rather than
confirmability, dependability, credibility and
transferability. These activities, which may lead to
students appropriating the language of quantitative
research when critiquing qualitative research, can only
serve to perpetuate the view of qualitative research as a
‘soft science’ and detract from its value as a research
approach in its own right that aims to acquire
information that is different from that acquired by
quantitative research (Leininger, 1994).
There has been considerable debate concerning whether
quantitative and qualitative research can be assessed
using the same criteria (Mays & Pope, 2000). While
there are many criteria that will be common to both
research approaches such as the identification of an
appropriate question, the choice of an appropriate
research design, the conduct of a thorough and relevant
literature review, there are also discrete areas of
difference. For example, variables are not always given
operational definitions in qualitative research as
sometimes the aim of the research is to seek definitions
of the concepts from the viewpoint of the informants.
Various frameworks were reviewed and the common
features that relate to quantitative and qualitative
research were identified. In general guidelines tend to
reflect the philosophies of the respective approaches in
that guidelines for quantitative research tend to be in the
form of checklists, whereas guidelines for qualitative
research tend to be more discursive.
Frameworks for critiquing
quantitative research
The framework presented by Sajiwandani (1996)
provides a useful checklist covering points that are
appropriate for critiquing quantitative research relevant
to nursing and health care students and provides an
explanation and rationale for critique. Polgar & Thomas
(2000) also provide guidelines specific to the critical
evaluation of quantitative research papers. Benton &
Cormack (2000) offer criteria for critical evaluation of
research but do not state that their criteria are intended
for use with a particular research approach, however, the
criteria are written within the quantitative framework in
so far as they refer to hypothesis, operational definitions,
validity and reliability of any instruments or
questionnaires. Treece & Treece’s (1986) classic text
offers a comprehensive list of questions to aid critical
evaluation, but again it is written within the quantitative
paradigm.
The website of cybernurse
(http://www.cybernurse.org.uk/research/Reading_and
_Critiquing_Research.htm) offers a framework for the
46
Developing a framework for critiquing health research
Journal of Health, Social and Environmental Issues (2005) Vol 6, No 1
47
areas that should be considered when critiquing a
research report. There is no indication regarding which
research approach this framework can be used for, but in
terms of data analysis only statistical analysis is
mentioned, yet hypotheses are not mentioned. In
addition, there are many important omissions, for
example, research design, recommendations,
limitations.
While considering a range of frameworks focusing on
quantitative research the areas that appeared most
consistently were in relation to the research design;
hypothesis, operational definitions, population and
sampling, sampling methods, validity and reliability of
data collection, data analysis and generalizability.
However, there were a plethora of critique frameworks
that focused on very specific designs, rather than on
generic quantitative research, and these of necessity had
far more detailed guidelines for critique. The website of
the University of Wales
(www.uwcm.ac.uk/library/critical_appraisal/forms)
offers different frameworks for appraising systematic
reviews; randomised control trials; trials without
randomisation; cohort (longitudinal) studies; casecontrol
studies and cross-sectional studies. This in itself
pre-supposes a level of research design awareness that is
likely not to be evident in undergraduate students during
the early stages of their programmes of study.
While there appears to be some degree of consensus
concerning the areas that should be addressed when
critiquing quantitative research the situation is less clear
when it comes to qualitative research.
Frameworks for critiquing
qualitative research
Hammersley (1992), writing specifically concerning
ethnography, provides criteria for assessing
ethnographic studies. Questions are raised concerning
the extent to which new theory is produced, how far is the
theory developed and how novel are the claims made. He
also refers to the credibility and transferability of the
findings, as well as the influence of the researcher on the
findings. Mays & Pope (2000) refer to the increase in
interest in assessing the quality of qualitative research
and, drawing on the earlier work of Hammersley (1992),
identify two broad criteria: validity and relevance. These
authors acknowledge that these concepts can also be
used when assessing the quality of quantitative research,
but when used in relation to qualitative research they
need to be operationalized differently to reflect the
distinctive goals of qualitative research.
The website of the Public Health Resource Unit
(http://www.phru.nhs.uk/~casp/qualitat.htm) presents
a framework for critically appraising qualitative research
built around ten questions, with supporting detailed
guidelines. Areas that are specific to qualitative research
include the relationship between the researcher and the
participants and rigour in relation to data analysis.
Greenhalgh & Taylor (1997) provide an overview of the
nature of qualitative research and again suggest a
framework for critique based on nine questions with
supporting guidance. In terms of being specific to
qualitative research, the authors refer to the need to
acknowledge the researcher’s perspective, a detailed
description of methods used for data collection, quality
control measures in data analysis and the credibility of
the results and the transferability of the findings to other
settings. Forchuk & Roberts (1993) claim that there is a
paucity of guidelines for examining qualitative work and
provide a framework for this purpose, which is aimed at
undergraduate nurses and other health professionals.
The authors cover Leininger’s (1990) criteria for rigour,
but with minimal explanation. Overall the guidelines are
relevant and useful for qualitative studies, but the journal
may not be readily accessible to all health studies
students.
Highly specialized texts exist that offer advice, discussion
and debate, concerning the evaluation of qualitative
research (Leininger, 1994; Morse & Field, 1996; Kuzel &
Engel, 2001), and, inter alia, refer to issues like the
context of the research and the need for an audit trail.
Frameworks for critiquing both
quantitative and qualitative
research
Gomm, Needham & Bullman (2000) provide questions
to be asked concerning quantitative research, in terms of
three sections: Questions to ask about data collection
instruments; questions to ask about experiments;
questions to ask about surveys, case finding (or ‘clinical
epidemiological’) studies and case control studies. They
also provide questions to ask about qualitative research
in which attention is drawn to the setting of the research,
the researcher’s role in the research and the relationship
of the study to other research in the field.
Stevens, Schade, Chalk & Slevin (1993) provide a chapter
on evaluating research in a book aimed at health care
professionals. This is perhaps one of the most misleading
guides in terms of evaluating qualitative research. A
framework for research evaluation is provided and at the
beginning it is acknowledged that qualitative research is
not necessarily performed and presented in the same
format as quantitative research. It is further stated that,
in the light of this, reference will also be made to
qualitative research. Though reference is made to
qualitative studies, it is inadequate and sometimes
misleading, for example, in the methods section
reference is made to validity and reliability in measuring
instruments, but qualitative methods are ignored.
Further, in the results section qualitative findings are not
mentioned.
Nieswiadomy’s (1998) guidelines for critique appear to
follow the quantitative paradigm, however, she does
stress that not all studies require a hypothesis and that
“studies of a purely descriptive nature” (p342) may not
contain hypotheses, in which case research questions
may be used. Also, under the section headed ‘Research
Design’, Nieswiadomy states that quantitative designs
and qualitative designs are evaluated using different
criteria. However, limited advice is offered to guide
qualitative critique. Valente (2003) provides a
framework that mentions quantitative and qualitative
research in some sections, for example, method, but
refers solely to quantitative in others, for example,
analysis. Overall, the framework is heavily biased
towards quantitative research, and when both
approaches are discussed it is not clear which approach
is being addressed.
The website of the University of Wales College of Medicine
(www.uwcm.ac.uk/library/critical_appraisal/forms)
provides a series of guides on critical appraisal of
research studies, all taking the format of a table that
identifies a question and directs the reader to answer by
ticking ‘yes’, ‘no’ or ‘can’t tell’, but with no guidance as to
what should be considered when answering the question.
The questions are focused towards critically appraising
the research for the purpose of ascertaining its relevance
to practice, and assumes a high level of knowledge of
research methods in order to be able to answer the
questions, so would be difficult for undergraduates to use
effectively.
Parahoo (1997) takes account of both quantitative and
qualitative approaches to research and provides a list of
broad headings that encompass both approaches. The
guidelines are comprehensive in terms of quantitative
research, but less so for qualitative research. Each point
for critique initially addresses quantitative strategies and
is followed by a paragraph suggesting a different
approach for qualitative work. For example, Parahoo
states “in qualitative studies, researchers may not want
to be influenced by previous research. They should,
however, give a rationale and make reference to the
relevant literature” (p363). However, qualitative
research is addressed with less rigour than quantitative
research and the less discerning student may well
confuse the two approaches. The guidelines fail to clearly
set out the different criteria for each strategy, for
example reliability and validity are discussed, but
confirmability, dependability, credibility and
transferability are not referred to. However, attention is
also drawn to the need for rigour and an audit trail.
In a book written for nurses, LoBiondo-Wood & Haber
(1994) provide two separate chapters for quantitative
and qualitative critique. Dealing with the two strategies
in different chapters could be difficult for the novice
student who is still trying to internalize the difference
between the two approaches. However, both are dealt
with thoroughly and do provide useful guidelines for the
more advanced students. They make useful crossreferences
to other chapters in the book. Hek (1996)
highlights the importance of critical evaluation as a
means by which nurses can practice knowledgeably, and
stresses the importance of developing critical evaluation
skills, recommending a six-stage process. Quantitative
and qualitative research are both addressed within a
specific guide to the sections of the research that should
be considered, but the complex integration of
quantitative and qualitative critique might be confusing
to the novice student. Some essential components, such
as setting, population and sample are omitted. Further,
the guide is presented in textual format and so some
detail can be lost.
Burns & Grove (2001) offer frameworks for both
quantitative and qualitative research in nursing,
acknowledging the need for differing approaches to the
critique of different types of studies. While their
framework for quantitative research includes the
standard topics like research objectives, questions or
hypotheses, the definition of variables, the identification
of independent and dependent variables, validity of
instruments, statistical procedures, when it comes to
qualitative research, other questions are raised. Burns
and Grove thus refer to ‘descriptive vividness’, looking
for clarity and factual accuracy of the researcher’s
account of the study. The context must be clear as data
are context-specific. Rigour in qualitative research
demands a clear account of the study elements, e.g. the
philosophy, the role of the researcher, the process.
Auditability and a decision trail are also required and any
theory derived from the study must reflect the data.
DePoy & Gitlin (1998) provide ‘guiding questions’ to
critically evaluate quantitative and qualitative research
studies. They present two adjacent lists, headed
‘experimental-type’ and ‘naturalist inquiry’, each with
very similar questions except for the entry for
quantitative research concerning validity and reliability,
where its qualitative counterpart refers to
trustworthiness.
Polit & Hungler (1999) offer separate guidelines for
quantitative research and for qualitative research. These
are thorough and complex and are presented in sections,
for example, guidelines for critiquing research problems,
research questions and hypotheses; guidelines for
critiquing research literature reviews, and so on. The
guidelines for quantitative research vary little from those
already reviewed. The guidelines for qualitative research
include reference to the research tradition within which
the study is carried out and highlight that the research
question and methodology should be consistent with the
research tradition. Again, an accurate description of the
research design is required, as is trustworthiness of the
data. Credibility, transferability, dependability and
confirmability are included in the guidelines. In terms of
data analysis, Polit and Hungler state that the themes
48
Developing a framework for critiquing health research
Journal of Health, Social and Environmental Issues (2005) Vol 6, No 1
49
should represent the narratives and there should be
evidence of accuracy of the researcher’s analysis and that
the context of the research should be clear. Polit and
Hungler’s framework for critiquing research is also
available on a web-site
(http://www.sonoma.edu/users/n/nolan/n400/critique
.htm). This is a comprehensive framework, but complex
and not easily accessible for novices.
Development of a new framework
Having reviewed a range of published research critique
frameworks, the first step was to identify the common
features (Table 1). Following this the strengths of
individual research critique frameworks were identified.
This enabled us to develop a framework that had areas
that were common to both quantitative and qualitative
approaches, and areas that were specific to each (Figure
1). To support the diagrammatic framework guidelines
are available and provide the teacher and the student
with an extended explanation of each item. Examples of
these guidelines are as follows:
Item in Research Critique
Framework Guideline
Is the literature review comprehensive and up-to-date? The literature review should reflect the current state of
knowledge relevant to the study and identify any gaps for
conflicts. It should include key or classic studies on the topic as
well as up to date literature. There should be a balance between
primary and secondary sources.
Quantitative:
Is the sample adequately described and reflective of
population?
Both the method of sampling and the size of the sample should
be stated so that the reader can judge whether the sample is
representative of the population and sufficiently large to
eliminate bias.
Qualitative:
Is the selection of participants described and the
sampling method identified?
Informants are selected for their relevant knowledge or
experience. Representativeness is not a criteria and purposive
sampling is often used. Sample size may be determined through
saturation.
Is the conclusion comprehensive? Conclusions must be supported by the findings. The researcher
should identify any limitations to the study. There may also be
recommendations for further research or, if appropriate,
implications for practice in the relevant field.
Quantitative Qualitative
Research design Philosophical background
Experimental hypothesis Research design
Operational definitions Concepts
Population Context
Sample Sample
Sampling Sampling
Validity/reliability of data collection Auditability of data collection
Data analysis Credibility/confirmability of data analysis
Generalizability Transferability
Table 1: Common features of research critique frameworks
50
Developing a framework for critiquing health research
Does the title reflect the content?
Are the authors credible?
Does the abstract summarize the key
components?
Is the rationale for undertaking the
research clearly outlined?
Is the literature review comprehensive
and up-to-date?
Is the aim of the research clearly stated?
Are all ethical issues identified and
addressed?
Is the methodology identified and justified?
Quantitative Qualitative
Is the study design clearly identified, and is the
rationale for choice of design evident?
Are the philosophical background and study
design identified and the rationale for
choice of design evident?
Is there an experimental hypothesis
clearly stated?
Are the key variables clearly defined?
Are the major concepts identified?
Is the population identified? Is the context of the study outlined?
Is the sample adequately described and reflective
of the population?
Is the selection of participants described
and the sampling method identified?
Is the method of data collection valid and reliable? Is the method of data collection auditable?
Is the method of data analysis valid and reliable? Is the method of data analysis credible and
confirmable?
Are the results presented in a way that is
appropriate and clear?
Is the discussion
Are the results generalizable? comprehensive Are the results transferable?
Is the conclusion comprehensive?
Figure 1: – Research critique framework
Journal of Health, Social and Environmental Issues (2005) Vol 6, No 1
51
Use of the framework
The framework is designed to be used both as a teaching
tool and as an aid to assessment. One of the motivating
factors for producing a framework was to provide clarity
and to ensure fairness for those students undertaking a
critical review of a research paper for assessment
purposes. During our experiences of helping students to
perform such critical review we had found that some
students had been unable to discriminate between those
questions that are appropriate to ask of quantitative
research and those that are relevant to qualitative
research. We hoped that by placing the questions that are
appropriate for the respective research approaches in
one single framework we would be able to facilitate the
clarification of some of the theoretical positions that
inform the respective research approaches and thus, in
turn, aid understanding of the need to pose different
questions. Thus, the framework can also be used in the
classroom for facilitating learning, and as a tool for group
activity.
Experience has demonstrated that it is the practice of
critically reviewing a research report that is valuable in
the learning process. Small group work provides the
student with opportunities for rewarding engagements
(Quinn, 1995), it allows students to work independently
and to discuss and clarify learning. In small groups
students have been provided with both quantitative and
qualitative research papers and have used the framework
and guidelines to produce their review. Feedback of the
review to the larger group allows further discussion and
development of knowledge and understanding.
The critique framework was used in teaching sessions
with two groups of under-graduate nursing and health
studies students and one small group of post-graduate
students. Nineteen students completed an evaluation
form. The numbers of students responding to particular
questions on a 0 – 5 scale are shown in Table 2. Students
were also asked two open questions:
• What did you like most about the framework?
• What did you like least about the framework?
What did you like most about the framework?
In response to the first question, the responses can be
grouped under two headings: ease of use and practical
application.
Ease of use
Students liked the presentation of the framework and
described it as straightforward, succinct and precise. The
fact that it fits on one page was pleasing to the students
and there were also comments relating to its simplicity
and brevity.
Practical application
Students found the framework easy to follow and
understand, describing it as very easy and very helpful.
They described the structure and the questions as good
and stated that the framework will help them to advance
their skills relating to the research process and methods.
It was also felt that the framework provides a useful
guide for critiquing research.
What did you like least about the framework?
Some comments suggested that the framework was too
short and could be more elaborate, but eight students
stated that there was nothing they disliked about it.
Discussion
We recognise that the comments presented here
represent the contributions of a small number of selfselecting
students and there is a need for a more
systematic approach to the evaluation of this framework.
This will be undertaken as the framework continues to be
used in classroom activities with students. However, the
current contributions from students do provide some
early indications of the potential value of the framework.
Overall, the students found the framework easy to use
and useful in terms of covering both quantitative and
qualitative research and helpful when carrying out a
critique of published research. Student responses to the
framework were largely positive, suggesting that it is a
0 1 2 3 4 5
How easy was the framework to use?
0 = not at all easy; 5 = very easy
2 5 5 7
How useful is it to have a framework covering both
quantitative and qualitative research?
0 = not at all useful; 5 = very useful
1 7 11
As a learning tool, to what extent did the framework help you
to appreciate the features that:
a) are common to all research?
0 = not at all; 5 = to a great extent
4 8 7
b) are specific to quantitative research? 3 13 3
c) are specific to qualitative research? 5 8 6
To what extent did the framework help you to carry out a
critique of a piece of research?
0 = not at all; 5 = to a great extent
2 8 9
Table 2: Evaluation of the Framework for Research Critique
useful tool in aiding learning about research and in
undertaking a research critique. The undergraduate
students who used the framework are required to
critique a piece of published research for their
assignment in their research methods module and it is
evident that they felt that the framework would help
them with this task.
Students responded favourably to the questions relating
to the features that are common to all research,
quantitative and qualitative research. However, in this
brief evaluation it was not possible to explore this
further, for example, by asking them why their responses
were positive or what in particular they found helpful.
This will form part of further evaluation as the
framework is used more widely.
Unlike some frameworks for research critique, this
framework gives equal weight to both quantitative and
qualitative research and uses the language of both
paradigms. In this way, students do not attempt to
critique qualitative research using a framework and
terms originally designed for quantitative research.
While students could be referred to two separate
frameworks, and students continue to be able to choose
to use separate frameworks, we believe that the
incorporation of the two approaches into one framework
serves to assist learning and reinforces the differences
between quantitative and qualitative research for the
‘novice’ student of research methods. Having acquired
understanding at an introductory level, advanced
frameworks are available for both research approaches
when, and if, students require greater depth at a more
advanced level of study.
Conclusion
Though the framework and guidelines were initially
designed for students working at both level two and level
three, it has also been found valuable with more
advanced students. Those undertaking masters level
study are frequently given the more complex task of
writing a critical literature review in preparation for a
research proposal or research report. Those students
who have not undertaken academic study for some time
find this daunting, and often request revision. The
framework has proved to be a useful tool in this activity.
For assessment at level two and three, students are
frequently required to critically review a paper of their
choice. Provision of the framework, with the assessment
guidelines, provides a direction for all students. The
inclusion of both strategies ensures that whatever the
choice of paper all students have guidelines with which to
work.
The framework, then, is of value in both teaching and
assessment at level two and three, and is also a
potentially useful teaching tool for masters level
students. It can be used as a teaching tool and displayed
on an overhead projector or on PowerPoint. It can also be
easily copied as a one page handout for students to work
with in the classroom or to take away for study. Further
use of the framework is required, but the intention is to
place it on WebCT, with the guidelines available as
‘clickable links’. As such, it will also serve as a revision
aid and will allow students to test their own knowledge,
clicking on those areas where they feel they need further
explanation. The next stage is to facilitate a more
systematic evaluation of this framework: we also
welcome comments from our colleagues.
References
Benton, D. C. (1999). Clinical effectiveness. In S. Hamer
and G. Collinson (Eds.) Achieving Evidence-Based
Practice. A. Handbook for Practitioners. Edinburgh:
Baillière Tindall.
Benton, D. C. & Cormack, D. F. S. (2000). Reviewing and
evaluating the literature. In D. F. S. Cormack (Ed.) The
research process in nursing (4th Ed.). Oxford: Blackwell
Sciences Ltd.
Bowling, A. (2002). Research methods in health.
Investigating health and health services (2nd Ed.).
Buckingham: Open University Press.
Burns, N. & Grove, S., K. (2001). The practice of nursing
research. Conduct, critique and utilization (4th Ed.).
Philadelphia: W. B. Saunders Company.
Chalen, V., Kaminski, S. & Harris, P. (1996). Researchmindedness
in the radiography profession. Radiography,
2, 2, 139-51.
DePoy, E. & Gitlin, L. N. (1998). Introduction to
research. Understanding and applying multiple
strategies (2nd Ed.). St. Louis: Mosby.
Domholdt, E., Flaherty, J. & Phillips, J. (1994). Critical
appraisal of literature by expert and inexperienced
physical therapy researchers. Physical Therapy, 74, 9,
853-60.
Forchuk, C. & Roberts, J. (1993). How to critique
qualitative research articles. Canadian Journal of
Nursing Research, 25, 4, 47-55.
Gomm, R. & Davies, C. (Eds.) (2000). Using evidence in
health and social care. London: Sage.
Green, J. & Thorogood, N. (2004). Qualitative methods
for health research. London: Sage.
Greenhalgh, T. & Taylor, R. (1997). How to read a paper:
Papers that go beyond numbers (qualitative research).
British Medical Journal, 315, 740-743.
52
Developing a framework for critiquing health research
Journal of Health, Social and Environmental Issues (2005) Vol 6, No 1
53
Hammersley, M. (1992). What’s wrong with
ethnography? Methodological explorations. London:
Routledge.
Hek, G. (1996). Guidelines on conducting a critical
research evaluation. Nursing Standard, 11, 6, 40-43.
Kuzel, A. J. & Engel, J. D. (2001). Some pragmatic
thoughts about evaluating qualitative health research in
Morse, J. M., Swanson, J. M. & Kuzel, A. J. (Eds). The
nature of qualitative evidence. London: Sage.
Lo-Biondo-Wood, G. & Haber, J. (1994). Nursing
Research (3rd Ed.). London: Mosby.
MacAuley, D., McCrum, E. & Brown, C. (1998).
Randomised controlled trial of the READER method of
critical appraisal in general practice. British Medical
Journal, 316, 1134-1137.
Mays, N. & Pope, C. (2000). Assessing quality in
qualitative research. British Medical Journal, 320, 50-
52.
McCaughan, D., Thompson, C., Cullum, N., Sheldon, T. &
Thompson, D. (2002) Acute care nurses’ perceptions of
barriers to using research information in clinicaldecision-
making. Journal of Advanced Nursing, 39, 1,
46-60.
Morse, J. M. & Field, P. A. (1996). Nursing research. The
application of qualitative approaches (2nd Ed.).
Cheltenham: Stanley Thornes (Publishers) Ltd.
Murdaugh, C., Kramer, M. & Schmalenberg, C. (1981).
The teaching of nursing research. A survey report. Nurse
Educator, 28-35.
Nieswiadomy, R. M. (1998). Foundations of nursing
research (2nd Ed.). Connecticut: Appleton & Lange.
Parahoo, K. (1997). Nursing research. Principles,
process and issues. Basingstoke: Macmillan Press Ltd.
Pearson, M. & Craig, J. V. (2002). Evidence-based
practice in nursing. In J. V. Craig and R. L. Smyth (Eds.)
Evidence-Based Practice Manual for Nurses. London:
Churchill Livingstone.
Perkins, E. R., Simnett, I. & Wright, L. (1999). Creative
tensions in evidence-based practice. In E. R. Perkins, I.
Simnett and L. Wright (Eds.) Evidence-based health
promotion. Chichester: John Wiley & Sons.
Polgar, S. & Thomas, S. A. (2000). Introduction to
research in the Health Sciences (4th Ed.). London:
Churchill Livingstone.
Polit, D. F. & Hungler, B. P. (1999). Nursing research.
Principles and methods (6th Ed.). Philadelphia:
Lippincott.
Quinn, F. (1995). The principles and practice of nurse
education (3rd Ed.). London: Chapman.
Sajiwandani, J. (1996). Ensuring the trustworthiness of
quantitative research through critique. Nursing Times
Research, 1, 2, 135-141.
Sandelowski, M. (1986). The problem of rigor in
qualitative research. Advances in Nursing Science, 8, 3,
27-37.
Stevens, P., Schade, A., Chalk, B. & Slevin, O. (1993).
Understanding research. Edinburgh: Campion Press.
Treece, E. W. & Treece, J. W. Jr. (1986). Elements of
research in nursing (4th Ed.). St. Louis: Mosby.
Valente, S. (2003). Critical analysis of research papers.
Journal for Nurses in Staff Development, 19, 3, 130-142.
http://www.uwcm.ac.uk/library/critical_appraisal/for
ms (Accessed January 16 2004).
http://www.cybernurse.org.uk/research/Reading_and_
Critiquing_Research.htm (Accessed January 16 2004).
http://www.phru.nhs.uk/~casp/qualitat.htm (Accessed
January 16 2004).
http://www.sonoma.edu/users/n/nolan/n400/critique.
htm (Accessed January 16 2004).
Kay Caldwell
Head of the Institute of Nursing and Midwifery
School of Health and Social Sciences
Middlesex University
Archway Campus
Furnival Building
10 Highgate Hill
London
N19 5LW
UK
Tel: +44 (0)208 411 6458
Email: k.caldwell@mdx.ac.uk
Lynne Henshaw
Senior Lecturer in Nursing
School of Health and Social Sciences
Middlesex University
Queensway
Enfield,
EN3 4SA
UK.
Tel: +44 (0)208 411 6474
Email: l.henshaw@mdx.ac.uk
Gina Taylor
Senior Lecturer in Health Studies
School of Health and Social Sciences
Middlesex University
Queensway
Enfield,
EN3 4SA
UK.
Tel: +44 (0)208 411 5383
Email: g.taylor@mdx.ac.uk
54
Developing a framework for critiquing health research

Does Prejudice and Discrimination Lead to the Development of Generalized Anxiety Disorder?

Psychology 13: Social Psychology

Paper 2: Literature Review (Instructions: Fall 2019)

Overview:

This paper is worth 10% of your total grade and will require you to write about 5 pages, double spaced, 12 point font, 1 inch margins for the top, bottom, right, and left margins.  This assignment was designed in order to allow you to delve a bit deeper into some facet of social psychology than we’re able to do in class. Learning how to do a literature review taps into and develops critical thinking skills in that you will learn how science progresses, integrate the science with things you already know or will know, and to extrapolate the concepts to new situations.  When we extrapolate, it means we can see applications of what we’ve learned, outside of the narrow situations in which the original information is presented.

In this paper you will write about one of four article choices accessible through the Pierce College website (online library database).  Instructions regarding how to access this database and find these four articles are provided on page 4 of these instructions.  Please browse through these articles and choose which one you find most interesting to you.  NOTE THAT YOU MUST CHOOSE ONE OF THE ARTICLES LISTED BELOW.  CHOOSING ANY OTHER ARTICLE WILL RESULT IN AN AUTOMATIC ZERO.  You will need to have Adobe Acrobat Reader installed on your computer to access these articles.  Most computers already have this installed.  If you do not, you can download it for free at… http://get.adobe.com/reader/

Possible Articles…

  1. Social Cognition and Perception… The Self-Fulfilling Prophecy; Feldman & Theiss; 1982; Journal of Educational Psychology
  2. Persuasion… Helpful or Hurtful?; Johnson & Downing; 1979; Journal of Personality and Social Psychology
  3. Prejudice and Discrimination… Aromatic Discrimination; Baron; 1983; Journal of Applied Psychology
  4. Attractiveness… Ugly Equals Bad; Dion; 1972; Journal of Personality and Social Psychology

Format Requirements:

Your literature review must have a cover sheet (this does not count as 1 of your 5 pages) with the name (you create your own title) of your literature review centered on the page in about 16-point font, and your name, institution, and date of submission in 12-point font, centered below the title.

Example: 

Does Prejudice and Discrimination Lead to the Development of Generalized Anxiety Disorder?

Chadwick J. Snow

Pierce College

  1. The first page of your review should begin right at the top margin.
  2. You will include proper referencing (APA) of the article you review at the very end of your paper. If

you’re not sure how to reference the paper, you can look at the reference list of the article you review  for correct formatting.

NOTE: You should only have ONE reference (the article you chose to review) AND note that the articles listed above are NOT properly referenced.  I want you to look up proper referencing on your own.

  1. NO QUOTING!!! You must be able to write this review in your own words.
  2. MAKE SURE THAT YOU PROVIDE SECTION HEADINGS FOR EVERY SINGLE COMPONENT

THROUGHOUT YOUR PAPER.

  1. Page 5 of these instructions explains the point breakdown for each part below.

 

 

Content Requirements: Part I

Summary:

  1. Begin the first page with a brief introduction which gives some background about the issue you’re reviewing. Why is it an interesting and/or important topic to study? (AT LEAST HALF OF A PAGE)
  2. You will summarize the research paper by:

 

  1. Stating what the authors’ purpose/hypothesis(es) of the study were. (2 to 4 sentences)

 

  1. Describing what they did in the study: the method (including participants / procedure / materials, etc…) they used to test their hypothesis(es). (AT LEAST TWO-THIRDS OF A PAGE)

 

  1. Describing the results of the study. I do not expect you to report statistics, only to give the gist of what the results showed. Was the hypothesis supported or not supported?  How or how not?  Explain thoroughly. (AT LEAST TWO-THIRDS OF A PAGE)

 

  1. Briefly discussing the implications of the results…what do they mean? Don’t just repeat the results; tell me what the researchers think their results mean. (AT LEAST HALF OF A PAGE)

 

 

NOTE: Keep in mind that I have read the study you’re reporting on.  So, I know it very well.  This means you must describe it well enough so that I know you fully comprehend the article you are reviewing.

 

 

 

Content Requirements: Part II

Analysis:

  1. An Unanswered Question(s) (1 to 2 sentences): Discuss at least one question you have about the issue you reviewed that was not answered by your reading of the study.

 

  1. Proposed Modification (AT LEAST TWO-THIRDS OF A PAGE): Propose a way the study can be modified that might help to answer your unanswered question(s).  Issues to address in the proposed modification:

 

  1. Would you use the same type of participants or different participants? For

example, if your study involved children, would you stick with children in your

proposed modification or would you switch to adults?  Why?

 

  1. What different testing materials would use and why would you use them?

 

  1. What is the value of doing this modification (i.e. what makes it special and

important)? Explain thoroughly.  This should be the longest section of your

Proposed Modification.

 

For example: if the study you reviewed was about how sexually abused girls

become fearful of romantic relationships later in life, might you redesign the

materials to determine if there is a specific form of sexual abuse that

increases the likelihood of being afraid of getting involved in romantic

relationships later in life?

 

 

 

 

  1. Application (AT LEAST HALF OF A PAGE): Finally, you’ll explain how what you learned

from the study you reviewed might transfer or apply to a different domain.

 

For example: if the study you reviewed was about how sexually abused girls

become fearful of romantic relationships later in life, how might verbally abused girls

react to social situations, such as parties or friendships; might they become more

introverted?

 

NOTE: The more different your application is from the original study (but still

preserving the underlying concept), the higher your grade for the application section

will be.

 

Your application MUST be different than your proposed modification.  REMEMBER, your modification is a variation of the study you read about.  Your application is creatively applying what you learned to a different (but related) domain of study.

 

Below are examples of what are NOT applications

 

  1. So, sexual abuse is a real problem in our society and can have a negative impact on those who get abused. (This is a conclusion).
  2. So, if sexually abused girls become fearful of romantic relationships later in life, then they might develop serious psychological disorders related to anxiety and depression from being alone all the time. (This is a consequence).
  3. We need to stop sexual abuse now! A massive effort needs to be launched to educate people regarding sex to help prevent sexual abuse from happening. (This is a prescription).
  4. Given that sexual abuse is a problem and needs to be stopped, we must also stop people from eating fatty foods to reduce obesity. (This is an unrelated topic).
  5. Clearly sexual abuse is a problem. The world is so full of problems that we need to eliminate this problem in order to free up time to solve other problems. (This is a piece of crap).
  6. Sexual abuse is a real problem. It’s a mess, just like the world.  Sexual abuse is truly a problem.  The world is such a disaster.  Sexual abuse is horrible. (This is hoping that Prof. Snow is tired from reading all these papers, will see that I have written many words down in this section, and won’t bother to actually read them).

 

 

NOTE:  Part I of your paper should be about 3 pages long and Part II should be at least 1.5 pages long.  DO NOT exceed 5.5 pages total.

 

 

Finally, do not forget your Reference Page.

 

 

If any of this is unclear, COME SEE ME AND ASK ME FOR CLARIFICATION.

 

AN EXAMPLE OF AN EXCELLENT PAPER 2 IS ON THE CLASS WEBSITE.

 

On your syllabus, note the due date of this paper and the consequences for turning it in late.

 

 

 

 

Instructions for Accessing the Four Possible Article Choices using Pierce’s Online Library Database

 

NOTE: Some students have had trouble accessing these articles using Internet Explorer.  You may want to use Google Chrome or some other web browser.

 

  1. Go to: www.piercecollege.edu.

 

  1. Click on “Library”.

 

  1. Click on “Databases A – Z”.

 

  1. Click on “P” and then scroll down and click on “PsycARTICLES”.

 

  1. Follow the login instructions for “Students”.

 

  1. In the search box, copy and paste EXACTLY the following from below (one article at a time of course)…

           

The Teacher and Student as Pygmalions: Joint Effects of Teacher and Student Expectations

 

Deindividuation and Valence of Cues: Effects on Prosocial and Antisocial Behavior

 

“Sweet smell of success”? The impact of pleasant artificial scents on evaluations of job applicants

 

Physical Attractiveness and Evaluation of Children’s Transgressions

 

  1. Under the article title that comes up in the search click on “PDF Full Text”. (NOTE: if more than one result comes up, make sure you choose the one that lists the author mentioned on Page 1 of these instructions).

 

 

That’s it!

 

 

 

REMEMBER:  Do this for all four articles so that you can decide which one you would like to write about.

 

Come see me if you are having trouble with these instructions.

 

 

 

 

Grade Breakdown:

 

 

Name:                                                                        Grade:

 

Note:  YS = Your Score; TP = Total Possible

 

Criteria

 

Format (20 points)                                                  YS       TP

Within prescribed page range                                           4

Cover page                                                                           2

Typing format                                                                        2

Section headings                                                                5

Good editing                                                                         5

Proper referencing                                                              2

Section Total                                                                         20       

 

Article Summary (45 points)                                YS       TP      

Introduction                                                                           7

Purpose/Hypothesis(es)                                                     6

Method                                                                                   12

Results                                                                                  12

Discussion                                                                            8

Section Total                                                                         45       

 

Analysis (35 points)                                               YS       TP

An Unanswered Question                                                 5

Proposed Modification                                                        15

Application                                                                            15

Section Total                                                                         35

 

Total Points                                                                           100

 

 

NOTE:  I expect more time, effort, thought, and written work devoted to components worth more points than to components worth fewer points.

 

 

 

 

Whether the evidence justifies consideration by the court of the issue of reckless conduct?

Hackbart v. Cincinatti Bengals

FACTS:

  • Plaintiff was a professional football player and during a game was hit in the back of the head by the defendant after being blocked by plaintiff.
  • Defendant admitted hitting the plaintiff in the head was intentional
  • Plaintiff filed a lawsuit alleging negligence and reckless misconduct
  • Trial court ruled in favor of the defendant stating that football was beyond the realm of imposition of the law for tortious conduct and that the plaintiff assumed the risk inherent in the game.
  • Plaintiff appealed claiming the trial court erred in failing to apply tort principals to the action and evidence of plaintiff’s prior game conduct was improperly admitted at trial.

RULE:

  • Because the jurisdiction to hear or determine case exists in this case, it must be tried on its merits. According to Colorado Constitution, Art. II 6 “court of justice shall be open to every person, property or character; and right and justice should be administered without sale, denial, or delay.” Because of this the district court held that the trial court’s ruling that this case had to be dismissed because the injury was inflicted during a professional football game was error.
  • According to subsection (b) of Rule 404, “Evidence of other crimes, wrongs, or acts is not admissible to prove the character of a person in order to show that he acted in conformity therewith. It may, however, be admissible for other purposes, such as proof of motive, opportunity, intent, preparation, plan, knowledge, identity, or absence of mistake or accident.” Because the district court did not find the game of football to be on trial, but rather the trial involved a particular act in one game, then the acts of violence which occurred in other games and between other teams and players were without relevance.
  • Because the plaintiff was not shown to have been an unlawful aggressor in the immediate incident, his prior acts are not relevant.
  • Recklessness requires the intent to do the act, but without an intent to cause the particular harm. It is enough if the actor knows that there is a strong probability that harm will result.

ISSUE:

  • The question in this case is whether in a regular season professional football game an injury which is inflicted by one professional football player on an opposing player can give rise to liability in tort where the injury was inflicted by the intentional striking of a blow during the game.
  • Whether the trial court erred in ruling that as a matter of policy the principles of law governing the infliction of injuries should be entirely refused where the injury took place in the course of the game.
  • Whether it was error to receive in evidence numerous episodes of violence which were unrelated to the case at bar, that is, incidents of intentional infliction of injury which occurred in other games
  • Whether it was error for the trial court to receive in evidence unrelated acts on the part of the plaintiff
  • Whether the evidence justifies consideration by the court of the issue of reckless conduct?

ANALYSIS:

CONCLUSION:

The ruling court reversed the trial court’s judgment for defendant and remanded a new trial holding where no law prevented the application of tort concepts to football. They found that the plaintiff had the right to have his tort claims adjudicated and that the evidence of plaintiff’s prior football conduct was irrelevant to claims and improperly admitted.

What particular aspects of religion contribute to this relationship?

http://spp.sagepub.com/
Social Psychological and Personality Science
http://spp.sagepub.com/content/early/2013/06/18/1948550613492345
The online version of this article can be found at:
DOI: 10.1177/1948550613492345
Social Psychological and Personality Science published online 18 June 2013
Ryan S. Ritter, Jesse Lee Preston and Ivan Hernandez
Twitter
Happy Tweets: Christians Are Happier, More Socially Connected, and Less Analytical Than Atheists on
Published by:
http://www.sagepublications.com
On behalf of:
Society for Personality and Social Psychology
Association for Research in Personality
European Association of Social Psychology
Society of Experimental and Social Psychology
Additional services and information for Social Psychological and Personality Science can be found at:
Email Alerts: http://spp.sagepub.com/cgi/alerts
Subscriptions: http://spp.sagepub.com/subscriptions
Reprints: http://www.sagepub.com/journalsReprints.nav
Permissions: http://www.sagepub.com/journalsPermissions.nav
What is This?
>> OnlineFirst Version of Record – Jun 18, 2013
Downloaded from spp.sagepub.com at UNIV OF ILLINOIS URBANA on June 20, 2013
Article
Happy Tweets: Christians Are Happier,
More Socially Connected, and Less
Analytical Than Atheists on Twitter
Ryan S. Ritter1, Jesse Lee Preston1, and Ivan Hernandez1
Abstract
We analyze data from nearly 2 million text messages (tweets) across over 16,000 users on Twitter to examine differences
between Christians and atheists in natural language. Analyses reveal that Christians use more positive emotion words and less
negative emotion words than atheists. Moreover, two independent paths predict differences in expressions of happiness:
frequency of words related to an intuitive (vs. analytic) thinking style and frequency of words related to social relationships. These
findings provide the first evidence that the relationship between religion and happiness is partially mediated by thinking style. This
research also provides support for previous laboratory studies and self-report data, suggesting that social connection partially
mediates the relationship between religiosity and happiness. Implications for theory and the future of social science using
computational methods to analyze social media are discussed.
Keywords
Twitter, religion, atheism, happiness, thinking style
Karl Marx (1843/1970) famously asserted that religion is ‘‘the
opium of the people.’’ Though he recognized that religion can
provide comfort in difficult circumstances, for Marx these
benefits were an illusion. The idea that religion hinders true
happiness is echoed by more recent arguments that the world
would be a better place without religion (e.g., Dawkins,
2006; Harris, 2008; Hitchens, 2007). But there is also evidence
for a positive correlation between religion and well-being
(Ferriss, 2002; Hackney & Sanders, 2003; Koenig & Larson,
2001; Poloma & Pendleton, 1990), observed across all four
major world religions (Buddhism, Christianity, Hinduism, and
Islam; Diener, Tay, & Myers, 2011).
In the present research, we use Twitter data to examine two
related research questions: (1) What is the relationship between
religion and happiness? and (2) what particular aspects of
religion contribute to this relationship?We investigate these questions
in a content analysis of Twittermessages (tweets)written by
religious and nonreligious individuals. This approach has several
important advantages. First, unlike traditional studies that assess
happiness through self-report (i.e., directly asking participants
how happy they are or to recall recent positive and negative
emotion; Diener, Suh, Lucas,& Smith, 1999), Twitter data allow
researchers to observe themood of users by the expression of happiness
(or unhappiness) in natural language. Twitter users are not
directed by survey questions or responding in a laboratory setting
that can trigger demand characteristics and distort accurate
responses. Instead, Twitter users are casually conversing on the
Internet with others on topics ranging from the mundane
(e.g., ‘‘I just saw a chicken cross the road’’) to life changing
(e.g., ‘‘I’m getting married!’’). Twitter can therefore provide a
window into users’ state of mind, in real time, as changes and
events are experienced. Furthermore,Twitter.comis currently the
ninth most popular website in the world, yielding millions of
tweets per day from an extremely large and diverse pool of users
(Alexa, 2012). Twitter thus provides a unique opportunity to
study psychological constructs on a large scale that is not possible
through traditional survey and laboratory methods (Lazer et al.,
2009). Finally, content analysis of Twitter allows us to examine
the linguistic markers of numerous different psychological variables
and their interrelationships simultaneously. In the present
research, we investigated two independent mechanisms that may
help explain the association between religion and happiness—
analytical thinking style and social connection—also observable
by differences in language use.
Thinking Style and Social Connection as Mediators
Whether religious people experience more or less happiness is
an important question in itself. But to truly understand how
religion and happiness are related we must also understand why
the two may be related. What features of religion could produce
1 University of Illinois at Urbana–Champaign, Champaign, IL, USA
Corresponding Author:
Ryan S. Ritter, University of Illinois at Urbana–Champaign, 603 East Daniel
Street, Champaign, IL 61820, USA.
Email: ryan.s.ritter@gmail.com
Social Psychological and
Personality Science
00(0) 1-7
ª The Author(s) 2013
Reprints and permission:
sagepub.com/journalsPermissions.nav
DOI: 10.1177/1948550613492345
spps.sagepub.com
Downloaded from spp.sagepub.com at UNIV OF ILLINOIS URBANA on June 20, 2013
differences in happiness? We explored two independent
mechanisms that may mediate the relationship between
religion and happiness. First, believers and nonbelievers may
differ in preference for an intuitive versus analytical thinking
style (Gervais & Norenzayan, 2012; Shenhav, Rand, & Greene,
2011). Whereas intuitive thinking relies on gut feelings to make
decisions, an analytical thinking style emphasizes criticism and
skepticism to draw conclusions (Frederick, 2005). It is easy to see
howdifferences in thinking stylemay be associated with religious
belief. Faith is often characterized by strong emotional conviction
and valued by the very virtue of its uncritical nature. In contrast,
religious disbelief can be characterized by its skeptical approach
to belief. Many scholars suggest that the belief in God is a cognitive
default for humans (Barrett, 2000; Bloom, 2007), and thus
analytical thinking and skepticism may be necessary for one to
reject the dominant belief in God.More important here, however,
these differences in thinking stylemay contribute to differences in
happiness. At its extreme, analytic thinking can foster intense
rumination that can contribute to depression (Andrews & Thomson,
2009).Analytical thinkingmay also diminish the capacity for
optimism and positive self-illusions that typify good mental
health (Taylor & Brown, 1988). If religious people are indeed
happier than nonreligious people, differences in thinking style
may help explain why. But to our knowledge, no previous
research has tested this prediction. Here, we examined whether
nonreligious people exhibit more analytical thinking in their
tweets compared to religious people and whether this could
predict differences in happiness between the two groups.
We were also interested in the role of social relationships as
a mediator between religion and happiness. Several lines of
study have suggested that the quality of social relationships
contribute to overall happiness and well-being (Diener & Seligman,
2002; Lyubomirsky, King, & Diener, 2005; Myers, 2000).
Religion frequently provides a tight-knit moral community in
whom group members can trust and depend on for social
support (Graham & Haidt, 2010). In other words, religious
people benefit by being surrounded by an extended ‘‘family’’
with whom they can share in life’s joys and endure its trials.
Consistent with this idea, religious people report having stronger
social relationships than less religious people, and this
difference in social support predicts happiness (Diener et al.,
2011; Salsman, Brown, Brechting, & Carlson, 2005). Another
goal of the present research was to investigate whether this
effect could be observed in natural language on Twitter.
Method
We report how we determined our sample size, all data
exclusions (if any), all manipulations, and all measures in the
study (Simmons, Nelson, & Simonsohn, 2012).
Procedure
All data were collected using Python v2.7.3, a freely available
and open-source programming language. We gained access to
the Twitter Application Programming Interface using the
Twython package for Python (McGrath, 2012).1
Christian and atheist Twitter users were selected for analysis
by sampling from those who elected to follow the Twitter feeds
of five Christian public figures or five atheist public figures.
The five Christian public figures were Pope Benedict XVI
(@PopeBXVI), Dinesh D’Souza (@DineshDSouza), Joyce
Meyer (@JoyceMeyer), Joel Osteen (@JoelOsteen), and Rick
Warren (@RickWarren). The five atheist public figures were
Richard Dawkins (@RichardDawkins), Sam Harris (@Sam-
HarrisOrg), Christopher Hitchens (@ChrisHitchens), Monica
Salcedo (@Monicks), and Michael Shermer (@MichaelShermer).
The most recent tweet in the sample was from October
1, 2012.
For each of these 10 public figures, we first obtained a list of
their followers and shuffled them into random order. Followers
and their timelines (i.e., recent tweets) were then sampled from
this list at a rate of 150 per hr for a 24-hr period, resulting in
3,600 possible follower timelines per public figure. Only
publicly available follower timelines were accessed and up to
200 of each follower’s most recent tweets were collected. This
process resulted in timelines from a total of 12,849 Christian
followers and 13,367 atheist followers. However, many of
these followers had relatively few tweets in their timeline
and/or did not report English as their language. The final sample
thus included the 7,557 Christian followers (877,537
tweets) and 8,716 atheist followers (1,039,812 tweets) who
self-reported English as their language and had at least 20
tweets in their timeline. Thirteen followers who met all of these
criteria were following both a Christian and an atheist public
figure in our sample and were excluded from the final analysis.
Prior to analysis, each follower timeline was cleaned by
converting all words to lowercase and removing numbers,
hyperlinks, punctuation (except apostrophes), and any mention
of another Twitter user (e.g., @<username>).
The majority of users in our sample either did not self-report
their location (n ¼ 5,252) or reported a time zone in the United
States or Canada (Atlantic ¼ 464; Eastern ¼ 2,377; Central ¼
1,916; Mountain ¼ 472; Arizona ¼ 268; Pacific ¼ 1,238;
Hawaii ¼ 226; and Alaska ¼ 164). The rest of the users
reported locations more sparsely distributed across the world
(e.g., London ¼ 895; Quito ¼ 607; Amsterdam ¼ 263; Beijing
¼ 63; Mumbai ¼ 24; Jerusalem ¼ 14).
Measures
Christian and atheist follower timelines were analyzed using
Linguistic Inquiry and Word Count (LIWC; Pennebaker,
Chung, Ireland, Gonzales, & Booth, 2007), a computerized text
analysis program. Given a piece of text, LIWC counts the
frequency of words or word stems present in a given language
category and outputs the percentage of words that appear in
each category. The LIWC dictionary includes subdictionaries
measuring objective linguistic categories (e.g., pronouns,
articles, and adverbs) as well as a variety of psychological processes
(e.g., affective, cognitive, and perceptual) and personal
2 Social Psychological and Personality Science 00(0)
Downloaded from spp.sagepub.com at UNIV OF ILLINOIS URBANA on June 20, 2013
processes (e.g., work, religion, and leisure). The LIWC dictionary
has been extensively developed and validated (for a
detailed description, see Pennebaker et al., 2007) and has been
successfully applied to the measurement of a wide variety of
constructs (for a review, see Tausczik & Pennebaker, 2010).
For example, LIWC reliably detects the positive and negative
emotion words used when people are asked to write about
positive and negative life events (e.g., Kahn, Tobin, Massey,
& Anderson, 2007) and correlates with human judgments of
affective content (e.g., Pennebaker & Francis, 1996). In a
recent investigation on Twitter, researchers used LIWC to measure
within-person fluctuations in affect and found that people
tend to be happiest early in the mornings and on the weekends
(Golder & Macy, 2011).
Happiness. The presence of positive emotions and the absence
of negative emotions each have an independent influence on
happiness (Diener & Emmons, 1984). Here, we operationalized
happiness as the relative frequency of words in LIWC’s positive
emotion dictionary (e.g., ‘‘love,’’ ‘‘nice’’) to the frequency
of words in the negative emotion dictionary (e.g., ‘‘hurt,’’
‘‘nasty’’). In addition, we examined the independent effects
of positive and negative emotion, respectively.
Social Connection and Thinking Style. Social connection was measured
as the frequency of words in LIWC’s social processes
dictionary (e.g., ‘‘mate,’’ ‘‘friend’’) and analytic thinking was
measured using the dictionary of insight words (e.g., ‘‘think,’’
‘‘consider’’). These dictionaries were developed and validated
using the same procedures as the affective dictionaries
described above (Pennebaker et al., 2007) and have also been
used in previous research (e.g., Pennebaker & Francis, 1996).
Religion. We compared the frequency of words in LIWC’s
religion dictionary (e.g., ‘‘God,’’ ‘‘church’’) to validate our
assumptions about Christian and atheist followers’ own religious
beliefs. The religion dictionary was developed along with
the other LIWC subdictionaries.
To avoid any artificial inflation of association among these
variables, we removed a total of 43 words or word stems that
appeared in more than one of the five LIWC dictionaries of
interest (positive emotion, negative emotion, social processes,
insight, and religion). For example, in the unmodified LIWC
2007 dictionary, the stem ‘‘bless*’’ is included in both the positive
emotion and the religion categories, and the stem ‘‘prais*’’
is included in the social processes, positive emotion, and religion
categories. We therefore excluded these 43 words and
word stems, so that common phrases (e.g., ‘‘praise God,’’ ‘‘God
bless’’) did not artificially bias the results.2
Results
Sample Validation
Table 1 provides descriptive statistics and correlations among
all the variables of interest. Christian and atheist followers did
not differ in the percentage of all words captured by the LIWC
dictionary (grand mean ¼ 74.47, p ¼ .70), suggesting that
differences in linguistic content cannot be accounted for by
simple differences in English proficiency.
As expected, Christian followers tweeted words in LIWC’s
religion dictionary more frequently than atheist followers,
F(1, 16271) ¼ 328.51, p < .001; Cohen’s d ¼ .29, and talking
about religion was associated with less negative affect among
Christian followers (r¼.19, p < .001). Conversely, increased
chatter about religion among atheist followers was associated
with more negative (r ¼ .12, p < .001) and less positive affect
(r¼.09, p < .001). These results suggest that the selection of
Christian/atheist followers was indeed a valid measure of
belief/nonbelief.
Table 1. Descriptive Statistics and Zero-Order Correlations.
LIWC Category M SD Religion Social Processes Happiness Positive Emotion Negative Emotion
Christian followers
Religion 1.12 1.59 —
Social 9.36 3.17 0.18** —
Happiness 3.45 2.68 0.09** 0.22** —
PosEmo 5.53 2.31 0.01 0.34** 0.90** —
NegEmo 2.08 1.16 0.19** 0.16** 0.52** 0.10** —
Insight 1.54 0.78 0.03 0.27** 0.06** 0.05** 0.25**
Atheist followers
Religion 0.73 1.16 —
Social 8.08 2.91 0.14** —
Happiness 2.44 2.25 0.14** 0.11** —
PosEmo 4.77 1.93 0.09** 0.29** 0.86** —
NegEmo 2.33 1.15 0.12** 0.27** 0.51** 0.00 —
Insight 1.78 0.90 0.18** 0.27** 0.08** 0.04* 0.21**
Note. LIWC ¼ Linguistic Inquiry and Word Count; M ¼ mean; SD ¼ standard deviation.
Means are expressed as the percentage of total words within follower time lines. Happiness is operationalized as the difference in negative emotion from positive
emotion.
*p < .01. **p < .001.
Ritter et al. 3
Downloaded from spp.sagepub.com at UNIV OF ILLINOIS URBANA on June 20, 2013
Main Analyses
Because of our large sample, we adopted a significance criterion
of p < .01 for all analyses. We tested a multiple mediator
model using PROCESS with 10,000 bootstrapped samples
(Hayes, 2012), where religious belief (Christian follower ¼ 1,
atheist follower ¼ 0) was used to predict happiness with social
connection and thinking style included as mediators. We also
analyzed the data separately using positive emotion and
negative emotion as outcomes to investigate the independent
components of happiness.
First and foremost, the predicted relationship between
religion and happiness was supported. Relative to the atheist
followers, Christian followers expressed more happiness in
their tweets (total effect ¼ 1.01, standard error [SE] ¼ .04,
t ¼ 26.21, p < .001; Cohen’s d ¼ .41), reflected in the expression
of more positive emotion (total effect ¼ 0.76, SE ¼ .03,
t ¼ 22.88, p < .001; Cohen’s d ¼ .36) and less negative emotion
(total effect¼0.25, SE ¼ .02, t¼13.95, p < .001; Cohen’s
d ¼.22; see Table 1 for means). Second, as seen in Figure 1,
we found evidence that this relationship is partially mediated
by social connection. Christians talked more about social processes
than atheists (b ¼ 1.27, SE ¼ .05, t ¼ 26.73, p < .001;
Cohen’s d ¼ .42), which in turn was associated with more happiness
(b ¼ 0.17, SE ¼ .01, t ¼ 25.51, p < .001; bPositive Emotion
¼ 0.23, SE ¼ .01, t ¼ 42.56, p < .001; bNegative Emotion ¼ 0.06,
SE ¼ .003, t ¼ 21.44, p < .001). On average, 9.36% of words
used by Christian followers were related to social processes,
compared to 8.08% among atheist followers, consistent with
the hypothesis that religion promotes social support and social
connectivity (see Table 1). Indeed, social connection partially
mediated the effect of religious belief on happiness (indirect
effect ¼ 0.21, 99% confidence interval [CI] ¼ [0.17, 0.26];
indirect effectPositive Emotion ¼ 0.29, 99% CI ¼ [0.23, 0.34];
indirect effectNegative Emotion ¼ 0.08, 99% CI ¼ [0.06, 0.10]).
Next, we investigated differences in thinking style. Atheist
followers were more likely than Christian followers to use
‘‘insight’’ words (b ¼ 0.24, SE ¼ .01, t ¼ 17.92, p <
.001; Cohen’s d¼.28), consistent with predictions that atheists
use a more analytical thinking style (see Table 1 for
means). As seen in Figure 1, analytic thinking was then associated
with less happiness (b¼0.36, SE ¼ .02, t¼15.53, p <
.001; bPositive Emotion ¼ 0.11, SE ¼ .02, t ¼ 5.90, p < .001;
bNegative Emotion ¼ 0.25, SE ¼ .01, t ¼ 23.01, p < .001). Use of
insight words also partially mediated the association between
belief and happiness (indirect effect ¼ .09, 99% CI ¼ [.06,
.11]; indirect effectPositive Emotion ¼ 0.03, 99% CI ¼ [0.01,
0.05]; indirect effectNegative Emotion ¼ 0.06, 99% CI ¼
[0.07, 0.05]). Follow-up analyses revealed another meaningful
pattern of thinking style: Christians and atheists differed
in the kinds of insight words used, independent of mean-level
differences. Christian followers were more likely to use insight
words best characterized by certainty and emotion (e.g.,
‘‘know,’’ ‘‘feel’’), whereas atheist followers were more likely
to use insight words characterized by skepticism and analysis
(e.g., ‘‘thought,’’ ‘‘reason;’’ see Figure 2).3 This interpretation
was further supported with follow-up analyses of the LIWC
dictionaries measuring tentativeness (e.g., ‘‘maybe,’’ ‘‘perhaps’’)
and certainty (e.g., ‘‘always,’’ ‘‘never’’). The
percentage of words expressing tentativeness was lower among
Christian tweets (M ¼ 1.70, standard deviation [SD] ¼ .84)
than atheist tweets, M ¼ 2.02, SD ¼ .94; F(1, 16271) ¼
506.72, p < .001; Cohen’s d ¼ .36. On the flip side of this
effect, the percentage of words expressing certainty was higher
among Christian tweets (M ¼ 1.37, SD ¼ .71) than atheist
tweets, M ¼ 1.34, SD ¼ .75; F(1, 16271) ¼ 6.27, p ¼ .01;
Cohen’s d ¼ .04. These findings are consistent with previous
evidence that atheists have a more analytical thinking style,
whereas believers prefer an intuitive thinking style.
Discussion
In a linguistic analysis of nearly 2 million text messages
(tweets) across 16,273 users on Twitter, we found that
Christians express more happiness than atheists in everyday
language. This relation was partially mediated by linguistic
markers of social connection and thinking style. Christians
were more likely to mention social processes that suggest
stronger relationships and support networks. Simultaneously,
atheists were more likely to use ‘‘insight’’ words (e.g., ‘‘think,’’
‘‘reason’’) that in turn predicted decreased happiness, the first
evidence that thinking style partially mediates the relation
between religion and happiness.
Our results reveal important psychological differences
between believers and nonbelievers, and also suggest reasons
why believers may be happier than nonbelievers in general.
However, these findings should not be taken to mean that
religion is a prerequisite for happiness or that atheists are
doomed to be miserable. Religion itself may not provide the
key to happiness. Rather, religion can promote well-being
through other factors. Such insights can be used to improve
happiness in believers and nonbelievers alike. For example,
atheists may improve happiness by creating strong social
0 = Atheist Follower
1 = Chrisan Follower
Social Connecon
(Social)
Analyc Thinking
(Insight)
Happiness
(Posive Emoon)
(Negave Emoon)
1.27**
-0.24**
0.17**
0.72**
(0.44**)
(-0.28**)
(-0.11**)
(0.25**)
(0.23**)
(.06**)
-0.36**
Figure 1. Indirect effects of religious belief on happiness through
social connection and analytic thinking. Values above the paths represent
effects on happiness (positive emotion minus negative emotion);
values in parentheses below the paths represent effects on positive
emotion and negative emotion, respectively. LIWC dictionary names
are in parentheses. LIWC ¼ Linguistic Inquiry and Word Count.
**p < .001.
4 Social Psychological and Personality Science 00(0)
Downloaded from spp.sagepub.com at UNIV OF ILLINOIS URBANA on June 20, 2013
communities and support networks. Currently, atheists are
among the least trusted groups in American society (Gervais,
Shariff, & Norenzayan, 2011) and are bound to experience some
increased level of rumination and unhappiness due to the problem
of social exclusion. However, Atheism and secularism have
increased in recent years (WIN-Gallup International, 2012), and
the divergence in happiness between believers and nonbelievers
may decrease as Atheism becomes more normative. Indeed,
nonreligious people are equally happy as religious people in nonreligious
nations (i.e., where they fit in; Diener et al., 2011), and
increasing the perceived prevalence of atheism can decrease
anti-atheist prejudice (Gervais, 2011). In other words, increases
in happiness among nonbelievers should parallel increases in the
availability of secular social support resources and increased
feelings of being respected in society, both of which facilitate
increased happiness. Future research measuring Twitter activity
in specific regions or nations (e.g., using self-reported location
information along with geotagged information about the precise
latitude and longitude of tweets) is encouraged to examine
questions related to person–culture fit.
It is important to note that there may be other mediators
and variables that account for the relationship between religion
and happiness that are not captured by these particular
analyses. For example, religion may help provide a meaning
system to believers that resolves existential issues and helps
buffer against anxiety (Inzlicht, Tullett, & Good, 2011),
which is consistent with previous evidence that having purpose
or meaning in life also mediates the association between
religion and happiness (Diener et al., 2011). Here, proclivity
for analytic thinking could hurt or help well-being. Atheists
may come to some unpleasant conclusions on existential
issues through analytical thinking, but they may also derive
happiness and meaning from science as an elegant system
of explanation (Preston, 2011; Preston & Epley, 2009). Additionally,
because we measured associations among these variables
simultaneously, we must be very cautious in interpreting
causality. The associations reported may indeed be mutually
reinforcing and could have causal influences opposite the
directions modeled here. For example, having a strong social
support network and meaningful relationships may cause happiness,
but being happy also causes people to have better
social relationships (Lyubomirsky et al., 2005). Future
research could address these limitations of causal inference
by including time as a variable, or by complementing Twitter
analyses with traditional laboratory-based research methods
that afford more experimental control.
The present studies demonstrated powerful effects by
accessing millions of messages available on Twitter. This
Figure 2. Top 30 differences in usage for words within the LIWC insight dictionary. To create this visualization, we first calculated the
percentage usage of each word within the LIWC insight dictionary for both Christian and atheist followers. We next subtracted the atheist
follower percentage from the Christian follower percentage for each word. Finally, we selected the 30 most divergent words for visualization:
15 representing those used relatively more often by Christian followers and 15 representing those used relatively more often by atheist
followers. The sizes of the circles are scaled to represent overall word usage. The color of the circles and their position along the x-axis are
scaled to represent relative word usage among Christian and atheist followers. Values indicate the number of mentions per 100,000 words,
Christian Count–atheist Count. LIWC ¼ Linguistic Inquiry and Word Count
Ritter et al. 5
Downloaded from spp.sagepub.com at UNIV OF ILLINOIS URBANA on June 20, 2013
novel method allows meaningful patterns to emerge in the
specific words people choose to use in tweets, rather than
relying on more traditional self-report methods. Twitter has
considerable advantages as a source of data—its massive scale,
ease of access, high external validity, and fewer demand
characteristics. But of course, it is not without limitations. First,
Twitter users may still engage in some impression management
strategies. Sampling moments are not random and users can
decide exactly what they want to tweet about and when, meaning
people can selectively control the content they want others
to see. This concern is at least partially alleviated by the fact
that Twitter users have no way to know what kind of research
their data may be used for, if at all. There is thus little concern
about the expectations of an experimenter and the impressions
one might make on them.
It is also important to acknowledge that sampling from followers
of major public figures—particularly those on the far
extremes of religious belief and disbelief—may not represent
typical Christians or atheists, and these effects could reflect a
comparison of extremely conservative Christians to militant
atheists. We have also operationalized Christians and atheists
as those who chose to follow public figures well known for
their beliefs. But of course, people can follow these public
figures for reasons wholly unrelated to their religion. Despite
the imperfect nature of this sampling method, the large-scale
nature of Twitter data appears robust. Given that we randomly
sampled from literally millions of possible followers, it is
reasonable to expect a distribution that includes extreme
believers and nonbelievers as well as those with more moderate
or indifferent attitudes toward religion. Most importantly,
we are encouraged by the utility of Twitter data insofar as it
corroborates previous research that has used both laboratorybased
experimental studies (e.g., Shenhav et al., 2011) and
nationally representative samples (Diener et al., 2011). This
convergence suggests that the present findings are not limited
solely to Christian and atheist extremists and that Twitter can
be used to derive novel insights into a variety of phenomenon
of interest to social psychologists.
A final important limitation of the present research—but
one that is not unique to Twitter data—is the inherent limitation
of computerized text analysis. The analyses here relied on
simple word counts, and cannot account for complex features
of language such irony or sarcasm, and are insensitive to context
(e.g., Tweeting about positive things even when unhappy).
People may also negate their use of positive or negative affect
words (e.g., ‘‘not good’’ and ‘‘not bad’’) to convey a valence
opposite to what would be coded by a computer. To address
this possibility, we removed from user’s Twitter time lines all
instances of words in the positive and negative emotion
dictionaries that were preceded by ‘‘no’’ or ‘‘not’’ (see also,
Golder & Macy, 2011). Rerunning the analyses on these data
did not significantly alter the results. Thus, despite some
important limitations of Twitter data, we argue that the benefits
of using computational methods to access large-scale ‘‘realworld’’
data far outweigh the costs, especially when complemented
by more traditional research methods.
Conclusion
Overall, the present research demonstrates a positive relationship
between religion and happiness that can be observed in
subtle differences in language use. This research also sheds
light on some of the underlying reasons for this relationship,
that is, that religious people have stronger social connections
that can promote positive well-being and that atheists engage
in a more analytical thinking style that can diminish
well-being. More broadly, these results reveal the power of
Twitter data as an important research tool. Linguistic markers
of psychological phenomena reliably emerge even in casual
Internet conversations. Twitter data can provide valuable
insight into complex psychological processes and should be
considered a powerful tool for social scientists as people
increasingly live their lives online.
Authors’ Note
The opinions expressed in this publication are those of the authors and
do not necessarily reflect those of the John Templeton Foundation.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to
the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the
research, authorship, and/or publication of this article: This publication
was made possible in part from grant support from the John Templeton
Foundation [grant number 29104], awarded to Jesse Preston.
Notes
1. Example Python code can be obtained from the first author upon
request.
2. Running the analyses using the unmodified Linguistic Inquiry and
Word Count (LIWC) 2007 dictionary yields the same pattern of
results. The biggest difference in using the unmodified dictionary
is that, among the Christian followers, religion and positive
emotion are positively correlated, r ¼ .17, p < .001.
3. An interactive visualization of within-dictionary differences for all
LIWC dictionaries of interest is available at the following website
(requires Java to view): http://labs.psychology.illinois.edu/pramlab/
SPPS_ForceGraph/
References
Alexa (2012). Twitter.com site info. Retrieved December 19, 2012,
from http://www.alexa.com/siteinfo/twitter.com
Andrews, P. W., & Thomson, J. A. (2009). The bright side of being
blue: Depression as an adaptation for analyzing complex problems.
Psychological Review, 116, 620–654.
Barrett, J. L. (2000). Exploring the natural foundations of religion.
Trends in Cognitive Sciences, 4, 29–34.
Bloom, P. (2007). Religion is natural. Developmental Science, 10,
147–151.
Dawkins, R. (2006). The God delusion. Boston, MA: HoughtonMifflin.
6 Social Psychological and Personality Science 00(0)
Downloaded from spp.sagepub.com at UNIV OF ILLINOIS URBANA on June 20, 2013
Diener, E., & Emmons, R. A. (1984). The independence of positive
and negative affect. Journal of Personality and Social Psychology,
47, 1105–1117.
Diener, E., & Seligman, M. E. P. (2002). Very happy people.
Psychological Science, 13, 81–84.
Diener, E., Suh, E. M., Lucas, R. E., & Smith, H. L. (1999). Subjective
well-being: Three decades of progress. Psychological Bulletin,
125, 276–302.
Diener, E., Tay, L., & Myers, D. G. (2011). The religion paradox: If
religion makes people happy, why are so many dropping out?
Journal of Personality and Social Psychology, 101, 1278–1290.
Ferriss, A. L. (2002). Religion and the quality of life. Journal of
Happiness Studies, 3, 199–215.
Frederick, S. (2005). Cognitive reflection and decision making. The
Journal of Economic Perspectives, 19, 25–42.
Gervais, W. M. (2011). Finding the faithless: Perceived atheist
prevalence reduces anti-atheist prejudice. Personality and Social
Psychology Bulletin, 37, 543–556.
Gervais, W. M., & Norenzayan, A. (2012). Analytic thinking
promotes religious disbelief. Science, 336, 493–496.
Gervais, W. M., Shariff, A., & Norenzayan, A. (2011). Do you believe
in atheists? Distrust is central to anti-atheist prejudice. Journal of
Personality and Social Psychology, 101, 1189–1206.
Golder, S. A., & Macy, M. W. (2011). Diurnal and seasonal mood vary
with work, sleep, and day length across diverse cultures. Science,
333, 1878–1881.
Graham, J., & Haidt, J. (2010). Beyond beliefs: Religions bind
individuals into moral communities. Personality and Social
Psychology Review, 14, 140–150.
Hackney, C. H., & Sanders, G. S. (2003). Religiosity and mental
health: A meta-analysis of recent studies. Journal for the Scientific
Study of Religion, 42, 43–55.
Harris, S. (2008). Letter to a Christian nation. New York, NY: Vintage.
Hayes, A. F. (2012). Process: A versatile computational tool for
observed variable mediation, moderation, and conditional process
modeling [White paper]. Retrieved from http://www.afhayes.com/
public/process2012.pdf
Hitchens, C. (2007). God is not great: How religion poisons
everything. Toronto, Canada: McClelland & Stewart.
Inzlicht, M., Tullett, A. M., & Good, M. (2011). The need to believe:
A neuroscience account of religion as a motivated process.
Religion, Brain & Behavior, 1, 192–212.
Kahn, J. H., Tobin, R. M., Massey, A. E., & Anderson, J. A. (2007).
Measuring emotional expression with the Linguistic Inquiry and
Word Count. The American Journal of Psychology, 120,
263–286.
Koenig, H. G., & Larson, D. B. (2001). Religion and mental health:
Evidence for an association. International Review of Psychiatry,
13, 67–78.
Lazer, D., Pentland, A., Adamic, L., Aral, S., Barabasi, A.-L.,
Brewer, D., . . . Alstyne, M. V. (2009). Computational social
science. Science, 323, 721–723.
Lyubomirsky, S., King, L., & Diener, E. (2005). The benefits of
frequent positive affect: Does happiness lead to success? Psychological
Bulletin, 131, 803–855.
Marx, K. (1843/1970). Critique of Hegel’s ‘‘philosophy of right.’’ In
J. O’Malley (Ed. & Trans.). London, UK: Cambridge University
Press (Original work published 1843, p. 131).
McGrath, R. (2012). Twython 2.5.4. Retrieved December 19, 2012,
from http://pypi.python.org/pypi/twython/
Myers, D. G. (2000). The funds, friends, and faith of happy people.
American Psychologist, 55, 56–67.
Pennebaker, J. W., Chung, C. K., Ireland, M., Gonzales, A., & Booth,
R. J. (2007). The development and psychometric properties of
LIWC2007 [Software manual]. Austin, TX: LIWC.net. Retrieved
from www.liwc.net
Pennebaker, J. W., & Francis, M. E. (1996). Cognitive, emotional, and
language processes in disclosure. Cognition & Emotion, 10,
601–626.
Poloma, M. M., & Pendleton, B. F. (1990). Religious domains and
general well-being. Social Indicators Research, 22, 255–276.
Preston, J. L. (2011). Religion is the opiate of the masses (but science
is the methadone). Religion, Brain, and Behavior, 1, 231–233.
Preston, J., & Epley, N. (2009). Science and God: An automatic
opposition between ultimate explanations. Journal of Experimental
Social Psychology, 45, 238–241.
Salsman, J. M., Brown, T. L., Brechting, E. H., & Carlson, C. R.
(2005). The link between religion and spirituality and psychological
adjustment: The mediating role of optimism and social support.
Personality and Social Psychology Bulletin, 31, 522–535.
Shenhav, A., Rand, D. G., & Greene, J. D. (2011). Divine intuition:
Cognitive style influences belief in God. Journal of Experimental
Psychology: General, 141, 423–428.
Simmons, J., Nelson, L., & Simonsohn, U. (2012). A 21 word solution.
Retrieved October 14, 2012, fromhttp://ssrn.com/abstract¼2160588
or http://dx.doi.org/10.2139/ssrn.2160588
Tausczik, Y. R., & Pennebaker, J. W. (2010). The psychological
meaning of words: LIWC and computerized text analysis
methods. Journal of Language and Social Psychology, 29, 24–54.
Taylor, S. E., & Brown, J. D. (1988). Illusion and well-being: A social
psychological perspective on mental health. Psychological
Bulletin, 103, 193–210.
WIN-Gallup International. (2012). Global index of religiosity and
atheism. Retrieved from http://www.wingia.com/web/files/news/
14/file/14.pdf
Author Biographies
Ryan S. Ritter received his BA from the University of Nevada, Reno,
and MA from the University of Illinois at Urbana–Champaign. He is
currently a PhD candidate in social psychology at the University of
Illinois at Urbana–Champaign.
Jesse Lee Preston received her PhD in social psychology from
Harvard University and is now an assistant professor at the University
of Illinois at Urbana–Champaign.
Ivan Hernandez received his BS from the University of Florida and
MA from the University of Illinois at Urbana–Champaign. He is
currently a PhD candidate in social psychology at the University of
Illinois at Urbana–Champaign.
Ritter et al. 7
Downloaded from spp.sagepub.com at UNIV OF ILLINOIS URBANA on June 20, 2013

Describe the reasons that make the problems or issues important to you.

Assignment Instructions

ANALYZE A CURRENT HEALTH CARE PROBLEM OR ISSUE

Prepare

For this assignment, you will analyze the current health care problem or issue of interest to you, which you used in the Week 4 assignment. You selected one of the problems or issues from the Assignment Topic Areas media resource.

To explore the chosen topic, use the first four topics of the Socratic Problem-Solving Approach interactive for critical thinking that were introduced in the Week 4 assignment. Start by defining the health care problem or issue on the health care topic of your choice, then provide details about the problems or issues that are part of the chosen topic, and identify causes for the problems or issues. Identify at least three scholarly or academic peer-reviewed journal articles about the topic you are discussing by using articles found in the Week 4 assignment or searching the Capella library using the applicable undergraduate library research guide.

Write Your Paper

  1. Use scholarly information to explain a health care problem or issue.
    • Assess the credibility of information sources.
    • Assess the relevance of the information sources.
  2. Analyze the problem or issue.
    • Describe the setting or context for the problems or issues.
    • Describe the reasons that make the problems or issues important to you.
    • Identify groups of people affected by the problems or issues.
  3. Discuss potential solutions for the problems or issues.
    • Describe potential solutions.
    • Compare and contrast your opinion with other opinions you find in sources from the Capella library.
    • Provide the pros and cons for one of the solutions you are proposing.
  4. Explain the ethical implications if the potential solution was implemented.
    • Describe what would be necessary to implement the proposed solution.
    • Provide examples from the literature to support the points you are making.
    • Discuss the pros and cons of implementing the proposed solution from an ethical principle point of view.

Organize your paper using the following structure and headings:

  • Title page. (A separate page.)
  • (A one-paragraph statement about the purpose of the paper.)
  • Identify the elements of the problem or issue, or question.
  • Analyze, define, and frame the problem or issue, or question.
  • Consider solutions, responses, or answers.
  • Choose a solution, response, or answer.
  • Implementation of the potential solution.
  • (One paragraph.)

Academic Requirements

Your paper should meet the following requirements:

  • Length: Include at least 4–6 typed, double-spaced pages, not including the title page and reference page.
  • Font and font size: Use Times New Roman, 12 point.
  • Writing: Produce text with minimal grammar, usage, spelling, and mechanical errors.
  • Sources: Integrate into text appropriate use of scholarly sources, evidence, and citation style.
  • References: Use at least three scholarly or academic peer-reviewed journal articles and three in-text citations within the paper. Visit APA Style and Formatif needed.
  • Academic Honesty: Submit a draft of your assignment to SafeAssign and make any necessary changes before you submit it to your instructor for grading.

Note: Read the Analyze a Current Health Care Problem or Issue Scoring Guide to fully understand how your paper will be graded.

Example assignment: You may use the Analyze a Current Health Care Problem or Issue Example Assignment [PDF] to give you an idea of what a Proficient or higher rating on the scoring guide would look like.

Analyze a Current Health Care Problem or Issue Scoring Guide

Due Date: End of Week 9
Percentage of Course Grade: 30%.

CRITERIA NON-PERFORMANCE BASIC PROFICIENT DISTINGUISHED
Use scholarly information to explain a health care problem or issue.
23%
Does not identify scholarly information that could explain a health care problem or issue. Identifies scholarly information that could explain a health care problem or issue. Uses scholarly information to explain a health care problem or issue. Uses relevant scholarly information to explain a health care problem or issue, including the reasons that the chosen information helps to explain a health care problem or issue.
Analyze the problem or issue.
22%
Does not identify a problem or issue. Identifies a problem or issue. Analyzes the problem or issue. Analyzes the problem or issue including definition, who is involved, and causes of the problem or issue.
Discuss potential solutions for the problems or issues.
20%
Does not describe a potential solution for the problems or issues. Describes a potential solution for the problems or issues. Discusses potential solutions for the problems or issues. Discusses potential solutions for the problems or issues, including potential consequences for ignoring the issues.
Explain the ethical implications if the potential solution was implemented.
20%
Does not identify the ethical implications if the potential solution was implemented. Identifies the ethical implications if the potential solution was implemented. Explains the ethical implications if the potential solution was implemented. Explains the ethical implications if the potential solution was implemented, enriching the analysis with examples from the readings.
Produce text with minimal grammatical, usage, spelling, and mechanical errors.
5%
Produces text with significant grammatical, usage, spelling, and mechanical errors, making text difficult to follow. Produces text with some grammatical, usage, spelling, and mechanical errors, making text difficult to follow at times. Produces text with minimal grammatical, usage, spelling, and mechanical errors. Produces text free of grammatical, usage, spelling, and mechanical errors.
Integrate into text appropriate use of scholarly sources, evidence, and citation style.
10%
Does not integrate into text appropriate use of scholarly sources, evidence, and citation style. Integrates into text mostly appropriate use of scholarly sources, evidence, and citation style, but there are lapses in style use. Integrates into text appropriate use of scholarly sources, evidence, and citation style. Integrates into text appropriate use of scholarly sources, evidence, and citation style without errors, and uses current reference sources.

 

 

 

Why Were Social Dilemmas Better at Predicting Withdrawing Behavior Than Were Attitudes and Norms?

Childhood Bullying and Social Dilemmas
Amelia Kohm*
Chapin Hall at the University of Chicago, Chicago, Illinois
.. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Children who witness bullying often do not defend victims. Bystanders might be reticent to intervene because they are stuck in
“social dilemmas.” Social dilemmas are situations in which individuals make decisions based on self-interest due to their lack of
confidence that others will join with them in decisions that benefit the collective. In this study, the social dilemmas concept, which
comes from game theory and social psychology, was applied to bullying for the first time. A total of 292 middle school students at
a private residential school in the United States completed surveys about their bullying-related experiences within their
residences of 10 to 12 students of the same gender. Multilevel modeling was employed to assess if and how attitudes, group norms,
and social dilemmas predict behavior in bullying situations. The findings suggested that both individual and group factors were
associated with behavior in bullying situations and that attitudes, group norms, and social dilemmas each made a unique
contribution to predicting behavior in bullying situations. Aggr. Behav. 41:97–108, 2015. © 2015 Wiley Periodicals, Inc. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. ..
Keywords: bullying; social dilemmas; bystanders; group norms
INTRODUCTION
Children who witness bullying defend victims in only
12% to 25% of bullying episodes regardless of their
sympathy for the victims or dislike of the bullies (Craig
& Pepler, 2000; O’Connell, 1999). For the bystanders
who decide not to intervene, such bold action may seem
futile at best and dangerous at worst. But might more
bystanders be more willing to intervene if they felt
confident that others would stand with them? As
Aristotle observed long ago: “No tyrant need fear till
men begin to feel confident in each other.”
Evidence from ethnographic studies of children’s
social hierarchies sheds light on the role of bystanders,
who are usually present in bullying situations (Atlas &
Pepler, 1998; Craig & Pepler, 2000; Hawkins, Pepler, &
Craig, 2001;O’Connell, Pepler,&Craig, 1999; Sutton&
Smith, 1999; Xie, Swift, Cairns, & Cairns, 2002). For
example, Adler and Adler (1995); who conducted seven
years of participant-observation and interview research
with third- through sixth-grade students, observed that
most children side with a popular clique member in any
dispute to avoid becoming victimized themselves.
Similarly, a research team that interviewed middle
school and high school students found that harassing and
humiliating weaker, less popular students was a common
method to try to increase their own status at school.
Moreover, victims’ friends rarely defended them and
sometimes joined in the bullying to boost their status
(Bishop et al., 2004).
Such findings, from research on social hierarchies,
provide evidence in line with the hypothesis that social
dilemmas would help to explain why children often do
not defend victims of bullying. Social dilemmas are
situations in which isndividuals make decisions based on
self-interest due to their lack of confidence that others
will join with them in decisions that benefit the collective
(Dawes, McTavish, & Shaklee, 1977; Van Lange,
Liebrand, Messick, &Wilke, 1992). In a common social
dilemma called a public goods dilemma, an individual is
reluctant to contribute to a public good, such as a public
park or clean air, if he or she believes that an insufficient
number of others will also contribute and thus his or her
own efforts would be wasted (Kollock, 1998).
The social dilemmas concept, which comes from
game theory and social psychology, has been applied to
school-age bullying only in the present study, but could
be a fruitful direction for future research. Perhaps
children refrain from defending victims because they
feel that such a selfless contribution (for the good of the
Correspondence to: Amelia Kohm, Chapin Hall at the University of
Chicago, 1313 East 60th Street, Chicago, IL 60637. E-mail: akohm@-
chapinhall.org
Received 29 January 2013; Revised 7 November 2014; Accepted 10
November 2014
DOI: 10.1002/AB.21579
Published online 6 January 2015 in Wiley Online Library
(wileyonlinelibrary.com).
AGGRESSIVE BEHAVIOR
Volume 41, pages 97–108 (2015)
© 2015 Wiley Periodicals, Inc.
victim and the good of the group since it might prevent
future bullying) would be futile unless a sufficient
number of other group members joined their efforts. As
the evidence from ethnographic studies suggests,
unilateral action might leave the defender vulnerable
to victimization (Adler&Adler, 1996; Merten, 1997). In
addition, children might have low expectations about
others supporting a defender because they might
recognize that other children are similarly motivated
to act in their own self-interest.
In a cross-sectional study of 1,220 Finnish elementary
school children, Salmivalli and Voeten (2004) examined
the connections among individual attitudes, group
norms, and students’ roles in bullying situations. Roles
included bullying others, assisting the bully, reinforcing
the bully, defending the victim, or staying outside the
bullying situation, and each role was associated with a
type of behavior. Because the researchers found
behavior in bullying situations to be predicted by not
only individual attributes (attitudes) but also group
characteristics (norms), their study provided an appropriate
model for the current one. In addition, Salmivalli
and Voeten found that when they added attitudes and
norms to their models, there were fairly small reductions
in the variance for behavior in bullying situations, at both
the individual and group levels, suggesting that other
factors are important to predicting behavior in bullying
situations. The current study replicated and extended the
previous study by focusing on whether social dilemmas
help further explain the variance in behavior in bullying
situations.
There were two hypotheses: Both individual factors
(such as attitudes) and group factors (such as norms)
would be associated with behavior in bullying situations;
and attitudes, group norms, and social dilemmas would
each make a unique contribution to predicting student
behavior in bullying situations.
METHOD
Sample and Participant Selection
Participants were 292 middle school students aged 11
to 14 years (29% in sixth grade, 35% in seventh grade,
and 36% in eighth grade; 48.3% were girls) at a private
residential school in the United States that serves
children from low-income families from throughout the
United States. Students at the school are normally
functioning and are not selected according to specific
needs. The racial composition of the school at the time of
the study was approximately 60% Caucasian, 20%
African American, 10% Hispanic, and 10% other.
Students at the school live in residences with other
students of the same gender. A married couple oversees
each residence. At the time of the study, the school had
37 middle school residences each composed of 10 to 12
students in Grades 6, 7, and 8. There was a similar
distribution of students from each grade in each
residence.
Assessments and Measures
Behavior in bullying situations. The Participant
Role Questionnaire (PRQ), developed by Salmivalli
and Voeten (2004), was used in the present study to
assess student behavior in bullying situations within
student residences, the dependent variable. The PRQ
first specifies bullying as when “one child is repeatedly
exposed to harassment and attacks from one or several
other children. Harassment and attacks may be, for
example, shoving or hitting the other one, calling him/
her names or making jokes about him/her, leaving him/
her outside the group, taking his or her things, or any
other behavior meant to hurt another.” The students
reviewed 15 items describing different ways to behave in
such situations and assessed how often each of their
housemates behaved in the ways described since the
school year began (response options are “never,”
“sometimes,” or “often”). The items form five scales
reflecting different participant roles associated with
bullying: bully, assistant, reinforcer, defender, and
outsider. Assistants do not initiate but join in the
bullying; reinforcers encourage the bullying; defenders
help victims; and outsiders are not involved in bullying
in any way (Goldbaum, Craig, & Shelley, 2003; Olthof
& Goossens, 2003; Salmivalli, 1999, 2001; Salmivalli,
Lappalainen, & Lagerspetz, 1998; Sutton & Smith,
1999). The PRQ has demonstrated adequate reliability
and validity in past studies. Cronbach’s alpha coefficients
based on data in the present study were .93 for
the bully scale, .95 for the assistant scale, .93 for the
reinforcer scale, .90 for the defender scale, and .55 for
the outsider scale. Although scores on the bully,
assistant, and reinforcer scales tend to be highly
correlated, according to the authors, they seem to
represent three distinct factors, rather than one underlying
construct (Salmivalli & Voeten, 2004). However,
other studies using the PRQ or an adapted 21-item
version by Sutton and Smith (for younger children)
found that the bully, reinforcer, and assistant roles may
be measuring the same underlying construct (Goldbaum,
Craig, & Shelley, 2003; Sutton & Smith, 1999; Tani,
Greenman, Schneider, & Fregosao, 2003). Thus,
“Composite Pro-bullying Behavior” was also computed
from all items related to bullying, assisting, and
reinforcing behavior.
Attitudes toward bullying. Attitudes toward
bullying were operationalized as students’ moral beliefs
regarding the appropriateness or inappropriateness of
bullying and related behavior (Salmivalli & Voeten,
Aggr. Behav.
98 Amelia Kohm
2004). Students’ attitudes toward bullying were measured
by asking them to evaluate the extent to which they
agreed or disagreed with 10 statements about bullying.
The scale range was .00 to 4.00. Scores were based on
self-reports. Scale means were imputed for missing data
for 23 participants. Higher scores corresponded to more
antibullying attitudes. In the Finnish study, the internal
consistencies of attitudes as measured by Cronbach’s
alpha coefficient was .75. In the present study, the
Cronbach’s alpha coefficient was .73.
Group norms. The development of the questionnaire
designed to assess bullying-related classroom
norms in the Finnish study was guided by the standard
definition of norms as expected standards of behavior in
a certain group (Franzoi, 1996). The norms questionnaire
included questions about behavior that would be
expected or not appropriate in the classroom (Salmivalli
& Voeten, 2004). For each of five situations, students
assessed the likelihood of seven consequences (such as
“Other kids in my residence would avoid him/her” or
“He/she would be considered cool”). A neutral norms
score was also computed based on the sum of the last
item for each condition (“nothing in particular would
take place”). The scale range was 30.00 to 120.00 for the
antibullying scale and 5.00 to 20.00 for the neutral scale.
Higher scores reflected perception of stronger antibullying
norms or neutral norms. Scores were based on selfreport
and aggregated by student residence. The
reliability of the antibullying norm, as measured by
the coefficient alpha, was .90. The alpha for the neutral
norm was .69. In the Finnish study, students were asked
to evaluate the consequences of each act by choosing
from eight optional answers. The present study modified
the norms measure by asking students to evaluate the
probability of several positive and negative consequences
using a Likert scale.
Social dilemmas. A social dilemmas instrument
was developed drawing on the goal-expectation theory
by Pruitt and Kimmel (1977). The theory states that
cooperative behavior arises in a “strategic environment”
(one in which people aim to make rational decisions
toward certain ends) when group members share a goal
of mutual cooperation and an expectation of cooperation
(Pruitt, 1998; Pruitt & Kimmel, 1977). In the present
study, it was assumed (although not measured) that
participants’ decisions regarding bullying were, at least
in part, rational and geared toward certain ends.
Noncooperation or “social dilemmas” arise when
individuals make decisions based on self-interest due
to their lack of confidence that others will join with them
in decisions that benefit the collective. The social
dilemma variable was operationalized as the degree to
which group members agreed that three conditions were
present in their residences: Unilateral action to defend
victims would be dangerous or ineffective; group efforts
could be more effective; and cooperation from others in
an effort to defend a victim was unlikely. Therefore, any
individual’s best short-term strategy was to act selfishly
(i.e., not defend a victim) even though the best long-term
strategy to reduce bullying in the group was to act
collectively (to defend the victim). The instrument
assessed social dilemmas within the context of three
different types of bullying: physical, verbal, and relational.
Eight questions were asked about each type of
bullying. Students were asked to indicate their level of
agreement (strongly agree, agree, disagree, or strongly
disagree) with each item. Examples of items related to
social dilemma conditions for the verbal bullying scale
were, “I could get other kids to stop teasing someone
with other students helping me” and “I could get other
kids to stop teasing someone by myself.” Because
participants were coded as 1 if they met the three social
dilemma conditions and 0 if they did not, means were
equivalent to percentage of participants who met
conditions based on the total number participants who
responded to all relevant questions. If a participant
skipped any of the items related to a condition, that
condition was coded as missing data and it was not
established whether the participant met the criteria for
being in a social dilemma. There was missing data for
7% to 23% of the participants, depending on the type of
bullying under consideration. Means were not imputed
for missing data because conditions were not established
based on scales composed of similar items. Therefore,
there were no logical means to impute. The reliability of
the six items related to social dilemma conditions was
then assessed for each type of bullying. The alpha for
verbal bullying (teasing) was .64, for physical bullying
(beating up or pushing around) was .71, and for
relational bullying (gossiping) was .67. The reliability
of all 18 items, assessed together, was .87.
Minor edits were made to the original items used in the
Finnish study to make them more understandable to
students at the participating school. Edits were based on
feedback during pilot testing of the instrument with 15
students at the school, in Grades 4 to 8.
Assessment of missing data. Missing data
points were replaced with imputed scale means or
sample means for categorical variables. Mean substitution
produces internally consistent sets of results.
However, it also artificially decreases the variation of
scores, and this decrease is proportional to the amount of
missing data. To assess the possible effect of missing
data, dummy variables were created as controls where
means were imputed for missing data. Only a small
number of the coefficients for the dummy variables for
the missing data were significant, suggesting that those
participants with missing data did not significantly differ
Aggr. Behav.
Childhood Bullying and Social Dilemmas 99
from thosewithout missing data. In addition, final models
for three outcomes (composite probullying, withdrawing,
and defending) were run with cases with missing data
deleted. This procedure eliminated approximately one
third of the cases (n¼190). However, even with this
much-reduced sample, the coefficients were generally
similar in size and direction to those produced with the
whole sample (which included imputed means and
dummy variable controls) suggesting that the missing
data did not have a substantial effect on the results.
Procedure
Parents and guardians of all students in the designated
grades (N¼389) were contacted to inform them of the
study, explain their children’s rights as participants, and
ask if they would like their child to participate. The
transience of this low-income population often made it
difficult to reach parents and guardians. Consent was
received from 308 (or 79%) of the parents and guardians
and refusal from 19 (or 5%). A total of 292 students
living in 37 student residence (or 95% of the students
who had parental consent) agreed to complete the
questionnaire.
The data were collected via online questionnaires in
the computer laboratory at the middle school building.
Those students with parental consent who also assented
to participate in the study completed the questionnaire
and were led through the four instruments in the
following order: attitudes measure, PRQ, social dilemmas
measure, and norms measure.
Analyses
To assess if and how attitudes, group norms, and social
dilemmas predict behavior in bullying situations,
multilevel modeling was employed using Hierarchical
Linear Modeling software (Raudenbush & Bryk, 2002).
Multilevel modeling is a type of regression analysis
designed to handle hierarchical or clustered data. In the
current study, students were considered Level 1 units and
were clustered in residences that were considered Level
2 units. Observations of students within groups were
likely to be more similar than observations of individual
students sampled from different residences. When such
conditions exist, there is an intraclass correlation (ICC),
and the assumption of independence of observations for
regular regression is violated (Hox, 1998; Kreft & De
Leeuw, 1998; Raudenbush & Bryk, 2002). In the current
study, the groups of interest were the residences, rather
than classrooms, because ICCs are typically higher in
family households than in classrooms, and residences
within an educational setting might be more similar to
households (Gulliford, Ukoumunne, & Chinn, 1999;
Murray et al., 1994; Siddiqui, Hedeker, Flay, & Hu,
1996).
A series of 11 multilevel regression models of
increasing complexity were run for each of the dependent
variables: probullying (a composite of the three
probullying behavior), withdrawing from bullying
situations, and defending victims of bullying.1 Each
series of regressions began with a null model, which
included an intercept and two variance components:
behavior differences between students within residences
and behavior differences between residence behavior
means. The null model served as a reference for
subsequent models, each of which included variables
from previous models and an additional variable of
interest.
Variables that controlled for missing data and/or
significant interactions between key variables with
gender or grade were added, along with variables of
interest as appropriate. Interactions between grade and
gender with nonsignificant coefficients were not included
in models. Grade and attitudes were entered into
the model as Level 1 predictors of behavior in bullying
situations. Such predictors could explain both withinand
between-group variances because each residence
had a different group of students. Gender and norms
were entered into the model as Level 2 predictors.
Because there was only one gender per residence, this
variable could not explain within-group variance.
Similarly, because the group norms variables were
aggregated to the group level, they could only explain
variance between groups. The social dilemma variable
was entered as a Level 1 predictor (i.e., whether the
individual reported all three social dilemma conditions)
and, in aggregate form, as a Level 2 predictor (i.e., the
percent age of residence members who reported all three
social dilemma conditions). The attitudes and norms
predictors were continuous variables whereas the grade,
gender, and social dilemma variables were dummy
variables. Unlike the study by Salmivalli and Voeten
(2004), the current study did not omit the general
intercept and thereby create separate coefficient estimates
for each grade. To simplify analyses, Grade 6 was
used as the reference category for grade.
As in the study by Salmivalli and Voeten (2004) a
Rankit transformation was employed to reduce the
influence of outliers and normalize the distribution of
behavioral variables (Noruésis, 1993). However, the
distribution of the raw scores did not strongly depart
from normality as it did in the earlier study. In addition,
for each model that added a Level 1 variable, the model
was run twice: once with the slope fixed (or set to 0) at
Level 2 and once with a random slope, one that is
1 This article does not report results on models for the individual
probullying roles-bully, reinforcer, and assistant-due to evidence that they
may be measuring the same underlying construct.
Aggr. Behav.
100 Amelia Kohm
allowed to vary across groups. The deviance statistics for
the two models were then compared with each other,
taking into account the number of parameters in each
model, using a chi-square test. In none of the tests was a
difference statistically significant. Thus all slopes for
Level 1 variables were fixed at Level 2, meaning that the
relation between individual-level variables and behavior
outcomes did not vary by residence.
RESULTS
Descriptive
Table I presents the means and standard deviations
of boys and girls in the three grade levels for each of
the variables2. The means and standard deviations
for the antibullying and neutral norms were residence
averages and were not categorized by grade
because each residence included students in all three
grades.
Reinforcing bullies, defending victims, or withdrawing
from bullying situations were more common
behavior than bullying and assisting a bully. Assisting
the bully seemed to decrease with age for girls in the
sample. Also, there was an increasing trend, from sixth
to eighth grade, in both defending victims and withdrawing
in bullying situations for both boys and girls.
Bullying, assisting, reinforcing, and withdrawing were
more prevalent among boys than girls, while defending
was more prevalent among girls. With respect to
attitudes, girls’ antibullying attitudes appeared to
decrease with age. Boys and girls did not appear to
differ in the strength of their antibullying attitudes. In
addition, boys’ and girls’ residences were similar in the
strength of antibullying and neutral norms.
The number of students who reported all three
conditions for social dilemmas with regard to verbal
bullying seemed to decrease with age for boys and
increase with age for girls. The number of girls reporting
social dilemma conditions related to relational bullying
also appeared to increase with age. In addition, the
number of girls reporting social dilemma conditions
related to physical bullying seemed to decrease with age.
The majority of students had witnessed bullying in
their residences, with verbal (96.2%) and relational
(91.8%) being the most common types of bullying. In
addition, 50% to 60% of the students, depending on the
type of bullying, believed that unilateral efforts to help
victims would be dangerous and/or ineffective in their
residences. Similarly, 44% to 54% believed that group
efforts would be more effective and/or safe. Fewer
students (approximately 30% for each type of bullying)
had low expectations that their housemates would help
them defend a victim.
Assessment of Regression Coefficients
Table II provides the regression coefficients for the
variables of interest and related standard errors for the
final model for each of the dependent variables. Because
coefficients were not standardized, comparisons across
predictors should be considered relative to their standard
errors. Review of the coefficients begins with withingroup
(Level 1) predictors and then focuses on betweengroup
(Level 2) predictors.
Grade was entered as a dummy variable with Grade 6
as the reference category. The differences between
seventh graders’ and sixth graders’ behavior in bullying
situations were not statistically significant. Similarly,
eighth graders did not differ from sixth graders in terms
of their behavior, except with regard to defending
victims. Students in the eighth grade, on average, ranked
significantly higher on defending behavior than those in
the sixth grade.
Consistent with Hypothesis 2, the coefficients suggested
that as antibullying attitudes increased, probullying
ranks decreased and defending ranks increased.
Antibullying attitudes, however, did not have a
significant effect on withdrawing behavior.
Contrary to expectations, within-group variation on
reporting social dilemma conditions generally did not
predict behavior in bullying situations. All coefficients
were nonsignificant, with the exception of those for
social dilemmas related to relational bullying. The
coefficient for this variable was significant in the model
for the probullying composite outcome. There was an
inverse relation between reporting social dilemma
conditions and probullying behavior. Thus, contrary to
expectations, those who reported all three conditions
tended to rank lower on probullying behavior. However,
the effect size, given that the values for social dilemmas
could only be 1 or 0, was modest.
The coefficient on gender was significant for all
behavior except defending. In general, boys’ residences
ranked higher than girls’ residences on probullying
behavior and on withdrawing behavior.
The relation of antibullying norms to probullying
behavior was significant and in the expected direction:
As antibullying norms increased, probullying behavior
ranks decreased. The coefficient for withdrawing
behavior was not significant, and the antibullying norms
coefficient for defending behavior approached significance
and was positive, as expected. Student residences
that ranked higher on neutral norms tended to have
students who ranked higher on probullying behavior and
2 Description in this section is based on inspection of the descriptive data in
Table 1 and no inferential statistics were carried out.
Aggr. Behav.
Childhood Bullying and Social Dilemmas 101
lower on defending, although the coefficient for the
composite probullying outcome only approached significance.
In addition, the coefficient for neutral norms
related to withdrawing behavior was not significant.
The number of students in a residence reporting all
three social dilemma conditions related to either
physical or relational bullying tended to have a positive
relation with probullying behavior and withdrawing, as
expected. None of the coefficients for mean social
dilemmas related to verbal bullying were significant
(however, note the interactions discussed below).
In addition, several significant interactions indicated
that the relation between mean social dilemmas and
behavior sometimes varied by gender or grade. As shown
in Figure 1, mean social dilemmas related to physical
bullying did not predict withdrawing behavior for boys,
but did predict this behavior for girls: on average, girls
scored far below the mean on withdrawing behavior in
residences with low mean scores (mean1 SD) and
scored slightly above the mean on withdrawing behavior
in residences with high mean scores (meanþ1 SD). In
addition, mean social dilemmas related to verbal bullying
did not predict girls’ defending behavior, but they
appeared to be related to boys’ defending behavior.
Boys in residences with low mean social dilemmas
related to verbal bullying (mean1 SD) tended to score
above the mean on defending behavior whereas boys in
residences with high social dilemmas (meanþ1 SD)
tended to score below the mean on defending behavior. A
significant interaction between grade and mean social
dilemma related to relational bullying was detected in the
final defender model. Sixth graders’ defending behavior,
on average, was not strongly associated with the number
of housemates reporting social dilemma conditions
related to relational bullying. However, eighth-grade
students in residences with low mean social dilemmas
related to relational bullying (mean1 SD) tended to
rank substantially higher on defending behavior than
those in high mean social dilemma residences (meanþ1
SD). However, it should be noted that even students in
residences with high mean social dilemmas tended to
score above the mean on defending behavior.
Assessment of Variance Components
In addition to coefficient statistics, Hierarchical
Linear Modeling also results in data on the variance
components of each model. Variance is analogous to
the error term in traditional regression equations. The
multilevel model disaggregated the total variation into
a component at the individual level (i.e., withinresidence
variation) and at the group level (i.e.,
between-residence variation).
TABLE I. Score Means (and Standard Deviations) of Boys and Girls From Different Grade Levels
Independent Variable Gender Grade 6 Grade 7 Grade 8
Behaviors
Bullying Boys .59 (.35) .70 (.38) .65 (.36)
Girls .54 (.40) .56 (.36) .48 (.34)
Assisting the bully Boys .66 (.36) .74 (.37) .71 (.35)
Girls .64 (.42) .62 (.39) .58 (.32)
Reinforcing the bully Boys .86 (.35) .92 (.35) .88 (.35)
Girls .87 (.41) .81 (.36) .80 (.37)
Defending the victim Boys .79 (.29) .84 (.31) .96 (.33)
Girls .83 (.26) .86 (.29) .94 (.31)
Withdrawing Boys .92 (.20) .93 (.18) .96 (.18)
Girls .88 (.19) .87 (.18) .91 (.13)
Attitudes
Boys 3.17 (.55) 2.75 (.53) 2.78 (.60)
Girls 3.02 (.64) 2.95 (.51) 2.80 (.54)
Group Norms
Antibullying norms Boys’ Homes 69.35 (11.45)
Girls’ Homes 69.45 (14.24)
Neutral norms Boys’ Homes 12.88 (3.08)
Girls’ Homes 12.77 (2.84)
Social Dilemmas
Verbal Bullying: Meets Conditions A, B, C Boys .19 (.39) .18 (.39) .10 (.31)
Girls .15 (.36) .17 (.38) .23 (.42)
Physical Bullying: Meets Conditions A, B, C Boys .10 (.30) .14 (.35) .10 (.31)
Girls .22 (.42) .16 (.37) .10 (.30)
Relational Bullying: Meets Conditions A, B, C Boys .07 (.26) .21 (.41) .04 (.20)
Girls .08 (.28) .11 (.32) .14 (.35)
Aggr. Behav.
102 Amelia Kohm
As indicated in Table II, ICCs for outcome behavior in
the present study ranged from 11.5% for defending and
withdrawing behavior to 19% to 20% for probullying
behavior. This finding supported Hypothesis 1 that both
individual and group factors would be associated with
behavior in bullying situations. In addition, although
there were clear associations between context and
behavior for all of the behavior measured, the probullying
behavior was more closely associated with context
than were withdrawing and defending.
Because none of the models included random slopes, it
was possible to compute explained (or modeled)
variance, analogous to R2 statistics in traditional
regression. These figures were computed by subtracting
the variances of the present model from the variances of
the null model and dividing by the variances of the null
model. Thus, they showed the proportion of total
variance at each level that was explained after the
addition of the variable to the present model. In some
cases, adding predictors to a model actually increased
the variance and thus decreased the variance explained.
These predictors unnecessarily complicated the models,
using up degrees of freedom and thus increasing
variance. In addition, if a predictor that models part of
the within-group variability does not model part of the
between-group variability, the decrease in the Level 1
variance must be balanced by an increase in the estimate
of the Level 2 variance. Adding a Level 1 predictor
results in a decrease in the similarity within groups and,
consequently, an increase in the dissimilarity between
groups (Snijders & Bosker, 1994).
As shown in Table II, the variable that explained the
most within-group variance for the probullying behavior
outcome was antibullying attitudes. None of the other
predictors resulted in sizeable decreases in variances.
Indeed, while the ICCs indicated that the majority of the
TABLE II. Total Explained Variance (R2) for Each Model
Behavior and ICC Model Variables Added (Level Added) Level 1 Variance Level 2 Variance R2W (%) R2B (%)
Composite Probully Behavior Null .815 .202
1 Grade .817 .203 0.25 0.50
ICC: 19.86% 2 Gender .817 .185 0.25 8.42
3 Antibullying Attitudes .732 .157 10.18 22.28
4 Antibullying Norms .73 .145 10.43 28.22
5 Neutral Norms .73 .127 10.43 37.13
6 Social Dilemma – Verbal Bullying .725 .137 11.04 32.18
7 Social Dilemma – Physical Bullying .731 .135 10.31 33.17
8 Social Dilemma – Relational Bullying .723 .144 11.29 28.71
9 Social Dilemma – Verbal Bullying .723 .138 11.29 31.68
10 Social Dilemma – Physical Bullying .723 .101 11.29 50.00
11 Social Dilemma – Relational Bullying .725 .077 11.04 61.88
Withdrawing Null .888 .116
1 Grade .876 .127 1.35 9.48
ICC: 11.55% 2 Gender .874 .114 1.58 1.72
3 Antibullying Attitudes .875 .117 1.46 0.86
4 Antibullying Norms .875 .129 1.46 11.21
5 Neutral Norms .875 .123 1.46 6.03
6 Social Dilemma – Verbal Bullying .877 .121 1.24 4.31
7 Social Dilemma – Physical Bullying .87 .124 2.03 6.90
8 Social Dilemma – Relational Bullying .873 .126 1.69 8.62
9 Social Dilemma – Verbal Bullying .873 .138 1.69 18.97
10 Social Dilemma – Physical Bullying .872 .107 1.80 7.76
11 Social Dilemma – Relational Bullying .873 .078 1.69 32.76
Defending the Victim Null .89 .116
1 Grade .851 .126 4.38 8.62
ICC: 11.53% 2 Gender .851 .133 4.38 14.66
3 Antibullying Attitudes .826 .114 7.19 1.72
4 Antibullying Norms .825 .095 7.30 18.10
5 Neutral Norms .824 .092 7.42 20.69
6 Social Dilemma – Verbal Bullying .829 .084 6.85 27.59
7 Social Dilemma – Physical Bullying .833 .076 6.40 34.48
8 Social Dilemma – Relational Bullying .836 .079 6.07 31.90
9 Social Dilemma – Verbal Bullying .84 .019 5.62 83.62
10 Social Dilemma – Physical Bullying .838 .023 5.84 80.17
11 Social Dilemma – Relational Bullying .821 .003 7.75 97.41
Note. R2W, within-group variance; R2B, between-group variance.
Aggr. Behav.
Childhood Bullying and Social Dilemmas 103
variance in the behavior is explained at the individual
level, the predictors included in the present study’s
models did not explain much of that variance. For the
probullying behavior model, the predictors explained
between 10% and 13% of the Level 1 variance. Eight
percent of the variance for defending behavior and only
2% of the variance for withdrawing were explained by
the predictors in the models. The predictors accounted
for significantly more of the Level 2 variance. For the
probullying models, the predictors explained 54% to
62% of the Level 2 variance. The predictors accounted
for 33% of the between-group variance in withdrawing
behavior and 97% of the between-group variance in
defending behavior.
For the probullying models (with the exception of
reinforcing), adding gender resulted in sizeable increases
in explained variance, particularly for bullying
behavior (from 1.46% to 17.01%). The addition of
antibullying attitudes resulted in even larger increases in
explained variance. (Although attitudes were added at
the individual level, housemates’ similarity in attitudes
resulted in reductions in Level 2 variance.) For example,
in the composite probullying model, adding antibullying
attitudes increased explained variance from 8.42% to
22.28%. Antibullying norms and neutral norms also
generally resulted in sizeable reductions in Level 2
variance for probullying behavior. Finally, although
adding the individual reports of social dilemma
conditions had very little effect on the overall explained
variance in the probullying models, adding the mean
social dilemma variables related to physical and relational
bullying resulted in sizeable increases in
explained Level 2 variance. For example, in the
composite probullying model, adding mean social
dilemmas related to physical bullying increased explained
variance from 31.68% to 50.00%.
For the withdrawing models, most of the predictors
added resulted in decreases in explained Level 2
variance. Indeed, the only predictors that had a
substantial effect were the mean social dilemma
variables related to physical and relational bullying.
Adding the mean social dilemma variable related to
relational bullying increased explained variance at Level
2 from 7.76% to 32.76%.
For the defending models, the additions of antibullying
norms, mean social dilemmas related to verbal
bullying, and mean social dilemmas related to relational
bullying each resulted in substantial increases in
explained variance. For example, adding mean social
dilemmas related to verbal bullying increased explained
variance from 31.90% to 83.62%.
DISCUSSION
The present study produced support for both hypotheses:
(1) Both group and individual factors predicted
behavior in bullying situations; and (2) Attitudes, group
norms, and social dilemmas each made a unique
contribution to predicting student behavior in bullying
situations. For the outcome behavior in the present study,
-0.90
-0.80
-0.70
-0.60
-0.50
-0.40
-0.30
-0.20
-0.10
0.00
0.10
0.20
Low Mean High
Withdrawing Behavior Z-Score
Mean Social Dilemma Related to Physical Bullying
Girls
Boys
Fig.1. Expected ranks for withdrawing behavior X mean social dilemmas (physical) X gender.
Aggr. Behav.
104 Amelia Kohm
the ICCs ranged from 11.5% for defending and
withdrawing behavior to between 19% and 20% for
the probullying behavior. These findings supported the
hypothesis that both individual and group factors would
be associated with behavior in bullying situations.
Moreover, the probullying behaviors were more closely
associated with group factors than were withdrawing
and defending. Salmivalli and Voeten (2004) did not
report on ICCs for their models, although they detected
variance at both levels, suggesting that both individual
and group factors predicted behavior in bullying
situations.
As predicted by Hypothesis 2, results indicated that
antibullying attitudes were predictors of behavior in
bullying situations and that as antibullying attitudes
increased, probullying ranks decreased and defending
ranks increased. Antibullying attitudes did not appear to
have a significant association with withdrawing behavior.
Salmivalli and Voeten (2004) also found that
antibullying attitudes were inversely related to probullying
behavior and positively related to defending
behavior. However, unlike the present study, Salmivalli
and Voeten also found that antibullying attitudes were
positively related to withdrawing behavior, which is in
line with the hypotheses for the present study.
The two samples might have had different societal
norms concerning withdrawing behavior (which are not
measured in either study). Students in the Finnish
sample, who opposed bullying, might have felt that
withdrawing is an acceptable response in bullying
situations, whereas students with antibullying attitudes
in the present study might have felt that defending is a
more acceptable response. Investigation into the differences
in cultural norms related to antisocial behavior,
behavior in bullying situations, and social behavior in
general between the United States and Finland and how
these differences vary by age, race, region, institution,
and gender fell outside of the scope of this study.
Although some research has been conducted comparing
the prevalence of bullying between countries, there is a
dearth of research comparing attitudes toward bullying,
their relation to behavior in bullying situations, and
possible reasons (such as cultural norms) for differences
in behavior between countries (Nansel, Craig, Overpeck,
Saluja,&Ruan, 2004). The results of one study indicated
few differences in England and Italy in children’s
attitudes toward bullying (Menesini et al., 1997).
Another study compared moral emotions and reasoning
to children’s behavior in bullying situations in Spain and
Italy. The research team found differences in egocentric
disengagement motives between Italian and Spanish
students and speculated on cultural norms that might
account for such differences (Menesini et al., 2003). No
similar comparisons between American and Finnish
students have been conducted. Other research has shown
a link between attitudes and behavior; although people
strive for attitude-behavior consistency, it is not always
clear whether attitudes cause behavior or vice versa
(Eagly & Chaiken, 1993).
The present study showed that antibullying and neutral
norms were group factors associated with probullying
behavior and defending behavior. Specifically, and
consistent with Hypothesis 2, as antibullying norms
increased, probullying behavior ranks decreased. The
antibullying norms’ coefficient for defending behavior
approached significance and was positive, as expected.
Student residences that rank higher on neutral norms
tended to have students who ranked higher on probullying
behavior and lower on defending. In addition, norms did
not appear to have a significant association with withdrawing
behavior. There were no significant interactions
between either norms variable with gender or grade in the
present study. Similarly, Salmivalli and Voeten (2004)
found that antibullying norms were negatively associated
with bullying and reinforcing behavior—but only for
fifth- and sixth-grade students—and positively associated
with defending behavior—but only for sixth-grade
students. Fourth-grade students’ behavior was generally
not associated with antibullying norms, although these
students were more likely to withdraw when antibullying
norms were lower than were students in the other grades.
Neutral norms had variable relations with behavior in the
Finnish study, depending on the grade and gender of
participants. In the present study, by contrast, more
positive relations were found between neutral norms and
probullying behavior. There was no significant relation
between neutral norms and withdrawing behavior in
either study. In addition, in both studies, there was a
negative relation between neutral norms and defending
behavior.
Because students in the present study attended a
residential school that promotes a certain school identity,
they might have been more influenced by school-wide
norms than were the Finnish children who attended day
schools, who, by contrast, might have been more
influenced by their immediate classmates. However,
because we measured norms in a somewhat different
manner in the present study than in the Finnish study,
differences in the findings should not be over interpreted.
In line with the current study, a number of studies
suggest that children tend to behave in ways that are
deemed acceptable by others in their particular group,
and behavior related to aggression and social withdrawal
appears to be particularly influenced by classroom
norms, while prosocial behavior does not appear to be as
closely linked with norms (Chang, 2004; Stormshak
et al., 1999Stormshak, Bierman, Bruschi, Dodge, &
Coie, 1999).
Aggr. Behav.
Childhood Bullying and Social Dilemmas 105
The findings of the present study suggested that social
dilemma dynamics help predict behavior in bullying
situations. Moreover, unlike attitudes and norms, social
dilemmas helped predict withdrawing behavior. In
addition, and contrary to expectations, within-group
variation in reporting social dilemma conditions generally
did not predict behavior in bullying situations.
However, as expected, the number of students in a
residence reporting all three social dilemma conditions
related to either physical or relational bullying tended to
have a positive relation with probullying behavior and
withdrawing. It should be noted that most of the
coefficients for mean social dilemmas related to verbal
bullying were not significant (with the exception of
boys’ defending behavior). In addition, several significant
interactions indicated that the relation between
mean social dilemmas and behavior sometimes varied
by gender or grade. Salmivalli and Voeten (2004) did not
measure social dilemmas in their study, nor have any
other studies examined the relation between social
dilemmas and behavior in bullying situations. However,
the findings regarding social dilemmas in the present
study raised some important questions, primarily: (1)
Why did social dilemmas predict behavior only at the
group level? and (2) Why were social dilemmas better at
predicting withdrawing behavior than were attitudes and
norms? These issues are addressed below.
Why Did Social Dilemmas Predict Only at the
Group Level?
Goal-Expectation Theory predicts that an individual,
under social dilemma conditions, looks at the situation
and understands that he or she is contributing to the
problem but believes that a unilateral effort will have no
impact on the situation; only a group effort will work.
Moreover, because he or she has low expectations that
enough other people will act in the interest of the group,
he or she concludes that it is pointless to act in the
interest of the group. In the present study, the social
dilemma predictors at the individual level (whether a
student agreed that the three social dilemma conditions
existed in his or her residence) did not predict behavior
well. However, students in residences where more
students reported social dilemma conditions—regardless
of their own assessment of social dilemma
conditions—scored higher on probullying behavior
and withdrawing and lower on defending behavior.
One possible interpretation is that the more students who
reported social dilemma conditions, the more likely it
was that those conditions actually existed. To date, the
most common method used in social dilemma research
has been laboratory experiments in which researchers
develop “games” that include social dilemma conditions
and then observe how participants behave in those
situations (Johnson & Johnson, 2001; Pellegrini, 2002;
Piliavin, 2001). In addition, the relatively few field
studies that have been conducted usually started with a
situation in which social dilemma conditions naturally
exist and then asked respondents how they behaved and
why (Fujii, Garling, & Kitamura, 2001; Ohnuma,
Hirose, Karasawa, Yorifuji, & Sugiura, 2005; Tyler &
Degoey, 1995). The present study relied on students’
perceptions to establish whether social dilemma conditions
existed within various residences. Thus it is
possible that, even though an individual within a
residence did not perceive the conditions, he or she
was in a residence that had the conditions, and was acting
accordingly, albeit not consciously. Another interpretation
might be that individuals’ low expectations of peers
led them to conclude that such behavior is the norm (a
norm not measured by the instrument used to measure
norms in the study since both the norms instrument and
the social dilemmas instrument explained unique
variance). The perceived norm, in turn, led them to
behave “noncooperatively” and perhaps to adjust their
attitudes accordingly.
Why Were Social Dilemmas Better at
Predicting Withdrawing Behavior Than
Were Attitudes and Norms?
Residences with more students perceiving social
dilemma conditions were characterized, in particular,
by a larger number of students reporting that they did not
expect their housemates to defend a victim in a bullying
situation. If students in such residences expected their
peers to withdraw from bullying rather than defend a
victim, then these students might have been more likely
to act in kind to conform to a withdrawing norm.
Limitations
Although the study produced interesting findings that
warrant further investigation, it is important to note its
limitations. The cross-sectional design did not allow an
assessment of the causal direction between the predictors
and behavior. Thus, although one hypothesis was
that attitudes, norms, and social dilemmas would lead to
certain behavior in bullying situations, it could be that
the behavior led to the attitudes, norms, and/or social
dilemmas. For example, sometimes individuals infer
their attitudes from their behavior. In addition, the
statistically significant associations that were found
between the predictor variables and the outcome
variables could result from both predictors, in a
statistical sense, and outcomes being associated with a
third, unmeasured, variable.
Missing data might also limit the reliability of the
findings of the present study. The response rate was 75%
of the total middle school population. The lack of
Aggr. Behav.
106 Amelia Kohm
participation by 25% of the population primarily was
due to parents and guardians not responding to the
request for consent. In addition, 34.9% of participants
had missing data on at least one predictor, and 10 (of 37)
residences had 50% or more students (who participated
in the study) with missing data on at least one predictor
variable. As discussed above, assessment of the impact
of missing data suggested that those participants with
missing data did not significantly differ from those
without missing data.
The instruments employed to measure the variables of
interest also had potential limitations. The PRQ
generally shows good psychometric properties, and
the bully, assistant, and reinforcer roles appear conceptually
distinct. However, the subscales used to assess
these three probullying roles might be measuring the
same underlying concept, according to results from
earlier studies. Thus, a conservative approach to
interpretation of findings would focus only on the
“composite probullying role.” In addition, as noted, the
outsider scale’s reliability was low in the present study
(the Cronbach’s alpha coefficient was .55), which
limited understanding of how the independent variables
were related to this dependent variable.
Another limitation might have been the way social
dilemmas were measured. As noted above, the study
relied on students’ perception of the conditions of a
social dilemma because there was no way to clearly
establish the existence of those conditions as one might
in situations in which the costs and benefits of acting
selfishly and cooperatively can be objectively demonstrated
as in laboratory studies. However, relying on
perceptions may be problematic with middle school
students, who might not be socially sophisticated enough
to understand the costs and benefits of unilateral versus
multilateral action. Social dilemmas also might have
been measured more accurately had more items related
to each social dilemma condition been included in the
survey instrument. In the present study, there were only
one to two items per condition, which did not allow a
very rigorous testing of reliability. Moreover, social
dilemmas were treated as a categorical variable (i.e.,
social dilemma conditions either existed or did not exist,
according to student reports). A continuous variable
might have provided a more subtle understanding of how
such conditions, as they grow stronger, affect individual
and group behavior.
Contribution
The study furthered inquiry into group factors related
to bullying. Past research in this area has focused on
norms as the key group factor that might affect bullying.
The current study examined another group factor: the
role of social dilemmas in bullying. The study also
contributed to the literature on real-life social dilemmas.
Social dilemma research has been criticized for relying
on computer simulations and laboratory experiments, in
which real or virtual participants play games that present
dilemmas. If future research supports the importance of
unraveling social dilemmas to the reduction of bullying
in schools, then interventions that employ strategies that
tend to moderate social dilemmas in other types of
circumstances might be tested.
Bullying research, in recent years, has focused more
on the role of bystanders in encouraging bullying or
passively allowing it to continue. The present study
provides a possible explanation for their behavior and a
possible direction for future interventions.
ACKNOWLEDGMENTS
I am unable to reveal the funding source of the
research because I must maintain the confidentiality
assurances made to the University of Chicago Human
Subjects Committee to protect identifying information
of the human participants in the research. There is also
the same requirement to protect human participants’
identifying information in the agreement with the funder
as a condition of the award.
REFERENCES
Adler, P. A., & Adler, P. (1995). Dynamics of inclusion and exclusion in
preadolescent cliques. Social Psychology Quarterly, 58, 145–162. doi:
10.2307/2787039.
Adler, P. A., & Adler, P. (1996). Preadolescent clique stratification and the
hierarchy of identity. Sociological Inquiry, 66, 111–142. doi: 10.1111/
j.1475–682x.1996.tb00213.x.
Atlas, R. S., & Pepler, D. J. (1998). Observations of bullying in the
classroom. Journal of Educational Research, 92, 86–99. doi: 10.1080/
00220679809597580.
Bishop, J. H., Bishop, M., Bishop, M., Gelbwasser, L., Green, S., Peterson,
E., & Zuckerman, A. (2004). Why we harass nerds and freaks: A
formal theory of student culture and norms. Journal of School Health,
74, 235–251. doi: 10.1111/j.1746–1561.2004.tb08280.x.
Chang, L. (2004). The role of classroom norms in contextualizing the
relations of children’s social behavior to peer acceptance. Developmental
Psychology, 40, 691–702. doi: 10.1037/0012–
1649.40.5.691.
Craig, W. M., & Pepler, D. J. (2000). Observations of bullying and
victimization in the school yard. InW.M. Craig (Ed.), Childhood social
development: The essential readings, (pp. 116–136). Malden, MA:
Blackwell Publishers.
Dawes, R. M., McTavish, J., & Shaklee, H. (1977). Behavior,
communication, and assumptions about other people’s behavior in a
commons dilemma situation. Journal of Personality and Social
Psychology, 35, 1–11. doi: 10.1037/0022–3514.35.1.1.
Eagly, A. H., & Chaiken, S. (1993). The psychology of attitudes, Fort
Worth, TX: Harcourt Brace Jovanovich College Publishers.
Franzoi, S. (1996). Social Psychology, Dubuque, IA: Time Mirror Higher
Education Group, Inc.
Fujii, S., Garling, T., & Kitamura, R. (2001). Changes in drivers’
perceptions and use of public transport during a freeway closure:
Effects of temporary structural change on cooperation in a real-life
Aggr. Behav.
Childhood Bullying and Social Dilemmas 107
social dilemma. Environment and Behavior, 33, 796–808. doi:
10.1177/00139160121973241.
Goldbaum, S., Craig,W. M., & Shelley, D. (2003). Predicting participant
roles in bullying. Paper session presented at the Society for Research in
Child Development Biennial Meeting, Tampa, FL.
Gulliford, M. C., Ukoumunne, O. C., & Chinn, S. (1999). Components of
variance and intraclass correlations for the design of community-based
surveys and intervention studies: Data from the health survey for
England 1994. American Journal of Epidemiology, 149, 876–883. doi:
10.1093/oxfordjournals.aje.a009904.
Hawkins, D. L., Pepler, D. J., & Craig, W. M. (2001). Naturalistic
observations of peer interventions in bullying. Social Development,
10, 512–527. doi: 10.1111/1467–9507.00178.
Hox, J. (1998). Multilevel modeling: When and why. In I. Balderjahn R.
Mathar & M. Schader (Eds.), Classification, data analysis, and data
highways: Proceedings of the 21st Annual Conference of the
Gesellschaft für Klassifikation e.V., University of Potsdam, March 12–
14, 1997, (pp. ix, 414) New York: Springer.
Johnson, D. W., & Johnson, R. T. (2001). Psychology of cooperation and
competition. In N. J. Smelser & P. B. Baltes (Eds.), International
encyclopedia of the social and behavioral sciences, Oxford, UK:
Elsevier Science.
Kollock, P. (1998). Social dilemmas: The anatomy of cooperation. Annual
Review of Sociology, 24, 183–214. doi: 10.1146/annurev.soc.24.1.183.
Kreft, I., & De Leeuw, J. (1998). Introducing multilevel modeling.
London: Sage.
Menesini, E., Eslea, M., Smith, P. K., Genta, M. L., Giannetti, E., Fonzi,
A., & Costabile, A. (1997). Cross-national comparison of children’s
attitudes towards bully/victim problems in school. Aggressive
Behavior, 23, 245–257. doi: 10.1002/(sici)1098–2337(1997)
23:4 (245::aid-ab3 ) 3.0.co;2-j.
Menesini, E., Sanchez, V., Fonzi, A., Ortega, R., Costabile, A., & Lo, F.
(2003). Moral emotions and bullying: A cross-national comparison of
differences between bullies, victims and outsiders. Aggressive
Behavior, 29, 515–530. doi: 10.1002/ab.10060.
Merten, D. E. (1997). The meaning of meanness: Popularity, competition,
and conflict among junior high school girls. Sociology of Education,
70, 175. doi: 10.2307/2673207.
Murray, D. M., Rooney, B. L., Hannan, P. J., Peterson, A. V., Ary, D. V.,
Biglan, A., & Futterman, R. (1994). Intraclass correlation among
common measures of adolescent smoking: Estimates, correlates, and
applications in smoking prevention studies. American Journal of
Epidemiology, 140(11), 1038–1050. Retrieved from http://aje.oxfordjournals.
org/content/140/11/1038.full.pdf.
Nansel, T. R., Craig, W., Overpeck, M. D., Saluja, G., & Ruan, W. J.
(2004). Cross-national consistency in the relationship between
bullying behavior and psychosocial adjustment. Archives of
Pediatric Adolescent Medicine, 158, 730. doi: 10.1001/archpedi.
158.8.730.
Noruésis, M. J. (1993). SPSS for Windows SPSS base system for
Windows (Version V6.0.) [Computer program]. Chicago: SPSS, Inc.
O’Connell, P. D. (1999). Peer processes and bullying: Naturalistic
observation on the playground. Unpublished doctoral dissertation,
York University, Toronto, Canada.
O’Connell, P., Pepler, D., & Craig, W. (1999). Peer involvement in
bullying: Insights and challenges for intervention. Journal of
Adolescence, 22, 437–452. doi: 10.1006/jado.1999.0238.
Ohnuma, S., Hirose, Y., Karasawa, K., Yorifuji, K., & Sugiura, J. (2005).
Why do residents accept a demanding rule? Fairness and social benefit
as determinants of approval of a recycling system. Japanese
Psychological Research, 47, 1–11. doi: 10.1111/j.1468–5584.2005.
00267.x.
Olthof, T., Goossens, F. A. (2003, April). Emotional and motivational
correlates of playing a particular role in bullying. Paper session
presented at the Society for Reseach in Child Development Biennial
Meeting, Tampa, Florida.
Pellegrini, A. D. (2002). Bullying, victimization, and sexual harassment
during the transition to middle school. Educational Psychologist, 37,
151–163. doi: 10.1207/s15326985ep3703_2.
Piliavin, J. A. (2001). Sociology of altruism and prosocial behavior. In
N. J. Smelser & P. B. Baltes (Eds.), International encyclopedia of the
social and behavioral sciences, (pp. 411–415) (Oxford, UK: Elsevier
Science.
Pruitt, D. G. (1998). Social conflict, In D. T. Gilbert S. T. Fiske & G.
Lindzey (Eds.), The handbook of social psychology 4th ed., 2, (pp.
470–503). Boston: McGraw-Hill.
Pruitt, D. G., & Kimmel, M. J. (1977). Twenty years of experimental
gaming: Critique, synthesis, and suggestions for the future. Annual
Review of Psychology, 28, 363–392. doi: 10.1146/annurev.
ps.28.020177.002051.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models:
Applications and data analysis methods, 2nd eds. Thousand Oaks, CA:
Sage.
Salmivalli, C. (1999). Participant role approach to school bullying:
Implications for interventions. Journal of Adolescence, 22, 453–459.
doi: 10.1006/jado.1999.0239.
Salmivalli, C. (2001). Group view on victimization: Empirical findings
and their implications. In J. Juvonen & S. Graham (Eds.), Peer
harassment in school: The plight of the vulnerable and victimized,(pp.
398–419). New York, NY: New York Guilford.
Salmivalli, C., Lappalainen, M., & Lagerspetz, K. M. J. (1998). Stability
and change of behavior in connection with bullying in schools: A twoyear
follow-up. Aggressive Behavior, 24, 205–218. doi: 10.1002/(sici)
1098–2337(1998)24:3 3.0.co;2-j.
Salmivalli, C., & Voeten, M. (2004). Connections between attitudes,
group norms, and behavior in bullying situations. International
Journal of Behavioral Development, 28, 246–259. doi: 10.1080/
01650250344000488.
Siddiqui,O., Hedeker, D., Flay, B. R.,&Hu, F.B. (1996). Intraclass correlation
estimates in a school-based smoking prevention study: Outcome and
mediating variables, by sex and ethnicity. American Journal of
Epidemiology, 144, 425–433. doi: 10.1093/oxfordjournals.aje.a008945.
Snijders, T. A. B., & Bosker, R. J. (1994). Modeled variance in two-level
models. Sociological Methods and Research, 22, 342–363. doi:
10.1177/0049124194022003004.
Stormshak, E. A., Bierman, K. L., Bruschi, C., Dodge, K. A., &Coie, J. D.
(1999). The relation between behavior problems and peer preference
in different classroom contexts. Child Development, 70, 169–182. doi:
10.1111/1467–8624.00013.
Sutton, J., & Smith, P. K. (1999). Bullying as a group process: An
adaptation of the participant role approach. Aggressive Behavior, 25,
97–111. doi: 10.1002/(sici)1098–2337(1999)25:2 3.0.co;2–7.
Tani, F., Greenman, P. S., Schneider, B. H., & Fregosao, M. (2003).
Bullying and the big five: A study of childhood personality and
participant roles in bullying incidents. School Psychology International,
24, 131–146. doi: 10.1177/0143034303024002001.
Tyler, T. R., & Degoey, P. (1995). Collective restraint in social dilemmas:
Procedural justice and social identification effects on support for
authorities. Journal of Personality and Social Psychology, 69, 482–
497. doi: 10.1037/0022–3514.69.3.482.
Van Lange, P.A. M., Liebrand,W.B. G.,Messick,D. M.,&Wilke, H. A. M.
(1992). Introduction and literature review. InW. B.G. LiebrandD.M.
Messick & H. A.M.Wilke (Eds.), Social dilemmas: Theoretical issues
and research findings, pp. vii, 334. Oxford, UK: Pergamon Press.
Xie, H., Swift, D. J., Cairns, B. D., & Cairns, R. B. (2002). Aggressive
behavior in social interaction and developmental adaptation: A
narrative analysis of interpersonal conflicts during early adolescence.
Social Development, 11, 205–221. doi: 10.1111/1467–9507.00195.
Aggr. Behav.
108 Amelia Kohm
Copyright of Aggressive Behavior is the property of John Wiley & Sons, Inc. and its content
may not be copied or emailed to multiple sites or posted to a listserv without the copyright
holder’s express written permission. However, users may print, download, or email articles for
individual use.

Are quotations accurate? Are omissions of words indicated by three spaced periods? Are additions of words enclosed within square brackets?

ENG 112 Checklist for Papers Using Sources

Taken from Current Issues and Enduring Questions: A Guide to Critical Thinking and Argument, with Readings, 8th ed. Barnet, Sylvan and Hugo Bedau. Boston: Bedford/St. Martin’s, 2008, 299.

Ask yourself the following questions:

  • Are all borrowed words and ideas credited, including those from Internet sources?
  • Are all summaries and paraphrases acknowledged as such?
  • Are quotations and summaries not too long?
  • Are quotations accurate? Are omissions of words indicated by three spaced periods? Are additions of words enclosed within square brackets?
  • Are quotations provided with helpful lead-ins?
  • Is documentation in proper form?

And of course, you will also ask yourself the questions that you would ask of a paper this did not use sources, such as:

  • Is the topic sufficiently narrowed?
  • Is the thesis (to be advanced or refuted) stated early and clearly, perhaps even in the title?
  • Is the audience kept in mind? Are opposing views stated fairly and as sympathetically as possible? Are controversial terms defined?
  • Are assumptions likely to be shared by readers? If not, are they argued rather than merely asserted?
  • Is the focus clear (evaluation, recommendation of policy)?
  • Is evidence (examples, testimony, statistics) adequate and sound?
  • Are inferences valid?
  • Is the organization clear (effective opening, coherent sequence of arguments, unpretentious ending)?
  • Is all worthy opposition faced?
  • Is the tone appropriate?
  • Has the paper been carefully proofread?
  • Is the title effective?
  • Is the opening paragraph effective?
  • Is the structure reader-friendly?
  • Is the closing paragraph effective?