Researching inter-rater reliability of faculty evaluation for nursing simulation in Bengaluru, India
Abstract
Session presented on Monday, September 19, 2016:
Background: Nursing simulation is a new educational concept in India. The traditional methods for teaching science in Indian culture are didactic lecture and rote memory (Umashankar & Dutta, 2007). While evidence suggests simulation is effective in promoting critical thinking and clinical decision making in the US (Hayden, Smiley, Alexander, Kardong-Edgren, & Jeffries, 2014), research is needed to determine if simulation education is effective among faculty and students in India. In order for simulation to be fairly evaluated, reliability and validity of data produced from observations of students' performance, must be considered carefully (Adamson, K., 2016). Purpose: To evaluate interrater reliability of faculty during nursing simulation in Bengaluru, India.
Methods: A quantitative interrater reliability study will be performed. Faculty in this study will evaluate eight nursing students participating in two simulations. In order to determine the consistency of faculty ratings of student performance as measured by The Seattle University Simulation Evaluation Tool (Mikasa, Cicerno & Adamson, 2013), inter-rater reliability will be assessed using intra-class correlations (ICCs). ICCs greater than .80 are considered acceptable.
Results: The study will be conducted in July of 2016 and results will be presented in the poster presentation at the Sigma Theta Tau International Leadership Conference.
Discussion: In conducting interrater reliability research among faculty members of simulations in Bengaluru, we are answering the call to improve the nursing education throughout India as well as producing rigorous and quality research in the area of nursing simulation. Evaluating faculty's observations and judgement of their students during simulation will create consistency in the learning process. This consistency will help validate the effectiveness of nursing simulation as a learning tool. Results will contribute to the science of nursing by establishing interrater reliability in India and improving nursing education as well as contribute more rigorous and quality research to the existing literature of medical simulation.
Sigma Membership
Non-member
Lead Author Affiliation
Baylor University, Dallas, Texas, USA
Type
Poster
Format Type
Text-based Document
Study Design/Type
N/A
Research Approach
Quantitative Research
Keywords:
Simulation, Interrater, Reliability
Recommended Citation
Liller, Kathryn Logan, "Researching inter-rater reliability of faculty evaluation for nursing simulation in Bengaluru, India" (2024). Leadership. 121.
https://www.sigmarepository.org/leadership/2016/posters/121
Conference Name
Leadership Connection 2016
Conference Host
Sigma Theta Tau International
Conference Location
Indianapolis, Indiana, USA
Conference Year
2016
Rights Holder
All rights reserved by the author(s) and/or publisher(s) listed in this item record unless relinquished in whole or part by a rights notation or a Creative Commons License present in this item record.
All permission requests should be directed accordingly and not to the Sigma Repository.
All submitting authors or publishers have affirmed that when using material in their work where they do not own copyright, they have obtained permission of the copyright holder prior to submission and the rights holder has been acknowledged as necessary.
Acquisition
Proxy-submission
Researching inter-rater reliability of faculty evaluation for nursing simulation in Bengaluru, India
Indianapolis, Indiana, USA
Session presented on Monday, September 19, 2016:
Background: Nursing simulation is a new educational concept in India. The traditional methods for teaching science in Indian culture are didactic lecture and rote memory (Umashankar & Dutta, 2007). While evidence suggests simulation is effective in promoting critical thinking and clinical decision making in the US (Hayden, Smiley, Alexander, Kardong-Edgren, & Jeffries, 2014), research is needed to determine if simulation education is effective among faculty and students in India. In order for simulation to be fairly evaluated, reliability and validity of data produced from observations of students' performance, must be considered carefully (Adamson, K., 2016). Purpose: To evaluate interrater reliability of faculty during nursing simulation in Bengaluru, India.
Methods: A quantitative interrater reliability study will be performed. Faculty in this study will evaluate eight nursing students participating in two simulations. In order to determine the consistency of faculty ratings of student performance as measured by The Seattle University Simulation Evaluation Tool (Mikasa, Cicerno & Adamson, 2013), inter-rater reliability will be assessed using intra-class correlations (ICCs). ICCs greater than .80 are considered acceptable.
Results: The study will be conducted in July of 2016 and results will be presented in the poster presentation at the Sigma Theta Tau International Leadership Conference.
Discussion: In conducting interrater reliability research among faculty members of simulations in Bengaluru, we are answering the call to improve the nursing education throughout India as well as producing rigorous and quality research in the area of nursing simulation. Evaluating faculty's observations and judgement of their students during simulation will create consistency in the learning process. This consistency will help validate the effectiveness of nursing simulation as a learning tool. Results will contribute to the science of nursing by establishing interrater reliability in India and improving nursing education as well as contribute more rigorous and quality research to the existing literature of medical simulation.