The Ibn-e-Sina University Mirpurkhas Scale of Affective Domain (ISUMSAD) is a newly developed instrument designed to measure the affective domain within health professions education and patient care. A pilot study was conducted to create a questionnaire with an optimal number of items, examining the measurement properties, underlying components, and latent variable structure of ISUMSAD. This initiative aimed to evaluate the feasibility and efficiency of a larger research project. The items encompass all five levels of the affective domain (Receiving, Responding, Valuing, Organizing, and Characterizing).
Fifty students from the Muhammad Institute of Physiotherapy & Rehabilitation Sciences (MIPRS), a constituent college of Ibn-e-Sina University Mirpurkhas (ISUM), completed ten initial scales comprising 217 affective domain items. These scales were selected by a five-member committee of medical education experts. We used low Corrected Item-Total Correlation, high Cronbach's Alpha if Item Deleted, low factor loadings and finally low communalities to identify items for removal, until the items were gradually reduced to 12, forming the finalized ISUMSAD scale. The same 50 students then rated these 12 items on a 7-point Likert scale (1 = strongly disagree, 7 = strongly agree), yielding total scores ranging from 12 to 84 per student.
The sample’s mean ISUMSAD score was 60.86/84 (SD = 12.7). Item-total correlations were positive, with Cronbach’s α = 0.92 and KMO = 0.855. Principal Component Analysis revealed two factors. Factor 1 was named “Empathy & Communication” and Factor 2 was named “Skills & Respect”.
Medical education has long prioritized cognitive knowledge and technical skills, often neglecting the affective domain-the dimension encompassing attitudes, emotions, values, and interpersonal skills [1]. While future physicians receive rigorous training in anatomy, pharmacology, and clinical procedures, far less emphasis is placed on affective competencies [2]. This oversight adversely impacts patient care, physician well-being, and healthcare systems, contributing to poor patient-provider relationships, burnout (affecting >50% of physicians) [3], ethical erosion, and dehumanized care [3].
Several factors explain this neglect: historical emphasis on cognitive/technical skills assessed via standardized exams (e.g., USMLE); difficulty quantifying affective traits; the hidden curriculum undermining formal training; time constraints; and concerns that affective education might "soften" physicians or compromise scientific rigor [4]. This persists despite evidence that empathy enhances diagnostic accuracy and treatment outcomes [5,6]. Consequently, empathy scales have been translated cross-culturally [7], and workshops improving emotional intelligence/communication skills developed [8].
Affective learning may be enhanced by developing practical assessment tools (e.g., ISUMSAD), creating dedicated affective domain curricula, integrating affective objectives into basic/clinical science courses, simulation-based training with standardized patients, reflective exercises (e.g., narrative medicine), and Mindfulness/resilience programs to mitigate burnout (Table 1).
| Table 1: The response options (Outcome Space) in Likert scale, numbered from 1-7. | |||||||
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | |
| Agreement | Strongly disagree | Disagree | Somewhat disagree | Neither agree, nor disagree (neutral) | Somewhat Agree | Agree | Strongly agree |
| Frequency | Never | rarely | Marginally less commonly | Cannot say | Marginally more commonly | Often | Always |
| Importance | Totally Unimportant | Moderately Unimportant | Slightly Unimportant | Neutral | Slightly Important | Moderately Important | Very Important |
| Quality | Very Poor | Moderately Poor | Slightly Poor | Neutral | Fair | Good | Excellent |
| Likelihood | Always untrue | Usually untrue | Often untrue | Neutral | Often True | Usually True | Always True |
| Likelihood | Definitely Not | Probably Not | Possibly Not | Possibly | Probably | Definitely | |
| McLeod S. [9] | |||||||
Thus, we developed the 12-item ISUMSAD questionnaire to examine its measurement properties, components, and latent variable structure.
A group of 5 experts in Medical Education picked up 10 scales, related to the Affective Domain.
We decided to structure the response options (Outcome Space) in Likert scale, numbered from 1-7. While doing this, we seriously debated the inclusion or exclusion of a midpoint (number 4 bel). Ultimately, we decided to include the midpoint (option 4) into the options [9].
In order to select items of the scale, the expert team looked at the scales that measure some aspects of the affective domain. It was decided that the number of items that were found promising would be narrowed down to an acceptable number (Table 2).
| Table 2: Reliability and validity of 10 scales (217 items). | |||
| Scale | Cronbach alpha | Kaiser-Meyer-Olkin (KMO) Bartlett Test of Sphericity Significance in bracket | |
| 1 | General components of affective domain | 0.914 | 0.802 (0.000) |
| 2 | Groningen reflection ability scale (gras) | 0.813 | 0.609 (0.000) |
| 3 | Jefferson scale of empathy | 0.706 | 0.537 (0.000) |
| 4 | Teique-SF EMOTIONAL INTELLIGENCE | 0.813 | 0.581 (0.000) |
| 5 | Modified professionalism | 0.690 | 0.603 (0.000) |
| 6 | Perceived choice and awareness of self-scale | 0.775 | 0.601 (0.000) |
| 7 | Revised Asian values scale (avs) | 0.549 | 0.627 (0.000) |
| 8 | Observation method- professional behavior evaluation | 0.982 | This matrix is not positive definite |
| 9 | Reflection activities | 0.825 | 0.780 (0.000) |
| 10 | Performance based assessment | 0.875 | 0.679 (0.000) |
Following 10 scales with 217 items were picked, including:
50 undergraduate students from Muhammad Institute of Physiotherapy & Rehabilitation Sciences (MIPRS), a constituent college of ISUM were selected through simple random sampling. Students were informed that this was not an assessment of their abilities. They were encouraged to assign a score to each question with utmost honesty and integrity, avoiding excessive contemplation.
First step was to find the reliability (Cronbach alpha) and validity (Kaiser-Meyer-Olkin-KMO Bartlett Test of Sphericity). We decided to include the items of scales which had sufficient reliability ((Cronbach alpha above 0.7) and validity (KMO above 0.6). The following were the results:
Based upon this criteria, Modified Professionalism and Revised Asian Values Scale (having Cronbach alpha of 0.690 and 0.549 respectively) were not considered further. Similarly, Jefferson scale of empathy and Teique-SF Emotional Intelligence were found to have KMO values less than 0.6, while Observation method- professional behavior evaluation’s matrix was not positive definite, suggesting that the factors used in the analysis had low factorability and hence items of these 3 scales were removed (Table 3).
| Table 3: Pattern matrixa. | |||
| T1 I greet and introduce myself before starting any communication. | 0.771 | ||
| T2 I listen actively to others when they talk to me. | 0.649 | ||
| T3 I like to discuss my ideas and opinions, nor do I like to invite others’ views if they are different from mine. | 0.329 | ||
| T4 I like to discuss my emotions, behaviors and judgement with others. | 0.733 | ||
| T5 I understand and respect people from different cultures and religions. | 0.614 | ||
| T6 I understand my own limitation | 0.341 | ||
| T7 I feel enthusiasm for learning and improvement. | 0.856 | ||
| T8 I consistently strive for excellence in learning new knowledge & skills. | -0.480 | ||
| T9 I always strive to master and refresh skills. | 0.833 | ||
| T10 I adjust my life according to the circumstances. | |||
| T11 I review my thinking and actions, and admit and change where I find myself wrong. | 0.476 | ||
| T12 I understand the importance of, and follow the procedures, protocols, rules and the guidelines. | 0.634 | ||
| T13 I feel accountable for what I say or do. | 0.518 | ||
| T14 I have interest in others. | 0.586 | ||
| T15 I place the needs of the team and any member of the team above self-interest. | 0.563 | ||
| T16 People consider me as a team leader and like to work under me. | 0.605 | ||
| T17 I am motivated to participate actively in the class and in wards. | 0.702 | ||
| T18 I display kindness and respect to others. | 0.725 | ||
| T19 I like communicating with others to resolve problems. | 0.701 | ||
| T20 I respect others right to self-determination and consent. | 0.852 | ||
| T21 I respect others right to privacy and confidentiality. | 0.735 | ||
| T22 I respond to any questions appropriately and positively, but without providing false hope or inaccurate information. | |||
| T23 I serve others by offering help and support when needed. | 0.651 | ||
| T24 I show verbal and non-verbal empathy with someone in a different situation. | 0.621 | ||
| T25 People generally feel that I am trustworthy as an individual and professional. | |||
| T26 I complete tasks and assignments on time. | 0.310 | ||
| T27 I usually do not lose composure in difficult situations. | 0.476 | ||
| T28 I do complete and keep accurate documentation of patient care and learning activities. | 0.303 | ||
| T29 I want to know the reason for what I'm doing | 0.403 | -0.531 | |
| T30 I believe that understanding body language is as important as verbal communication. | 0.342 | ||
| T31 I adjust my life according to the circumstances. | 0.754 | ||
| T32 I adjust my views according to the circumstances. | 0.774 | ||
| Extraction Method: Principal Component Analysis. Rotation Method: Promax with Kaiser Normalization. | |||
| a. Rotation converged in 5 iterations. As we can see, 3 items (10, 22 and 25) did not load when absolute value below 0.3 was stopped from loading, 1 item (8) was only negatively loaded and 5 items (3, 6, 26, 28 and 30) loaded below 0.4. These 9 items were removed leaving 23 items. | |||
Finally, among these 10 scales, scale 1, 2, 6, 9 and 10 were found to have sufficient reliability and validity. In other words, out of 217 items, 140 items were removed and 77 were considered for developing new scale. These 77 items were as follows.
There were many repetitions in the items. Consequently, the team of five medical education experts reviewed each item, eliminating both verbal and literal redundancies, and rephrasing the items to ensure uniformity and clarity. Certain items were deemed irrelevant to the assessment of the affective domain and were subsequently excluded. 32 items were chosen and they were rewritten in simple, easy to understand form (Tables 4,5).
| Table 4: Pattern Matrixa. | |||
| T1 I greet and introduce myself before starting any communication. | 0.772 | ||
| T2 I listen actively to others when they talk to me. | 0.657 | ||
| T4 I like to discuss my emotions, behaviors and judgement with others. | 0.763 | ||
| T5 I understand and respect people from different cultures and religions. | 0.642 | ||
| T7 I feel enthusiasm for learning and improvement. | 0.853 | ||
| T9 I always strive to master and refresh skills. | 0.815 | ||
| T11 I review my thinking and actions, and admit and change where I find myself wrong. | 0.490 | ||
| T12 I understand the importance of, and follow the procedures, protocols, rules and the guidelines. | 0.657 | ||
| T13 I feel accountable for what I say or do. | 0.568 | ||
| T14 I have interest in others. | . | 0.534 | |
| T15 I place the needs of the team and any member of the team above self-interest. | 0.563 | ||
| T16 People consider me as a team leader and like to work under me. | 0.580 | ||
| T17 I am motivated to participate actively in the class and in wards. | 0.674 | ||
| T18 I display kindness and respect to others. | 0.748 | ||
| T19 I like communicating with others to resolve problems. | 0.684 | ||
| T20 I respect others right to self-determination and consent. | 0.840 | ||
| T21 I respect others right to privacy and confidentiality. | 0.835 | ||
| T23 I serve others by offering help and support when needed. | 0.635 | ||
| T24 I show verbal and non-verbal empathy with someone in a different situation. | 0.711 | ||
| T27 I usually do not lose composure in difficult situations. | 0.484 | ||
| T29 I want to know the reason for what I'm doing | 0.413 | ||
| T31 I adjust my life according to the circumstances. | 0.754 | ||
| T32R I adjust my views according to the circumstances. | 0.795 | ||
| Extraction Method: Principal Component Analysis. Rotation Method: Promax with Kaiser Normalization. | |||
| a. Rotation converged in 5 iterations. Then we moved to communalities | |||
| Table 5: Communalities. | ||
| T1 I greet and introduce myself before starting any communication. | 1.000 | 0.605 |
| T2 I listen actively to others when they talk to me. | 1.000 | 0.432 |
| T4 I like to discuss my emotions, behaviors and judgement with others. | 1.000 | 0.698 |
| T5 I understand and respect people from different cultures and religions. | 1.000 | 0.560 |
| T7 I feel enthusiasm for learning and improvement. | 1.000 | 0.728 |
| T9 I always strive to master and refresh skills. | 1.000 | 0.697 |
| T11 I review my thinking and actions, and admit and change where I find myself wrong. | 1.000 | 0.376 |
| T12 I understand the importance of, and follow the procedures, protocols, rules and the guidelines. | 1.000 | 0.611 |
| T13 I feel accountable for what I say or do. | 1.000 | 0.333 |
| T14 I have interest in others. | 1.000 | 0.460 |
| T15 I place the needs of the team and any member of the team above self-interest. | 1.000 | 0.334 |
| T16 People consider me as a team leader and like to work under me. | 1.000 | 0.358 |
| T17 I am motivated to participate actively in the class and in wards. | 1.000 | 0.597 |
| T18 I display kindness and respect to others. | 1.000 | 0.661 |
| T19 I like communicating with others to resolve problems. | 1.000 | 0.499 |
| T20 I respect others right to self-determination and consent. | 1.000 | 0.709 |
| T21 I respect others right to privacy and confidentiality. | 1.000 | 0.741 |
| T23 I serve others by offering help and support when needed. | 1.000 | 0.457 |
| T24 I show verbal and non-verbal empathy with someone in a different situation. | 1.000 | 0.589 |
| T27 I usually do not lose composure in difficult situations. | 1.000 | 0.250 |
| T29 I want to know the reason for what I'm doing | 1.000 | 0.550 |
| T31 I adjust my life according to the circumstances. | 1.000 | 0.605 |
| T32 I adjust my views according to the circumstances. | 1.000 | 0.670 |
| Extraction Method: Principal Component Analysis. | ||
| 3 items (13, 15 and 27) had communalities less than .35 and were removed. Leaving 20 items. They were renumbered. Leaving 20 items. | ||
The expert committee did consider two important points at this stage. First about mitigating the confounding influence of a response pattern known as 'acquiescence response style, by turning half of the items phrased positively and scored directly (1 = very strongly disagree, 2 = less strongly disagree, 3 = mildly disagree, 4 = neither agree nor disagree, 5 = mildly agree, 6 = more strongly agree, and 7 = very strongly agree), While the other half phrased negatively, necessitating the researcher to reverse the scores assigned by the students as: 1 = very strongly agree, 2= less strongly agree, 3 = Mildly agree, 4 = Neither agree nor disagree, 5 = mildly disagree, 6 = more strongly disagree 7 = very strongly disagree). But this reverse is known to alter the way the responder answers the questions and hence the committee decided not to continue with developing the questionnaire in a 'acquiescence response style (Tables 6-10). Based upon the finding of the pilot study and recommendation of expert panel to simplify the items for easy understanding, a scale having 32 items was developed as follows.
| Table 6: Renumbering. | ||
| New No. | Old No. | Item |
| 1 | 1 | I greet and introduce myself before starting any communication |
| 2 | 2 | I listen actively to others when they talk to me |
| 3 | 4 | I like to discuss my emotions, behaviors and judgement with others. |
| 4 | 5 | I understand and respect people from different cultures and religions. |
| 5 | 7 | I feel enthusiasm for learning and improvement |
| 6 | 9 | I always strive to master and refresh skills. |
| 14 | 11 | I review my thinking and actions, and admit and change where I find myself wrong. |
| 7 | 12 | I understand the importance of, and follow the procedures, protocols, rules and the guidelines. |
| 15 | 14 | I have interest in others. |
| 16 | 16 | People consider me as a team leader and like to work under me. |
| 8 | 17 | I am motivated to participate actively in the class and in wards. |
| 9 | 18 | I display kindness and respect to others. |
| 10 | 19 | I like communicating with others to resolve problems. |
| 11 | 20 | I respect others right to self-determination and consent. |
| 19 | 21 | I respect others right to privacy and confidentiality. |
| 12 | 23 | I serve others by offering help and support when needed. |
| 20 | 24 | I show verbal and non-verbal empathy with someone in a different situation. |
| 13 | 29 | I want to know the reason for what I'm doing |
| 17 | 31 | I adjust my life according to the circumstances. |
| 18 | 32 | I adjust my views according to the circumstances. |
| Table 7: Item-total statistics. | |||||
| Scale Mean if Item Deleted | Scale Variance if Item Deleted | Corrected Item-Total Correlation | Squared Multiple Correlation | Cronbach's Alpha if Item Deleted | |
| EC1 I greet and introduce myself before starting any communication. | 93.4200 | 197.596 | 0.648 | 0.767 | 0.843 |
| EC2 I listen actively to others when they talk to me. | 93.2000 | 210.776 | 0.569 | 0.737 | 0.848 |
| EC3 I like to discuss my emotions, behaviors and judgement with others. | 94.1400 | 201.347 | 0.725 | 0.753 | 0.841 |
| EC4 I understand and respect people from different cultures and religions. | 93.4800 | 211.193 | 0.573 | 0.639 | 0.848 |
| EC5 I feel enthusiasm for learning and improvement. | 93.6200 | 202.853 | 0.712 | 0.848 | 0.841 |
| EC6 I always strive to master and refresh skills. | 93.7200 | 203.879 | 0.605 | 0.722 | 0.845 |
| EC7 I understand the importance of, and follow the procedures, protocols, rules and the guidelines. | 93.5200 | 210.091 | 0.569 | 0.673 | 0.848 |
| EC8 I am motivated to participate actively in the class and in wards. | 93.8000 | 216.531 | 0.493 | 0.622 | 0.851 |
| EC9 I display kindness and respect to others. | 93.6400 | 205.704 | 0.734 | 0.766 | 0.842 |
| EC10 I like communicating with others to resolve problems. | 93.6200 | 210.322 | 0.555 | 0.756 | 0.848 |
| EC11 I respect others right to self-determination and consent. | 93.7400 | 204.115 | 0.679 | 0.827 | 0.843 |
| EC12 I serve others by offering help and support when needed. | 93.6400 | 212.439 | 0.474 | 0.687 | 0.851 |
| EC13 I want to know the reason for what I'm doing | 94.0800 | 225.912 | 0.253 | 0.574 | 0.858 |
| IS14 I like to review my thinking and actions, and admit and change where I find myself wrong. | 94.6600 | 230.760 | 0.012 | 0.503 | 0.873 |
| IS15 I have interest in others. | 94.3000 | 212.214 | 0.441 | 0.599 | 0.852 |
| IS16 People consider me as a team leader and like to work under me. | 94.1400 | 221.266 | 0.262 | 0.547 | 0.859 |
| IS17 I adjust my life according to the circumstances. | 93.3200 | 225.079 | 0.211 | 0.875 | 0.860 |
| IS18 I adjust my views according to the circumstances. | 93.4600 | 223.029 | 0.205 | 0.889 | 0.862 |
| U19 I respect others right to privacy and confidentiality. | 93.8200 | 225.579 | 0.137 | 0.712 | 0.865 |
| U20 I show verbal and non-verbal empathy with someone in a different situation. | 93.9800 | 218.755 | 0.293 | 0.700 | 0.858 |
| Table 8: Pattern matrixa | |||
| Component | |||
| 1 | 2 | 3 | |
| T1 I greet and introduce myself before starting any communication. | 0.755 | ||
| T2 I listen actively to others when they talk to me. | 0.649 | ||
| T4 I like to discuss my emotions, behaviors and judgement with others. | 0.743 | ||
| T5 I understand and respect people from different cultures and religions. | 0.604 | ||
| T7 I feel enthusiasm for learning and improvement. | 0.845 | ||
| T9 I always strive to master and refresh skills. | 0.830 | ||
| T11 I review my thinking and actions, and admit and change where I find myself wrong. | 0.426 | ||
| T12 I understand the importance of, and follow the procedures, protocols, rules and the guidelines. | 0.632 | ||
| T14 I have interest in others. | 0.518 | ||
| T16 People consider me as a team leader and like to work under me. | 0.581 | ||
| T17 I am motivated to participate actively in the class and in wards. | 0.711 | ||
| T18 I display kindness and respect to others. | 0.724 | ||
| T19 I like communicating with others to resolve problems. | 0.710 | ||
| T20 I respect others right to self-determination and consent. | 0.864 | ||
| T21 I respect others right to privacy and confidentiality. | 0.827 | ||
| T23 I serve others by offering help and support when needed. | 0.658 | ||
| T24 I show verbal and non-verbal empathy with someone in a different situation. | 0.753 | ||
| T29 I want to know the reason for what I'm doing | 0.419 | ||
| T31 I adjust my life according to the circumstances. | 0.846 | ||
| T32 I adjust my views according to the circumstances. | 0.872 | ||
| Extraction Method: Principal Component Analysis. Rotation Method: Promax with Kaiser Normalization. | |||
| a. Rotation converged in 6 iterations. | |||
| Table 9: Communalities. | ||
| Initial | Extraction | |
| EC1 I greet and introduce myself before starting any communication. | 1.000 | 0.593 |
| EC2 I listen actively to others when they talk to me. | 1.000 | 0.457 |
| EC3 I like to discuss my emotions, behaviors and judgement with others. | 1.000 | 0.708 |
| EC4 I understand and respect people from different cultures and religions. | 1.000 | 0.574 |
| EC5 I feel enthusiasm for learning and improvement. | 1.000 | 0.716 |
| EC6 I always strive to master and refresh skills. | 1.000 | 0.694 |
| EC7 I understand the importance of, and follow the procedures, protocols, rules and the guidelines. | 1.000 | 0.296 |
| EC8 I am motivated to participate actively in the class and in wards. | 1.000 | 0.612 |
| EC9 I display kindness and respect to others. | 1.000 | 0.433 |
| EC10 I like communicating with others to resolve problems. | 1.000 | 0.358 |
| EC11 I respect others right to self-determination and consent. | 1.000 | 0.585 |
| EC12 I serve others by offering help and support when needed. | 1.000 | 0.639 |
| EC13 I want to know the reason for what I'm doing | 1.000 | 0.537 |
| IS14 I like to review my thinking and actions, and admit and change where I find myself wrong. | 1.000 | 0.736 |
| IS15 I have interest in others. | 1.000 | 0.734 |
| IS16 People consider me as a team leader and like to work under me. | 1.000 | 0.453 |
| IS17 I adjust my life according to the circumstances. | 1.000 | 0.624 |
| IS18 I adjust my views according to the circumstances. | 1.000 | 0.547 |
| U19 I respect others right to privacy and confidentiality. | 1.000 | 0.724 |
| U20 I show verbal and non-verbal empathy with someone in a different situation. | 1.000 | 0.768 |
| Extraction Method: Principal Component Analysis. | ||
| Table 10: Summarising the above tables. | ||||||||||
| New No. | Old No. | Item | Item mean | Std. Deviation | Corrected Item-Total Correlation | Cronbach's Alpha if Item Deleted | Communalities | Correlation with factor 1 Empathy & Communication | Correlation with factor 2 interpersonal skills | Correlation with factor 3 Understanding |
| 1 | 1 | I greet and introduce myself before starting any communication | 5.28 | 1.85 | 0.648 | 0.843 | 0.593 | 0.755 | ||
| 2 | 2 | I listen actively to others when they talk to me | 5.5 | 1.34 | 0.569 | 0.848 | 0.457 | 0.649 | ||
| 3 | 4 | I like to discuss my emotions, behaviors and judgement with others. | 4.56 | 1.51 | 0.725 | 0.841 | 0.708 | 0.743 | ||
| 4 | 5 | I understand and respect people from different cultures and religions. | 5.22 | 1.31 | 0.573 | 0.848 | 0.574 | 0.604 | ||
| 5 | 7 | I feel enthusiasm for learning and improvement | 5.08 | 1.47 | 0.712 | 0.841 | 0.716 | 0.845 | ||
| 6 | 9 | I always strive to master and refresh skills. | 4.98 | 1.63 | 0.605 | 0.845 | 0.694 | 0.830 | ||
| 7 | 12 | I understand the importance of, and follow the procedures, protocols, rules and the guidelines. | 5.18 | 1.38 | 0.569 | 0.848 | 0.612 | 0.632 | ||
| 8 | 17 | I am motivated to participate actively in the class and in wards. | 4.9 | 1.65 | 0.493 | 0.851 | 0.585 | 0.711 | ||
| 9 | 18 | I display kindness and respect to others. | 5.06 | 1.30 | 0.734 | 0.842 | 0.639 | 0.724 | ||
| 10 | 19 | I like communicating with others to resolve problems. | 5.08 | 1.4 | 0.555 | 0.848 | 0.537 | 0.710 | ||
| 11 | 20 | I respect others right to self-determination and consent. | 4.96 | 1.47 | 0.679 | 0.843 | 0.736 | 0.864 | ||
| 12 | 23 | I serve others by offering help and support when needed. | 5.06 | 1.46 | 0.474 | 0.851 | 0.453 | 0.658 | ||
| 13 | 29 | I want to know the reason for what I'm doing | 4.62 | 1.03 | 0.253 | 0.858 | 0.547 | 0.419 | ||
| 14 | 11 | I like to review my thinking and actions, and admit and change where I find myself wrong. | 4.04 | 1.83 | 0.012 | 0.873 | 0.296 | 0.426 | ||
| 15 | 14 | I have interest in others. | 4.4 | 1.56 | 0.441 | 0.852 | 0.433 | 0.518 | ||
| 16 | 16 | People consider me as a team leader and like to work under me | 4.56 | 1.46 | 0.262 | 0.859 | 0.358 | 0.581 | ||
| 17 | 31 | I adjust my life according to the circumstances. | 5.38 | 1.28 | 0.211 | 0.860 | 0.724 | 0.846 | ||
| 18 | 32 | I adjust my views according to the circumstances. | 5.24 | 1.53 | 0.205 | 0.862 | 0.768 | 0.872 | ||
| 19 | 21 | I respect others right to privacy and confidentiality. | 4.88 | 1.61 | 0.137 | 0.865 | 0.734 | 0.827 | ||
| 20 | 24 | I show verbal and non-verbal empathy with someone in a different situation. | 4.72 | 1.57 | 0.293 | 0.858 | 0.624 | 0.753 | ||
After developing this new scale, a pilot study was conducted where same 50 students (who had answered the 217 items of 10 scales) answered these 32 questions. The results of this newly developed 32 items were entered into SPSS® version. It was decided that we will reduce the number of items by removing those will low reliability (Cronbach’s alpha), validity (KMO, Bartlett’s test and Significance), dimension reduction, communalities and Corrected Item-Total Correlation. We decided to use the Principal Component Analysis as the Extraction Method, Promax with Kaiser Normalization as the Rotation Method and the Pattern Mixture model in longitudinal data analysis. The results were as follows in 4 steps of gradual reduction of items:
STEP 1: 32 items reliability, validity and dimension reduction.
| Reliability Statistics | |
| Cronbach's Alpha | N of Items |
| 0.720 | 32 |
| KMO and Bartlett's Test | |
| Kaiser-Meyer-Olkin Measure of Sampling Adequacy | 0.549 |
| Bartlett's Test of Sphericity | Approx. Chi-Square | 977.492 |
| Df | 496 | |
| Sig | 0.000 |
STEP 2: 23 items reliability, validity, dimension reduction and communalities.
| Reliability Statistics | |
| Cronbach's Alpha | N of Items |
| 0.858 | 23 |
| Summary Item Statistics | |||||||
|
Mean | Minimum | Maximum | Range | Maximum / Minimum | Variance | N of Items |
| Item Means | 4.866 | 4.020 | 5.500 | 1.480 | 1.368 | 0.155 | 23 |
| Item Variances | 2.073 | 1.057 | 3.430 | 2.373 | 3.246 | 0.364 | 23 |
| Inter-Item Covariances | 0.430 | -0.677 | 1.936 | 2.613 | -2.861 | 0.272 | 23 |
| Inter-Item Correlations | 0.208 | -0.348 | 0.892 | 1.240 | -2.559 | 0.060 | 23 |
| KMO and Bartlett's Test | ||
| Kaiser-Meyer-Olkin Measure of Sampling Adequacy. | 0.689 | |
| Bartlett's Test of Sphericity | Approx. Chi-Square | 704.704 |
| Df | 253 | |
| Sig. | 0.000 | |
STEP 3: 20 items reliability, validity, dimension reduction and communalities.
| Reliability Statistics | ||
| Cronbach's Alpha | Cronbach's Alpha Based on Standardized Items | N of Items |
| 0.859 | 0.864 | 20 |
| Summary Item Statistics | |||||||
| Mean | Minimum | Maximum | Range | Maximum / Minimum | Variance | N of Items | |
| Item Means | 4.935 | 4.040 | 5.500 | 1.460 | 1.361 | 0.130 | 20 |
| Inter-Item Covariances | 0.504 | -0.677 | 1.936 | 2.613 | -2.861 | 0.298 | 20 |
| Inter-Item Correlations | 0.241 | -0.348 | 0.892 | 1.240 | -2.559 | 0.063 | 20 |
| KMO and Bartlett's Test | ||
| Kaiser-Meyer-Olkin Measure of Sampling Adequacy. | 0.702 | |
| Bartlett's Test of Sphericity | Approx. Chi-Square | 621.772 |
| Df | 190 | |
| Sig. | 0.000 | |
STEP 4: Final scale with 12 items. Its reliability, validity, dimension reduction and communalities.
| Reliability Statistics | ||
| Cronbach's Alpha | Cronbach's Alpha Based on Standardized Items | N of Items |
| 0.920 | 0.921 | 12 |
| KMO and Bartlett's Test | |
| Kaiser-Meyer-Olkin Measure of Sampling Adequacy. | .855 |
| Bartlett's Test of Sphericity | Approx. Chi-Square | 361.208 |
| df | 66 | |
| Sig. | 0.000 |
A lack of trust in physicians lowers the quality of care, discourages the use of preventive services, and adversely affects patients’ adherence to clinical advice. High levels of distrust can even lead to violence and destruction of medical equipment and property unless the legal system provides easy remedies for perceived harms caused by healthcare providers [22]. The World Medical Association, in its 2020 assembly, included an agenda item addressing the “surge of violence against health personnel worldwide [23]. Another study found that moral integrity, a patient-centered approach, effective communication skills, and trust lead to better management and improved patient satisfaction [24]. In a study investigating patient trust in doctors, more than half of participants rated doctors’ communication behavior as fair rather than good (53.6% vs 45.6%). Those over 50 years old (OR 1.96; p=0.007, 95% CI: 1.198-3.226) and those who perceived doctors’ communication as good (OR 8.48; p=0.0001, 95% CI: 5.257-13.709) were significantly more likely to have full trust in their doctors (Tables 11-13). Another study stressed that the moral integrity and personal qualities of the doctor are crucial for gaining patient trust [25].
| Table 11: Descriptive statistics. | |||||||
| N | Range | Minimum | Maximum | Sum | Mean | SD | |
| Factor1 total | 50 | 30.00 | 18.00 | 48.00 | 1794.00 | 35.8800 | 7.98120 |
| Factor2 total | 50 | 25.00 | 10.00 | 35.00 | 1249.00 | 24.9800 | 5.69457 |
| Total of items | 50 | 49.00 | 30.00 | 79.00 | 3043.00 | 60.8600 | 12.72313 |
| Total of factors | 50 | 49.00 | 30.00 | 79.00 | 3043.00 | 60.8600 | 12.72313 |
| Table 12: Summary item statistics. | |||||||
| Mean | Minimum | Maximum | Range | Maximum / Minimum | Variance | N of Items | |
| Item Means | 5.072 | 4.560 | 5.500 | 0.940 | 1.206 | 0.052 | 12 |
| Inter-Item Covariances | 1.035 | 0.431 | 1.936 | 1.506 | 4.497 | 0.118 | 12 |
| Inter-Item Correlations | 0.492 | 0.254 | 0.739 | 0.484 | 2.904 | 0.014 | 12 |
| Item-Total Statistics | |||||
| Scale Mean if Item Deleted | Scale Variance if Item Deleted | Corrected Item-Total Correlation | Squared Multiple Correlation | Cronbach's Alpha if Item Deleted | |
| T1 | 55.5800 | 128.208 | 0.721 | 0.665 | 0.912 |
| T2 | 55.3600 | 140.602 | 0.611 | 0.651 | 0.916 |
| T3 | 56.3000 | 133.847 | 0.735 | 0.681 | 0.911 |
| T4 | 55.6400 | 141.419 | 0.600 | 0.511 | 0.917 |
| T5. | 55.7800 | 132.420 | 0.808 | 0.810 | 0.908 |
| T6 | 55.8800 | 131.251 | 0.746 | 0.653 | 0.910 |
| T7 | 55.6800 | 139.855 | 0.616 | 0.532 | 0.916 |
| T8 | 55.9600 | 143.835 | 0.597 | 0.544 | 0.917 |
| T9 | 55.8000 | 138.653 | 0.703 | 0.626 | 0.913 |
| T10 | 55.7800 | 139.849 | 0.607 | 0.570 | 0.916 |
| T11 | 55.9000 | 132.990 | 0.788 | 0.779 | 0.909 |
| T12 | 55.8000 | 141.143 | 0.535 | 0.552 | 0.920 |
| Table 13: Summary of final scale of ISUMSAD- 12 items. | |||||||||
| Item No | Item mean | Std. Deviation | Corrected Item-Total Correlation | Cronbach's Alpha if Item Deleted | Communalities | Factor 1 Empathy & Communication | Factor 2 Skills & Respect | Skewness | Kurtosis |
| 1 | 5.28 | 1.25 | 0.721 | 0.912 | 0.623 | 0.647 | -1.35 | 0.7 | |
| 2 | 5.5 | 1.34 | 0.611 | 0.916 | 0.487 | 0.632 | -1.26 | 1.06 | |
| 3 | 4.56 | 1.51 | 0.735 | 0.911 | 0.705 | 0.827 | -0.303 | -0.670 | |
| 4 | 5.22 | 1.31 | 0.600 | 0.917 | 0.617 | 0.919 | -1.1 | -1.25 | |
| 5 | 5.08 | 1.47 | 0.808 | 0.908 | 0.726 | 0.599 | -1.19 | 1.16 | |
| 6 | 5.18 | 1.38 | 0.616 | 0.916 | 0.589 | 0.857 | -1.113 | 0.974 | |
| 7 | 5.06 | 1.3 | 0.703 | 0.913 | 0.616 | 0.715 | -1.508 | 2.222 | |
| 8 | 4.98 | 1.63 | 0.746 | 0.910 | 0.698 | 0.686 | -1.163 | 0.848 | |
| 9 | 4.9 | 1.65 | 0.597 | 0.917 | 0.664 | 0.930 | -1.331 | 2.661 | |
| 10 | 5.08 | 1.4 | 0.607 | 0.916 | 0.576 | 0.763 | -1.644 | 2.856 | |
| 11 | 4.96 | 1.47 | 0.788 | 0.909 | 0.744 | 0.662 | -1.453 | 1.419 | |
| 12 | 5.06 | 1.46 | 0.535 | 0.920 | 0.530 | 0.799 | -1.290 | 0.519 | |
| Legend:
T1 I greet and introduce myself before starting any communication. T2 I listen actively to others when they talk to me. T3 I like to discuss my emotions, behaviours and judgement with others. T4 I understand and respect people from different cultures and religions. T5 I feel enthusiasm for learning and improvement. T6 I understand the importance of, and follow the procedures, protocols, rules and the guidelines. T7 I display kindness and respect to others. T8 I always strive to master and refresh skills. T9 I am motivated to participate actively in the class and in wards. T10 I like communicating with others to resolve problems. T11 I respect others right to self-determination and consent. T12 I serve others by offering help and support when needed. |
|||||||||
According to patients, trust is built largely on a doctor's interpersonal competence. Behaviors associated with trust include thoroughly evaluating problems, understanding a patient's individual experience, showing compassion and empathy, advocacy, reliability, dependability, clear and complete communication, continuity of care, building partnerships, giving adequate time during consultations, providing appropriate and effective treatment, and being honest and respectful [26-32].
Therefore, it is important to include teaching and assessment of the affective domain in the medical curriculum. For this, we have developed the 12-item ISUMSAD described above.
When choosing the number of response options, we debated whether to allow respondents to choose from six options or to include a midpoint as a seventh option. Including or excluding a midpoint has both benefits and drawbacks. A midpoint allows respondents to express neutral feelings, but it may also serve as a “dumping ground” for those who lack knowledge, motivation, or wish to be socially acceptable. However, excluding the midpoint may deprive respondents of the opportunity to select an option that genuinely reflects their views, forcing them to choose inaccurately [33]. This has convinced some researchers, such as Hujat, et al, [34] to include the midpoint. On this occasion, we decided to include the midpoint.
Thus, the expert committee decided to keep the midpoint, making it a 7-point questionnaire.
Although authors attempt to mitigate response bias by including negatively worded items in Likert scale, it is known to adversely affect reliability and validity. Hence, we decided not to include negatively worded items in our scale.
According to Cronbach [35], a reliability value greater than 0.6 is acceptable. Cronbach's alphas are claimed to mirror instructional grades, where A-0.9 or higher are considered excellent; B-0.8 to 0.9 are adequate; C-0.7 to 0.8 are marginal; D-0.6 to 0.07 are seriously suspect; F-less than 0.6 are totally unacceptable [36]. The higher the average correlation between items, the greater the internal consistency of a test. We saw the reliability increasing with Cronbach alpha moving from 0.720 to 0.858, 0.859 and finally to 0.920 for 32, 23, 20 and 12 items. Hence the internal consistency of 0.92 for 12 items ISUMSAD is excellent.
The most efficient method was to identify and remove items with low factor loadings (generally below 0.5) [37], as such items do not substantially contribute to the underlying factors and may adversely affect the KMO value. By discarding these items, we could improve overall inter-item correlations, potentially resulting in a higher KMO score37. We used Principal Component Analysis (PCA) for dimensionality reduction and data analysis. PCA focuses on finding principal components, which are orthogonal directions of maximum variance in the data. PCA reveals information about factor loadings or component loadings, which show how much each original variable contributes to the new principal components, analogous to factors in factor analysis [38]. PCA produced two distinct factors. Factor 1, consisting of 7 items has been named “Empathy-Communication’ and Factor 2, consisting of 5 items has been named “Skills-Respect”. Additionally, we have chosen to use the pattern matrix rather than the structure matrix, as the former demonstrates the distinct contribution of a variable to a factor and is simpler to interpret [37]. The structure matrix shows shared variance not accounted for by the pattern matrix and is more complicated to interpret [37]. The KMO test measures the sampling adequacy, while Bartlett's test checks for significant correlations between variables, indicating whether factor analysis is appropriate. A significant Bartlett's test (p < 0.05) and a KMO value above 0.6 (or 0.5, depending on the source) generally suggest that factor analysis is appropriate [39-42]. KMO value of 0.855 and Bartlett's test score with significance of 0.000 for the final 12 items reflect excellent validity.
While both inter-item correlation and Pearson’s correlation evaluate the relationships between variables, their uses are distinct. Inter-item correlation focuses on the connections between individual items within a single scale or test, and is a test of internal consistency. Inter-item correlation evaluates how closely the scores of one item of a scale is related to the scores of other items within that same scale [43]. This metric reflects the internal consistency of the scale, indicating how effectively the items collectively measure the same underlying concept. All our 12 items had inter-item correlation above 0.2 with each other, average being 0.492, indicating that items are related but not overly redundant. A Cronbach’s alpha of 9.2 and inter-item correlation of 0.492 suggest good internal consistency of ISUMSAF.
In contrast, Pearson’s correlation is a broader statistical tool that measures the linear association between any two continuous variables. The Pearson correlation (Tables 14,15) shows excellent linear relationships between different items and two factors of ISUMSAF.
| Table 14: FACTOR 1- “Empathy & communication” & its pearson’s correlation. | ||||||||||
| Item | ||||||||||
| T1 | T2 | T3 | T4 | T5 | T6 | T7 | Factor1 Empathy-Communication | Total | ||
| T1 I greet and introduce myself before starting any communication. | Pearson Correlation | 1 | 0.640 | 0.540 | 0.452 | 0.712 | 0.579 | 0.501 | 0.829 | 0.787 |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.001 | 0.000 | 0.000 | 0.004 | 0.000 | 0.000 | ||
| T2 I listen actively to others when they talk to me. | Pearson Correlation | 0.604 | 1 | 0.501 | 0.364 | 0.724 | 0.402 | 0.403 | 0.740 | 0.675 |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.009 | 0.000 | 0.004 | 0.004 | 0.000 | 0.000 | ||
| T3 I like to discuss my emotions, behaviours and judgement with others. | Pearson Correlation | 0.540 | 0.501 | 1 | 0.686 | 0.622 | 0.507 | 0.625 | 0.816 | 0.787 |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | ||
| T4 I understand and respect people from different cultures and religions. | Pearson Correlation | 0.452 | 0.364 | 0.686 | 1 | 0.477 | 0.484 | 0.554 | 0.723 | 0.664 |
| Sig. (2-tailed) | 0.001 | 0.009 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | ||
| T5 I feel enthusiasm for learning and improvement. | Pearson Correlation | 0.712 | 0.724 | 0.622 | 0.477 | 1 | 0.496 | 0.553 | 0.844 | 0.846 |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | ||
| T6 I understand the importance of, and follow the procedures, protocols, rules and the guidelines. | Pearson Correlation | 0.579 | 0.402 | 0.507 | 0.484 | 0.496 | 1 | 0.631 | 0.745 | 0.681 |
| Sig. (2-tailed) | 0.000 | 0.004 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | ||
| T7 I display kindness and respect to others. | Pearson Correlation | 0.501 | 0.403 | 0.625 | 0.554 | 0.553 | 0.631 | 1 | 0.768 | 0.753 |
| Sig. (2-tailed) | 0.000 | 0.004 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | |||
| Factor1 Empathy-Communication | Pearson Correlation | 0.829 | 0.740 | 0.816 | 0.723 | 0.844 | 0.745 | 0.768 | 1 | 0.951 |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | |||
| Total | Pearson Correlation | 0.787 | 0.675 | 0.787 | 0.664 | 0.846 | 0.681 | 0.753 | 0.951 | 1 |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | |||
| **. Correlation is significant at the 0.01 level (2-tailed). | ||||||||||
| Table 15: FACTOR 2 “Skills-respect” & its Pearson’s correlation. | ||||||||
| Item | ||||||||
| T8 | T9 | T10 | T11 | T12 I | Factor2 Skills-Respect | Total | ||
| T8 I always strive to master and refresh skills. | Pearson Correlation | 1 | 0.503** | 0.599** | 0.738** | 0.513** | 0.859** | |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | ||
| T9 I am motivated to participate actively in the class and in wards. | Pearson Correlation | 0.503** | 1 | 0.544** | 0.522** | 0.531** | 0.753** | 0.654** |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | ||
| T10 I like communicating with others to resolve problems. | Pearson Correlation | 0.599** | 0.544** | 1 | 0.568** | 0.300* | 0.752** | 0.674** |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.000 | 0.036 | 0.000 | 0.000 | ||
| T11 I respect others right to self-determination and consent. | Pearson Correlation | 0.738** | 0.522** | 0.568** | 1 | 0.599** | 0.870** | 0.830** |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | ||
| T12 I serve others by offering help and support when needed. | Pearson Correlation | 0.513** | 0.531** | 0.300* | 0.599** | 1 | 0.740** | 0.614** |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.036 | 0.000 | 0.000 | 0.000 | ||
| Factor2 Skills-Respect | Pearson Correlation | 0.859** | 0.753** | 0.752** | 0.870** | 0.740** | 1 | 0.901** |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | ||
| Total | Pearson Correlation | 0.800** | 0.654** | 0.674** | 0.830** | 0.615** | 0.901** | 1 |
| Sig. (2-tailed) | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | ||
| *.Correlation is significant at the 0.05 level (2-tailed), **.Correlations is significant at the 0.01 level (2-tailed). | ||||||||
Another interesting observation is that in our study, item means, Cronbach's alpha, KMO, Inter-Item Covariances and inter-item correlations keep increasing with reducing number of items (Table 16). Cronbach's alpha [44] & KMO are influenced by the number of items and the number of respondents. Reducing either can lead to lower values for both statistics, indicating potential issues with internal consistency and suitability for factor analysis. However, our values kept on going higher and higher with each reduction of the number of items, suggestion a great internal consistency and correlation between remaining items and little internal consistency and correlation with the items removed [45].
| Table 16: Comparison of Cronbach’s alpha, KMO, item means and inter-item Covariances and Correlations with reducing number of items. | ||||
| 32 items | 23 items | 20 items | 12 items | |
| Mean item | 4.776 | 4.866 | 4.935 | 5.072 |
| Cronbach’s alpha | 0.720 | 0.858 | 0.864 | 0.920 |
| Inter-Item Correlations | 0.133 | 0.208 | 0.241 | 0.492 |
| KMO | 0.549 | 0.689 | 0.702 | 0.855 |
This pilot study has generated a 12 items ISUMSAD, which measures the affective domain with excellent reliability and validity. The correlation between items of the same factor, the associated factor and total scale score were found to be either excellent or moderate. This scale has all the qualities of being a good scale and may be used to assess the affective domain of students for various purposes. A larger follow up study is planned to further assess the scale.
SignUp to our
Content alerts.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Are you the author of a recent Preprint? We invite you to submit your manuscript for peer-reviewed publication in our open access journal.
Benefit from fast review, global visibility, and exclusive APC discounts.