For this assignment, you will be asked to select one previously validated psychometric tool measuring a psychological construct of your choice (with the exception of constructs that have the potential to cause distress for participants, such as experiences of trauma, phobias etc.). You are then required to alter the questionnaire with the aim of measuring this construct in a specific population, namely, postgraduate taught students. This can be achieved through changing question wording, adding or removing questions, changing response options, etc.
It is important that you provide an evidence-based justification of your choice of questionnaire in the introduction and explain why it should be adapted to measure this construct in postgraduate taught students specifically. You should also discuss why a questionnaire is the favourable method of measuring this construct, contrasting it with at least one alternative method such as interviewing or observing participants. In doing this, you should bear in mind strengths and weaknesses of questionnaires discussed in the first questionnaire lecture as well as the context of your enquiry.
Furthermore, you should discuss one additional demographic factor that may affect this construct and provide an evidence-based justification for evaluating your new questionnaire in light of this factor. Note that this can be any factor other than gender.
Finally, you should state the purpose of your proposed data collection beyond this exercise – for example, to inform future research investigating the effect of this construct on other variables, to inform higher education practice etc.
Your participants for this assignment should comprise two different communities:
1. Pilot validation: Two to four people from your course should review a draft of your adapted questionnaire and provide critical feedback. You should then amend your final instrument accordingly.
2. Main validation: At least 20 research participants from your course should then complete the final version of the adapted questionnaire.
Please use the following structure for your assignment:
• Explain the research background to your validation by briefly defining your chosen construct and summarising the existing research focusing on it.
• Describe the previously validated psychometric tool and justify why it should be adapted to specifically measure the construct in postgraduate taught students. In doing so, you may need to highlight limitations of either the current research and/or issues with the existing questionnaire to form a basis for a clear rationale for developing an adapted tool.
• Clearly explain the rationale for the use of questionnaires to measure this construct in this population.
• Make your study aims, research questions and/or hypotheses clear. These should relate to the development of a new or improved questionnaire to address a specific research issue in the defined population.
Comprehensively report on the process of your questionnaire design and development:
• The initial process of adapting the original questionnaire, including, where possible, evidence-based justification for changes.
• Procedures for obtaining critical feedback and actions taken following this (how you revised your tool). Any changes made need to be clearly presented and justified, for example in a table.
• Describe the pilot instrument itself (indexing it as an appendix), as well as your participant group and recruitment procedures.
• Include a brief statement (~250 words) discussing any ethical considerations involved in the data collection, with reference to the four ethical principles of the British Psychological Society and their associated value statements and standards (see the Code of Ethics and Conduct). Outline your conduct relating to these. Your response should address the following questions:
o Which of the principles do you believe are relevant to this project?
o What procedures do you think would be necessary to ensure they that have been successfully addressed?
o To what extent do you think these have been met?
• Briefly describe your intended strategy for data management and analysis of responses.
Present the results of your data analysis. This must include:
• An exploratory data analysis whereby you provide skewness and kurtosis of the collected data, and identify outliers (if any).
• Descriptive analysis where by you describe the sample and provide the central tendencies of the questionnaire data.
• A split-half reliability analysis whereby you assess whether responses on the first half (e.g., questions 1 – 10) of the questionnaire correlate with responses on the second half (e.g., questions 11 – 20).
• A calculation of the internal consistency (Cronbach’s alpha) for the first and second half of the questionnaire as well as the whole questionnaire.
• Where possible, a comparison of your values to those available from a published validation study of the same original questionnaire. – Are they higher or lower? What does this tell us?
• A t-test evaluating the performance of participants derived from two different demographic groups on the questionnaire.
• A chi-square independence test comparing the performance of participants derived from the two distinct demographic groups on high and low values in the questionnaire. High- and low-scoring groups should be formed by conducting a median split.
All relevant statistical techniques will be covered in the second questionnaire lecture.
Return to your aims and hypotheses and summarise the main outcomes of your work and then discuss these findings in relation to:
• The extent to which they informed the research issues and questions
• The extent to which your research design and procedures were useful in addressing these
• What you have learnt from this whole pilot exercise, and how you might further develop the piloted instrument in the service of possible further research.
In this section, you also discuss how this tool might now be able to address new questions and generate new knowledge in the field.
Relevant literature for your chosen study context and participant group, research design, and data collection strategies can be drawn from this and other module reference lists, or through library catalogue search.