Data collection methods

Qualitative and Quantitative Methods

Data are usually collected through qualitative and quantitative methods. Qualitative approaches aim to address the ‘how’ and ‘why’ of a program and tend to use unstructured methods of data collection to fully explore the topic. Qualitative questions are open-ended such as ‘why do participants enjoy the program?’ and ‘How does the program help increase self-esteem for participants?’. Qualitative methods include focus groups, group discussions and interviews. Quantitative approaches on the other hand address the ‘what’ of the program. They use a systematic standardised approach and employ methods such as surveys¹ and ask questions such as ‘what activities did the program run?’ and ‘what skills do staff need to implement the program effectively?’

Both methods have their strengths and weaknesses. Qualitative approaches are good for further exploring the effects and unintended consequences of a program. They are, however, expensive and time consuming to implement. Additionally the findings cannot be generalised to participants outside of the program and are only indicative of the group involved.

Quantitative approaches have the advantage that they are cheaper to implement, are standardised so comparisons can be easily made and the size of the effect can usually be measured. Quantitative approaches however are limited in their capacity for the investigation and explanation of similarities and unexpected differences. It is important to note that for peer-based programs quantitative data collection approaches often prove to be difficult to implement for agencies as lack of necessary resources to ensure rigorous implementation of surveys and frequently experienced low participation and loss to follow up rates are commonly experienced factors.

Mixed Methods

A mixed methods approach as your design, combining both qualitative and quantitative research data, techniques and methods within a single research framework.

Mixed methods approaches may mean a number of things: ie a number of different types of methods in a study or at different points within a study, or, using a mixture of qualitative and quantitative methods.

Mixed methods encompass multifaceted approaches that combine to capitalise on strengths and reduce weaknesses that stem from using a single research design. Using this approach to gather and evaluate data may assist to increase the validity and reliability of the research.

Some of the common areas in which mixed-method approaches may be used include:

• Initiating, designing, developing and expanding interventions;
• Evaluation;
• Improving research design; and
• Corroborating findings, data triangulation or convergence.

Some of the challenges of using a mixed methods approach include:

• Delineating complementary qualitative and quantitative research questions;
• Time-intensive data collection and analysis; and
• Decisions regarding which research methods to combine.

These challenges call for training and multidisciplinary collaboration and may therefore require greater resources and a higher workload than using a single method. However this may be mediated by identifying key issues early and ensuring the participation of experts in qualitative and quantitative research.

Mixed methods are useful in highlighting complex research problems such as