LibGuides: HSS Research Methodologies: Method Pitfalls

Method Pitfalls

The choice of research methodology establishes conceptual structure of investigation, the decision-making processes, and methods of analysis used to address the central research problem of your study. Taking the time to select and develop the appropriate research methodology helps to organise your thoughts, set the boundaries of your study, maximise the reliability of your findings, and avoid misleading or incomplete conclusions.

If any aspect of your research methodology is flawed or underdeveloped, the quality and reliability of your final results, as well as the overall value of your study, will be diminished.

Below and on your right is a list of common problems one should be mindful of when designing a study.

Lack of Specificity -- do not describe the investigative aspects of your study in overly-broad generalities. Avoid using vague qualifiers, such as, extremely, very, entirely, completely, etc. It's important that you design a study that describes the process of investigation in clear and concise terms. Otherwise, the reader cannot be certain what you intend to do.

Poorly Defined Research Problem -- the starting point of most new research in the social sciences is to formulate a problem statement and begin the process of developing questions that address the problem. Your paper should outline and explicitly delimit the problem and state what you intend to investigate since it will determine what research design you will use [identifying the research problem always precedes choice of design].

Lack of Theoretical Framework -- the theoretical framework represents the conceptual foundation of your study. Therefore, your research design should include an explicit set of logically derived hypotheses and rational assumptions that can be tested in relation to the research problem.

Significance -- the research design must include a clear answer to the "So What?" question. Be sure you clearly articulate why your study is important and how it contributes to the larger body of literature about the topic being investigated.

Sources: Mauch, J.E., Park, N. (2003). Guide to the Successful Thesis and Dissertation. A Handbook for Students and Faculty (5th ed.) pp. 249-250. London: CRC Press; Simon, M.K. (2005). Dissertation and Scholarly Research: Recipes for Success. Dubuque: Kendall/Hunt Publishing Company; Preece, R. (1994). Starting Research. An Introduction to Academic Research and Dissertation Writing. London; Pinter Publishers; Madsen, D. (1992). Successful Dissertations and Theses. San Francisco: Jossey-Bass; Bell, J. (2010). Doing your Research Project: a guide for first-time researchers in education, health and social science. Berkshire: Open University Press.

Method Pitfalls (continued)

Relationship between Past Research and Your Study -- do not simply offer a summary description of prior research. Your literature review should be critical and include explicit statements linking the results of prior research to the research you are about to undertake. This can be done, for example, by identifying basic weaknesses in previous studies and how your study helps to fill this gap in knowledge.	Contribution to the Field -- in placing your research within the context of prior research, don't just note that a gap exists; be clear in describing how your work contributes to, or possibly challenges, existing assumptions or findings.
Provincialism -- this refers to designing a narrowly applied scope, geographical area, sampling, or method of analysis that restricts your ability to create meaningful outcomes and, by extension, obtaining results that are relevant and possibly transferable to understanding phenomena in other settings.	Objectives, Hypotheses, or Questions -- your research design should include one or more questions or hypotheses that you are attempting to answer about the research problem underpinning your study. They should be clearly articulated and tied to the overall aims of your paper. Although there is no rule regarding the number of questions or hypotheses associated with a research problem, most studies in the social sciences address between one and five key questions.
Poor Method -- the design must include a well-developed and transparent plan for how you intend to collect or generate data and how it will be analysed.	Proximity Sampling -- this refers to using a sample which is based not upon the purposes of your study, but rather, is based upon the proximity of a particular group of subjects. The units of analysis, whether they be persons, places, or things, must not be based solely on ease of access and convenience.
Techniques or Instruments -- be clear in describing the techniques [e.g., semi-structured interviews] or instruments [e.g., questionnaire] used to gather data. Your research design should note how the technique or instrument will provide reasonably reliable data to answer the stated research questions.	Statistical Treatment -- in quantitative studies, you must give a complete description of how you will organise the raw data for analysis. In most cases, this involves describing the data through the measures of central tendencies like mean, median, and mode that help the researcher explain how the data are concentrated and, thus, lead to meaningful interpretations of key trends or patterns found within the data.
Vocabulary -- research often contains jargon and specialised language that the reader is presumably familiar with. However, avoid overuse of technical or pseudo-technical terminology. Problems with vocabulary also can refer to the use of popular terms, clichés, or culture-specific language that is inappropriate for academic writing.	Ethical Dilemmas -- in the methods section of qualitative research studies, your design must document how you intend to minimise risk for participants [a.k.a., "respondents", "human subjects"] during stages of data gathering while, at the same time, still being able to adequately address your research question(s). Failure to do so can lead the reader to question the validity and objectivity of your entire study.
Limitations of Study -- all studies have limitations. Your research design should anticipate and explain the reasons why these limitations exist and clearly describe the extent of missing data. It is important to include a statement concerning what impact these limitations may have on the validity of your results and how you helped ameliorate the impact of these limitations.