Evaluation Methods Analysis - Essay Example

Evaluation Methods Introduction When conducting any form of experiment, whether it is scientific, psychological, or social, it is important to understand and fully grasp the different methods of evaluation. It is imperative to know which methods would work, which ones would not, and why. While some methods may be appropriate for some experiments, they might not be so helpful in others; likewise, one evaluation method may not be as effective as another. As part of the research, the experimenter should know the workings of the different observation methods. It is important to know which observation method is best for a specific experiment, as the results lie with how the data is gathered and interpreted. The observation has to positively benefit the experiment, though it is also helpful to understand why other methods would not work in that specific experiment. This will aid both the experimenter and the reader into understanding how some methods worked better than others. In regards to non-participation observation and participation observation, it is important to understand the type of experiment that is being done before deciding on which observation method would be the best. Some studies and experiments require participation as it allows the one conducting the experiment to see the different effects and possible results; the experimenter can come to a conclusion based on the results of individuals by interacting with the participants. With non-participation observation, the experimenter does not interact with the participants, so they have to use other methods to come upon their conclusions as they do not allow themselves to experience the thing being studied. Non-Participation Observation Non-participation observation is also known as direct or naturalistic observation, and it is when data and other information are collected by observing behavior without getting involved with the participants. The experimenter sets up the research environment and observes the behavior from outside of that population, watching from the sidelines, and not letting him or herself get involved with that portion of the experiment. They gather the information that they need by being only an observer; oftentimes, the population being observed is not aware of the fact that they are being so, as it may alter the way they behave. There are two types of non-participation observation: overt and covert. Overt is when the participants are aware that they are in an experiment and are being observed. A covert experiment is when the participants are unaware of the fact that they are being observed. The latter is performed more often, due to the fact that behavior would not be altered, as they do not know that they are part of an experiment. Pros With non-participation observation, the one controlling the experiment can view their population without influencing it. The most common forms of non-participation observations are naturalistic observation and simulations (Fraenkel & Wallen, 2006); this is due to the fact that these things should not be altered, but should be viewed as they are on their own, without influences or outside distractions. This form of observation is one of the truest forms, as it allows the experimenter to see things for how they really are. Cons Some of the downsides to non-participation observation include the observer not being able to get close enough to what he or she is observing. As this type of observation is done at a distance, the experimenter has a more difficult time controlling the experiment. This, of course, can also been seen as a positive effect, but if the observer is unable to get the results that he or she wants or expects, then the experiment can be considered a failure or will not yield the results planned or expected. Overt Versus Covert In regards to overt and covert observations, an entirely different list of pros and cons apply. An overt observation may influence the behavior of the population being observed, yet there are more ethnical guidelines that must be observed and followed when performing a covert observation (Plummer, 2005). While it may take a little more to perform a covert observation, it is perhaps the most effective way when observing a population in its natural environment. There is less to get in the way of the actual experiment and the possible outcomes. Likewise, it would be easier to do an overt observation, though risking the chance of having the population behave according to what they believe is expected of them. It all comes down to what is required of the observation, and what the actual population consists of. Participation Observation Unlike non-participation observation, observation involving participants means the researcher setting up and taking part in their experiment. The researcher is an active member of the group that he or she is observing, and actually helps to progress the observation further. They are able to influence the group that they are observing, allowing them to most likely reach the goals that they had intended on. Though, as with non-participation observation, there are upsides and downsides to participation observation. Pros Some of the positive aspects of participation observation involve the observer getting up close and personal with his or her experiment, as well as to guide the experiment into the direction they want it to go in. The experimenter is able to become intimate with the population, their environment, and their practices. Participation observation lets the experimenter to be in the direct center of the action, as opposed to just watching from the sidelines. It is a more personal, intimate experience for everyone involved in the experiment. Unfortunately, there is more interference in a participation observation then there is in an experiment that does not involve outside participation. Cons One of the greater negative aspects of participation observation is that the one conducting the experiment can have a big influence on the processes and the outcomes of the experiment, which could mean that the experiment does not yield the proper results. If the other participants, the population being studied, are aware of the experiment, they might alter what they are doing to meet expectations. Knowing which method to use and why One of the important parts of conducting an experiment is knowing which observation method would be the best one to use and why; likewise, it is also helpful to know why the other methods would not work as well, if at all. As aforementioned, the most common experiments that involve non-participation observation are naturalistic observation and simulations; these are the experiments that do not need the interference of an outside source, including the experimenter, and needs to be conducted undisturbed as though there was no experiment being conducted at all. A participation observation can be done when the experimenter can be a benefit to the experiment, though this can sometimes prove to be a negative thing. When it comes to long term experiments, participation observation would be best, as it allows the person conducting the experiment to obtain more detailed information about the population that they are studying. Non-participation observation is a good choice when doing a short term experiment, as the longer an observer watches their subjects, the more likely it is that the experiment will get off track. The observation method that is used will decide the outcome of the experiment, which is why it is imperative to know beforehand the proper method to use. When trying to capture the population in their natural setting, it would be best to observe them from a distance, to use non-participation observation; it could alter the experiment and the outcome if there was outside interference and influence, as it would not be natural to their environment and their scenario, even if it were a simulation as opposed to the actual environment. If outside influence is not that big of a deal, then a participation observation could work out well. When doing a non-participation observation, it has to be decided if it should be overt or covert. If there absolutely cannot be any interference, then a covert observation would be the best method to use, as the population would be unaware of the observation and continue to act in the ways that are natural for them. The person conducting the experiment would have to be aware of the ethical boundaries if they decided to hold a covert observation. Similarities While there are many differences between non-participation observation and participation observation, there are also a few similarities that should be made known. Despite the fact that non-participation and participation methods are completely different methods, there is still a strong similarity between a non-participation overt method and participation methods: they both involve the population being aware of the experiment being conducted on them. Both of these observations have the ability to be influenced by their experiment conductors, which can alter the overall outcome of the experiment. Perhaps the most obvious comparison is that both methods are methods of observation. They both provide ways for an observer to further understand something that he or she could not get from simple research. Furthermore, both methods can be conducted in numerous ways, whether by interviews, questionnaires, surveys, and, perhaps the most difficult yet most effective method, actual observation. All of these can help the observer to realize and understand things from a first-person perspective; he or she could learn more than they would through secondary sources, though those are also helpful in any research situation. Conclusion Conducting any sort of experiment is all about using methods: methods of study, research, observation, and conclusion. Conducting an experiment also involves understanding why some things are and why other things cannot be. Questioning, using methods of observation, and understanding – a simple, though vague, pattern to any research experiment. Before an experiment can commence, it is important to know and understand the observation method that would best benefit the experiment, but before that can be done, the basis of the experiment needs to be understood. When deciding which observation method should be used, a few things need to be taken into consideration. The purpose and importance of the study must be made aware; the population and their role in the experiment must be made clear; it should be considered whether or not outside interference could damage the experiment. The actual type of experiment will help to decide the observation method, whether the experiment involves the population being in their natural environment, a simulation, or another form of location or scenario. In a non-participation observation, the person conducting the experiment does not involve himself in the actual experiment. He or she stands to the side, takes notes, and learns by watching. However, there are two types of non-participation observation: an overt observation means that the population is aware that they are being observed, while a covert observation means that the group is not aware of what is taking place, despite involving them. Participation observation involves the experimenter to get down in the center of what is going on, becoming part of the experiment. It is up to the experimenter to understand which method is best for their experiment and why. References Fraenkel, J & Wallen, N. (2006). Observation and interviewing. Retrieved September 7, 2008, from http://highered.mcgrawhill.com/sites/0072981369/student_view0/chapter19/ main_points.html Plummer, Ken. (2005). Sociology: A global introduction. New York: Prentice Hall. Read More