Assignments on Doing the Research - Assignment Example

Assignment Research Scenario Introduction In this assignment, three different scenarios are given, and then it is decided whether a personal interview, telephone survey, or self-administered questionnaire would be appropriate. The reasons are also stated and explained. Scenario 1 A survey of the residents of a new subdivision on why they happened to select that area in which to live. Propose some questions to secure some information about what they like and do not like about life in the subdivision. A self-administered questionnaire would be appropriate because there are likely to be a very large number of residents, and this is an easy and cheap method. Also, they can have the opportunity to give sensitive details of why they want to live in the area in the convenience of their own home in private. A telephone survey may not be suitable because being a new area they may not all have a landline connection. A select number of interviews are also possible but the survey will typically consist of a limited number of fixed questions requiring quantifiable data, so again written responses would be the ideal way of collecting the data. Examples of three questions that could be asked: 1. What attracted you most to this area? [provide a set of options] 2. Have you moved to live closer to any of you family, relations or friends? 3. How did you come to know of this new subdivision? [provide a set of options] Scenario 2 A poll of students at Metro University on their preferences among three candidates who are running for president of the student government. A telephone survey would be appropriate because the students are at a single university and their contact details are held on record. They can also be selected randomly very easily, and the whole survey be conducted from a single convenient location. Given that the students only have to disclose their preference between three candidates, this survey can be administered quickly. Interviews are unnecessary because no in-depth information is required. A written questionnaire is also possible but may be too time-consuming for a short and simple survey. Scenario 3 A study of financial officers of the Fortune 500 corporations to learn their predictions for the economic outlook in their industries in the next year. Personal interviews are appropriate because the surveyor needs to establish a rapport with a small sample of financial officers to extract useful, detailed and insightful information. This is also an open topic as there is no predetermined set of questions, and the type of information desired consists of opinions and forecasts. Also, the chances of officers responding to written or telephone surveys is slim due to busy schedules. Appointments can guarantee a time with the officers, and make them and their time feel valued, and hence increase the likelihood of valuable information, which after all is the main objective. Conclusion The three scenarios allowed the illustration of situations in which each of the three different methods of data collection for surveys can be applied. This also helps to identify the strengths and weaknesses of each method, which are stated under each scenario. Assignment 2: Research Applications Introduction This is a research application assignment that considers a survey conducted on a sample of randomly chosen customers in a company. Customers rated their level of satisfaction with the service received from the company on a scale from 1 to 10. Research Data The mean level of satisfaction of the sample is 6.3, and the standard deviation is 1.5 Data Analysis a. What is the standard error of the mean if the sample included 100 customers? The sample size (n) in this case is 100. standard error of the mean = standard deviation ÷ √ sample size = 1.5 ÷ √ 100 = 1.5 ÷ 10 = 0.15 b. What is the standard error of the mean if the sample included 400 customers? The sample size (n) in this case is 400. standard error of the mean = standard deviation ÷ √ sample size = 1.5 ÷ √ 400 = 1.5 ÷ 20 = 0.075 c. Explain the relationship between your answers to a) and b) In a the sample size is relatively smaller (100) than b, or conversely, in b the sample size is relatively greater (400). The smaller sample size yielded a larger standard error and the larger sample size yielded a smaller standard error figure. To put it another way, the larger sample size reduced the chance of extreme sample statistics. d. What is the distribution of the sample mean? Why? This is only a single sample. But if a distribution of sample means were formed, it would show what is known as a t-distribution. That is, it would be shaped like a normal curve, but will be less peaked and have more widely spread tails at both ends. The number of degrees of freedom determines the latter characteristic. With a larger sample size having fewer extreme sample means, the standard error gets smaller, and so the distribution resembles the normal curve more and more. Conclusion A rating system provides a quick and convenient way of assessing customer satisfaction levels. The mean figure is derived to show the satisfaction level of a typical customer. The standard deviation is a measure of the spread of the actual values based on the arithmetic mean. The larger sample size in b reduced the chance of extreme sample statistics and can therefore be more representative of the population of customers. Assignment 3: Research Article Review Introduction A checklist is used to review and evaluate a peer-reviewed journal article in an area of business that has an intervention of treatment, and where the research process involves a control group and experimental group. The area of business is professional development training programs, and the two groups compared are those that undergo traditional face-to-face live instruction and those that utilize web-based technology. The intervention is to use the technology driven approach to improve effectiveness in the training. Selected Article Title: Video-Driven Multimedia, Web-Based Training in the Corporate Sector: Pedagogical Equivalence and Component Effectiveness Author: Katherine Pang, University of Texas at Tyler, USA Journal: The International Review of research in Open and Distance learning, Vol. 10, No. 3 Date: June 2009 Online Access: http://www.irrodl.org/index.php/irrodl/article/view/629/1265 Article Review 1. Describe the purpose of the article. “To assess the pedagogical equivalence, as determined by knowledge gains, and the pedagogical effectiveness of certain components in a video-driven multimedia, web-based professional development training program as compared to a traditional, face-to-face program under real-world constraints of time and limited economic resources.” The study thus makes a comparison of the two methods for professional development training to see which is more effective and leads to greater gains. 2. What is the problem? Is it clearly stated? The problem or business need is to effectively provide professional development training programs. ‘The Use of Technology’ section touches upon “the importance of professional development… to the maintenance and effectiveness of today’s workforce”, and that “organizations recognize that there is a need to frequently examine the pedagogy, instructional strategies, and delivery mediums of workplace training.” 3. Does the problem have a theoretical rationale? Professional development and corporate training is beneficial to both the individual and the company. It is believed to be directly related to productivity and business profitability. 4. How significant is the problem? The competitive environment demands that companies maintain a highly developed, trained and productive management and workforce. Rapid changes in technology also necessitate that business intelligence and personal skills are kept up to date. Moreover, the current recessionary times have intensified the need to both survive and thrive. 5. Is there a review of the literature? If so, is it relevant? Describe briefly. Some previous literature on the topic is reviewed under the heading The Use of Technology’. Frustrated efforts to utilize the technology, “doubts about the benefits of e-learning”, the ‘knowledge era’, delivery mediums of workplace learning, issues of commitment, constraints and benefits etc. are given coverage. This is useful background knowledge to contextualize the study. However, no similar studies are cited. Instead, the author maintains, “there is a lack of sound research material in the area of pedagogical equivalency and effectiveness.” 6. Are the constructs operationally defined? ‘Pedagogical equivalence’ and ‘pedagogical effectiveness’ are special terms used in the study but they are not operationally defined. However, measures of ‘pedagogical equivalence’ and ‘pedagogical effectiveness’ are described as ‘knowledge gains’ and ‘content mastery’. These constructs are not defined in the article. 7. What are the hypotheses? How clearly are they stated? The hypotheses are clearly stated in the section titled “The Study’: “A video-driven multimedia, web-based professional development program is pedagogically equivalent to a live, instructor-led program in delivering competency-based professional development training, as measured by knowledge gains. Further, certain components in the web-based environment are more effective for learning.” 8. Is the procedure (or method) used to address and answer the problem described fully and completely to enable future researchers to replicate the study? Describe briefly. The study involved participants holding a variety of positions within organizations. The method and materials used are clearly described as well as the research design and instruments used. The actual questions and points used are also stated. Therefore, the method does address the need, and is described fully and completely so that other researchers can replicate the study. 9. Was a sample used? If so, how was it selected? Provide sample information. A sample was indeed used and its characteristics are given. The study comprised of 38 participants whose ages ranged from 21 to over 51, the majority being 31 or older. The participants had worked for up to 21 years. Their educational backgrounds are also noted, and they held a variety of positions within organizations. Many of them were business owners. 10. What are the limitations/delimitations of the study? Were these stated? The author admits that the sample size was small but claims that “there was ample power to validate the findings.” Further, it is made clear that the majority of the participants were business owners or had management experience. Therefore, the findings are limited to this group. However, the author suggests, “additional research can prove valuable for generalizing the results to other populations.” 11. Are there any probable sources of error that might have influenced the results of the study? If so, have they been controlled or acknowledged as limitations to the generalizability of the research? No probable sources of error are mentioned in the study. All the participants were well educated so it is unlikely for example that any of the questions were misunderstood 12. What statistical techniques are used to analyze the data? Are they appropriate? “An F-test and t-test are used to analyze the data for the assessment and the two post-tests.” These are appropriate because the F-test is used for the null hypothesis of equal means, and the t-test is used for the null hypothesis that a normal population has a certain mean. The t-test helped to reveal differences “between the web-instructed and live-instructed participants on the questionnaire to determine exposure to and experience with professional development programs. The F-test helped to reveal those items which were significant. 13. How clearly are the results presented? Describe the results. The individual results for each question and point are given in tables 3 and 4, which are then collectively analyzed. Table 3 results relate to ‘Professional Development Program’ and 4 statistics (means and standard deviations for each of the 2 comparison groups) are calculated for each of the 10 questions. Table 4 results relate to ‘E-Learning and Live Program Post Test Questions’ and 2 statistics (mean and standard deviation) are calculated for each of the 10 questions. The figures support the later statements on the findings. 14. What are the findings? Are they presented clearly? Do the data support the conclusions? Does the researcher over-generalize the findings? Explain. The findings support the hypothesis but they also additionally suggest, “The web-based environment may be a better alternative because of its cost-effectiveness.” The finding are clearly worded without any ambiguity. The significant results are summarized in the following four points (summarized): E-learning videos enhance knowledge of content more than the use of whiteboards in live instruction. Handouts in e-learning enhance understanding more than handouts in live instruction. Interactivity in e-learning enhance understanding more than interactivity in live instruction. Multimedia environment in e-learning facilitates learning more than live programs. The author states, “The results have wide implications for corporate training, where on-demand learning, cost, and loss of revenue from travel and instruction often determine the mode and method for training.” This is true given the nature of the study but this particular study was not so large that it alone can justify these implications. The study tested a particular learning scenario and measured a particular type of ‘knowledge gains’. And, there may very well be cases where ‘traditional live instruction’ proves superior to the technological approach. Thus, I believe the research does over-generalize the findings to support the position of the first hypothesis (re. equivalence), and establish the second hypothesis (re. more effective). Conclusion The 14-point checklist provided a good means to review the article by evaluating the quality of the research study. The article contains all the important elements of a typical business research study but the author was probably too hopeful of supporting her hypothesis and generalizing the findings. Read More