Monday, September 3, 2007

Nelson & Carson (2006) evaluation by Ping

Nelson, G. & J. Carson. (2006). Cultural issues in peer response: Revisiting ‘culture.’ In K. Hyland & F. Hyland (eds.), 42-59.

This article is quite easy to read. I was able to read it without constantly thinking of getting more coffee, so that's good. And it's short, too. I'm very grateful I picked this one :)

In the article, Nelson and Carson argue that culture could be a contextual factor in the effectiveness of peer response. In their study on peer group interactions, they found the three Chinese participants all expressed their reluctance to disagree with other peers' comments and their desire to maintain the harmony of the group. Their shared cultural expectations seem to explain why they didn't give negative feedback to their peers and why they held back their criticism. The students found it difficult to participate successfully in peer response interactions because giving negative feedback works against their cultural values. Therefore, the effectiveness of peer feedback is discounted. Nelson and Carson then hypothesize that cultural backgrounds may influence the dynamics of group interactions and further play a role in the effectiveness of peer feedback.

They also pointed out that the construct of “culture” is controversial. Using it as a contextual factor has been critiqued by postmodern, post-structuralist, and post-colonial theorists as reductionist, assuming culture to be static and coherent. The authors illustrate the debate on culture-stereotype connection at some length and, in the end, they take a stance by saying that there is “a systematic, culturally determined way in which all members in a certain culture think, behave, and act” (Nelson & Carson, 1994, p. 14). There are multiple causes of successful and unsuccessful peer feedback. By examining possible cultural effects in peer feedback, the study aims to highlight the complex variables in providing quality feedback.

Overall, I enjoy reading it. I'll recommend it to anyone who is interested in cross-cultural issues and contextual elements of peer feedback interactions. The article doesn't require any background knowledge. Even if you are not familiar with peer response, you will not have much trouble reading it.

However, my problem with the article is I still don't know how to tease apart the contextual factors the authors investigated. I mean, how much can we say that the effectiveness is culture-related? How much can we say we are not making stereotype connection when we talk about cultural homogeneity? These questions seem to linger in my mind.
Evaluation of Morris (2002) by Myong Hee

Morris, F. (2002). Negotiation moves and recasts in relation to error types and learner repair in the foreign language classroom. Foreign Language Annals, 35(4), 395-404.

This study investigates interaction of adult beginning learners of Spanish in the foreign language classroom. Forth-two students formed pairs and worked on the same jigsaw task. Their interaction was coded for types of error (syntactic/lexical), types of negative feedback (explicit/recasts/negotiation moves), and repair. Findings show that (1) they did not use explicit negative feedback; however, they provided implicit negative feedback (70% of errors received); (2) syntactic errors tended to invite recasts, whereas lexical errors tended to invite negotiation moves; (3) they tended to repair ill-formed utterance immediately, but the frequency of repaired errors followed feedback was low; and (4) all syntactic repairs and the majority of lexical repairs followed negotiation moves.

I found this article useful. The role of interaction has been central in SLA and accordingly pair and small group activities have been promoted in the L2 classroom. Along with a CLT approach, a small group activity has been highly encouraged in order to promote student-centered class and to improve fluency through practicing a target language. In the case of EFL context, a small group activity is the major source of learner interaction, along with teacher-learner interaction. As I promote a lot of group work in my classes, I have been curious to know whether it is beneficial to my students. This study reveals what is going on between NNS learners while interacting in dyads. It may be a good example to those who want to investigate a similar study in other FL classrooms.

I’d like to recommend this article to be added to our SLS 750. As I mentioned above, peer correction is another important feedback area to explore. I guess there are some (at least a few) who are planning to look into peer feedback in the FL/SL classroom. For those, this study may be a good reference.

Evaluation of Bitchener, Young, & Cameron (2005) by Hung-Tzu

Bitchener, J., Young, S., & Cameron, D. (2005). The effect of different types of corrective feedback on ESL student writing. Journal of Second Language Writing, 14, 191-205.

Bitchener, Young, and Cameron (2005) examined how different types of corrective feedback on linguistic errors determine accuracy performance in learner writing. 53 post-intermediate adult ESL learners were divided into three treatment groups: direct written feedback on the target features, direct written corrective feedback + 5 minute student-researcher conference, and no corrective feedback on the target features. In four different pieces of writing within 12 weeks, learners’ errors on the use of preposition, simple past tense, and definite articles were corrected. The study found that when the three targeted errors were considered as a single group, the type of feedback provided did not have a significant effect on accuracy, however, when linguistic categories were considered separately, the types of feedback had a significant effect on the accuracy performance. Learners who were in the written feedback + conference group outperformed the other two groups significantly in accuracy performance of simple past tense and definite articles, but not prepositions.

The researchers indicated that the difference of learner improvement on the three linguistic errors could be explained with the notions of “treatable” and “untreatable” errors proposed by Ferris (1999). Ferris distinguished “treatable” and “untreatable” errors, defining the former as rule-governed error (such as verb tense forms) and the letter as idiosyncratic error, which require learners’ acquired language knowledge to correct the error (such as word choice). Based on the results of Bitchener et al., more “treatable” errors (in this case, the use of simple past tense and definite articles) were amendable through explicit written feedback and one-to-one conferences in which rules were explained and clarified.

Rather than examining the accuracy performance with text revision on the same writing, Bitchener et al. specifically stated that this study attempted to investigate long-term improvement of linguistic features by using four new pieces of writing within 12 weeks. Since one of the most crucial factors contributing to the diverse results in written corrective feedback research lies in the difference on how researchers define effectiveness, Bitchener et al. were careful in formulating what they intend to measure. The results showed that there was significant variation in accuracy performance across the four pieces of writing and that learners’ progress did not show a linear and upward pattern, leading the researchers to suggest that in order to measure long-term effect of corrective feedback on writing, a period longer than a semester is needed.

I think the article is straightforward and therefore fairly easy to read. With a brief summery of the Truscott and Ferris debate as a start, the study offers a clear picture of the research and discussion involved in whether and how to give L2 learners feedback on their written grammatical error. For those who are familiar with the domain, this article could be a nice review, and for those who are more interested in oral corrective feedback, this could be an introduction to read without going much into details. My overall evaluation to the article is therefore “recommended”.

One article that seem particular interesting to me when reading this study was:

Ferris, D. R., & Roberts, B. (2001). Error feedback in L2 writing classes: How explicit does it need to be? Journal of Second Language Writing, 10, 161-184.

The distinction on “treatable” and “untreatable” errors was examined in this study. Since lexical errors were categorized as a more “untreatable” error, looking at how lexical errors were treated in this study will help me fine-tune my own research.

Evaluation of McDonough(2005)'s article by Yun Deok Choi

McDonough, K. (2005). Identifying the impact of negative feedback and learners' responses on ESL question development. Studies in Second Language Acquisition, 27, 79-103.

The article has a purpose to pinpoint if both negative feedback and learners’ response to it, or modified output, can notably predict the development of ESL question formation, based on Pienemann & Johnston’s developmental sequence for that structure. As for research method, the researcher used both sixty university students in Thai who were all assessed at stage 4 and five native speaker interlocutors. At stage 4, pseudo-inversion and yes/no inversion occur. Sentences like “Where are they now?” and “*Could you gave me some suggestion?” can be exemplars for this stage. The researcher employed a pretest and post-test design and all participants were equally assigned into four groups during three treatment sessions: an “enhanced opportunity to modify” group in which the NSs responded to students’ inaccurate question forms through repetition with stress and rising intonation and then they offered open-ended clarification request like “what?” and stop for a moment for giving an opportunity to the students for modifying their previous erroneous utterance, an “opportunity to modify” group where the NSs responded to learners’ inaccurate question forms just by providing an open-ended clarification request, a “feedback without opportunity to modify” group in which the NSs highlighted students’ inaccurate question forms by repetition with stress and rising intonation but they did not give chances to the students for modifying their utterance and continued their conversation, and “no feedback” in which the NSs did not offer any kind of feedback in response to the students’ inaccurate expressions. During treatment sessions, while the students completed three sets of two communicative activities eliciting question forms, they also kept writing learning journals, which were used to identify whether the students paid attention to target forms. After the treatment, all students finished four oral production tests that consisted of a warming-up activity and two activities eliciting question forms.

As to analysis of treatment task data, the students in “enhanced opportunity to modify,” “opportunity to modify,” “feedback without opportunity to modify,” and “no feedback” groups got different amount of negative feedback in decreasing order although the difference was not significant. And also the students in both “enhanced opportunity to modify” and “opportunity to modify” groups produced modified output while the others didn’t; however, the difference was not significant, either. Interestingly, the learning journals revealed that only the students in “feedback without opportunity to modify” group did not attend to the target forms. In terms of data analysis on oral production tests, the students should produce two question forms at a higher stage, stage5, in order to be judged to be developed or advanced to a higher level. At stage 5, “wh question + auxiliary verb” forms appear, and we can take “why is the girl looking at the moon?” for an example. Based on the data analysis, the researcher discovered that only modified output related to a more advanced level could critically predict the development of ESL question formation. She also suggested that “clarification requests” played a role indirectly in development of the target structure by promoting students’ production of modified output.

I think this article is pretty useful and interesting since it examined whether implicit negative feedback, namely “clarification request,” and modified output had beneficial effects on English question formation, separately or in combination. The researcher also tried to control the students’ attention to the target structure by manipulating the salience of inaccurate utterance provided by the interlocutors with a couple of techniques such as repetition, stress and rising intonation. I got the impression that the study is very similar to that of Doughty and Varela (1998) in light of not only using highlighting techniques (repetition, stress and rising intonation) with negative feedback (“clarification request” versus “recast”) in order to draw students’ attention to the target language features (English question formation versus English past tense) but also offering a time for the students to respond right after the feedback from the interlocutor while the other independent variables are different. In addition, I also thought that the study is unique in terms of distinguishing “clarification request” from other types of prompts such as “elicitation,” “metalinguistic clues,” and “repetition” based on the degree of explicitness even though the researcher just mentioned that the reason that she chose “clarification requests” among other types of negative feedback because the earlier research proved that they provide learners with more chances to produce modified output, especially compared with “recasts.” However, I was wondering whether the researcher made use of “clarification requests” per se while I was reading the article since she also included other elements such as “repetition, which is one of the other types of prompts,” stress, and rising intonation to “clarification requests” like Doughty and Varela did in their study and this point has been criticized by other researchers. What would have happen if she had only used “clarification requests?” I think it’s a remaining question to solve in the future research.

Actually I hardly enjoyed reading this article, especially when I was reading the result section. It was because the researcher mentioned various statistical terms such as a Kruskal-Wallis test, a Mann-Whitney test, and logistic regression. Since I am a novice in Statistics, it was a bit difficult and frustrating to interpret the data. However, if someone who is good at various Statistical techniques, it would be very rewarding work to read the article.

I don’t strongly recommend that it should be added to our 750 reading packet since it’s similar to Doughty and Varela (1998)’s study and I assume that almost everybody in our class already read it. Besides, it dealt with various Statistical terminologies that maybe some of us don’t know at all. If it isn’t enjoyable for almost everybody for any reason, there’s no need to add it since there are a lot of more interesting articles that are easy to follow.

Sachs and Polio (2007) by Kevin

Learners' Uses of Two Types of Written Feedback on a L2 Writing
Revision Task SSLA, 29, 67-100

This study is an attempt to determine the effectiveness of two types of feedback in improving learners written grammatical accuracy. The two types are error correction; here defined as direct correction of student's mistakes with the correct forms provided by the teacher, and reformulation; here defined as maintaining the meaning but not necessarily the form by rewriting the student's incorrect sentences in a more native like way. Reformulations with think-aloud comments were also examined to study student's awareness of their reformulations and the effect that this has on the effectiveness of the reformulation. Because of possible problems with the error correction part of the first study, a second study was done with a larger n size was done to control for these effects. In both studies, error correction was shown to be more effective than both kinds of reformulations in improving students written grammar. In addition, reformulations + think aloud were shown to be of limited use in studying awareness and noticing due to the interfering effect and extra cognitive load that is required to verbally report on awareness.

On the bright side, this article mentions the idea of depth of processing, which is popular among vocabulary acquisition researchers and which we talked about on the second day of class. The researchers believe that this concept should be imported to error correction research in general, which I think may be a good idea. This article also discusses in some detail the idea of how noticing is related to acquisition through error feedback. Examining the role of noticing at the level of awareness (superficial linguistic level) and at the level of understanding (knowledge of linguistic rules and metacognitive linguistic knowledge) is a secondary goal of the research here.
Both depth of processing and a more nuanced notion of noticing are important ideas and this article may prod other researchers into taking a look at these areas. Unfortunately this study doesn't contribute much to the discussion.

In addition to the awkward title of this paper, there are several problems, which for the most part, the authors are aware of and state clearly, with the design of the experiment. While it is interesting that the authors bring up the idea of depth processing, they choose direct reformulations as a way to test their hypothesis. According to the authors, the following sentences are examples of a reformulation and error correction:

As he was jogging, his tammy was shaked ORIGINAL
As he was jogging, his tummy was shaking. REFORMULATION

As he was jogging his tammy(crossed out and rewritten) was shaked(crossed out as rewritten as shaking)

As is obvious, they are very nearly the same thing. The first reformulation would not require much depth of processing and most likely result in students just copying the answer.
At any rate, the results show that error correction is more effective, but the researchers admit that the design of the experiment encouraged students to simply memorize the correct feedback and that the error correction results were better simply because the format, and not the type of feedback was different. So at best, we have superficial, short term improvement of grammar points that may or may not be due to the type of feedback, which doesn't tell us much.
One interesting result of the experiment is that it reinforced the idea that students providing verbal feedback about their state of awareness during error correction interferes with the error correction and should therefore be controlled for.

This was not an especially thrilling read. If you are in love with quantitative statistical analysis (Here is a test, what is the exact definition of a Kruskal-Wallis Test?) then you might be interested in this one because the authors use every trick in the book to make up for the fact that their n size is too small and there is no normal distribution to work with. Otherwise, you will find yourself skipping down to the results and discussion.

I don't recommend this one, but it raises a few good questions.