Translation Evaluation Products of Political Translation through Holistic, Analytic, CDI (Calibration of Dichotomous Items) and PIE Method (Preselected Items Evaluation)

Translation Evaluation targets at scrutinizing and marking the students' drafts and translators’ competences, analyzing linguistic and paralinguistic facets of the text, perusing tools and models of translation evaluation, developing an independent method to retrieve data which quantifies scientific output expatiating societal impacts, and valuing and validating translation evaluation results of societal quality on the basis of specific translation theory and competence. Juxtaposition of the source text with target text and also target text per se are the processes in translation evaluation (Mobaraki & Aminzadeh 2012:63).The research objectives of the present research proposal are as follows: (1) To calculate interrater and intrarater reliability correlation for holistic, analytic, CDI, and PIE methods; (2) To calculate the correlation between holistic, analytic, CDI, and PIE methods to see their strengths and weaknesses when evaluating the translation,

In order to evaluate the mentioned methods, this research proposal makes use of scrutinizing 'Joint Comprehensive Plan of Action' (Vienna, 14 July 2015) between Iran and 5+1 along with 10 different translations. The source language written in English can be found in Whitehouse and Washington Post and the translations are going to be translated by the IRIB (Islamic Republic of Iran Broadcast) translators and official translation agencies. The present proposal divides research question section into three parts as (1) 6 questions regarding intrarater reliability, (2) 6 questions regarding interrater reliability, and (3) 6 questions concerning correlation.

A total number of 50 translator students will participate in this study. They were enrolled in the fourth (n=30) year bachelor-level and second (n=20) year master-level English-Persian translation workshops and courses from the three Iranian universities (University of Isfahan, Ferdowsi University, and University of Tehran). The students are given 90 minutes to render the text. Also students are allowed to access their computers (in case of possibility) to utilize whatever electronic reference since this research proposal tries to make sure that heuristic competence is included in the translation performance. For statistical reasons, this yields in a selection of 10 graders for holistic method, 10 graders for analytic method, 10 graders for CDI method, and 10 graders for PIE method. In this direction, 10 raters in holistic and 10 raters in analytic methods will be selected from the University of Isfahan, and Ferdowsi University who have experienced translation training with more than 15 years of experience in evaluating and assessing students' translation performance. And 10 raters for CDI and 10 raters for PIE methods will be selected from two translation agencies (Worldtransnet Complex and Basirat translation Agency respectively) because of their longstanding experience in translating the legal and official deeds directly supervised by Ministry of Justice and Ministry of Foreign Affairs.