Guest post: Translating with and without medical background – a retrospective study

Medical Translation: A Retrospective Study on the Quality of Medical Translation Produced by Translators With and Without a Medical Background

Newest guest post on the Stinging Nettle! Yana Onikiychuk (MD and freelance medical translator and interpreter from Limassol, Cyprus), Ekaterina Chashnikova (freelance medical translator and editor from Moscow, Russia) and Artem Karateev (specialist on social research, PhD, Moscow State University in Moscow, Russia) conducted a study on medical translation by medical professionals vs. background translators. They give here very detailed results of the study – a fascinating read! We are very proud to have been allowed to publish it here as a guest post – many thanks to the authors for conducting the survey and this excellent article, but also for allowing us to publish it on our blog as well!

Abstract

During the last century, the volume of investigations and scientific knowledge in the field of medicine has grown exponentially. At the same time, the exchange of  information among medical professionals has increased to enormous amounts, becoming a fundamental aspect of the development of medical science. However, this exchange would not be possible if people were not speaking the same language. We can see that English is becoming a main language of science in the world scientific arena, as a vast majority of publications and reports are done in this particular language. Yet, some linguistic barriers to effective communication still exist.. Medical translation is a highly specialized field, dealing both with translation of medical-related written information and with interpreting of medical events. Healthcare interpreting is of particular interest because of its role in establishing communication bridges between healthcare practitioners and their non-native language patients. This report elucidates the role of medical translation and interpreting in modern society and in promoting medical and related sciences. We also bring out preliminary results on a new study in the field of medical translation, in which we compare medical translators with and without a medical background and the types of mistakes they tend to make more often when translating medical documents. According to the preliminary statistics, translators with a linguistic background are more prone to terminological and logical mistakes, while translators with a medical background are more prone to grammatical and stylistic mistakes. With an increase in years of experience, this difference becomes insignificant, and translators start to make fewer mistakes overall.

Introduction

For the last centuries, we have seen a burst of development and innovation in the field of medicine. New information arises everyday on diseases, therapy and patient management. And this new information has to be transformed into other languages and cultures to ensure its global use. The field of medical translation and interpreting serves this purpose. Medical interpreting plays a vital role in the exchange of oral information at medical meetings, conferences, workshops or even at the hospital unit between doctor and patient (so-called healthcare interpreting). Medical translation deals with all variety of medical documentation, from scientific articles to patient information leaflets for drugs or marketing materials for medical devices. These documents vary significantly in terms of style and terminology, but they have one thing in common: the price of a mistake during translation is enormously high and equals the health and life of a patient. What kind of professionals are involved in medical translation? We can divide alltranslators and interpreters working with medical information into two big groups. The first group is comprised of professionals with a linguistic background specialized in the translation/interpreting of medical content. They acquired such specialization with specific training or just with practice, frequently dealing with medical documents/events. The second group consists of professionals with a medical background. This could be medical/nursing school, or an education in biomedicine or pharmaceutical science. Such professionals usually have a good command in their native language and one or two foreign languages, which they learn at university or at different language courses. Some of them, but not all receive dedicated training on the translation of medical documents, which is included on the curriculum in many medical and pharmaceutical schools. Very few professionals from this group obtain additional education in translation and linguistics, and this is usually offered in a truncated curriculum. Medical translators/interpreters with a medical or relevant degree are not common within the translation industry, especially in Western Europe and the US, as the cost of obtaining a medical education and going into the medical profession is extremely high in those countries. However, in Russia and Eastern Europe (e.g. Poland, Hungary) there are some translators of this kind in the market. The reason for this is that specialized medical translators are in high demand in these countries, and the moderate income level of medical professionals forces them to find an additional part-time or even full-time translation job. These two groups of medical translators/interpreters have some significant differences in product quality when they work with medical information.
In our study, we reviewed test samples from medical translators with and without a medical background and assessed the differences in the types of mistakes they are prone to make while translating medical documents.

Methodology

Our study has a retrospective design and consists of two phases. In phase 1 we evaluated test translations from freelance medical translators. Translation was performed from English into Russian on medical text. This assessment was performed by two independent reviewers in a blinded fashion. Every sample was assessed for stylistic, grammatical and spelling mistakes, adequate translation of source terms and medical concepts. We also assessed the formatting and layout of the target text. After this assessment, the blinding was broken and results were matched with CVs from the translators who preformed those tests. Statistical analysis was performed by an independent expert in social studies and statistics. Primary information processing was performed with statistical grouping. The sample was divided into 3 cohorts: translators with a linguistic background (L), translators with a medical background (MD), and translators with a combined medical and linguistic background (MDL). Every subject was assessed by 2 endpoints: number of stylistic (St) and grammatical (Gr) mistakes and number of terminological (Tm) and logical (Lg) mistakes.Our initial hypothesis was that medical translation professionals with a linguistic background tend to make more ‘terminological’ mistakes, while professionals with a medical or relevant background make more ‘stylistic’ mistakes. With years of experience, the total number of mistakes decreases, and the difference between these two groups becomes insignificant. For phase 2 we developed a questionnaire for experts in medical translation to evaluate their opinion on training for medical translators/interpreters, the importance of a medical background for translating medical content, and potential problems with medical translation by professionals with and without a medical background.

Results

The study is still ongoing. At this moment, we have enrolled 60 sample translations. Four samples were excluded as non-evaluable. The enrollment plan is 2000 samples to provide statistical power for the study. Test samples were divided into 3 cohorts: translators with a linguistic background (L), translators with a medical background (MD), and translators with a combined medical and linguistic background (MDL). Primary endpoints were (1) number of mistakes per sample, (2) correlation between the number of mistakes and background and/or years of experience, and (3) quality of translation from MDLs. The following mistakes were assessed: terminological (Tm), logical (Lg), stylistic (St) and grammatical (Gr). For statistical analysis, Tm mistakes were combined with Lg mistakes, while St mistakes were assessed in combination with Gr mistakes. Preliminary results on sample distribution are shown on Figure 1.

According to the preliminary results, we can divide all translation samples into 3 groups: best-performing group (BPG) with the lowest number of mistakes, moderately performing group (MPG) with an acceptable number of mistakes, and poor performing group (PPG) with a high number of mistakes. BPG includes 8 professionals (2 Ls, 4 MDs and 2 MDLs), MPG includes the highest number of samples (37 professionals 18 Ls, 16 MDs and 3 MDLs), and PPG includes 11 professionals (3 MDs and 8 Ls). The method of averages confirms that MDs and MDLs make fewer Tm and Lg mistakes than Ls. MDLs also make fewer St and Gr mistakes than Ls and MDs. Surprisingly, MDs make fewer St and Gr mistakes than Ls. This result doesn’t correspond to the initial hypothesis, but more samples are needed to consider this difference significant. The yellow line in the plot separates the group of translators with a tolerable number of mistakes, and most of those professionals were hired by the translation agencies providing test samples for this research.

Discussion

The majority of mistakes from all three cohorts were done by Ls. Perhaps a better understanding of the source text makes a translator produce better target text in Russian. Working out on Tm and Lg mistakes improves St and Gr mistakes, as we don’t see subjects behind the blue line. The number and type of mistakes in L cohort was characterized by significant variability. This could be explained by differences in background, specialization and years of experience. MDs and MDLs make fewer Tm and Lg mistakes than Ls. MDLs also make fewer St and Gr mistakes than Ls and MDs. Surprisingly, MDs make fewer St and Gr mistakes than Ls. This result doesn’t correspond to the initial hypothesis, but more samples are needed to consider this difference significant. With these additional samples, we plan to analyze the type of distribution and the density of distribution, and also to reveal any correlation between years of experience and number of mistakes for all 3 cohorts.

References

Samoilov D. (2011) “On Medical Translation”. Publication on-line at http://www.practica.ru/Articles/medical.htm (in Russian)
Shahova N. (2012) “Discovering the Russian Translation Market.” in SlavFile. vol. 21(1), No. 1
Garbovskiy N. (2004). Translation Theory. Moscow: Moscow University Publishing House (in Russian)
Komissarov V. (1990). Translation Theory. Moscow: Vysshaya Shkola (in Russian)
Komissarov V. (2001). Modern Translation Science. Moscow: Vysshaya Shkola (in Russian)
Latyshev L. (2001). Translation Technology. Moscow: NVI-Tesaurus (in Russian)
Lvovskaya Z. (1985). Theoretical Issues in Translation Process. Moscow: Vysshaya Shkola (in Russian)
Alekseeva I. (2004). Introduction to Translation Science. Saint-Petersburg: Academia Publishing House (in Russian)
Buzadzhi D. (2009). New Approach to Classification of Mistakes in Translation. Moscow: Vserossiyskiy Center Perevodov (in Russian)
Kunilovskaya M. (2008). “Mistakes in Translation: Types and Classification”. Publication on-line at http://tc.utmn.ru/node/76 (in Russian)

Download the article as pdf here on Yana Onikiychuk’s website

Proactive publication of clinical trial data – discussing the way forward

09/08/2012 – The European Medicines Agency has announced that it will proactively publish clinical trial data and enable access to full data sets by interested parties. A number of practical and policy issues need to be addressed before complex data sets can be made available.

The Agency is organising a workshop on 22 November 2012 to listen to the views, interests, and concerns from a broad range of institutions, groups and individuals. Results from the workshop will help the Agency define the modalities of proactive access to clinical trial data, in a way that best serves patients and public health in an open and transparent forum.

Registration is open until 31 October 2012. Expressions of interest should be sent to ctdataworkshop@ema.europa.eu by 31 October 2012. Places are limited to 150 and will be offered on a first-come-first-served basis.

Source: EMA News and press releases - http://www.ema.europa.eu

EMA boosts EU transparency with online publication of suspected side effect reports

 

 

 

Member States and the Agency release data on medicines in compliance with EudraVigilance access policy

31/05/2012 – The European Medicines Agency has today begun publishing suspected side effect reports for medicines authorised in the European Economic Area (EEA) on a new public website: http://www.adrreports.eu. The reports come directly from the European Union (EU) medicines safety database EudraVigilance, and are one of the many types of data used by regulators to monitor the benefits and risks of a medicine once authorised. The launch of the new website is part of the Agency’s continuing efforts to ensure EU regulatory processes are transparent and open and is a key step in the implementation of the EudraVigilance access policy.

The information published today relates to approximately 650 medicines and active substances authorised through the centralised procedure, which is managed by the Agency. Information on the website is presented in the form of a single report per medicine or active substance. Each report pulls together the total number of individual suspected side effect reports submitted to EudraVigilance by Member States and marketing-authorisation holders. These aggregated data can be viewed by age group, sex, type of suspected side effect and by outcome. Within a year the Agency aims to additionally publish suspected side effect reports for common drug substances used in nationally authorised medicines.

A side effect (also known as an adverse drug reaction) includes side effects arising from use of a medicine within the terms of the marketing authorisation as well as from use outside the terms of the marketing authorisation, including overdose, misuse, abuse and medication errors, and those associated with occupational exposure.

All information on the website relates to suspected side effects. Suspected side effects may not be related to or caused by the medicine, and as a result, the published information cannot be used to determine the likelihood of experiencing a side effect or as an indication that a medicine is harmful. All users of the website are asked to read and accept a disclaimer explaining how to understand the information before they view a web report.

Medicines are an important part of modern healthcare, providing effective treatments for many diseases and conditions. For a medicine to be authorised for use in the EU the benefits of the medicine must always outweigh the risks.

Today’s launch also highlights the importance of side effect reporting and pharmacovigilance in safeguarding public health within the EU. Side-effect reporting is a key element in ensuring the detection of new or changing safety issues, and the Agency continues to further strengthen its work with partners and stakeholders across Europe to ensure a robust system for safety signal detection.

In June, the Agency will launch the website in the remaining 22 official EU languages.

Press release issued May 31st, 2012 on the EMA website – http://www.ema.europa.eu