Posted in English

Chaos Barks All Night!

So I was asked a question about something I said in the post about Linguee the other day. I said that I thought Google Translate (aka Gtranslate) was better than Deepl for certain things. Both are translation apps, but Deepl is usually thought of as better at European portuguese, so people will usually recommend it. That’s usually good advice: if you didn’t know any Portuguese and you wanted to translate something into European Portuguese you’re usually better off with Deepl.

Deepl (left) correctly translates this book title into European Portuguese while Gtranslate comes up with the Brazilian version.

So why did I say Gtranslate was better? Because we’re language students, so I think we usually don’t want the app to do all the work for us. English-Portuguese translation isn’t something we need often. But what we do want is the opposite: we want it to check our work by translating it back into English because of it can understand it then that’s a pretty good indicator that we got it right.

So for example, if I’ve written “Este carro é muito carro”, what I want is for it to say “this car is very car”, so I know I’ve goofed; I’ve put an extra r in “caro”. If it translated it correctly as “this car is very expensive”, I wouldn’t notice my idiocy.

And so I thought Deepl would be less useful because it is AI and it’s cleverer, which means if you did something like this it would be more likely to guess what you meant and translate it correctly, hiding the error and lulling you into a false sense of security.

Líliana, (whose website The Talking Sardines caters for early stage learners around A1/A2), asked for an example so I tried a few. Want to see if I was right? Read on!

Let Battle Commence

OK, so let’s put both apps in the Thunderdome together and see which emerges victorious. Two apps enter, one app leaves. In each round, I have presented the translators with a sentence with a couple of minor errors. Remember, it’s a backwards competition. What I want is for it to give the wrong answer because that’s more useful than hiding the mistake.

In each case, Deepl on the left, Gtranslate on the right

“Gosto de escreve contas de fada”

Escreve should be an infinitive “escrever” and a fairy tale is a “conto de fado”, not a “conta de fado”

Deepl responded to “conta de fada” better, by translating it literally. Gtranslate is cleverer (ie less useful) because it has hidden the mistake, but Gtranslate also makes change suggestions – in the middle of the screen it asks: “Será que quis dizer…”, meaning “Did you mean to say…” and there it gets bonus points for spotting the grammatical error in escrever and suggesting I change it. Great!

Result: tie! Each spotted one mistake and ignored the other.

Well, this is a surprise. Maybe I was too harsh on Deepl?

“Os caos ladram tudo a noite”

The word cão (Dog) has one of those weird plurals: cães. The word “caos” does exist but it means “chaos”. Oh and and obviously I’ve used “tudo” (everything) in place of “toda” (all).

This would make a great album title, wouldnt it? Gtranslate has a helpful suggestion, but both have correctly translated one mistake and erased the other

Result: tie! Both get one right, one wrong. Whether or not you want it to spoon feed the answer is a matter of taste so I don’t give Gtranslate extra points for that.

“Estou na quinda a trater dos porcos”

Quinta and tratar are both spelled wrong

Deepl is just freestlying. I don’t even know what it’s thinking there. Gtranslate has translated it correctly (not helpful) but it has very cleverly and helpfully suggests that I fix both spelling errors. Great work!

Result: Gtranslate is victorious. Initially it loses marks for ostensibly ignoring the errors, but it scores top marks for prompting me to fix both, not just the first. Deepl only highlights one mistake.

“Estou na fazendo a elementar os gansos”

Fazenda is another word for farm (I think I’m right in saying it’s more specifically a larger, family owned farm), whereas fazendo is just the present participle of fazer. And the verb I’m looking for is “alimentar”.

Both helpfully mistranslated both words. Gtranslate is correctly able to suggest the correction for one of them at least.

Result: tie! Both have done their job correctly, translating garbage into garbage. Whether or not you want the extra help Gtranslate gives you is a matter of taste.

“O gato está a cazar rattos”

Caçar and ratos are both spelled wrong.

Deepl tries to be clever and interpret cazar but guesses the z is supposed to be a g. It has no idea what I am talking about with the extra t in rattos. Good. Gtranslate cleverly translates both words correctly, which is unhelpful, but it redeems itself by suggesting corrections for both words.

Result: Deepl is victorious. Although gtranslate has clearly done a better job here, I think I would prefer Deepl’s confusion, prompting me to rethink what I’d written, so I’m reluctantly awarding it the laurels here.

“A mãe teve depressão pós-pato desde o nascimento do beber.”

Postpartum depression is missing an r and bebé has gained one.

Deepl helpfully produces surreal results on the first mistake but annoyingly airbrushes out the second. Gtranslate unhelpfully takes the first error in its stride but does a better job of highlighting the second. It also provides a suggested correction in which it suggests a spelling change, so between its two parts of its reply it has correctly flagged both errors.

Result: Gtranslate wins another round.

“O meu irmã está a assustar a um espectáculo”

Irmã is feminine and the “o meu” should match. The verb should be assistir, not assustar

Deepl is reliving childhood trauma. Well, that’s fine, at least it acknowledges something is wrong. Gtranslate keeps a level head, correctly mistranslates the word that is incorrect. It also offers a suggestion to harmonise the gender of irmã.

Result: Gtranslate is a clear winner since it gives a far more precise indication of what’s wrong without peeing in its pants.

Conclusion

As I said at the beginning, Deepl remains the best for English-Portuguese translation, but as the results show, in most cases, Gtranslate is better for reverse-translation in situations where you want to check your own written portuguese.

I was surprised by the results. I was expecting Deepl to be more accomplished at working around errors. It was far more hit and miss than that, but it’s undeniable in most cases that what Gtranslate offers is much more useful than what Deepl offers. You’re much more likely to be able to fix your errors that way.

Remember, this isn’t going to be enough on its own. My process is usually:

  • Read the text and correct obvious errors.
  • Paste into Gtranslate, correct what it mistranslates.
  • Paste into FLiP to check for syntactical errors. FLiP has its blind spots and will occasionally flag a valid word, but by and large it’s helpful.
  • Show to a teacher and/or post it here and wait for someone to tell me i have 38 more errors to fix.
Unknown's avatar

Author:

Just a data nerd

7 thoughts on “Chaos Barks All Night!

    1. Yes, I think that’s certainly true for Google translate. The reason I chose “The Girl on the Train” as an example is that that’s the name of an American book that has a different name in Portugal vs Brazil. Deepl knows its Portuguese name (“A Rapariga no Comboio”), so I think Deepl is using portuguese sources.

      Liked by 1 person

  1. Thank you so much for writing this article. I’ve shared it with my students!

    I’m wondering if Gtranslate would have won more rounds if you had used more common mistakes. I suspect Deep.l’s AI correction bias might have been more easily exposed.

    For instance, if I write “Vou comer uma tostada” (a classic mistake I’m yet to understand why it’s so persistent) instead of “Vou comer uma torrada”, Deep.l as clever little boy gives me “I’m going to have a toast” whereas Gtranslate says “I’m going to eat a tostada” thus telling me I’ve burnt by bread.

    Liked by 1 person

      1. Yes, Deep.l made the correct guess. If I were a student using your method of reverse translation, I would have thought my original text in Portuguese was correct. However, using GT I can see that it won’t translate “tostada”, probably because it doesn’t make much sense (the same usually happens with words that don’t exist), giving me a hint that my text in Portuguese is not correct.

        Liked by 1 person

Leave a comment