Interested in Contributing?

Scored Systems

System Submitter System Notes Constraint Run Notes BLEU BLEU (11b) BLEU-cased BLEU-cased (11b) TER z BLEU-cased-norm zz BEER 2.0 zzz CharactTER
UCAM_primary_multifrontend  (Details) Juan
University of Cambridge
Hierarchical phrase based translation with WFSTs. yes 3 front end preprocessing: stanford corenlp, morfessor, stem+postag (treetagger). 1st pass lattices 5g rescored and union of lattices lmbr rescored.

25.9

25.9

24.6

24.6

0.656

UCAM_secondary_1frontend  (Details) Juan
University of Cambridge
Hierarchical phrase based translation with WFSTs. yes 1 front end preprocessing: stanford corenlp. 1st pass lattices 5g rescored and lmbr rescored.

25.9

25.9

24.5

24.5

0.655

uedin-wmt13-ru-en  (Details) Nadir
University of Edinburgh
Phrase-based Moses yes [1288-14]

25.9

25.9

24.3

24.3

0.647

QCRI-MES  (Details) Hassan
Qatar Computing Research Institute
QCRI-Munich-Edinburgh-Stuttgart yes

25.9

25.9

24.2

24.2

0.650

CMU-primary  (Details) chrisdyer
Carnegie Mellon University
Hiero system, CRF transliteration, synthetic phrases, MIRA, MBR, Brown-cluster LM yes

25.4

25.4

24.1

24.1

0.652

balagur  (Details) shad
Yandex School of Data Analysis
Phrase-based statistical machine translation system yes Preprocessing: spellchecker; allignment: normalized russian; postprocessing: transliteration

25.2

25.2

23.7

23.7

0.653

LIA  (Details) huets
LIA - UniversitÚ d'Avignon - France
Factored phrase-based translation model yes Factored translation model + transliteration

25.1

25.1

23.5

23.5

0.654

MES-QCRI:ru-en  (Details) Nadir Durrani
University of Edinburgh
MES: Munich-Edinburgh-Stuttgart yes OSM (Operation Sequence Model) with transliteration

24.5

24.5

22.9

22.9

0.661

umd-ru-en  (Details) vlad
umd
yes

24.4

24.4

22.7

22.7

failed

OmniFluent Translate Russian-to-English constrained  (Details) OmniFluent
SAIC/Leidos
OmniFluent Translate - a hybrid MT system, combining statistical MT and rule-based processing. yes ru-en EVAL-PRIMARY-1

24.2

24.2

22.5

22.5

0.668

JHU Ru-En  (Details) jhushua
Johns Hopkins University
yes Pruned Hiero model, data selection, tuned on extended dev set

24.3

24.3

22.5

22.5

0.658

uedin-syntax  (Details) uedin-maria
University of Edinburgh
yes

23.8

23.8

22.5

22.5

0.667

umd-ru-en  (Details) vlad
umd
yes primary,sparse

23.8

23.8

22.1

22.1

failed

OmniFluent Translate Russian-to-English unconstrained  (Details) OmniFluent
SAIC/Leidos
OmniFluent Translate - a hybrid MT system, combining statistical MT and rule-based processing. This system is unconstrained because the Multi-UN Russian-English corpus is used to train a second phrase table. no ru-en EVAL-UNCONSTRAINED-1

23.8

23.8

22.1

22.1

0.671

OmniFluent Translate Russian-to-English constrained  (Details) OmniFluent
SAIC/Leidos
OmniFluent Translate - a hybrid MT system, combining statistical MT and rule-based processing. yes ru-en EVAL-PRIMARY-2

23.7

23.7

22.1

22.1

0.671

OmniFluent Translate Russian-to-English constrained  (Details) OmniFluent
SAIC/Leidos
OmniFluent Translate - a hybrid MT system, combining statistical MT and rule-based processing. yes ru-en EVAL-PRIMARY-3

23.8

23.8

22.0

22.0

0.671

PROMT Hybrid  (Details) Alex Molchanov
PROMT LLC
no primary

22.9

22.9

21.9

21.9

0.670

FDA  (Details) bicici
Instance selection with Feature Decay Algorithms (FDA) and phrase-based translation with Moses. yes

22.2

22.2

21.2

21.2

0.685

cu-zeman  (Details) zeman
Charles University in Prague, ┌FAL
yes secondary; not for manual evaluation; normalized; constrained; s.evaluator.05f2a097.20130430-1206; A:ru-lemma-en-lemma DEV:wmt2012 LM:news8all LM:news8euro LMA:en+stc LMO:6 S:ru T:en TM:news8euro.ru-en TST:wmt2013; 0.1975 [0.1915,0.2032]

20.3

20.3

19.1

19.1

0.706

cu-zeman  (Details) zeman
Charles University in Prague, ┌FAL
yes primary; unnormalized; constrained; s.evaluator.05f2a097.20130430-1206; A:ru-lemma-en-lemma DEV:wmt2012 LM:news8all LM:news8euro LMA:en+stc LMO:6 S:ru T:en TM:news8euro.ru-en TST:wmt2013; 0.1975 [0.1915,0.2032]

19.3

19.3

18.1

18.1

0.712

Moses RU-EN  (Details) Karel Bilek
UFAL MFF UK
no

22.4

22.4

17.4

17.4

0.674

Moses RU-EN  (Details) Karel Bilek
UFAL MFF UK
no

10.9

10.9

10.0

10.0

0.786

STC7  (Details) stc7
no

failed

failed

failed

failed

failed