A conjoint analysis framework for evaluating user preferences in machine translation

dc.contributor.authorKirchhoff, K.
dc.contributor.authorCapurro, Daniel
dc.contributor.authorTurner, A. M.
dc.date.accessioned2020-01-14T01:28:59Z
dc.date.available2020-01-14T01:28:59Z
dc.date.issued2014
dc.description.abstractDespite much research on machine translation (MT) evaluation, there is surprisingly little work that directly measures users' intuitive or emotional preferences regarding different types of MT errors. However, the elicitation and modeling of user preferences is an important prerequisite for research on user adaptation and customization of MT engines. In this paper we explore the use of conjoint analysis as a formal quantitative framework to assess users' relative preferences for different types of translation errors. We apply our approach to the analysis of MT output from translating public health documents from English into Spanish. Our results indicate that word order errors are clearly the most dispreferred error type, followed by word sense, morphological, and function word errors. The conjoint analysis-based model is able to predict user preferences more accurately than a baseline model that chooses the translation with the fewest errors overall. Additionally we analyze the effect of using a crowd-sourced respondent population versus a sample of domain experts and observe that main preference effects are remarkably stable across the two samples
dc.format.extent1
dc.identifier.doi10.1007/s10590-013-9140-x
dc.identifier.issn0922-6567
dc.identifier.urihttps://doi.org/10.1007/s10590-013-9140-x
dc.identifier.urihttps://repositorio.uc.cl/handle/11534/27455
dc.issue.numeroNo. 1
dc.pagina.inicio17
dc.revistaMachine Translationes_ES
dc.rightsacceso restringido
dc.subjectEvaluationes_ES
dc.subjectMachine translationes_ES
dc.subjectPreference elicitationes_ES
dc.subjectUser modelinges_ES
dc.subjectComputer aided language translationes_ES
dc.subjectStatistical methodses_ES
dc.subjectBaseline modelses_ES
dc.subjectConjoint analysises_ES
dc.subjectMachine translationses_ES
dc.subjectQuantitative frameworkses_ES
dc.subjectWord order errorses_ES
dc.subjectErrorses_ES
dc.subject.ddc400
dc.subject.deweyLenguases_ES
dc.titleA conjoint analysis framework for evaluating user preferences in machine translationes_ES
dc.typeartículo
dc.volumenVol. 28
sipa.codpersvinculados3150
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
A conjoint analysis framework for evaluating user preferences in machine translation .pdf
Size:
22.22 KB
Format:
Adobe Portable Document Format
Description: