U
¿dV @ sx d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddl m
Z
ddl m Z dd l
mZ dd
lmZ dd lmZ dd lmZ dd
lmZ ddlmZ dZdZ dZ dZ dZ dZ dZ!dZ"dZ#dZ$dZ%dZ&ee'dZ(dd Z)G dd dej*Z+G d d d Z,G d d d ej*Z-G d d! d!e-Z.G d"d# d#e-Z/G d$d% d%e-Z0G d&d' d'e0Z1G d(d) d)e0Z2G d*d+ d+e1Z3d,S )-z>
Appraise evaluation framework
See LICENSE for usage details
)datetime timedelta)SequenceMatcher)
format_exc)Set)User)ValidationError)models)escape) format_lazy)utc)
ugettext_lazy) _get_logger
d i i 2 ))ZSRC Source text)ZTGT Target text)REFzReference text)BADz
Bad reference)ZCHKzRedundant check)namec C s8 | d }| d d }| d d }| d }t ||||dS )zD
Converst the given value in secodns to datetime.timedelta.
iQ i < )dayshoursminutessecondsr )value_daysZ_hoursZ_minsZ_secs r" J/var/www/rival/public_html/translation-eval/EvalData/models/base_models.pyseconds_to_timedelta1 s
r$ c @ sd e Zd ZdZejdeedeededdZ ejde
edeede
ddZ dd Z d
d Z
d S )
ObjectIDz6
Encodes an object type and ID for retrieval.
Tz Type name(max. {value} characters)r )db_index
max_length verbose_name help_textz
Primary IDc C s d}dzxz@d | j| j}ddlm}m}m}m}m}m }m
} t |}W n2 d | j| j}
t
|
t
t Y nX W 5 | S X )zO
Returns actual object instance for current ObjectID instance.
Nz{0}.objects.get(id={1})r )DataAssessmentTaskDirectAssessmentTaskDirectAssessmentContextTask DirectAssessmentDocumentTaskMultiModalAssessmentTask PairwiseAssessmentDocumentTaskPairwiseAssessmentTaskzObjectID {0}.{1} invalid)formattypeName primaryIDZEvalData.modelsr, r- r. r/ r0 r1 r2 evalLOGGERwarnr ) selfinstance_coder, r- r. r/ r0 r1 r2 _msgr" r" r# get_object_instanceO s $
z ObjectID.get_object_instancec C s t | jd | j d | j S )N.)stridr4 r5 r9 r" r" r# __str__p s zObjectID.__str__N)__name__
__module__ __qualname____doc__r
CharFieldMAX_TYPENAME_LENGTH_fr4 MAX_PRIMARYID_LENGTHr5 r= rB r" r" r" r# r% < s !r% c @ s. e Zd ZdZe Zedd Zedd ZdS )AnnotationTaskRegistryz
Keeps a registry of known annotation task types.
Use @AnnotationTaskRegistry.register decorator to register class.
c C s | j }tj| | S )z7
Add annotation task type to registry.
)rC rL _ANNOTATION_TASK_REGISTRYadd)obj_namer" r" r# register} s z AnnotationTaskRegistry.registerc C s t jS )z8
Get annotation task types in registry.
)rL rM r" r" r" r# get_types s z AnnotationTaskRegistry.get_typesN) rC rD rE rF setrM staticmethodrQ rR r" r" r" r# rL t s
rL c s e Zd ZdZejddeddZejddeddZejddeddZ ejdded dZ
ejdded
dZ ej ddded d Z
ej ddded
d Zej dddedd ZejedejdddeddZejeddejddddedd Zejeddejddddedd Zejeddejddddedd Zejeddejddddedd Zejdded d Zejdd dd ZG d d! d!Zd"d# Z d$d% Z d&d' Z d(d) Z d*d+ Z d,d- Z! fd.d/Z"d0d1 Z# Z$S )2 BaseMetadataz7
Abstract base metadata for all object models.
TFz Date created) auto_now_addeditabler* zDate activatedblanknullr* zDate completedz Date retiredz
Date modifiedz
Activated?)rY r( defaultr* z
Completed?zRetired?z"%(app_label)s_%(class)s_created_byz%(app_label)s_%(class)ssz
Created by)r( on_deleterW related_namerelated_query_namer* z$%(app_label)s_%(class)s_activated_byz Activated by)rY r( r\ rW rZ r] r^ r* z$%(app_label)s_%(class)s_completed_byz Completed byz"%(app_label)s_%(class)s_retired_byz
Retired byz#%(app_label)s_%(class)s_modified_byz Modified byzRaw data)rY rW r* )rY r[ rW c @ s e Zd ZdZdgZdS )zBaseMetadata.MetaT _str_nameNrC rD rE abstractorderingr" r" r" r# Meta s rd c C sX t jtd}|| _|r |nd| _|| _|r2|nd| _|| _|rF|nd| _ |
dS )zz
Sets boolean states for current model instance.
Also sets respective dates for all three states.
)tzinfoN) r utcnowreplacer
activated
dateActivated completed
dateCompletedretired dateRetiredsave)r9 rh rj rl Zutc_nowr" r" r# _set_boolean_states s z BaseMetadata._set_boolean_statesc C s | ddd dS )zy
Sets activated=True for current model instance.
This implies completed=False and retired=False.
TFNro rA r" r" r# activate s zBaseMetadata.activatec C s | ddd dS )zy
Sets completed=True for current model instance.
This implies activated=False and retired=False.
FTNrp rA r" r" r# complete s zBaseMetadata.completec C s | ddd dS )zz
Sets retired=True for current model instance.
This implies activated=False and completed=False.
FTNrp rA r" r" r# retire s zBaseMetadata.retirec C s* z| W dS tk
r$ Y dS X dS )z7
Validates the current model instance.
TFN)
full_cleanr rA r" r" r# is_valid( s
zBaseMetadata.is_validc C s d | jj| jS )zF
Generate human readable name for use with __str__().
z{0}[{1}])r3 __class__rC r@ rA r" r" r# _generate_str_name3 s z BaseMetadata._generate_str_namec s~ | j rh| }| j|kr || _tjj| jj| j d}| shtjj | jj| j d}d
|j }t | t
t| j|| dS )z
For object instances with an ID, we precompute the _str_name
attribute so that future __str__() lookups are efficient.
Also, we ensure that a matching ObjectID binding is created.
)r4 r5 z Created serialized ObjectID:{0}N)r@ rw r` r% objectsfilterrv rC existscreater3 r7 infosuperrU rn )r9 argskwargsZ _new_nameqsZ _serializedr< rv r" r# rn 9 s
zBaseMetadata.savec C s | j dkr| | j S )Nr_ )r` rn rA r" r" r# rB R s
zBaseMetadata.__str__)%rC rD rE rF r
DateTimeFieldrI Z dateCreatedri rk rm Z dateModified BooleanFieldrh rj rl
ForeignKeyr PROTECTZ createdByZ activatedByZ completedByZ retiredByZ
modifiedBy TextFieldZrawDatar` rd ro rq rr rs ru rw rn rB
__classcell__r" r" r r# rU s
rU c s e Zd ZdZejde e d dddZejee de e
dedd Z ejee d
e e
dedd Z ejee d e e
dedd Z
d fd
d Z fddZ fddZdd Z ZS )Marketz*
Models a language/locale market.
FT)r) rW uniquezSource languager& r' r) r* r+ zTarget languagez Domain nameNc sR d | j| j| j}tjj|d}| r>tt t
d|dt t| | dS )zD
Verifies that desired marketID is still available.
{0}_{1}_{2}marketIDz8Market with identical marketID ("{mID}") already exists.)ZmIDN)
r3 sourceLanguageCodetargetLanguageCode
domainNamer rx ry rz r rI rJ r} clean_fields)r9 exclude
_new_marketID_market_instancer r" r# r ~ s zMarket.clean_fieldsc s0 d | j| j| j}|| _tt| j|| d S )Nr )r3 r r r r r} r rn )r9 r~ r r r r" r# rn s z Market.savec sr d | j| j| j}tjj|d}t| dr6| jdkrD| rddS n |
}|dk rd| j |j krddS t t|
S )zV
Validates the current Market instance, checking marketID uniqueness.
r r r r_ FN)r3 r r r r rx ry hasattrr rz getr@ r} ru )r9 Z_expected_marketIDr Z_market_instance_objr r" r# my_is_valid s zMarket.my_is_validc C s | j S )Nr rA r" r" r# rw s zMarket._generate_str_name)N)rC rD rE rF r
rG MAX_LANGUAGECODE_LENGTHMAX_DOMAINNAME_LENGTHr rI rJ r r r r rn r rw r r" r" r r# r Z s2
r c @ s e Zd ZdZejedejdZej e
e de e de
ddZ
ej ee de e deddZej ee d e e deddZG d
d d Zd d
ZdS )Metadataz.
Models metadata associated to tasks.
Tr( r\ z Corpus namer& r' r z Version infoZSourcec @ s e Zd ZdgZdZdS )z
Metadata.Metar` zMetadata recordN)rC rD rE rc r* r" r" r" r# rd s rd c C s d | jj| jj| j| jS )Nz{0}->{1}/{2}["{3}"])r3 marketr r
corpusName versionInforA r" r" r# rw s zMetadata._generate_str_nameN)rC rD rE rF r
r r r r rG MAX_CORPUSNAME_LENGTHrI rJ r MAX_VERSIONINFO_LENGTHr MAX_SOURCE_LENGTHsourcerd rw r" r" r" r# r s& r c st e Zd ZdZejededdZeje de
eddZ ej e
dejdZG d d
d
Z fd d Zd
d Z ZS )EvalItemzu
Abstract base class for evaluation data items.
Models corresponding, 1-based, integer ID and metadata.
zItem IDz (1-based))r* r+ Tz Item type)choicesr( r) r* r c @ s e Zd ZdZdgZdS )z
EvalItem.MetaTr` Nra r" r" r" r# rd s rd c sD t | dr| j sdS t| jts(dS | jdk r6dS tt| S )zR
Validates the current evaluation item, checking ID and metadata.
metadataF )r r ru
isinstanceitemIDintr} r rA r r" r# ru s
zEvalItem.is_validc C s d | jj| j| jS )Nz {0}.{1}[{2}])r3 rv rC r r rA r" r" r# rw s
zEvalItem._generate_str_name)rC rD rE rF r
PositiveIntegerFieldrI r rG SET_ITEMTYPE_CHOICESMAX_ITEMTYPE_LENGTHZitemTyper r r r rd ru rw r r" r" r r# r s r c s` e Zd ZdZejeedeededdZ ej
e edeede ddZ fddZ
ZS ) TextSegmentz'
Models a single text segment.
z
Segment IDr& r' r z Segment textc s@ t | jtdsdS t| j}|dk s.|tkr2dS tt| S )zL
Validates the current TextSegment instance, checking text.
This is a test sentence.Fr )r segmentTexttypelenMAX_SEGMENTTEXT_LENGTHr} r ru r9 _lenr r" r# ru # s
zTextSegment.is_valid)rC rD rE rF r
rG MAX_SEGMENTID_LENGTHrI rJ Z segmentIDr r r ru r r" r" r r# r s r c s e Zd ZdZejeedeededdZ ej
deddZ ejeed eededdZ ej
ded
dZ
fd d Z ZS )
TextPairz-
Models a pair of two text segments.
z Source IDr& r' r Tr rY r* z Target IDr c sr t | jtdrdS t| j}|dk s.|tkr2dS t | jtdrFdS t| j}|dk s`|tkrddS tt| S )zI
Validates the current TextPair instance, checking text.
r Fr ) r
sourceTextr r r
targetTextr} r ru r r r" r# ru O s
zTextPair.is_valid)rC rD rE rF r
rG r rI rJ ZsourceIDr r ZtargetIDr ru r r" r" r r# r 3 s( r c s e Zd ZdZejeedeededdZ ej
deddZ ejdeed eededd
Z ej
dded d Z
ej
dded
d Zej
ddedd Zej
ddedd Zej
ddedd Zdd Zd ddZd ddZdd Z fdd Z ZS ) TextSegmentWithTwoTargetsz=
Models a text segment with one or two sub-segments.
z Item ID (1)r& r' r TzText (1)r z Item ID (2))rZ r) r* r+ zText (2)rX zContext (left)zContext (right)zTarget context (1)zTarget context (2)c C s | j p
| jS )z3Checks if the current segment has context provided.) contextLeft contextRightrA r" r" r# has_context s z%TextSegmentWithTwoTargets.has_contextr c C s& | j r"|| j d| d S dS )z
Returns formatted last 5 sentences from the left context.
Use separator='
' to show one sentence per line.
Nr_ )r joinsplit)r9 last separatorr" r" r# context_left s z&TextSegmentWithTwoTargets.context_leftc C s$ | j r || j dd| S dS )z
Returns formatted first 5 sentences from the right context.
Use separator='
' to show one sentence per line.
r Nr_ )r r r )r9 firstr r" r" r#
context_right s z'TextSegmentWithTwoTargets.context_rightc C sD | j r | js| j | jfS t| j }t| j }td||}d}d}| D ]\}}}} }
|dkr|dd||| 7 }|dd|| |
7 }qP|dkr|dd||| d 7 }|dd|| |
d 7 }qP|dkr |d d|| |
d 7 }qP|d
krP|d d||| d 7 }qP| | fS ) a
Returns the pair of texts with HTML tags highlighting token differences.
Both texts must be non empty.
HTML tags in both texts will be escaped automatically.
For example,
'a b c d e' and 'a B c e f'
will become:
'a b c d e',
'a B c e f'
Nr_ equalr rg z zinsertz deletez ) target1Text target2Textr r r get_opcodesr strip) r9 Ztoks1Ztoks2matcherZtext1Ztext2tagi1i2j1j2r" r" r# target_texts_with_diffs s6
z1TextSegmentWithTwoTargets.target_texts_with_diffsc s t | jtdrdS t| j}|dk s.|tkr2dS trttdkrt | jtdrVdS t| j}|dk sp|tkrtdS | j| jkrdS tt| S )zb
Validates the current TextSegmentWithTwoTargets instance, checking
text.
r Fr r ) r r r r r r r} r ru r r r" r# ru s
z"TextSegmentWithTwoTargets.is_valid)r r )r r )rC rD rE rF r
rG r rI rJ Z target1IDr r Z target2IDr r r Ztarget1ContextLeftZtarget2ContextLeftr r r r ru r r" r" r r# r d s\
+r N)4rF r r difflibr tracebackr typingr django.contrib.auth.modelsr django.core.exceptionsr django.dbr
django.utils.htmlr django.utils.textr rJ Zdjango.utils.timezoner
django.utils.translationr rI ZAppraise.utilsr r r r r r r r r Z MAX_REQUIREDANNOTATIONS_VALUErH rK r rC r7 r$ Modelr% rL rU r r r r r r r" r" r" r# sJ
8 Lb&/"1