U ¿du'@sdZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm Z dd lm Z dd lm Z dd lm Z dd lmZdd lmZddlmZddlmZGdddeZdddZdddZdddZdS)z> Appraise evaluation framework See LICENSE for usage details )datetime) BaseCommand) CommandError)Dataset)_create_uniform_task_map)_identify_super_users)_load_campaign_manifest)_process_campaign_agendas)_process_campaign_teams)_process_market_and_metadata)_process_users)_validate_language_codes)CAMPAIGN_TASK_TYPES)generate_confirmation_tokenc@s eZdZdZddZddZdS)Commandz+Initialises campaign based on manifest filecCsb|jddtdd|jdtdddd|jd tdd d d|jd d ddd|jdd ddddS)N manifest_jsonz manifest-jsonz%Path to manifest file in JSON format.)metavartypehelpz --csv-outputz--csvz4Path used to create CSV file containing credentials.)rdefaultrrz --xlsx-outputz--xlsxz6Path used to create Excel file containing credentials.z--include-completed store_trueFz5Include completed tasks in task agenda re-assignment.)actionrrz--task-confirmation-tokenszaGenerate valid task confirmation tokens needed for integration with external crowd sourcing apps.) add_argumentstr)selfparserrY/var/www/rival/public_html/translation-eval/Campaign/management/commands/init_campaign.py add_argumentss@zCommand.add_argumentsc Os|d}|jd||d}|jd||rX|dsXtd||d}|jd||r|d std |t|}t||jd }|d  }|d d} t ||||| |jd dS)NrzJSON manifest path: {0!r} csv_outputzCSV output path: {0!r}z.csvz,csv_output {0!r} does not point to .csv file xlsx_outputzExcel output path: {0!r}z.xlsxz.xlsx_output {0!r} does not point to .xlsx file)stdoutinclude_completedtask_confirmation_tokensF) getr!writeformatlowerendswithrr_create_context_init_campaign) rargsoptionsrrr manifest_datacontextonly_activatedconfirmation_tokensrrrhandleBs4     zCommand.handleN)__name__ __module__ __qualname__rrr1rrrrrs'rTFNc Csf|d}td|t}|dk r4|d|dt||d|d|dd|dk rb|d|S) aInitialises campaign based on manifest data. Parameters: - context:dict[str]->any dictionary containing manifest data; - csv_output:str path to CSV output file, or None; - xlsx_output:str path to Excel output file, or None; - only_activated:bool only include activated tasks for agenda creation; - confirmation_tokens:bool export valid task confirmation tokens. ALL_LANGUAGESzAll languages:NzIdentified superuser: {0}r CAMPAIGN_NAME) domain_name corpus_namez#Processed Market/Metadata instances)printrr%r&r ) r.rr r/r0 skip_agendasr!r5Z superusersrrrr*is  0r*c Cs|rFt|ddd}||dW5QRX|dk rF|d||rt|dd}||d W5QRX|dk r|d |dS) aExport credentials to screen, CSV and Excel files. Parameters: - export_data:Dataset contains triples or 4-tuples (username, password, url, [token]); - csv_output:str path to CSV output file, or None; - xlsx_output:str path to Excel output file, or None. w)modenewlineZcsvNzExported CSV file: {0!r}wb)r=ZxlsxzExported Excel file: {0!r})openr%exportr&)Z export_datarr r!out_filerrr_export_credentialss rCc Csdti}g}t}i}|dD]T}|\}}} } } |||||||f|| } | | | |d|||f<qt|d|krd} |dk r|dn |dd} | tkrd| d t }t |||d |d |d |d |d|| |ddd }|S)zCreate context from manifest JSON. Parameters: - manifest_data:dict[str]->any dictionary containing manifest data; uniformTASKS_TO_ANNOTATORS REDUNDANCY TASK_TYPEDirectNzNo task type found in the manifest file, assuming it is "Direct". If this is incorrect, define "TASK_TYPE" in the manifest file.z6Unrecognized TASK_TYPE '{0}'. Supported tasks are: {1}z, CAMPAIGN_KEYr6 CAMPAIGN_NO CAMPAIGN_URL TASK_OPTIONSr<) r5rIr6rJrKrFrErGrL) rsetaddappendr r%r$rr&joinkeys ValueError)r-r!Z GENERATORSr5ZALL_LANGUAGE_CODESrEZ pair_data source_code target_coder=Znum_annotatorsZ num_tasks generatorrG_msgr.rrrr)s\       r))TFFN)N)N)__doc__rdjango.core.management.baserrZtablibrCampaign.utilsrrrr r r r r rDashboard.utilsrrr*rCr)rrrrs,              U U