U 4Af0@snddlZddlmZmZer>ddlmZmZddlmZm Z dZ ddZ d d Z d d Z d dZddZdS)N)is_sklearn_availablerequires_backends)pearsonr spearmanr)f1_scorematthews_corrcoefu This metric will be removed from the library soon, metrics should be handled with the 🤗 Evaluate library. You can have a look at this example script for pointers: https://github.com/huggingface/transformers/blob/main/examples/pytorch/text-classification/run_glue.pycCs"tttttd||kS)Nsklearn)warningswarnDEPRECATION_WARNING FutureWarningrsimple_accuracyZmean)predslabelsrF/tmp/pip-unpacked-wheel-zw5xktn0/transformers/data/metrics/__init__.pyrs  rcCs@tttttdt||}t||d}||||ddS)Nr )Zy_trueZy_pred)accf1 acc_and_f1)r r r r rrrr)rrrrrrrr$s     rcCsFtttttdt||d}t||d}||||ddS)Nr rr)ZpearsonrZcorr)r r r r rpearson_and_spearmanrr)rrZ pearson_corrZ spearman_corrrrrr0s   rcCs:tttttdt|t|ksBtdt|dt||dkrXdt||iS|dkrndt ||iS|dkrt ||S|d krt ||S|d krt ||S|d krd t ||iS|d krdt ||iS|dkrdt ||iS|dkrdt ||iS|dkrdt ||iS|dkr.dt ||iSt |dS)Nr /Predictions and labels have mismatched lengths  and ZcolaZmcczsst-2rZmrpczsts-bZqqpZmnlizmnli/acczmnli-mmz mnli-mm/accZqnliZrteZwnliZhans) r r r r rglue_compute_metricslenAssertionErrorrrrrKeyErrorZ task_namerrrrrr<s4  ,      rcCsdtttttdt|t|krBtdt|dt||dkrXdt||iSt |dS)Nr rrZxnlir) r r r r rxnli_compute_metricsr ValueErrorrrrrrrrZs  r)r utilsrrZ scipy.statsrrZsklearn.metricsrrr rrrrrrrrr s