U 4Af@stdZddlZddlmZmZmZddlmZddlm Z ddl m Z m Z m Z mZmZddlmZGd d d e ZdS) z& Image/Text processor class for FLAVA N)ListOptionalUnion) ImageInput)ProcessorMixin) BatchEncodingPaddingStrategyPreTokenizedInput TextInputTruncationStrategy) TensorTypecseZdZdZddgZdZdZdfdd Zdee ee e e e e e e fee eeefe eeefeeeeeeeeeeeeeeeeeeee eefd d dZddZddZeddZeddZeddZZS)FlavaProcessora Constructs a FLAVA processor which wraps a FLAVA image processor and a FLAVA tokenizer into a single processor. [`FlavaProcessor`] offers all the functionalities of [`FlavaImageProcessor`] and [`BertTokenizerFast`]. See the [`~FlavaProcessor.__call__`] and [`~FlavaProcessor.decode`] for more information. Args: image_processor ([`FlavaImageProcessor`], *optional*): The image processor is a required input. tokenizer ([`BertTokenizerFast`], *optional*): The tokenizer is a required input. image_processor tokenizerZFlavaImageProcessor)Z BertTokenizerZBertTokenizerFastNc sld}d|kr"tdt|d}|dk r.|n|}|dkrBtd|dkrRtdt|||j|_dS)Nfeature_extractorzhThe `feature_extractor` argument is deprecated and will be removed in v5, use `image_processor` instead.z)You need to specify an `image_processor`.z"You need to specify a `tokenizer`.) warningswarn FutureWarningpop ValueErrorsuper__init__rZcurrent_processor)selfrrkwargsr __class__N/tmp/pip-unpacked-wheel-zw5xktn0/transformers/models/flava/processing_flava.pyr,s zFlavaProcessor.__init__TFr)imagestextadd_special_tokenspadding truncation max_lengthstridepad_to_multiple_ofreturn_image_maskreturn_codebook_pixelsreturn_token_type_idsreturn_attention_maskreturn_overflowing_tokensreturn_special_tokens_maskreturn_offsets_mapping return_lengthverbosereturn_tensorscKs|dkr|dkrtd|dk rP|jf|||||||| | | |||||d|}|dk rr|j|f| | |d|}|dk r|dk r|||S|dk r|Sttf||dSdS)a  This method uses [`FlavaImageProcessor.__call__`] method to prepare image(s) for the model, and [`BertTokenizerFast.__call__`] to prepare text for the model. Please refer to the docstring of the above two methods for more information. Nz?You have to specify either text or images. Both cannot be none.)r r!r"r#r$r%r&r)r*r+r,r-r.r/r0)r'r(r0)dataZ tensor_type)rrrupdaterdict)rrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.r/r0rencodingZimage_featuresrrr__call__?sL zFlavaProcessor.__call__cOs|jj||S)z This method forwards all its arguments to BertTokenizerFast's [`~PreTrainedTokenizer.batch_decode`]. Please refer to the docstring of this method for more information. )r batch_decoderargsrrrrr6szFlavaProcessor.batch_decodecOs|jj||S)z This method forwards all its arguments to BertTokenizerFast's [`~PreTrainedTokenizer.decode`]. Please refer to the docstring of this method for more information. )rdecoder7rrrr9szFlavaProcessor.decodecCs"|jj}|jj}tt||S)N)rmodel_input_namesrlistr3fromkeys)rZtokenizer_input_namesZimage_processor_input_namesrrrr:sz FlavaProcessor.model_input_namescCstdt|jS)Nzg`feature_extractor_class` is deprecated and will be removed in v5. Use `image_processor_class` instead.)rrrimage_processor_classrrrrfeature_extractor_classs z&FlavaProcessor.feature_extractor_classcCstdt|jS)Nz[`feature_extractor` is deprecated and will be removed in v5. Use `image_processor` instead.)rrrrr>rrrrs z FlavaProcessor.feature_extractor)NN)NNTFFNrNNNNNFFFFTN)__name__ __module__ __qualname____doc__ attributesr=Ztokenizer_classrrrrr r rboolstrr r intr r5r6r9propertyr:r?r __classcell__rrrrrsf    D  r)rCrtypingrrrZ image_utilsrZprocessing_utilsrZtokenization_utils_baserr r r r utilsr rrrrrs