U ʗRe}�@s�dZddlZddlZddlZddlmZmZddlmZddl m Z mZmZm Z ddlmZmZmZmZmZmZddlmZdd d ddd ddddddgZdddddgZedd��ZGdd�de�ZGdd�ded�ZGdd�de�ZGd d �d e�Z Gd!d"�d"�Z!e!�Z"Gd#d$�d$e#�Z$Gd%d&�d&�Z%d'd�Z&Gd(d)�d)�Z'e'�Z(d*d�Z)Gd+d�d�Z*Gd,d�de�Z+Gd-d.�d.e�Z,Gd/d �d ee,d�Z-Gd0d�d�Z.Gd1d �d e-�Z/d2d3�Z0Gd4d5�d5e,�Z1Gd6d7�d7e-e1d�Z2dS)8z� pygments.lexer ~~~~~~~~~~~~~~ Base lexer classes. :copyright: Copyright 2006-2022 by the Pygments team, see AUTHORS. :license: BSD, see LICENSE for details. �N)� apply_filters�Filter)�get_filter_by_name)�Error�Text�Other� _TokenType)�get_bool_opt�get_int_opt�get_list_opt�make_analysator�Future�guess_decode)� regex_opt�Lexer� RegexLexer�ExtendedRegexLexer�DelegatingLexer�LexerContext�include�inherit�bygroups�using�this�default�words)s�utf-8)s��zutf-32)s��zutf-32be)s��zutf-16)s��zutf-16becCsdS)N��xrr��/builddir/build/BUILDROOT/alt-python38-pip-22.2.1-2.el8.x86_64/opt/alt/python38/lib/python3.8/site-packages/pip/_vendor/pygments/lexer.py�!�r"c@seZdZdZdd�ZdS)� LexerMetaz� This metaclass automagically converts ``analyse_text`` methods into static methods which always return float values. cCs(d|krt|d�|d<t�||||�S)N�analyse_text)r�type�__new__)�mcs�name�bases�drrr!r'*szLexerMeta.__new__N)�__name__� __module__�__qualname__�__doc__r'rrrr!r$$sr$c@s^eZdZdZdZdZgZgZgZgZ dZ dd�Zdd�Zdd �Z d d�Zdd d�Zdd�ZdS)ra� Lexer for a specific language. Basic options recognized: ``stripnl`` Strip leading and trailing newlines from the input (default: True). ``stripall`` Strip all leading and trailing whitespace from the input (default: False). ``ensurenl`` Make sure that the input ends with a newline (default: True). This is required for some lexers that consume input linewise. .. versionadded:: 1.3 ``tabsize`` If given and greater than 0, expand tabs in the input (default: 0). ``encoding`` If given, must be an encoding name. This encoding will be used to convert the input string to Unicode, if it is not already a Unicode string (default: ``'guess'``, which uses a simple UTF-8 / Locale / Latin1 detection. Can also be ``'chardet'`` to use the chardet library, if it is installed. ``inencoding`` Overrides the ``encoding`` if given. NrcKs�||_t|dd�|_t|dd�|_t|dd�|_t|dd�|_|�dd �|_|�d �pZ|j|_g|_ t |dd�D]}|�|�qpdS) N�stripnlT�stripallF�ensurenl�tabsizer�encoding�guess� inencoding�filtersr)�optionsr r0r1r2r r3�getr4r7r� add_filter)�selfr8�filter_rrr!�__init__aszLexer.__init__cCs(|jrd|jj|jfSd|jjSdS)Nzz)r8� __class__r,�r;rrr!�__repr__ms �zLexer.__repr__cKs&t|t�st|f|�}|j�|�dS)z8 Add a new stream filter to this lexer. N)� isinstancerrr7�append)r;r<r8rrr!r:ts zLexer.add_filtercCsdS)a~ Has to return a float between ``0`` and ``1`` that indicates if a lexer wants to highlight this text. Used by ``guess_lexer``. If this method returns ``0`` it won't highlight it in any case, if it returns ``1`` highlighting with this lexer is guaranteed. The `LexerMeta` metaclass automatically wraps this function so that it works like a static method (no ``self`` or ``cls`` parameter) and the return value is automatically converted to `float`. If the return value is an object that is boolean `False` it's the same as if the return values was ``0.0``. Nr)�textrrr!r%|szLexer.analyse_textFc s�t�t��s�jdkr$t��\�}nވjdkr�zddlm}Wn,tk rj}ztd�|�W5d}~XYnXd}tD].\}}��|�rt�t |�d�� |d�}q�qt|dkr�|��dd��} �� | �d �p�d d�}|�n(�� j��d��r �t d�d��n��d��r �t d�d�� dd �� dd ��j�rJ��n�j�r\��d ��jdk�rt��j��j�r��d ��s��d 7��fdd�} | �}|�s�t|�j��}|S)a= Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. r5�chardetr)rDzkTo enable chardet encoding guessing, please install the chardet library from http://chardet.feedparser.org/N�replaceir4ruz � � c3s$��D]\}}}||fVq dS�N)�get_tokens_unprocessed)�_�t�v�r;rCrr!�streamer�sz"Lexer.get_tokens..streamer)rA�strr4r�pip._vendorrD�ImportError� _encoding_map� startswith�len�decode�detectr9rEr1�stripr0r3� expandtabsr2�endswithrr7)r;rC� unfilteredrJrD�e�decoded�bomr4�encrN�streamrrMr!� get_tokens�sR � � zLexer.get_tokenscCst�dS)z� Return an iterable of (index, tokentype, value) pairs where "index" is the starting position of the token within the input text. In subclasses, implement this method as a generator to maximize effectiveness. N)�NotImplementedErrorrMrrr!rI�szLexer.get_tokens_unprocessed)F)r,r-r.r/r)�url�aliases� filenames�alias_filenames� mimetypes�priorityr=r@r:r%r`rIrrrr!r0s ;)� metaclassc@s$eZdZdZefdd�Zdd�ZdS)ra This lexer takes two lexer as arguments. A root lexer and a language lexer. First everything is scanned using the language lexer, afterwards all ``Other`` tokens are lexed using the root lexer. The lexers from the ``template`` lexer package use this base lexer. cKs0|f|�|_|f|�|_||_tj|f|�dSrH)� root_lexer�language_lexer�needlerr=)r;�_root_lexer�_language_lexer�_needler8rrr!r=�szDelegatingLexer.__init__cCs�d}g}g}|j�|�D]H\}}}||jkrP|rF|�t|�|f�g}||7}q|�|||f�q|rx|�t|�|f�t||j�|��S)N�)rjrIrkrBrT� do_insertionsri)r;rC�buffered� insertions� lng_buffer�irKrLrrr!rI�s �z&DelegatingLexer.get_tokens_unprocessedN)r,r-r.r/rr=rIrrrr!r�s c@seZdZdZdS)rzI Indicates that a state should include rules from another state. N�r,r-r.r/rrrr!r�sc@seZdZdZdd�ZdS)�_inheritzC Indicates the a state should inherit from its superclass. cCsdS)Nrrr?rrr!r@sz_inherit.__repr__N)r,r-r.r/r@rrrr!rv�srvc@s eZdZdZdd�Zdd�ZdS)�combinedz: Indicates a state combined from multiple states. cGst�||�SrH)�tupler')�cls�argsrrr!r' szcombined.__new__cGsdSrHr)r;rzrrr!r=szcombined.__init__N)r,r-r.r/r'r=rrrr!rwsrwc@sFeZdZdZdd�Zddd�Zddd�Zdd d �Zdd�Zd d�Z dS)�_PseudoMatchz: A pseudo match object constructed from a string. cCs||_||_dSrH)�_text�_start)r;�startrCrrr!r=sz_PseudoMatch.__init__NcCs|jSrH)r}�r;�argrrr!r~sz_PseudoMatch.startcCs|jt|j�SrH)r}rTr|rrrr!�end!sz_PseudoMatch.endcCs|rtd��|jS)Nz No such group)� IndexErrorr|rrrr!�group$sz_PseudoMatch.groupcCs|jfSrH)r|r?rrr!�groups)sz_PseudoMatch.groupscCsiSrHrr?rrr!� groupdict,sz_PseudoMatch.groupdict)N)N)N) r,r-r.r/r=r~r�r�r�r�rrrr!r{s r{csd�fdd� }|S)zL Callback that yields multiple actions for each group in the match. Nc3s�t��D]�\}}|dkrqqt|�tkrR|�|d�}|r�|�|d�||fVq|�|d�}|dk r|r||�|d�|_||t|�|d�|�|�D]}|r�|Vq�q|r�|��|_dS)N�)� enumerater&rr�r~�posr{r�)�lexer�match�ctxrt�action�data�item�rzrr!�callback4s&� zbygroups..callback)Nr)rzr�rr�r!r0sc@seZdZdZdS)�_ThiszX Special singleton used for indicating the caller class. Used by ``using``. Nrurrrr!r�Jsr�csji�d�kr:��d�}t|ttf�r.|�d<nd|f�d<�tkrTd��fdd� }nd ��fdd� }|S) a� Callback that processes the match with a different lexer. The keyword arguments are forwarded to the lexer, except `state` which is handled separately. `state` specifies the state that the new lexer will start in, and can be an enumerable such as ('root', 'inline', 'string') or a simple string which is assumed to be on top of the root state. Note: For that to work, `_other` must not be an `ExtendedRegexLexer`. �state�stack�rootNc3sj�r��|j�|jf��}n|}|��}|j|��f��D]\}}}||||fVq<|rf|��|_dSrH)�updater8r>r~rIr�r�r��r�r�r��lx�srtrKrL)� gt_kwargs�kwargsrr!r�iszusing..callbackc3s^��|j��f��}|��}|j|��f��D]\}}}||||fVq0|rZ|��|_dSrH)r�r8r~rIr�r�r�r��_otherr�r�rr!r�xs )N)N)�poprA�listrxr)r�r�r�r�rr�r!rSs c@seZdZdZdd�ZdS)rz� Indicates a state or state action (e.g. #pop) to apply. For example default('#pop') is equivalent to ('', Token, '#pop') Note that state tuples may be used as well. .. versionadded:: 2.0 cCs ||_dSrH)r�)r;r�rrr!r=�szdefault.__init__N)r,r-r.r/r=rrrr!r�sc@s"eZdZdZddd�Zdd�ZdS) rz� Indicates a list of literal words that is transformed into an optimized regex that matches any of the words. .. versionadded:: 2.0 rocCs||_||_||_dSrH)r�prefix�suffix)r;rr�r�rrr!r=�szwords.__init__cCst|j|j|jd�S)N�r�r�)rrr�r�r?rrr!r9�sz words.getN)roro)r,r-r.r/r=r9rrrr!r�s c@sJeZdZdZdd�Zdd�Zdd�Zdd �Zddd�Zd d�Z dd�Z d S)�RegexLexerMetazw Metaclass for RegexLexer, creates the self._tokens attribute from self.tokens on the first instantiation. cCs t|t�r|��}t�||�jS)zBPreprocess the regular expression component of a token definition.)rAr r9�re�compiler�)ry�regex�rflagsr�rrr!�_process_regex�s zRegexLexerMeta._process_regexcCs&t|�tks"t|�s"td|f��|S)z5Preprocess the token component of a token definition.z2token type must be simple type or callable, not %r)r&r�callable�AssertionError)ry�tokenrrr!�_process_token�s�zRegexLexerMeta._process_tokencCst|t�rd|dkrdS||kr$|fS|dkr0|S|dd�dkrRt|dd��Sdsbtd|��n�t|t�r�d |j}|jd 7_g}|D],}||ks�td|��|�|�|||��q�|||<|fSt|t��r|D] }||ks�|dks�td |��q�|Sd�std|��dS)z=Preprocess the state transition action of a token definition.�#pop��#pushN�z#pop:Fzunknown new state %rz_tmp_%dr�zcircular state ref %r)r�r�zunknown new state zunknown new state def %r) rArO�intr�rw�_tmpname�extend�_process_staterx)ry� new_state�unprocessed� processed� tmp_state�itokens�istaterrr!�_process_new_state�s> ��z!RegexLexerMeta._process_new_statecCs�t|�tkstd|��|ddks0td|��||kr@||Sg}||<|j}||D�].}t|t�r�||ks~td|��|�|�||t|��qZt|t�r�qZt|t �r�|� |j||�}|�t �d�jd|f�qZt|�tks�td|��z|�|d||�}Wn>tk �rD} ztd |d||| f�| �W5d} ~ XYnX|�|d �} t|�dk�rhd}n|� |d||�}|�|| |f�qZ|S)z%Preprocess a single state definition.zwrong state name %rr�#zinvalid state name %rzcircular state reference %rroNzwrong rule def %rz+uncompilable regex %r in state %r of %r: %sr��)r&rOr��flagsrArr�r�rvrr�r�rBr�r�r�rxr�� Exception� ValueErrorr�rT)ryr�r�r��tokensr��tdefr��rex�errr�rrr!r��sJ � �� zRegexLexerMeta._process_stateNcCs<i}|j|<|p|j|}t|�D]}|�|||�q$|S)z-Preprocess a dictionary of token definitions.)�_all_tokensr�r�r�)ryr)� tokendefsr�r�rrr!�process_tokendefs zRegexLexerMeta.process_tokendefc Cs�i}i}|jD]�}|j�di�}|��D]�\}}|�|�}|dkr||||<z|�t�}Wntk rpYq(YnX|||<q(|�|d�}|dkr�q(||||d�<z|�t�} Wntk r�Yq(X|| ||<q(q|S)a Merge tokens from superclasses in MRO order, returning a single tokendef dictionary. Any state that is not defined by a subclass will be inherited automatically. States that *are* defined by subclasses will, by default, override that state in the superclass. If a subclass wishes to inherit definitions from a superclass, it can use the special value "inherit", which will cause the superclass' state definition to be included at that point in the state. r�Nr�)�__mro__�__dict__r9�items�indexrr�r�) ryr��inheritable�c�toksr�r��curitems�inherit_ndx�new_inh_ndxrrr!� get_tokendefs s0 zRegexLexerMeta.get_tokendefscOsLd|jkr:i|_d|_t|d�r(|jr(n|�d|��|_tj |f|�|�S)z:Instantiate cls after preprocessing its token definitions.�_tokensr�token_variantsro) r�r�r��hasattrr�r�r�r�r&�__call__)ryrz�kwdsrrr!r�;s zRegexLexerMeta.__call__)N)r,r-r.r/r�r�r�r�r�r�r�rrrr!r��s#, 1r�c@s$eZdZdZejZiZddd�ZdS)rz� Base for simple stateful regular expression-based lexers. Simplifies the lexing process so that you need only provide a list of states and regular expressions. �r�ccs�d}|j}t|�}||d}|D�](\}}} |||�} | r"|dk rrt|�tkrb||| ��fVn||| �EdH| ��}| dk �rHt| t�r�| D]D}|dkr�t|�dkr�|� �q�|dkr�|� |d�q�|� |�q�nbt| t��rt| �t|�k�r|dd�=n || d�=n,| dk�r*|� |d�nd�sMetaclass for ProfilingRegexLexer, collects regex timing info.csLt|t�r t|j|j|jd��n|�t��|��tjf��fdd� }|S)Nr�cs`�jd��fddg�}t��}��|||�}t��}|dd7<|d||7<|S)Nr�rrr�)� _prof_data� setdefault�timer�)rCr��endpos�info�t0�res�t1�ry�compiledr�r�rr!� match_funcMsz:ProfilingRegexLexerMeta._process_regex..match_func) rArrr�r�r�r��sys�maxsize)ryr�r�r�r�rr�r!r�Es �z&ProfilingRegexLexerMeta._process_regexN)r,r-r.r/r�rrrr!r�Bsr�c@s"eZdZdZgZdZddd�ZdS)�ProfilingRegexLexerzFDrop-in replacement for RegexLexer that does profiling of its regexes.�r�c#s��jj�i�t��||�EdH�jj��}tdd�|��D��fdd�dd�}tdd�|D��}t �t d�jj t|�|f�t d �t d d�t d�|D]}t d |�q�t d �dS)NcssN|]F\\}}\}}|t|��d��dd�dd�|d|d||fVqdS)zu'z\\�\N�Ai�)�reprrWrE)�.0r��r�nrKrrr!� cs� �z=ProfilingRegexLexer.get_tokens_unprocessed..cs |�jSrH)�_prof_sort_indexrr?rr!r"fr#z.T)�key�reversecss|]}|dVqdS)�Nr)r�r rrr!rhsz2Profiling result for %s lexing %d chars in %.3f mszn==============================================================================================================z$%-20s %-64s ncalls tottime percall)r�r�zn--------------------------------------------------------------------------------------------------------------z%-20s %-65s %5d %8.4f %8.4f)r>r�rBrrIr��sortedr��sum�printr,rT)r;rCr��rawdatar�� sum_totalr+rr?r!rI^s(� ��z*ProfilingRegexLexer.get_tokens_unprocessedN)r�)r,r-r.r/r�rrIrrrr!r�Xsr�)3r/r�r�r��pip._vendor.pygments.filterrr�pip._vendor.pygments.filtersr�pip._vendor.pygments.tokenrrrr�pip._vendor.pygments.utilr r rrr r�pip._vendor.pygments.regexoptr�__all__rR�staticmethod�_default_analyser&r$rrrOrrvrrxrwr{rr�rrrrr�rrrrpr�r�rrrr!�s` ��!' 2)aH@