demo.cpython-312.pyc
1 � 2 ��i� � � � d dl mZ d dlZd dlZd dlZd dlZd dlmZmZ d dl m 3 Z 4 d dl m Z m Z d dlmZmZ d dlmZmZ d dlmZmZ d d lmZ ej2 ej4 d 5 � � ej6 e � Z ed � � G d� d� � Z dd�Z dd� dd�Z dd�Z!e dk( r e!� yy# e"$ r ejF d� Y yw xY w)� )� annotationsN)�asdict� dataclass)�Any)�GenerationResult�VllmGrpcClient)�discover_surface� write_summary)� get_incident�scenario_names)�save_final_decision�parse_final_decision)� FinalDecisionz/%(asctime)s %(levelname)s %(name)s: %(message)s)�level�formatT)�slotsc �6 � e Zd ZU ded< ded< ded< ded< y ) 6 �DemoRun�str�scenarior �decisionr � 7 generation�dict[str, Any]�surfaceN)�__name__� 8 __module__� __qualname__�__annotations__� � � app/demo.pyr r s � ��M��� � � �r r c �� � g }| d D ]/ }|d D ]% }|d rdnd}|j |d � d|� d�� �' �1 d d 9 j | d � � d d 10 j |� � �S ) N�services�methods�server_streaming�stream�unary�namez [�]zprotobuf packages=z, �protobuf_packagesz; rpcs=)�append�join)r � service_lines�service�method�modes r! �_surface_headerr1 s� � ��M��:�&� ?�� �i�(� ?�F� %�&8� 9�8�w�D� � � �F�6�N�#3�2�d�V�1�!=� >� ?�?� 11 �T�Y�Y�w�/B�'C� D� E� F�� � �-�(�)� +�r �localhost:8000��endpointc �� � t |�� }t |� t | � }t ||�� } |rt d� d� }nd }|j |d|�� } |j � |r 12 t � t | j |j � } 13 |r t | 14 � |r,t d� t t j |dd� � � t | | 15 | |� 16 � S # |j � w xY w) Nr3 )r4 r zStreaming model output:c � � t | dd�� S )N� T)�end�flush)�print)�texts r! �<lambda>zrun_demo.<locals>.<lambda>; s � �U�4�R�t�%D� r T)r& �on_textz 17 Discovery summary:� )�indent� sort_keys)r r r r )r r 18 r r r: �generate_incident�closer � 19 raw_output� incident_idr �json�dumpsr ) r r& �save�verboser4 r �incident�client� stream_fnr r s r! �run_demorL + s� � � ��1�G��'���H�%�H� �X�w� ?�F� � � �+� ,�D�I� �I��-�-� �� � .� 20 � 21 � � � �� � ��#�J�$9�$9�8�;O�;O�P�H� ��H�%�� �$�%� �d�j�j���d�;�<� ��� �� � �� � � ��s �'C � C0c 22 � � t j d�� } | j dt � d�� | j ddd� � | j d 23 dd � � | j d dd � � | j ddd�� | j � }t |j |j |j |j |j �� }t d� t dt |j � � �� t d� t d|j j � �� t d� t d|j j � d|j j" d�d|j j$ � d|j j& � �� t d � t |j( j+ d � � � y ) Nz%Run the Incident Commander gRPC demo.)� descriptionz 24 --scenarioT)�choices�requiredz--stream� 25 store_truez Stream model output to stdout.)�action�helpz--savez$Persist outputs/final_decision.json.z --verbosezPrint full discovery JSON.z 26 --endpointr2 zvLLM gRPC endpoint.)�defaultrS )r& rG rH r4 zDiscovered gRPC surface:z zSelected RPC method:zObserved metrics:z time_to_first_update_ms=z end_to_end_latency_ms=z.2fz output_bytes_received=z finish_reason=zFinal structured decision:r> )r? )�argparse�ArgumentParser� add_argumentr � 27 parse_argsrL r r& rG rH r4 r: r1 r r � selected_rpc�time_to_first_update_ms�end_to_end_latency_ms�output_bytes_received� finish_reasonr �model_dump_json)�parser�args�runs r! �mainrb Z s� � � � $� $�1X� Y�F� 28 ��� �n�.>���N� 29 ��� 30 �<�>^��_� 31 ���� �<b��c� 32 ��� �L�?[��\� 33 ��� �.>�EZ��[� � � � �D� 34 � � � ��{�{� �Y�Y�� � �� � � �C� 35 � 36 $�%� �B��� � �,�.� 37 /�0� � 38 �!� �B�s�~�~�*�*�+� 39 ,�-� � 40 � � � 41 $�S�^�^�%K�%K�$L� M!�!$� � �!E�!E�c� J� K!�!$� � �!E�!E� F� G� � � �5�5�6� 8�� 42 � 43 &�'� �#�,�,� 44 &� 45 &�a� 46 &� 47 0�1r �__main__� )r r �returnr ) r r r& �boolrG rf rH rf r4 r re r )re �None)$� 48 __future__r rU rE �logging�sys� dataclassesr r �typingr � 49 app.clientr r �app.discover_vllm_grpcr r 50 �app.incident_samplesr r � 51 app.parserr r � app.schemasr � basicConfig�INFO� getLoggerr �loggerr r1 rL rb �KeyboardInterrupt�exitr r r! �<module>rx s� �� "� � � � 52 � )� � 7� B� =� @� %� �� � � 53 �,�,� <�� 54 �� � �8� $�� ��� � � � � �$ %� ,��,� �,� � ,� 55 � ,� � ,� �,�^ 2�@ �z��� �� �� � ������ ��s �1B: �:C�C