iaSrSSKrSSKrSSKrSSKJr SSKJr SrSr Sr Sr Sr S r S rS rS rS rSrSrSrSrSrSrSrSr\ \\ \\ \\ \\\\\\\\\0r\R75VVs0sHupX_M snnrSrSrSrS r S r!Sr"Sr#Sr$Sr%Sr&Sr'Sr(Sr)\RT"\)5r+Sr,"SS5r-\-r.S.S\/S \/S!\0S"\1S#\14 S$jjr2S#\14S%jr3S#\14S&jr4S#\14S'jr5S#\14S(jr6S/S)\7S*\/S#\14S+jjr8S0S)\7S,\7S#\14S-jjr9gs snnf)1a6 Dirty Worker Binary Protocol Binary message framing over Unix sockets, inspired by OpenBSD msgctl/msgsnd. Replaces JSON protocol for efficient binary data transfer. Header Format (16 bytes): +--------+--------+--------+--------+--------+--------+--------+--------+ | Magic (2B) | Ver(1) | MType | Payload Length (4B) | +--------+--------+--------+--------+--------+--------+--------+--------+ | Request ID (8 bytes) | +--------+--------+--------+--------+--------+--------+--------+--------+ - Magic: 0x47 0x44 ("GD" for Gunicorn Dirty) - Version: 0x01 - MType: Message type (REQUEST, RESPONSE, ERROR, CHUNK, END) - Length: Payload size (big-endian uint32, max 64MB) - Request ID: uint64 (replaces UUID string) Payload is TLV-encoded (see tlv.py). N)DirtyProtocolError) TLVEncodersGDrequestresponseerrorchunkendstashstatusmanage z>2sBBIQic\rSrSrSr\r\r\r\ r \ r \ r\r\r\r\r\S\S\S\S\4Sj5r\S\S\4S j5r\S'S\S \S \S \S\S\4 Sjj5r\S\S\4Sj5r \S\S\4Sj5r!\S\S\4Sj5r"\S\S\4Sj5r#\S\S\4Sj5r$\S(S\S\S\S\4Sjj5r%\S)S\S\S\S\4Sjj5r&\S\S\4Sj5r'\S\(RRS\4Sj5r*\S\(RVS\SS 4Sj5r,\S \-RZS!\S\4S"j5r.\S \-RZS\4S#j5r/\S \-RZS\SS 4S$j5r0\S\S\4S%j5r1S&r2g )*BinaryProtocolbz-Binary message protocol for dirty worker IPC.msg_type request_idpayload_lengthreturncN[R"[[[UX!5$)z Encode the 16-byte message header. Args: msg_type: Message type (MSG_TYPE_REQUEST, etc.) request_id: Unique request identifier (uint64) payload_length: Length of the TLV-encoded payload Returns: bytes: 16-byte header )structpack HEADER_FORMATMAGICVERSION)rrrs I/var/www/ias/venv/lib/python3.13/site-packages/gunicorn/dirty/protocol.py encode_headerBinaryProtocol.encode_headerrs {{=%()7 7datac[U5[:a[S[U5S[3US9e[R"[ US[5upp4nU[ :wa[SU<S[ <3USSS9eU[:wa[SUS[3USSS9eU[;a[S US 3USSS9eU[:a[S US [S 35eX5U4$)z Decode the 16-byte message header. Args: data: 16 bytes of header data Returns: tuple: (msg_type, request_id, payload_length) Raises: DirtyProtocolError: If header is invalid zHeader too short:  bytes, expected raw_dataNzInvalid magic: z , expected zUnsupported protocol version: zUnknown message type: 0x02xzMessage too large: z bytes (max: )) len HEADER_SIZErr"unpackr$r%r&MSG_TYPE_TO_STRMAX_MESSAGE_SIZE)r+magicversionrlengthrs r' decode_headerBinaryProtocol.decode_headers t9{ "$$SYK/@ N  8>}} 4 -8 4* E>$!%+eY?cr  g $0 WINcr  ? *$*8C.9cr  $ $$%fX];K:LAN V++r*Napp_pathactionargskwargscUUU(a [U5O/U=(d 0S.n[R"U5n[R [ U[ U55nXv-$)a Encode a request message. Args: request_id: Unique request identifier (uint64) app_path: Import path of the dirty app action: Action to call on the app args: Positional arguments kwargs: Keyword arguments Returns: bytes: Complete message (header + payload) )r=r>r?r@)listrencoderr(MSG_TYPE_REQUESTr3)rr=r>r?r@ payload_dictpayloadheaders r'encode_requestBinaryProtocol.encode_requestsZ"!"&DJBl  ##L1--.> .1'l<r*cSU0n[R"U5n[R[U[ U55nXC-$)z Encode a success response message. Args: request_id: Request identifier this responds to result: Result value (must be TLV-serializable) Returns: bytes: Complete message (header + payload) result)rrCrr(MSG_TYPE_RESPONSEr3)rrKrErFrGs r'encode_responseBinaryProtocol.encode_responsesC!&) ##L1--.?.1'l<r*cHSSKJn [X5(aUR5nO:[U[5(aUnO"[ U5R [U50S.nSU0n[R"U5n[R[U[U55nXe-$)z Encode an error response message. Args: request_id: Request identifier this responds to error: DirtyError instance, dict, or Exception Returns: bytes: Complete message (header + payload) r DirtyError error_typemessagedetailsr)errorsrQ isinstanceto_dictdicttype__name__strrrCrr(MSG_TYPE_ERRORr3)rrrQ error_dictrErFrGs r' encode_errorBinaryProtocol.encode_errors ' e ( (J t $ $J#5k22u:J  , ##L1--nj.1'l<r*cSU0n[R"U5n[R[U[ U55nXC-$)z Encode a chunk message for streaming responses. Args: request_id: Request identifier this chunk belongs to data: Chunk data (must be TLV-serializable) Returns: bytes: Complete message (header + payload) r+)rrCrr(MSG_TYPE_CHUNKr3)rr+rErFrGs r' encode_chunkBinaryProtocol.encode_chunksA~ ##L1--nj.1'l<r*c<[R[US5nU$)z Encode an end-of-stream message. Args: request_id: Request identifier this ends Returns: bytes: Complete message (header + empty payload) r)rr( MSG_TYPE_ENDrrGs r' encode_endBinaryProtocol.encode_ends --lJJ r*c<[R[US5nU$)z Encode a status query message. Args: request_id: Request identifier Returns: bytes: Complete message (header + empty payload) r)rr(MSG_TYPE_STATUSrgs r' encode_statusBinaryProtocol.encode_status s --oz1M r*opcountcUUS.n[R"U5n[R[U[ U55nXT-$)z Encode a worker management message. Args: request_id: Request identifier op: Management operation (MANAGE_OP_ADD or MANAGE_OP_REMOVE) count: Number of workers to add/remove Returns: bytes: Complete message (header + payload) )rnro)rrCrr(MSG_TYPE_MANAGEr3)rrnrorErFrGs r' encode_manageBinaryProtocol.encode_manage/sG ##L1--oz.1'l<r*tablecUUS.nUbX6S'UbXFS'UbXVS'[R"U5n[R[U[ U55nX-$)ag Encode a stash operation message. Args: request_id: Unique request identifier (uint64) op: Stash operation code (STASH_OP_*) table: Table name key: Optional key for put/get/delete operations value: Optional value for put operation pattern: Optional pattern for keys operation Returns: bytes: Complete message (header + payload) )rnrtkeyvaluepattern)rrCrr(MSG_TYPE_STASHr3) rrnrtrvrwrxrErFrGs r' encode_stashBinaryProtocol.encode_stashEsp$  ?"%   $) !  &- ###L1--nj.1'l<r*cv[RU5upn[U5[U-:a#[ S[U-S[U53USSS9eUS:Xa0nO'U[[U-n[ R "U5n[UnXrU4$![a e[an[ SU3USSS9eSnAff=f)aH Decode a complete message (header + payload). Args: data: Complete message bytes Returns: tuple: (msg_type_str, request_id, payload_dict) msg_type_str is the string name (e.g., "request") payload_dict is the decoded TLV payload as a dict Raises: DirtyProtocolError: If message is malformed zIncomplete message: expected z bytes, got N2r.rFailed to decode TLV payload: ) rr;r3r4rr decode_full Exceptionr6)r+rrr:rE payload_datae msg_type_strs r'decode_messageBinaryProtocol.decode_messagefs (6'C'CD'I$f t9{V+ +$/ f0D/EF4yk#cr  Q;L K&,@AL )55lC 'x0 55&  (4QC8)#2. s,BB8#B33B8readerc# UR[5IShvN n[RU5up4nUS:a2URU5IShvN n[R"U5nO0n[UnXS .n U RU5 U $Nv![RaPn[ UR 5S:Xae[ S[ UR 5S[3UR S9eSnAff=fN![Ra2n[ S[ UR 5SU3UR S9eSnAff=f![ a e[an[ SU3USSS9eSnAff=f7f) a( Read a complete binary message from async stream. Args: reader: asyncio StreamReader Returns: dict: Message dict with 'type', 'id', and payload fields Raises: DirtyProtocolError: If read fails or message is malformed asyncio.IncompleteReadError: If connection closed mid-read NrzIncomplete header: got r-r.zIncomplete payload: got r~r}rZid) readexactlyr4asyncioIncompleteReadErrorr3partialrrr;rrrr6update) rrGrrrr:rrErrKs r'read_message_async!BinaryProtocol.read_message_asyncs !--k::F(6'C'CF'K$f A: %+%7%7%??  )55lC L'x0 &9 l# S;** 199~"$)#aii.)9:'=*    @.. (.s199~.>? &x)YY &  (4QC8)#2. sE3BBBE3C>C<C>E0#E3BC9)A C44C99E3<C>>E-D??EE3E0E++E00E3writerrTc# [RU5nURU5 UR5IShvN gN7f)a Write a message to async stream. Accepts dict format for backwards compatibility. Args: writer: asyncio StreamWriter message: Message dict with 'type', 'id', and payload fields Raises: DirtyProtocolError: If encoding fails ConnectionError: If write fails N)r_encode_from_dictwritedrain)rrTr+s r'write_message_async"BinaryProtocol.write_message_asyncs2 //8 Tllns:AAAsockncSn[U5U:alURU[U5- 5nU(d3[U5S:Xa [S5e[S[U5SU3US9eX#- n[U5U:aMlU$)z Receive exactly n bytes from a socket. Args: sock: Socket to read from n: Number of bytes to read Returns: bytes: Received data Raises: DirtyProtocolError: If read fails or connection closed r*rzConnection closedzConnection closed after r-r.)r3recvr)rrr+rs r' _recv_exactlyBinaryProtocol._recv_exactlys$i!mIIa#d)m,Et9>,-@AA(.s4yk9J1#N! MD$i!m r*ch[RU[5n[RU5up#nUS:a-[RX5n[R "U5nO0n[UnXS.n U RU5 U $![ a e[an[ SU3USSS9eSnAff=f)z Read a complete message from socket (sync). Args: sock: Socket to read from Returns: dict: Message dict with 'type', 'id', and payload fields Raises: DirtyProtocolError: If read fails or message is malformed rr~Nr}r.r) rrr4r;rrrrr6r) rrGrrr:rrErrrKs r' read_messageBinaryProtocol.read_messages --dK@'5'C'CF'K$f A:)77EL )55lC L'x0 &9 l# &  (4QC8)#2. sBB1B,,B1cP[RU5nURU5 g)z Write a message to socket (sync). Args: sock: Socket to write to message: Message dict with 'type', 'id', and payload fields Raises: DirtyProtocolError: If encoding fails OSError: If write fails N)rrsendall)rrTr+s r' write_messageBinaryProtocol.write_message/s //8 Tr*c URS5nURSS5n[U[5(a[U5S-n[RU5nUc[ SU35eU[ :XaW[RUURSS5URSS5URS 5URS 55$U[:Xa%[RUURS 55$U[:Xa&[RUURS 055$U[:Xa%[RUURS 55$U[:Xa[R!U5$U[":Xaf[R%UURS5URSS5URS5URS5URS55$U[&:Xa[R)U5$U[*:Xa6[R-UURS5URSS55$[ SU35e)z Encode a message dict to binary format. Supports the old dict-based API for backwards compatibility. Args: message: Message dict with 'type', 'id', and payload fields Returns: bytes: Complete encoded message rZrrlzUnknown message type: r=r>r?r@rKrr+rnrtrvrwrxrorzUnhandled message type: )getrWr\hashMSG_TYPE_FROM_STRrrDrrHrLrMr]r_rbrcrfrhryrzrkrlrqrr)rTrrrs r'r BinaryProtocol._encode_from_dict?s#{{6* [[q)  j# & &j),>>J$((6  $'=l^%LM M ' '!00 J+ Hb) F# H%  * *!11 H%  '!.. GR(  '!.. F#  %!,,Z8 8  '!.. D! GR( E" G$ I&   (!// ; ;  (!// D! GQ'  %'?z%JK Kr*NNrNNN)3r[ __module__ __qualname____firstlineno____doc__r4r7MSG_TYPE_REQUEST_STRrDMSG_TYPE_RESPONSE_STRrLMSG_TYPE_ERROR_STRr]MSG_TYPE_CHUNK_STRrbMSG_TYPE_END_STRrfMSG_TYPE_STASH_STRryMSG_TYPE_STATUS_STRrkMSG_TYPE_MANAGE_STRrq staticmethodintbytesr(tupler;r\rYrHrMr_rcrhrlrrrzrr StreamReaderr StreamWriterrsocketrrrr__static_attributes__rr*r'rrbs7K'+-'N'N#L'N)O)O 7 7 7c 7e 7 7.,E.,e.,.,`:> 3 # s " 37 CH  4 C E  "    <  u  " s u   # %   # 3 s 5  *37  # c *>+/48.FMMce6%6==%T%%N FMM D T  CL4CLECLCLr*rr=r>r?r@r cf[RUUUU(a [U5O/U=(d 0S.$)a- Build a request message dict. Args: request_id: Unique request identifier (int or str) app_path: Import path of the dirty app (e.g., 'myapp.ml:MLApp') action: Action to call on the app args: Positional arguments kwargs: Keyword arguments Returns: dict: Request message dict )rZrr=r>r?r@) DirtyProtocolrDrB)rr=r>r?r@s r' make_requestrs2 .."T ,B  r*c*[RUUS.$)z Build a success response message dict. Args: request_id: Request identifier this responds to result: Result value Returns: dict: Response message dict )rZrrK)rrL)rrKs r' make_responsers// r*cSSKJn [X5(aUR5nO:[U[5(aUnO"[ U5R [U50S.n[RUUS.$)z Build an error response message dict. Args: request_id: Request identifier this responds to error: DirtyError instance or dict with error info Returns: dict: Error response message dict rrPrR)rZrr) rVrQrWrXrYrZr[r\rr])rrrQr^s r'make_error_responsersj#%$$]]_ E4  u+..5z ,, r*c*[RUUS.$)z Build a chunk message dict for streaming responses. Args: request_id: Request identifier this chunk belongs to data: Chunk data Returns: dict: Chunk message dict )rZrr+)rrb)rr+s r'make_chunk_messagers,, r*c([RUS.$)z Build an end-of-stream message dict. Args: request_id: Request identifier this ends Returns: dict: End message dict r)rrf)rs r'make_end_messagers** r*rnrtcZ[RUUUS.nUbX6S'UbXFS'UbXVS'U$)a] Build a stash operation message dict. Args: request_id: Unique request identifier (int or str) op: Stash operation code (STASH_OP_*) table: Table name key: Optional key for put/get/delete operations value: Optional value for put operation pattern: Optional pattern for keys operation Returns: dict: Stash message dict )rZrrnrtrvrwrx)rry)rrnrtrvrwrxmsgs r'make_stash_messagersJ",,  C  E  G  I Jr*roc,[RUUUS.$)z Build a worker management message dict. Args: request_id: Unique request identifier (int or str) op: Management operation (MANAGE_OP_ADD or MANAGE_OP_REMOVE) count: Number of workers to add/remove Returns: dict: Manage message dict )rZrrnro)rrq)rrnros r'make_manage_messagers --  r*rrr):rrrr"rVrtlvrr%r&rDrLr]rbrfryrkrqrrrrrrrrr6itemsr STASH_OP_PUT STASH_OP_GETSTASH_OP_DELETE STASH_OP_KEYSSTASH_OP_CLEAR STASH_OP_INFOSTASH_OP_ENSURESTASH_OP_DELETE_TABLESTASH_OP_TABLESSTASH_OP_EXISTS MANAGE_OP_ADDMANAGE_OP_REMOVEr$calcsizer4r7rrr\rrYrrrrrrrr)kvs00r'rs , &   !"*,&&"&(( '6&;&;&=>&=daQT&=>      oom, $aLaLR 59sC-1=A2$d<D$ D "6:s3>B>Cc?s$C: