Commit 96aac45
committed
fix(litellm): strip embedded thought_signature from tool call id
When a Gemini thinking model exposes its thought_signature only embedded in
the tool call id via the __thought__ separator,
_message_to_generate_content_response extracted the signature onto
part.thought_signature but assigned the full, unsplit id (including the
__thought__<signature> suffix) to part.function_call.id.
That corrupted id is persisted to session history and, on later turns, replayed
to the model as a literal tool_call_id, which OpenAI-compatible endpoints reject
(422 'Tool Call ID required on tool calls'). Because the malformed id is now
part of the event history, every subsequent turn on the thread fails
identically, permanently breaking the conversation.
Strip the embedded suffix so function_call.id is the clean, original id, while
still preserving the signature separately on part.thought_signature. The
extra_content and provider_specific_fields paths are unchanged. Adds regression
and unit tests.
Fixes #64541 parent 13bef9c commit 96aac45
2 files changed
Lines changed: 95 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
987 | 987 | | |
988 | 988 | | |
989 | 989 | | |
| 990 | + | |
| 991 | + | |
| 992 | + | |
| 993 | + | |
| 994 | + | |
| 995 | + | |
| 996 | + | |
| 997 | + | |
| 998 | + | |
| 999 | + | |
| 1000 | + | |
| 1001 | + | |
| 1002 | + | |
| 1003 | + | |
| 1004 | + | |
| 1005 | + | |
| 1006 | + | |
| 1007 | + | |
| 1008 | + | |
| 1009 | + | |
| 1010 | + | |
| 1011 | + | |
| 1012 | + | |
| 1013 | + | |
| 1014 | + | |
| 1015 | + | |
| 1016 | + | |
990 | 1017 | | |
991 | 1018 | | |
992 | 1019 | | |
| |||
2182 | 2209 | | |
2183 | 2210 | | |
2184 | 2211 | | |
2185 | | - | |
| 2212 | + | |
| 2213 | + | |
| 2214 | + | |
| 2215 | + | |
| 2216 | + | |
| 2217 | + | |
2186 | 2218 | | |
2187 | 2219 | | |
2188 | 2220 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
57 | 57 | | |
58 | 58 | | |
59 | 59 | | |
| 60 | + | |
60 | 61 | | |
61 | 62 | | |
62 | 63 | | |
| |||
2937 | 2938 | | |
2938 | 2939 | | |
2939 | 2940 | | |
| 2941 | + | |
| 2942 | + | |
| 2943 | + | |
| 2944 | + | |
| 2945 | + | |
| 2946 | + | |
| 2947 | + | |
| 2948 | + | |
| 2949 | + | |
| 2950 | + | |
| 2951 | + | |
| 2952 | + | |
| 2953 | + | |
| 2954 | + | |
| 2955 | + | |
| 2956 | + | |
| 2957 | + | |
| 2958 | + | |
| 2959 | + | |
| 2960 | + | |
| 2961 | + | |
| 2962 | + | |
| 2963 | + | |
| 2964 | + | |
| 2965 | + | |
| 2966 | + | |
| 2967 | + | |
| 2968 | + | |
| 2969 | + | |
| 2970 | + | |
| 2971 | + | |
| 2972 | + | |
| 2973 | + | |
| 2974 | + | |
| 2975 | + | |
| 2976 | + | |
| 2977 | + | |
| 2978 | + | |
| 2979 | + | |
| 2980 | + | |
| 2981 | + | |
| 2982 | + | |
| 2983 | + | |
| 2984 | + | |
| 2985 | + | |
| 2986 | + | |
| 2987 | + | |
| 2988 | + | |
| 2989 | + | |
| 2990 | + | |
| 2991 | + | |
| 2992 | + | |
| 2993 | + | |
| 2994 | + | |
| 2995 | + | |
| 2996 | + | |
| 2997 | + | |
| 2998 | + | |
| 2999 | + | |
| 3000 | + | |
| 3001 | + | |
2940 | 3002 | | |
2941 | 3003 | | |
2942 | 3004 | | |
| |||
0 commit comments