You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
BLUF: Is there a way to recover when a generative output is malformed?
I am currently experimenting with LangExtract using a custom Bedrock model provider with Claude 4.5 as the generative model (due to limitations of my environment, this is the only generative model/platform I can use). However, due to the very nature of generative models, sometimes (but often enough) we get malformed responses from the model. When such an error occurs, this causes the whole LangExtract pipeline to fail and lose all progress. For example Extraction text must be a string, integer, or float. Found: <class 'NoneType'>. In one case, I had extraction passes set to 3, and on the final pass the error arose and I lost all previous progress/extractions - this seems like such a waste!
In the case of errors:
Is there a way to trigger a retry on failed passes/batches?
Can we "skip" over failed passes/batches and keep the successful extractions? As to not waste time/money.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
BLUF: Is there a way to recover when a generative output is malformed?
I am currently experimenting with LangExtract using a custom Bedrock model provider with Claude 4.5 as the generative model (due to limitations of my environment, this is the only generative model/platform I can use). However, due to the very nature of generative models, sometimes (but often enough) we get malformed responses from the model. When such an error occurs, this causes the whole LangExtract pipeline to fail and lose all progress. For example
Extraction text must be a string, integer, or float. Found: <class 'NoneType'>. In one case, I had extraction passes set to 3, and on the final pass the error arose and I lost all previous progress/extractions - this seems like such a waste!In the case of errors:
Mahalo! 🤙
Beta Was this translation helpful? Give feedback.
All reactions