Nidhi Singh eacb398f75 fix(tools): add return_exceptions to asyncio.gather in web_tools ...

Three asyncio.gather() calls in tools/web_tools.py ran without
return_exceptions=True. A single failing task (e.g. LLM rate limit on
one URL) would raise out of gather() and discard every other
successfully fetched/summarized result.

Pass return_exceptions=True and filter BaseException entries with a
warning log before unpacking. Affects:

- chunk summarization gather (large web_extract pages)
- firecrawl per-result LLM post-processing
- tavily crawl per-result LLM post-processing

Closes #2744

2026-05-15 01:50:41 -07:00

66 KiB

Raw Blame History

View Raw