Avoid IoT telemetry timeouts on large CouchDB streams - #481

Closed

ShuxinLin wants to merge 1000 commits into

mainfrom

fix/iot-couchdb-telemetry-loading

ShuxinLin commented Jul 24, 2026

Collaborator

Summary

materialize per-asset IoT summary docs during CouchDB loads for full-stream extent, coverage, stats, latest reading, and measured sensor lookup
make design-view fast paths opt-in via IOT_ENABLE_VIEW_FAST_PATH so cold view index builds do not block tool calls
add _all_docs primary-key range pagination for bounded history/windowed telemetry reads and avoid couchdb3 truthiness network calls

Verification

uv run pytest src/servers/iot/tests/test_tools.py src/couchdb/tests/test_loader.py
COUCHDB_URL= uv run pytest src/servers/iot/tests/test_tools.py src/couchdb/tests/test_loader.py
python3 -m py_compile src/servers/iot/main.py src/servers/iot/telemetry_helper.py src/couchdb/loader.py src/servers/iot/tests/conftest.py src/servers/iot/tests/test_tools.py src/couchdb/tests/test_loader.py
git diff --check
python3 -m json.tool src/couchdb/_design_iot.json >/dev/null

Large-data smoke

Using /Users/shuxin.lin/Projects/AssetOpsBenchScenarioGeneration/scenarios_data/shared/iot/asset_data_1030.json: built 1 summary for 1,516,948 records in ~14.6s after JSON parse; after inserting iot_summary:COMP-01 into local CouchDB, stream_extent returned in 0.024s, history limit=2 in 0.122s, and windowed sensor_stats in 0.027s.

DhavalRepo18 and others added 30 commits

June 14, 2026 12:40


          removed unused file

799c588


          plan_execute

862db3f


          removed unused import

7ed1f8a


          revised code

172e5aa


          Merge pull request #373 from IBM/openai_compatible

792a0de

revised code


          refactor(evaluation): align static JSON scorer with evaluation pipeline

07f9683


          docs(evaluation): add acknowledgments

7622d45


          Merge branch 'main' into add-static-json-evaluator

62c8b2f


          Merge pull request #369 from ChathurangiShyalika/add-static-json-eval…

48b7f6e

…uator

feat(evaluation): add static JSON scorer


          docs(mcp-servers): align WO server tool list with main.py

4d09e54


          Merge pull request #377 from IBM/docs/update-wo-tools

f3fb1cb

docs(mcp-servers): align WO server tool list with main.py


          revised code

dd9a704

Signed-off-by: Dhaval Patel <pateldha@us.ibm.com>


          Done

Signed-off-by: Dhaval Patel <pateldha@us.ibm.com>


          Use binary installs for gitleaks/trufflehog to satisfy org action policy

8e26fb1

Signed-off-by: Dhaval Patel <pateldha@us.ibm.com>


          Triage known historical secret findings

88cb79d

Signed-off-by: Dhaval Patel <pateldha@us.ibm.com>


          TruffleHog: gate on verified secrets only

4f4ee35

Signed-off-by: Dhaval Patel <pateldha@us.ibm.com>


          adding security tag

cef70bb

Signed-off-by: Dhaval Patel <pateldha@us.ibm.com>


          Guard all data files across src/couchdb and subfolders

6880cd5

Signed-off-by: Dhaval Patel <pateldha@us.ibm.com>


          testing

7a70d43

Signed-off-by: Dhaval Patel <pateldha@us.ibm.com>


          finalied local check for data upload

b541648

Signed-off-by: Dhaval Patel <pateldha@us.ibm.com>


          docs: resolve inconsistency in tools taxonomy (#375)

d94cf3f

- Added Category column to tools table in docs/mcp-servers.md
- Categorized each tool as read, write, LLM-use, or cpu-centric
- Added Categories column to MCP Servers table in INSTRUCTIONS.md

Signed-off-by: Abhijeet Sharma <abhijeet.rajendra18@gmail.com>


          docs: add TokenRouter infrastructure support acknowledgment

80c6db1

Signed-off-by: TokenRouter <support@tokenrouter.com>


          Merge pull request #382 from TokenRouterAI/docs/tokenrouter-infrastru…

7c30397

…cture-support

docs: add TokenRouter infrastructure support acknowledgment


          Merge pull request #381 from IBM/add-secret-scanning

4e3ccea

Adding a Secutiry Check


          feat(wo): support failure_code in update_workorder

8f2d3ce

Expose failure_code through both the update_workorder core function and the
MCP tool wrapper, and cover partial-update behavior in the lifecycle test.

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          adding link to arxiv paper

06977ff

Signed-off-by: Dhaval Patel <pateldha@us.ibm.com>


          Merge pull request #388 from IBM/adding_a_small_test

4ee8fc0

adding link to arxiv paper


          Merge pull request #380 from IBM/feat/wo-tool-update

feat(wo): support failure_code in update_workorder


          docs(contrib): add vibration and SWaT dataset mappings

367c3df

Signed-off-by: ulises-jeremias <ulisescf.24@gmail.com>


          chore: apply ruff formatting

c102a56

Signed-off-by: Parman Mohammadalizadeh <prmma23@gmail.com>

Chathurangi Shyalika and others added 27 commits

July 20, 2026 22:15


          Add OpenCode temperature configuration

d6000fa

Signed-off-by: Chathurangi Shyalika <chathurangishyalika@Chathurangis-MacBook-Pro.local>


          Merge branch 'main' into opencode_agent

cc0e08c


          docs: clarify TSFM anomaly run recipe path

ad6619b

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          docs: clarify TSFM anomaly run recipe path

6542b31

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Add Stirrup temperature configuration

e2ee430

Signed-off-by: Chathurangi Shyalika <chathurangishyalika@dhcp-9-31-97-67.watson.ibm.com>


          Enable OpenCode workspace writes with bash

014b337

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Merge branch 'main' into stirrup_agent

8b98252


          Clarify OpenCode scenario-suite bash writes

9c77cff

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Merge pull request #469 from IBM/opencode_agent

Add OpenCode temperature configuration


          Merge pull request #473 from IBM/stirrup_agent

4fa791e

Add Stirrup temperature configuration


          Merge pull request #474 from IBM/opencode-bash-workspace-writes

ef69f64

Enable OpenCode workspace writes with bash


          Document TSFM anomaly run workflow

b7ddf55

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Tighten TSFM anomaly guidance

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Merge remote-tracking branch 'origin/main' into codex/tsfm-anomaly-ru…

d18bfa2

…n-recipe

# Conflicts:
#	src/servers/tsfm/main.py
#	src/servers/tsfm/tests/test_run_tools.py

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Trim TSFM catalog instruction

227b5bd

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Expand TSFM anomaly workflow instruction

0915b22

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Revert TSFM MCP docs changes

a5f0b5c

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Merge pull request #471 from IBM/codex/tsfm-anomaly-run-recipe

48a60bf

docs: clarify TSFM anomaly run recipe path


          Handle noisy final MCQ answers in static JSON evaluation

ee13d55

Signed-off-by: Chathurangi Shyalika <chathurangishyalika@Chathurangis-MacBook-Pro.local>


          Fix OpenCode TokenRouter Claude provider

5b00188

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Disable tool streaming for TokenRouter Claude

eddbdb2

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Merge pull request #476 from IBM/benchmark_evaluation

8e6bc99

Handle noisy final MCQ answers in static JSON evaluation


          Merge pull request #478 from IBM/fix/opencode-tokenrouter-claude

9bcd0a9

Disable tool streaming for TokenRouter Claude


          Improve IoT CouchDB telemetry loading

55dc2e2

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Use IoT views for more telemetry lookups

92744da

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Materialize IoT telemetry summaries

808f654

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>


          Materialize daily IoT telemetry summaries

e7d19e0

Signed-off-by: Shuxin Lin <linshuhsin@gmail.com>

ShuxinLin commented Jul 24, 2026 •

edited

Loading

Collaborator Author

Updated with daily materialized IoT summaries for bounded sensor_stats windows.

Scenario 1030 validation on asset_data_1030.json:

Built 213 summary docs from 1,516,948 telemetry records: 1 asset summary + 212 daily summaries.
Build timing: 32.5s total locally, with 28.6s in summary aggregation.
CouchDB summary-only validation, IOT_ENABLE_VIEW_FAST_PATH unset: single March Motor_current stats call returned in ~51 ms.
The trajectory's 12 bounded stats calls completed concurrently in ~172 ms wall time against the summary docs.

The summaries are produced during src/couchdb/init_data.py / load_collection("iot", ...), so existing CouchDB data must be reloaded before the benchmark sees this path.

DhavalRepo18 closed this

DhavalRepo18 force-pushed the fix/iot-couchdb-telemetry-loading branch from 1e9562b to e7d19e0 Compare

September 9, 2026 03:54

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet