Commit 099f2e5
committed
fix: thread timeout_secs through multi-model paths and add system route guard
- Add timeout_secs parameter to gateway_inference_set_multi and pass
through to SetClusterInferenceRequest
- Add print_timeout to multi-model output display
- Add timeout field to router test helper make_route (upstream added
timeout to ResolvedRoute)
- Add system route guard: upsert_multi_model_route rejects
route_name == sandbox-system with InvalidArgument
- Add timeout_secs: 0 to multi-model test ClusterInferenceConfig structs
- Add upsert_multi_model_route_rejects_system_route test
Signed-off-by: Lyle Hopkins <lyle@cosmicnetworks.com>1 parent c4560de commit 099f2e5
3 files changed
Lines changed: 42 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3749 | 3749 | | |
3750 | 3750 | | |
3751 | 3751 | | |
| 3752 | + | |
| 3753 | + | |
| 3754 | + | |
| 3755 | + | |
| 3756 | + | |
| 3757 | + | |
| 3758 | + | |
| 3759 | + | |
| 3760 | + | |
3752 | 3761 | | |
3753 | 3762 | | |
3754 | 3763 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
218 | 218 | | |
219 | 219 | | |
220 | 220 | | |
| 221 | + | |
221 | 222 | | |
222 | 223 | | |
223 | 224 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
254 | 254 | | |
255 | 255 | | |
256 | 256 | | |
| 257 | + | |
| 258 | + | |
| 259 | + | |
| 260 | + | |
| 261 | + | |
| 262 | + | |
| 263 | + | |
| 264 | + | |
257 | 265 | | |
258 | 266 | | |
259 | 267 | | |
| |||
1228 | 1236 | | |
1229 | 1237 | | |
1230 | 1238 | | |
| 1239 | + | |
1231 | 1240 | | |
1232 | 1241 | | |
1233 | 1242 | | |
| |||
1278 | 1287 | | |
1279 | 1288 | | |
1280 | 1289 | | |
| 1290 | + | |
1281 | 1291 | | |
1282 | 1292 | | |
1283 | 1293 | | |
| |||
1363 | 1373 | | |
1364 | 1374 | | |
1365 | 1375 | | |
| 1376 | + | |
| 1377 | + | |
| 1378 | + | |
| 1379 | + | |
| 1380 | + | |
| 1381 | + | |
| 1382 | + | |
| 1383 | + | |
| 1384 | + | |
| 1385 | + | |
| 1386 | + | |
| 1387 | + | |
| 1388 | + | |
| 1389 | + | |
| 1390 | + | |
| 1391 | + | |
| 1392 | + | |
| 1393 | + | |
| 1394 | + | |
| 1395 | + | |
| 1396 | + | |
| 1397 | + | |
1366 | 1398 | | |
0 commit comments