t 20 ttft time 136.43186185004888
2025-05-18 16:36:26.623 [info] Average of latest 20 stream time 300.9490660000476
2025-05-18 16:36:26.623 [info] Average of latest 20 total time NaN
2025-05-18 16:36:26.623 [info] Average of latest 20 client time 493.2771362304687
2025-05-18 16:36:26.623 [info] Average of latest 20 discrepencies NaN
2025-05-18 16:36:26.623 [info] CPP RT LOG: All stats {"streamingtime":437.9814453125,"actualTtftFromStart":247.74267578125,"timeTillServerRequest":111.3369140625,"requestToTtft":136.40576171875,"totalTime":549.278564453125}
2025-05-18 16:36:44.232 [info] CURSOR LOG: requestId 6ecce713-a6df-42ea-a05f-678b23846f72  
2025-05-18 16:36:44.521 [info] CURSOR LOG: Done streaming cpp with id 6ecce713-a6df-42ea-a05f-678b23846f72
2025-05-18 16:36:44.521 [info] CPP RT LOG: Time taken for streaming cpp 289.7275390625 with request 6ecce713-a6df-42ea-a05f-678b23846f72
2025-05-18 16:36:44.521 [info] CPP Request Log with id 6ecce713-a6df-42ea-a05f-678b23846f72
2025-05-18 16:36:44.521 [info] =======>Model output 

2025-05-18 16:36:44.521 [info] =======>Debug stream time 167.08094800030813
2025-05-18 16:36:44.521 [info] =======>Debug ttft time 135.23224300006405
2025-05-18 16:36:44.523 [info] Average of latest 20 ttft time 133.7235177000519
2025-05-18 16:36:44.523 [info] Average of latest 20 stream time 289.3413046000642
2025-05-18 16:36:44.523 [info] Average of latest 20 total time NaN
2025-05-18 16:36:44.523 [info] Average of latest 20 client time 468.410986328125
2025-05-18 16:36:44.523 [info] Average of latest 20 discrepencies NaN
2025-05-18 16:36:44.523 [info] CPP RT LOG: All stats {"streamingtime":289.7275390625,"actualTtftFromStart":236.146240234375,"timeTillServerRequest":113.09521484375,"requestToTtft":123.051025390625,"totalTime":402.788818359375}
2025-05-18 16:36:59.869 [info] CURSOR LOG: requestId 48f7f1cd-6816-4d9f-9939-f9a09bcbda8e  
2025-05-18 16:37:00.652 [info] CURSOR LOG: Done streaming cpp with id 48f7f1cd-6816-4d9f-9939-f9a09bcbda8e
2025-05-18 16:37:00.652 [info] CPP RT LOG: Time taken for streaming cpp 783.61474609375 with request 48f7f1cd-6816-4d9f-9939-f9a09bcbda8e
2025-05-18 16:37:00.652 [info] CPP Request Log with id 48f7f1cd-6816-4d9f-9939-f9a09bcbda8e
2025-05-18 16:37:00.652 [info] =======>Model output 

2025-05-18 16:37:00.652 [info] =======>Debug stream time 566.6035559999873
2025-05-18 16:37:00.652 [info] =======>Debug ttft time 187.34410899999784
2025-05-18 16:37:00.652 [info] Average of latest 20 ttft time 133.50914980002273
2025-05-18 16:37:00.652 [info] Average of latest 20 stream time 299.9132353500725
2025-05-18 16:37:00.653 [info] Average of latest 20 total time NaN
2025-05-18 16:37:00.653 [info] Average of latest 20 client time 483.2578979492188
2025-05-18 16:37:00.653 [info] Average of latest 20 discrepencies NaN
2025-05-18 16:37:00.653 [info] CPP RT LOG: All stats {"streamingtime":783.61474609375,"actualTtftFromStart":230.79736328125,"timeTillServerRequest":95.14013671875,"requestToTtft":135.6572265625,"totalTime":878.7314453125}
2025-05-18 16:37:17.931 [info] CURSOR LOG: requestId aab54bcd-4c0c-46f5-a26d-06e4253ec7cf  
2025-05-18 16:37:18.183 [info] CURSOR LOG: Done streaming cpp with id aab54bcd-4c0c-46f5-a26d-06e4253ec7cf
2025-05-18 16:37:18.183 [info] CPP RT LOG: Time taken for streaming cpp 253.09375 with request aab54bcd-4c0c-46f5-a26d-06e4253ec7cf
2025-05-18 16:37:18.183 [info] CPP Request Log with id aab54bcd-4c0c-46f5-a26d-06e4253ec7cf
2025-05-18 16:37:18.183 [info] =======>Model output 

2025-05-18 16:37:18.183 [info] =======>Debug stream time 121.6301289992407
2025-05-18 16:37:18.183 [info] =======>Debug ttft time 107.59391799941659
2025-05-18 16:37:18.184 [info] Average of latest 20 ttft time 128.73485745002108
2025-05-18 16:37:18.184 [info] Average of latest 20 stream time 286.8900280000438
2025-05-18 16:37:18.184 [info] Average of latest 20 total time NaN
2025-05-18 16:37:18.184 [info] Average of latest 20 client time 456.79180908203125
2025-05-18 16:37:18.184 [info] Average of latest 20 discrepencies NaN
2025-05-18 16:37:18.184 [info] CPP RT LOG: All stats