0625 with request 0c91789f-498d-4fda-a539-716c51196433
2025-05-18 17:45:18.911 [info] CPP Request Log with id 0c91789f-498d-4fda-a539-716c51196433
2025-05-18 17:45:18.911 [info] =======>Model output 

2025-05-18 17:45:18.911 [info] =======>Debug stream time 273.1764799999073
2025-05-18 17:45:18.911 [info] =======>Debug ttft time 50.94869799911976
2025-05-18 17:45:18.912 [info] Average of latest 20 ttft time 98.65573994993755
2025-05-18 17:45:18.912 [info] Average of latest 20 stream time 284.5392934498639
2025-05-18 17:45:18.912 [info] Average of latest 20 total time NaN
2025-05-18 17:45:18.912 [info] Average of latest 20 client time 433.3117431640625
2025-05-18 17:45:18.912 [info] Average of latest 20 discrepencies NaN
2025-05-18 17:45:18.912 [info] CPP RT LOG: All stats {"streamingtime":408.422119140625,"actualTtftFromStart":189.762451171875,"timeTillServerRequest":52.68359375,"requestToTtft":137.078857421875,"totalTime":461.081298828125}
2025-05-18 17:45:19.552 [info] CURSOR LOG: requestId bc47e7b1-6fd6-4598-a8c7-21a0f6d4418f  
2025-05-18 17:45:19.996 [info] CURSOR LOG: Done streaming cpp with id bc47e7b1-6fd6-4598-a8c7-21a0f6d4418f
2025-05-18 17:45:19.996 [info] CPP RT LOG: Time taken for streaming cpp 445.043212890625 with request bc47e7b1-6fd6-4598-a8c7-21a0f6d4418f
2025-05-18 17:45:19.997 [info] CPP Request Log with id bc47e7b1-6fd6-4598-a8c7-21a0f6d4418f
2025-05-18 17:45:19.997 [info] =======>Model output 

2025-05-18 17:45:19.997 [info] =======>Debug stream time 318.96911800000817
2025-05-18 17:45:19.997 [info] =======>Debug ttft time 49.92002199986018
2025-05-18 17:45:19.997 [info] Average of latest 20 ttft time 94.39012889992736
2025-05-18 17:45:19.997 [info] Average of latest 20 stream time 292.1337019498489
2025-05-18 17:45:19.997 [info] Average of latest 20 total time NaN
2025-05-18 17:45:19.997 [info] Average of latest 20 client time 441.07752685546876
2025-05-18 17:45:19.997 [info] Average of latest 20 discrepencies NaN
2025-05-18 17:45:19.997 [info] CPP RT LOG: All stats {"streamingtime":445.043212890625,"actualTtftFromStart":175.701904296875,"timeTillServerRequest":53.384033203125,"requestToTtft":122.31787109375,"totalTime":498.40869140625}
2025-05-18 17:45:27.365 [info] CURSOR LOG: requestId 45aeff36-7186-47ab-95a6-99dafb1df566  
2025-05-18 17:45:27.776 [info] CURSOR LOG: Done streaming cpp with id 45aeff36-7186-47ab-95a6-99dafb1df566
2025-05-18 17:45:27.776 [info] CPP RT LOG: Time taken for streaming cpp 412.279541015625 with request 45aeff36-7186-47ab-95a6-99dafb1df566
2025-05-18 17:45:27.776 [info] CPP Request Log with id 45aeff36-7186-47ab-95a6-99dafb1df566
2025-05-18 17:45:27.776 [info] =======>Model output 

2025-05-18 17:45:27.776 [info] =======>Debug stream time 288.2658970002085
2025-05-18 17:45:27.776 [info] =======>Debug ttft time 90.648020000197
2025-05-18 17:45:27.777 [info] Average of latest 20 ttft time 89.55532444993733
2025-05-18 17:45:27.777 [info] Average of latest 20 stream time 278.21681899986
2025-05-18 17:45:27.777 [info] Average of latest 20 total time NaN
2025-05-18 17:45:27.777 [info] Average of latest 20 client time 422.5107666015625
2025-05-18 17:45:27.777 [info] Average of latest 20 discrepencies NaN
2025-05-18 17:45:27.777 [info] CPP RT LOG: All stats {"streamingtime":412.279541015625,"actualTtftFromStart":175.551513671875,"timeTillServerRequest":51.718017578125,"requestToTtft":123.83349609375,"totalTime":463.984375}
2025-05-18 17:45:31.440 [info] CURSOR LOG: requestId 5691e041-5b4e-451f-be86-99e1cdf05b0d  
2025-05-18 17:45:31.883 [info] CURSOR LOG: Done streaming cpp with id 5691e041-5b4e-451f-be86-99e1cdf05b0d
2025-05-18 17:45:31.883 [info] CPP RT LOG: Time taken for streaming cpp 443.16015625 with request 5691e041-5b4e-451f-be86-99e1cdf05b0d
2025-05-18 17:45:31.883 [info] CPP Request Log with id 5691e041-5b4e-451f-be86-99e1cdf05b0d
2025-05-18 17:45:31.883 [info] =======>Model output 

2025-05-18 17:45:31.883 [info] =======>Debug stream time 318.71985200000927
2025-05-18 17:45:31.883 [info] =======>Debug ttft time 91.40317199984565
2025-05-18 17:45:31.884 [info] Average of latest 20 ttft time 88.74578714995877
2025-05-18 17:45:31.884 [info] Average of latest 20 stream time 288.0713051498984
2025-05-18 17:45:31.884 [info] Average of latest 20 total time NaN
2025-05-18 17:45:31.884 [info] Average of latest 20 client time 432.0140869140625
2025-05-18 17:45:31.884 [info] Average of latest 20 discrepencies NaN
2025-05-18 17:45:31.884 [info] CPP RT LOG: All stats {"streamingtime":443.16015625,"actualTtftFromStart":176.762939453125,"timeTillServerRequest":51.56787109375,"requestToTtft":125.195068359375,"totalTime":494.714111328125}
2025-05-18 17:45:32.008 [info] CURSOR LOG: requestId 5ec5d51a-6fa0-4b19-9a81-334ecc50b9ff  
2025-05-18 17:45:32.472 [info] CURSOR LOG: Done streaming cpp with id 5ec5d51a-6fa0-4b19-9a81-334ecc50b9ff
2025-05-18 17:45:32.472 [info] CPP RT LOG: Time taken for streaming cpp 465.42236328125 with request 5ec5d51a-6fa0-4b19-9a81-334ecc50b9ff
2025-05-18 17:45:32.472 [info] CPP Request Log with id 5ec5d51a-6fa0-4b19-9a81-334ecc50b9ff
2025-05-18 17:45:32.472 [info] =======>Model output 

2025-05-18 17:45:32.472 [info] =======>Debug stream time 335.3477869993076
2025-05-18 17:45:32.472 [info] =======>Debug ttft time 72.00860499963164
2025-05-18 17:45:32.473 [info] Average of latest 20 ttft time 86.41772259994177
2025-05-18 17:45:32.473 [info] Average of latest 20 stream time 298.3614167998661
2025-05-18 17:45:32.473 [info] Average of latest 20 total time NaN
2025-05-18 17:45:32.473 [info] Average of latest 20 client time 442.4139404296875
2025-05-18 17:45:32.473 [info] Average of latest 20 discrepencies NaN
2025-05-18 17:45:32.473 [info] CPP RT LOG: All stats {"streamingtime":465.42236328125,"actualTtftFromStart":185.605224609375,"timeTillServerRequest":52.450439453125,"requestToTtft":133.15478515625,"totalTime":517.836181640625}
2025-05-18 17:45:32.662 [info] CURSOR LOG: requestId b26399c8-b1d1-4b42-9409-d366dc1a1fa5  
2025-05-18 17:45:33.082 [info] CURSOR LOG: Done streaming cpp with id b26399c8-b1d1-4b42-9409-d366dc1a1fa5
2025-05-18 17:45:33.082 [info] CPP RT LOG: Time taken for streaming cpp 420.97119140625 with request b26399c8-b1d1-4b42-9409-d366dc1a1fa5
2025-05-18 17:45:33.082 [info] CPP Request Log with id b26399c8-b1d1-4b42-9409-d366dc1a1fa5
2025-05-18 17:45:33.082 [info] =======>Model output 

2025-05-18 17:45:33.082 [info] =======>Debug stream time 294.3571660000016
2025-05-18 17:45:33.082 [info] =======>Debug ttft time 38.80277600005502
2025-05-18 17:45:33.083 [info] Average of latest 20 ttft time 83.05163399993035
2025-05-18 17:45:33.083 [info] Average of latest 20 stream time 297.30781509985974
2025-05-18 17:45:33.083 [info] Average of latest 20 total time NaN
2025-05-18 17:45:33.083 [info] Average of latest 20 client time 439.2872314453125
2025-05-18 17:45:33.083 [info] Average of latest 20 discrepencies NaN
2025-05-18 17:45:33.083 [info] CPP RT LOG: All stats {"streamingtime":420.97119140625,"actualTtftFromStart":179.066162109375,"timeTillServerRequest":52.36767578125,"requestToTtft":126.698486328125,"totalTime":473.289794921875}
2025-05-18 17:45:34.970 [info] CURSOR LOG: requestId 36515205-7d80-4a14-b588-d0cf35d6befe  
2025-05-18 17:45:35.444 [info] CURSOR LOG: Done streaming cpp with id 36515205-7d80-4a14-b588-d0cf35d6befe
2025-05-18 17:45:35.444 [info] CPP RT LOG: Time taken for streaming cpp 474.747802734375 with request 36515205-7d80-4a14-b588-d0cf35d6befe
2025-05-18 17:45:35.444 [info] CPP Request Log with id 36515205-7d80-4a14-b588-d0cf35d6befe
2025-05-18 17:45:35.444 [info] =======>Model output 

2025-05-18 17:45:35.444 [info] =======>Debug stream time 345.3429659996182
2025-05-18 17:45:35.444 [info] =======>Debug ttft time 95.18994299974293
2025-05-18 17:45:35.444 [info] Average of latest 20 ttft time 80.99956734992156
2025-05-18 17:45:35.444 [info] Average of latest 20 stream time 300.1166481998545
2025-05-18 17:45:35.444 [info] Average of latest 20 total time NaN
2025-05-18 17:45:35.444 [info] Average of latest 20 client time 442.484814453125
2025-05-18 17:45:35.444 [info] Average of latest 20 discrepencies NaN
2025-05-18 17:45:35.444 [info] CPP RT LOG: All stats {"streamingtime":474.747802734375,"actualTtftFromStart":184.380126953125,"timeTillServerRequest":57.6630859375,"requestToTtft":126.717041015625,"totalTime":532.390380859375}
2025-05-18 17:47:46.416 [info] CURSOR LOG: requestId cdde24e6-152f-4d97-b777-335c5acb673d  
2025-05-18 17:47:46.697 [info] CURSOR LOG: Done streaming cpp with id cdde24e6-152f-4d97-b777-335c5acb673d
2025-05-18 17:47:46.697 [info] CPP RT LOG: Time taken for streaming cpp 281.89501953125 with request cdde24e6-152f-4d97-b777-335c5acb673d
2025-05-18 17:47:46.697 [info] CPP Request Log with id cdde24e6-152f-4d97-b777-335c5acb673d
2025-05-18 17:47:46.697 [info] =======>Model output 

2025-05-18 17:47:46.697 [info] =======>Debug stream time 155.998112000525
2025-05-18 17:47:46.697 [info] =======>Debug ttft time 118.8369450001046
2025-05-18 17:47:46.699 [info] Average of latest 20 ttft time 81.95953154989111
2025-05-18 17:47:46.699 [info] Average of latest 20 stream time 283.76212799984785
2025-05-18 17:47:46.699 [info] Average of latest 20 total time NaN
2025-05-18 17:47:46.699 [info] Average of latest 20 client time 426.3144165039063
2025-05-18 17:47:46.699 [info] Average of latest 20 discrepencies NaN
2025-05-18 17:47:46.699 [info] CPP RT LOG: All stats {"streamingtime":281.89501953125,"actualTtftFromStart":187.210693359375,"timeTillServerRequest":59.29345703125,"requestToTtft":127.917236328125,"totalTime":341.16943359375}
2025-05-18 17:53:18.861 [info] CURSOR LOG: requestId b9da40f0-aa48-4cac-bb32-3a5da09118cf  
2025-05-18 17:53:19.139 [info] CURSOR LOG: Done streaming cpp with id b9da40f0-aa48-4cac-bb32-3a5da09118cf
2025-05-18 17:53:19.140 [info] CPP RT LOG: Time taken for streaming cpp 279.461669921875 with request b9da40f0-aa48-4cac-bb32-3a5da09118cf
2025-05-18 17:53:19.140 [info] CPP Request Log with id b9da40f0-aa48-4cac-bb32-3a5da09118cf
2025-05-18 17:53:19.140 [info] =======>Model output 

2025-05-18 17:53:19.140 [info] =======>Debug stream time 149.91381599986926
2025-05-18 17:53:19.140 [info] =======>Debug ttft time 138.7516459999606
2025-05-18 17:53:19.140 [info] Average of latest 20 ttft time 85.31842869987304
2025-05-18 17:53:19.140 [info] Average of latest 20 stream time 278.56914779986545
2025-05-18 17:53:19.140 [info] Average of latest 20 total time NaN
2025-05-18 17:53:19.140 [info] Average of latest 20 client time 421.49810791015625
2025-05-18 17:53:19.140 [info] Average of latest 20 discrepencies NaN
2025-05-18 17:53:19.140 [info] CPP RT LOG: All stats {"streamingtime":279.461669921875,"actualTtftFromStart":184.63134765625,"timeTillServerRequest":54.69873046875,"requestToTtft":129.9326171875,"totalTime":334.138427734375}
2025-05-18 17:53:23.566 [info] CURSOR LOG: requestId 5642f7e6-b29e-45c5-b3b5-de9447d6f7f9  
2025-05-18 17:53:24.047 [info] CURSOR LOG: Done streaming cpp with id 5642f7e6-b29e-45c5-b3b5-de9447d6f7f9
2025-05-18 17:53:24.047 [info] CPP RT LOG: Time taken for streaming cpp 482.4912109375 with request 5642f7e6-b29e-45c5-b3b5-de9447d6f7f9
2025-05-18 17:53:24.047 [info] CPP Request Log with id 5642f7e6-b29e-45c5-b3b5-de9447d6f7f9
2025-05-18 17:53:24.047 [info] =======>Model output 

2025-05-18 17:53:24.047 [info] =======>Debug stream time 347.0866410001181
2025-05-18 17:53:24.047 [info] =======>Debug ttft time 162.35055600013584
2025-05-18 17:53:24.048 [info] Average of latest 20 ttft time 88.17610729987791
2025-05-18 17:53:24.048 [info] Average of latest 20 stream time 277.7761399498704
2025-05-18 17:53:24.048 [info] Average of latest 20 total time NaN
2025-05-18 17:53:24.048 [info] Average of latest 20 client time 421.4097900390625
2025-05-18 17:53:24.048 [info] Average of latest 20 discrepencies NaN
2025-05-18 17:53:24.048 [info] CPP RT LOG: All stats {"streamingtime":482.4912109375,"actualTtftFromStart":212.55419921875,"timeTillServerRequest":80.603759765625,"requestToTtft":131.950439453125,"totalTime":563.056640625}
2025-05-18 18:00:07.382 [info] CURSOR LOG: requestId 340fca80-4065-4104-b4ab-83978e81b42e  
2025-05-18 18:00:07.835 [info] CURSOR LOG: Done streaming cpp with id 340fca80-4065-4104-b4ab-83978e81