$ C:\quantdiff\llama.cpp\bin\llama-server.exe -m C:\quantdiff\dl\campaign\dbf58f4c413b\gemma-4-12b-it-Q3_K_M.gguf --host 127.0.0.1 --port 8089 -c 4096 -np 1 -ngl 999 -fa on --jinja --seed 1234 --no-webui -a quant 0.00.105.595 I srv llama_server: initializing ... 0.00.105.602 I cmn common_param: common_params_print_info: verbosity = 3 (adjust with the `-lv N` CLI arg) 0.00.105.725 I srv init_listene: The UI is disabled 0.00.105.728 I srv init_listene: Use --ui/--no-ui (or deprecated --webui/--no-webui) to enable/disable 0.00.105.809 W srv llama_server: security: no API key is set and CORS allows all origins (see https://github.com/ggml-org/llama.cpp/pull/25655) 0.00.109.506 I srv load_model: loading model 'C:\quantdiff\dl\campaign\dbf58f4c413b\gemma-4-12b-it-Q3_K_M.gguf' 0.01.325.275 W load: control-looking token: 1 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.325.535 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.325.940 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.365.895 W load: '' is a normal token here, removing it from EOG list 0.03.277.386 I cmn init: llama threadpool init, n_threads = 8 0.03.357.585 I srv load_model: initializing, n_slots = 1, n_ctx_slot = 4096, kv_unified = 'false' 0.03.365.945 I srv llama_server: model loaded 0.03.365.950 I srv llama_server: listening on http://127.0.0.1:8089 0.04.544.611 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 0, t_last = -1 0.04.544.752 I slot launch_slot_: id 0 | task 0 | processing task, is_child = 0 0.04.986.130 I slot print_timing: id 0 | task 0 | prompt eval time = 139.51 ms / 160 tokens ( 0.87 ms per token, 1146.85 tokens per second) 0.04.986.136 I slot print_timing: id 0 | task 0 | eval time = 301.85 ms / 23 tokens ( 13.72 ms per token, 72.88 tokens per second) 0.04.986.137 I slot print_timing: id 0 | task 0 | total time = 441.36 ms / 183 tokens 0.04.986.143 I slot print_timing: id 0 | task 0 | graphs reused = 22 0.04.986.143 I slot print_timing: id 0 | task 0 | graph reallocs = 0 / 0 (same size) / (changed size) 0.04.986.168 I slot release: id 0 | task 0 | stop processing: n_tokens = 182, truncated = 0 0.05.016.139 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 182, t_last = 4882558 0.05.042.424 I slot launch_slot_: id 0 | task 26 | processing task, is_child = 0 0.05.406.570 I slot print_timing: id 0 | task 26 | prompt eval time = 95.60 ms / 113 tokens ( 0.85 ms per token, 1181.96 tokens per second) 0.05.406.575 I slot print_timing: id 0 | task 26 | eval time = 268.52 ms / 21 tokens ( 13.43 ms per token, 74.48 tokens per second) 0.05.406.576 I slot print_timing: id 0 | task 26 | total time = 364.13 ms / 134 tokens 0.05.406.577 I slot print_timing: id 0 | task 26 | graphs reused = 41 0.05.406.578 I slot print_timing: id 0 | task 26 | graph reallocs = 0 / 0 (same size) / (changed size) 0.05.406.600 I slot release: id 0 | task 26 | stop processing: n_tokens = 133, truncated = 0 0.05.435.732 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 133, t_last = 5302989 0.05.453.186 I slot launch_slot_: id 0 | task 50 | processing task, is_child = 0 0.05.858.436 I slot print_timing: id 0 | task 50 | prompt eval time = 109.45 ms / 153 tokens ( 0.72 ms per token, 1397.83 tokens per second) 0.05.858.442 I slot print_timing: id 0 | task 50 | eval time = 295.78 ms / 23 tokens ( 13.44 ms per token, 74.38 tokens per second) 0.05.858.443 I slot print_timing: id 0 | task 50 | total time = 405.23 ms / 176 tokens 0.05.858.443 I slot print_timing: id 0 | task 50 | graphs reused = 62 0.05.858.444 I slot print_timing: id 0 | task 50 | graph reallocs = 0 / 0 (same size) / (changed size) 0.05.858.471 I slot release: id 0 | task 50 | stop processing: n_tokens = 175, truncated = 0 0.05.888.980 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 175, t_last = 5754860 0.05.911.286 I slot launch_slot_: id 0 | task 76 | processing task, is_child = 0 0.06.332.352 I slot print_timing: id 0 | task 76 | prompt eval time = 124.64 ms / 194 tokens ( 0.64 ms per token, 1556.53 tokens per second) 0.06.332.358 I slot print_timing: id 0 | task 76 | eval time = 296.41 ms / 23 tokens ( 13.47 ms per token, 74.22 tokens per second) 0.06.332.359 I slot print_timing: id 0 | task 76 | total time = 421.05 ms / 217 tokens 0.06.332.360 I slot print_timing: id 0 | task 76 | graphs reused = 83 0.06.332.360 I slot print_timing: id 0 | task 76 | graph reallocs = 0 / 0 (same size) / (changed size) 0.06.332.386 I slot release: id 0 | task 76 | stop processing: n_tokens = 216, truncated = 0 0.06.357.294 I slot get_availabl: id 0 | task -1 | selected slot by LCP similarity, f_sim_best = 0.118 (> 0.100 thold), f_keep = 0.097 0.06.384.391 I slot launch_slot_: id 0 | task 102 | processing task, is_child = 0 0.06.855.985 I slot print_timing: id 0 | task 102 | prompt eval time = 124.09 ms / 178 tokens ( 0.70 ms per token, 1434.40 tokens per second) 0.06.855.991 I slot print_timing: id 0 | task 102 | eval time = 347.48 ms / 27 tokens ( 13.36 ms per token, 74.82 tokens per second) 0.06.855.992 I slot print_timing: id 0 | task 102 | total time = 471.57 ms / 205 tokens 0.06.855.992 I slot print_timing: id 0 | task 102 | graphs reused = 108 0.06.855.993 I slot print_timing: id 0 | task 102 | graph reallocs = 0 / 0 (same size) / (changed size) 0.06.856.017 I slot release: id 0 | task 102 | stop processing: n_tokens = 204, truncated = 0 0.06.872.722 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 204, t_last = 6752406 0.06.898.123 I slot launch_slot_: id 0 | task 132 | processing task, is_child = 0 0.07.463.098 I slot print_timing: id 0 | task 132 | prompt eval time = 122.95 ms / 169 tokens ( 0.73 ms per token, 1374.50 tokens per second) 0.07.463.104 I slot print_timing: id 0 | task 132 | eval time = 442.00 ms / 34 tokens ( 13.39 ms per token, 74.66 tokens per second) 0.07.463.105 I slot print_timing: id 0 | task 132 | total time = 564.96 ms / 203 tokens 0.07.463.106 I slot print_timing: id 0 | task 132 | graphs reused = 140 0.07.463.106 I slot print_timing: id 0 | task 132 | graph reallocs = 0 / 0 (same size) / (changed size) 0.07.463.129 I slot release: id 0 | task 132 | stop processing: n_tokens = 202, truncated = 0 0.07.469.152 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 202, t_last = 7359518 0.07.494.181 I slot launch_slot_: id 0 | task 169 | processing task, is_child = 0 0.07.938.140 I slot print_timing: id 0 | task 169 | prompt eval time = 133.75 ms / 212 tokens ( 0.63 ms per token, 1585.01 tokens per second) 0.07.938.147 I slot print_timing: id 0 | task 169 | eval time = 310.18 ms / 24 tokens ( 13.49 ms per token, 74.15 tokens per second) 0.07.938.148 I slot print_timing: id 0 | task 169 | total time = 443.94 ms / 236 tokens 0.07.938.149 I slot print_timing: id 0 | task 169 | graphs reused = 162 0.07.938.150 I slot print_timing: id 0 | task 169 | graph reallocs = 0 / 0 (same size) / (changed size) 0.07.938.180 I slot release: id 0 | task 169 | stop processing: n_tokens = 235, truncated = 0 0.07.975.940 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 235, t_last = 7834569 0.08.005.942 I slot launch_slot_: id 0 | task 196 | processing task, is_child = 0 0.08.618.191 I slot print_timing: id 0 | task 196 | prompt eval time = 149.99 ms / 264 tokens ( 0.57 ms per token, 1760.13 tokens per second) 0.08.618.196 I slot print_timing: id 0 | task 196 | eval time = 462.24 ms / 35 tokens ( 13.60 ms per token, 73.55 tokens per second) 0.08.618.197 I slot print_timing: id 0 | task 196 | total time = 612.23 ms / 299 tokens 0.08.618.198 I slot print_timing: id 0 | task 196 | graphs reused = 195 0.08.618.198 I slot print_timing: id 0 | task 196 | graph reallocs = 0 / 0 (same size) / (changed size) 0.08.618.228 I slot release: id 0 | task 196 | stop processing: n_tokens = 298, truncated = 0 0.08.645.188 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 298, t_last = 8514618 0.08.681.835 I slot launch_slot_: id 0 | task 234 | processing task, is_child = 0 0.09.178.292 I slot print_timing: id 0 | task 234 | prompt eval time = 105.08 ms / 140 tokens ( 0.75 ms per token, 1332.32 tokens per second) 0.09.178.298 I slot print_timing: id 0 | task 234 | eval time = 391.36 ms / 30 tokens ( 13.50 ms per token, 74.10 tokens per second) 0.09.178.299 I slot print_timing: id 0 | task 234 | total time = 496.44 ms / 170 tokens 0.09.178.300 I slot print_timing: id 0 | task 234 | graphs reused = 223 0.09.178.300 I slot print_timing: id 0 | task 234 | graph reallocs = 0 / 0 (same size) / (changed size) 0.09.178.320 I slot release: id 0 | task 234 | stop processing: n_tokens = 169, truncated = 0 0.09.209.469 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 169, t_last = 9074710 0.09.230.518 I slot launch_slot_: id 0 | task 267 | processing task, is_child = 0 0.09.582.677 I slot print_timing: id 0 | task 267 | prompt eval time = 110.18 ms / 156 tokens ( 0.71 ms per token, 1415.88 tokens per second) 0.09.582.683 I slot print_timing: id 0 | task 267 | eval time = 241.96 ms / 19 tokens ( 13.44 ms per token, 74.39 tokens per second) 0.09.582.684 I slot print_timing: id 0 | task 267 | total time = 352.14 ms / 175 tokens 0.09.582.685 I slot print_timing: id 0 | task 267 | graphs reused = 240 0.09.582.685 I slot print_timing: id 0 | task 267 | graph reallocs = 0 / 0 (same size) / (changed size) 0.09.582.708 I slot release: id 0 | task 267 | stop processing: n_tokens = 174, truncated = 0 0.09.588.802 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 174, t_last = 9479097 0.09.611.433 I slot launch_slot_: id 0 | task 289 | processing task, is_child = 0 0.10.185.600 I slot print_timing: id 0 | task 289 | prompt eval time = 120.08 ms / 164 tokens ( 0.73 ms per token, 1365.81 tokens per second) 0.10.185.606 I slot print_timing: id 0 | task 289 | eval time = 454.07 ms / 35 tokens ( 13.36 ms per token, 74.88 tokens per second) 0.10.185.607 I slot print_timing: id 0 | task 289 | total time = 574.15 ms / 199 tokens 0.10.185.607 I slot print_timing: id 0 | task 289 | graphs reused = 273 0.10.185.609 I slot print_timing: id 0 | task 289 | graph reallocs = 0 / 0 (same size) / (changed size) 0.10.185.632 I slot release: id 0 | task 289 | stop processing: n_tokens = 198, truncated = 0 0.10.222.563 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 198, t_last = 10082022 0.10.246.794 I slot launch_slot_: id 0 | task 327 | processing task, is_child = 0 0.10.739.300 I slot print_timing: id 0 | task 327 | prompt eval time = 131.89 ms / 204 tokens ( 0.65 ms per token, 1546.73 tokens per second) 0.10.739.305 I slot print_timing: id 0 | task 327 | eval time = 360.60 ms / 28 tokens ( 13.36 ms per token, 74.88 tokens per second) 0.10.739.306 I slot print_timing: id 0 | task 327 | total time = 492.49 ms / 232 tokens 0.10.739.307 I slot print_timing: id 0 | task 327 | graphs reused = 299 0.10.739.308 I slot print_timing: id 0 | task 327 | graph reallocs = 0 / 0 (same size) / (changed size) 0.10.739.335 I slot release: id 0 | task 327 | stop processing: n_tokens = 231, truncated = 0 0.10.771.297 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 231, t_last = 10635725 0.10.799.670 I slot launch_slot_: id 0 | task 358 | processing task, is_child = 0 0.11.365.425 I slot print_timing: id 0 | task 358 | prompt eval time = 112.77 ms / 171 tokens ( 0.66 ms per token, 1516.35 tokens per second) 0.11.365.431 I slot print_timing: id 0 | task 358 | eval time = 452.97 ms / 35 tokens ( 13.32 ms per token, 75.06 tokens per second) 0.11.365.432 I slot print_timing: id 0 | task 358 | total time = 565.74 ms / 206 tokens 0.11.365.433 I slot print_timing: id 0 | task 358 | graphs reused = 332 0.11.365.433 I slot print_timing: id 0 | task 358 | graph reallocs = 0 / 0 (same size) / (changed size) 0.11.365.454 I slot release: id 0 | task 358 | stop processing: n_tokens = 205, truncated = 0 0.11.382.631 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 205, t_last = 11261843 0.11.406.976 I slot launch_slot_: id 0 | task 396 | processing task, is_child = 0 0.11.875.939 I slot print_timing: id 0 | task 396 | prompt eval time = 121.35 ms / 168 tokens ( 0.72 ms per token, 1384.41 tokens per second) 0.11.875.945 I slot print_timing: id 0 | task 396 | eval time = 347.60 ms / 27 tokens ( 13.37 ms per token, 74.80 tokens per second) 0.11.875.946 I slot print_timing: id 0 | task 396 | total time = 468.95 ms / 195 tokens 0.11.875.946 I slot print_timing: id 0 | task 396 | graphs reused = 357 0.11.875.947 I slot print_timing: id 0 | task 396 | graph reallocs = 0 / 0 (same size) / (changed size) 0.11.875.970 I slot release: id 0 | task 396 | stop processing: n_tokens = 194, truncated = 0 0.11.881.713 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 194, t_last = 11772360 0.11.906.310 I slot launch_slot_: id 0 | task 426 | processing task, is_child = 0 0.12.531.294 I slot print_timing: id 0 | task 426 | prompt eval time = 119.80 ms / 167 tokens ( 0.72 ms per token, 1394.04 tokens per second) 0.12.531.300 I slot print_timing: id 0 | task 426 | eval time = 505.17 ms / 39 tokens ( 13.29 ms per token, 75.22 tokens per second) 0.12.531.301 I slot print_timing: id 0 | task 426 | total time = 624.96 ms / 206 tokens 0.12.531.301 I slot print_timing: id 0 | task 426 | graphs reused = 394 0.12.531.302 I slot print_timing: id 0 | task 426 | graph reallocs = 0 / 0 (same size) / (changed size) 0.12.531.325 I slot release: id 0 | task 426 | stop processing: n_tokens = 205, truncated = 0 0.12.566.978 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 205, t_last = 12427714 0.12.592.039 I slot launch_slot_: id 0 | task 468 | processing task, is_child = 0 0.13.112.721 I slot print_timing: id 0 | task 468 | prompt eval time = 103.81 ms / 141 tokens ( 0.74 ms per token, 1358.28 tokens per second) 0.13.112.726 I slot print_timing: id 0 | task 468 | eval time = 416.86 ms / 27 tokens ( 16.03 ms per token, 62.37 tokens per second) 0.13.112.727 I slot print_timing: id 0 | task 468 | total time = 520.67 ms / 168 tokens 0.13.112.728 I slot print_timing: id 0 | task 468 | graphs reused = 419 0.13.112.729 I slot print_timing: id 0 | task 468 | graph reallocs = 0 / 0 (same size) / (changed size) 0.13.112.749 I slot release: id 0 | task 468 | stop processing: n_tokens = 167, truncated = 0 0.13.143.119 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 167, t_last = 13009138 0.13.165.634 I slot launch_slot_: id 0 | task 498 | processing task, is_child = 0 0.13.540.344 I slot print_timing: id 0 | task 498 | prompt eval time = 119.72 ms / 163 tokens ( 0.73 ms per token, 1361.52 tokens per second) 0.13.540.350 I slot print_timing: id 0 | task 498 | eval time = 254.97 ms / 20 tokens ( 13.42 ms per token, 74.52 tokens per second) 0.13.540.351 I slot print_timing: id 0 | task 498 | total time = 374.69 ms / 183 tokens 0.13.540.351 I slot print_timing: id 0 | task 498 | graphs reused = 437 0.13.540.352 I slot print_timing: id 0 | task 498 | graph reallocs = 0 / 0 (same size) / (changed size) 0.13.540.374 I slot release: id 0 | task 498 | stop processing: n_tokens = 182, truncated = 0 0.13.564.515 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 182, t_last = 13436764 0.13.587.709 I slot launch_slot_: id 0 | task 521 | processing task, is_child = 0 0.13.948.597 I slot print_timing: id 0 | task 521 | prompt eval time = 105.67 ms / 145 tokens ( 0.73 ms per token, 1372.24 tokens per second) 0.13.948.603 I slot print_timing: id 0 | task 521 | eval time = 255.20 ms / 20 tokens ( 13.43 ms per token, 74.45 tokens per second) 0.13.948.604 I slot print_timing: id 0 | task 521 | total time = 360.87 ms / 165 tokens 0.13.948.605 I slot print_timing: id 0 | task 521 | graphs reused = 455 0.13.948.605 I slot print_timing: id 0 | task 521 | graph reallocs = 0 / 0 (same size) / (changed size) 0.13.948.626 I slot release: id 0 | task 521 | stop processing: n_tokens = 164, truncated = 0 0.13.971.325 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 164, t_last = 13845015 0.13.992.410 I slot launch_slot_: id 0 | task 544 | processing task, is_child = 0 0.14.312.498 I slot print_timing: id 0 | task 544 | prompt eval time = 104.71 ms / 140 tokens ( 0.75 ms per token, 1337.05 tokens per second) 0.14.312.503 I slot print_timing: id 0 | task 544 | eval time = 215.36 ms / 17 tokens ( 13.46 ms per token, 74.29 tokens per second) 0.14.312.504 I slot print_timing: id 0 | task 544 | total time = 320.07 ms / 157 tokens 0.14.312.505 I slot print_timing: id 0 | task 544 | graphs reused = 470 0.14.312.506 I slot print_timing: id 0 | task 544 | graph reallocs = 0 / 0 (same size) / (changed size) 0.14.312.527 I slot release: id 0 | task 544 | stop processing: n_tokens = 156, truncated = 0 0.14.333.200 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 156, t_last = 14208916 0.14.353.322 I slot launch_slot_: id 0 | task 564 | processing task, is_child = 0 0.14.975.715 I slot print_timing: id 0 | task 564 | prompt eval time = 122.10 ms / 173 tokens ( 0.71 ms per token, 1416.86 tokens per second) 0.14.975.721 I slot print_timing: id 0 | task 564 | eval time = 500.27 ms / 38 tokens ( 13.52 ms per token, 73.96 tokens per second) 0.14.975.722 I slot print_timing: id 0 | task 564 | total time = 622.37 ms / 211 tokens 0.14.975.723 I slot print_timing: id 0 | task 564 | graphs reused = 506 0.14.975.724 I slot print_timing: id 0 | task 564 | graph reallocs = 0 / 0 (same size) / (changed size) 0.14.975.752 I slot release: id 0 | task 564 | stop processing: n_tokens = 210, truncated = 0 0.14.993.576 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 210, t_last = 14872142 0.15.021.722 I slot launch_slot_: id 0 | task 605 | processing task, is_child = 0 0.15.671.853 I slot print_timing: id 0 | task 605 | prompt eval time = 112.50 ms / 158 tokens ( 0.71 ms per token, 1404.46 tokens per second) 0.15.671.858 I slot print_timing: id 0 | task 605 | eval time = 537.61 ms / 33 tokens ( 16.80 ms per token, 59.52 tokens per second) 0.15.671.859 I slot print_timing: id 0 | task 605 | total time = 650.11 ms / 191 tokens 0.15.671.860 I slot print_timing: id 0 | task 605 | graphs reused = 537 0.15.671.861 I slot print_timing: id 0 | task 605 | graph reallocs = 0 / 0 (same size) / (changed size) 0.15.671.884 I slot release: id 0 | task 605 | stop processing: n_tokens = 190, truncated = 0 0.15.696.310 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 190, t_last = 15568273 0.15.723.974 I slot launch_slot_: id 0 | task 641 | processing task, is_child = 0 0.16.304.954 I slot print_timing: id 0 | task 641 | prompt eval time = 131.05 ms / 200 tokens ( 0.66 ms per token, 1526.14 tokens per second) 0.16.304.960 I slot print_timing: id 0 | task 641 | eval time = 449.91 ms / 34 tokens ( 13.63 ms per token, 73.35 tokens per second) 0.16.304.961 I slot print_timing: id 0 | task 641 | total time = 580.96 ms / 234 tokens 0.16.304.962 I slot print_timing: id 0 | task 641 | graphs reused = 569 0.16.304.963 I slot print_timing: id 0 | task 641 | graph reallocs = 0 / 0 (same size) / (changed size) 0.16.304.988 I slot release: id 0 | task 641 | stop processing: n_tokens = 233, truncated = 0 0.16.336.369 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 233, t_last = 16201377 0.16.368.424 I slot launch_slot_: id 0 | task 678 | processing task, is_child = 0 0.16.899.262 I slot print_timing: id 0 | task 678 | prompt eval time = 124.34 ms / 184 tokens ( 0.68 ms per token, 1479.79 tokens per second) 0.16.899.269 I slot print_timing: id 0 | task 678 | eval time = 406.47 ms / 31 tokens ( 13.55 ms per token, 73.81 tokens per second) 0.16.899.270 I slot print_timing: id 0 | task 678 | total time = 530.82 ms / 215 tokens 0.16.899.271 I slot print_timing: id 0 | task 678 | graphs reused = 598 0.16.899.272 I slot print_timing: id 0 | task 678 | graph reallocs = 0 / 0 (same size) / (changed size) 0.16.899.296 I slot release: id 0 | task 678 | stop processing: n_tokens = 214, truncated = 0 0.16.930.165 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 214, t_last = 16795685 0.16.961.225 I slot launch_slot_: id 0 | task 712 | processing task, is_child = 0 0.17.807.283 I slot print_timing: id 0 | task 712 | prompt eval time = 127.55 ms / 196 tokens ( 0.65 ms per token, 1536.65 tokens per second) 0.17.807.289 I slot print_timing: id 0 | task 712 | eval time = 718.49 ms / 55 tokens ( 13.31 ms per token, 75.16 tokens per second) 0.17.807.290 I slot print_timing: id 0 | task 712 | total time = 846.03 ms / 251 tokens 0.17.807.291 I slot print_timing: id 0 | task 712 | graphs reused = 651 0.17.807.292 I slot print_timing: id 0 | task 712 | graph reallocs = 0 / 0 (same size) / (changed size) 0.17.807.319 I slot release: id 0 | task 712 | stop processing: n_tokens = 250, truncated = 0 0.17.813.611 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 250, t_last = 17703708 0.17.846.287 I slot launch_slot_: id 0 | task 770 | processing task, is_child = 0 0.18.477.705 I slot print_timing: id 0 | task 770 | prompt eval time = 139.08 ms / 232 tokens ( 0.60 ms per token, 1668.13 tokens per second) 0.18.477.712 I slot print_timing: id 0 | task 770 | eval time = 492.31 ms / 37 tokens ( 13.68 ms per token, 73.12 tokens per second) 0.18.477.714 I slot print_timing: id 0 | task 770 | total time = 631.39 ms / 269 tokens 0.18.477.714 I slot print_timing: id 0 | task 770 | graphs reused = 685 0.18.477.715 I slot print_timing: id 0 | task 770 | graph reallocs = 0 / 0 (same size) / (changed size) 0.18.477.753 I slot release: id 0 | task 770 | stop processing: n_tokens = 268, truncated = 0 0.18.500.935 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 268, t_last = 18374142 0.18.537.100 I slot launch_slot_: id 0 | task 810 | processing task, is_child = 0 0.19.138.388 I slot print_timing: id 0 | task 810 | prompt eval time = 127.89 ms / 193 tokens ( 0.66 ms per token, 1509.11 tokens per second) 0.19.138.394 I slot print_timing: id 0 | task 810 | eval time = 473.38 ms / 36 tokens ( 13.53 ms per token, 73.94 tokens per second) 0.19.138.395 I slot print_timing: id 0 | task 810 | total time = 601.27 ms / 229 tokens 0.19.138.396 I slot print_timing: id 0 | task 810 | graphs reused = 719 0.19.138.396 I slot print_timing: id 0 | task 810 | graph reallocs = 0 / 0 (same size) / (changed size) 0.19.138.419 I slot release: id 0 | task 810 | stop processing: n_tokens = 228, truncated = 0 0.19.163.184 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 228, t_last = 19034808 0.19.194.886 I slot launch_slot_: id 0 | task 849 | processing task, is_child = 0 0.19.714.061 I slot print_timing: id 0 | task 849 | prompt eval time = 107.99 ms / 148 tokens ( 0.73 ms per token, 1370.48 tokens per second) 0.19.714.067 I slot print_timing: id 0 | task 849 | eval time = 411.16 ms / 32 tokens ( 13.26 ms per token, 75.40 tokens per second) 0.19.714.068 I slot print_timing: id 0 | task 849 | total time = 519.15 ms / 180 tokens 0.19.714.068 I slot print_timing: id 0 | task 849 | graphs reused = 749 0.19.714.069 I slot print_timing: id 0 | task 849 | graph reallocs = 0 / 0 (same size) / (changed size) 0.19.714.090 I slot release: id 0 | task 849 | stop processing: n_tokens = 179, truncated = 0 0.19.756.506 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 179, t_last = 19610479 0.19.779.990 I slot launch_slot_: id 0 | task 884 | processing task, is_child = 0 0.20.429.421 I slot print_timing: id 0 | task 884 | prompt eval time = 120.62 ms / 174 tokens ( 0.69 ms per token, 1442.57 tokens per second) 0.20.429.426 I slot print_timing: id 0 | task 884 | eval time = 528.79 ms / 41 tokens ( 13.22 ms per token, 75.64 tokens per second) 0.20.429.427 I slot print_timing: id 0 | task 884 | total time = 649.41 ms / 215 tokens 0.20.429.428 I slot print_timing: id 0 | task 884 | graphs reused = 788 0.20.429.429 I slot print_timing: id 0 | task 884 | graph reallocs = 0 / 0 (same size) / (changed size) 0.20.429.450 I slot release: id 0 | task 884 | stop processing: n_tokens = 214, truncated = 0 0.20.462.968 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 214, t_last = 20325839 0.20.488.122 I slot launch_slot_: id 0 | task 928 | processing task, is_child = 0 0.21.278.676 I slot print_timing: id 0 | task 928 | prompt eval time = 129.88 ms / 204 tokens ( 0.64 ms per token, 1570.64 tokens per second) 0.21.278.681 I slot print_timing: id 0 | task 928 | eval time = 660.65 ms / 51 tokens ( 13.21 ms per token, 75.68 tokens per second) 0.21.278.682 I slot print_timing: id 0 | task 928 | total time = 790.53 ms / 255 tokens 0.21.278.683 I slot print_timing: id 0 | task 928 | graphs reused = 837 0.21.278.683 I slot print_timing: id 0 | task 928 | graph reallocs = 0 / 0 (same size) / (changed size) 0.21.278.707 I slot release: id 0 | task 928 | stop processing: n_tokens = 254, truncated = 0 0.21.323.473 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 254, t_last = 21175097 0.21.352.583 I slot launch_slot_: id 0 | task 982 | processing task, is_child = 0 0.21.950.159 I slot print_timing: id 0 | task 982 | prompt eval time = 120.71 ms / 178 tokens ( 0.68 ms per token, 1474.65 tokens per second) 0.21.950.165 I slot print_timing: id 0 | task 982 | eval time = 476.85 ms / 37 tokens ( 13.25 ms per token, 75.50 tokens per second) 0.21.950.166 I slot print_timing: id 0 | task 982 | total time = 597.56 ms / 215 tokens 0.21.950.167 I slot print_timing: id 0 | task 982 | graphs reused = 872 0.21.950.167 I slot print_timing: id 0 | task 982 | graph reallocs = 0 / 0 (same size) / (changed size) 0.21.950.188 I slot release: id 0 | task 982 | stop processing: n_tokens = 214, truncated = 0 0.21.978.099 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 214, t_last = 21846578 0.22.003.882 I slot launch_slot_: id 0 | task 1022 | processing task, is_child = 0 0.22.573.201 I slot print_timing: id 0 | task 1022 | prompt eval time = 105.88 ms / 153 tokens ( 0.69 ms per token, 1444.99 tokens per second) 0.22.573.206 I slot print_timing: id 0 | task 1022 | eval time = 463.42 ms / 36 tokens ( 13.24 ms per token, 75.53 tokens per second) 0.22.573.207 I slot print_timing: id 0 | task 1022 | total time = 569.30 ms / 189 tokens 0.22.573.208 I slot print_timing: id 0 | task 1022 | graphs reused = 906 0.22.573.209 I slot print_timing: id 0 | task 1022 | graph reallocs = 0 / 0 (same size) / (changed size) 0.22.573.231 I slot release: id 0 | task 1022 | stop processing: n_tokens = 188, truncated = 0 0.22.619.091 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 188, t_last = 22469620 0.22.641.932 I slot launch_slot_: id 0 | task 1061 | processing task, is_child = 0 0.23.000.673 I slot print_timing: id 0 | task 1061 | prompt eval time = 116.65 ms / 154 tokens ( 0.76 ms per token, 1320.17 tokens per second) 0.23.000.679 I slot print_timing: id 0 | task 1061 | eval time = 242.07 ms / 19 tokens ( 13.45 ms per token, 74.36 tokens per second) 0.23.000.680 I slot print_timing: id 0 | task 1061 | total time = 358.72 ms / 173 tokens 0.23.000.681 I slot print_timing: id 0 | task 1061 | graphs reused = 923 0.23.000.682 I slot print_timing: id 0 | task 1061 | graph reallocs = 0 / 0 (same size) / (changed size) 0.23.000.703 I slot release: id 0 | task 1061 | stop processing: n_tokens = 172, truncated = 0 0.23.031.230 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 172, t_last = 22897092 0.23.052.987 I slot launch_slot_: id 0 | task 1083 | processing task, is_child = 0 0.23.675.309 I slot print_timing: id 0 | task 1083 | prompt eval time = 119.37 ms / 179 tokens ( 0.67 ms per token, 1499.59 tokens per second) 0.23.675.314 I slot print_timing: id 0 | task 1083 | eval time = 502.94 ms / 39 tokens ( 13.24 ms per token, 75.56 tokens per second) 0.23.675.315 I slot print_timing: id 0 | task 1083 | total time = 622.30 ms / 218 tokens 0.23.675.315 I slot print_timing: id 0 | task 1083 | graphs reused = 960 0.23.675.316 I slot print_timing: id 0 | task 1083 | graph reallocs = 0 / 0 (same size) / (changed size) 0.23.675.339 I slot release: id 0 | task 1083 | stop processing: n_tokens = 217, truncated = 0 0.23.719.494 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 217, t_last = 23571728 0.23.745.324 I slot launch_slot_: id 0 | task 1125 | processing task, is_child = 0 0.24.431.358 I slot print_timing: id 0 | task 1125 | prompt eval time = 130.48 ms / 207 tokens ( 0.63 ms per token, 1586.41 tokens per second) 0.24.431.364 I slot print_timing: id 0 | task 1125 | eval time = 555.54 ms / 43 tokens ( 13.23 ms per token, 75.60 tokens per second) 0.24.431.365 I slot print_timing: id 0 | task 1125 | total time = 686.02 ms / 250 tokens 0.24.431.365 I slot print_timing: id 0 | task 1125 | graphs reused = 1001 0.24.431.366 I slot print_timing: id 0 | task 1125 | graph reallocs = 0 / 0 (same size) / (changed size) 0.24.431.389 I slot release: id 0 | task 1125 | stop processing: n_tokens = 249, truncated = 0 0.24.466.415 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 249, t_last = 24327778 0.24.495.987 I slot launch_slot_: id 0 | task 1171 | processing task, is_child = 0 0.24.986.310 I slot print_timing: id 0 | task 1171 | prompt eval time = 104.92 ms / 140 tokens ( 0.75 ms per token, 1334.29 tokens per second) 0.24.986.316 I slot print_timing: id 0 | task 1171 | eval time = 385.38 ms / 30 tokens ( 13.29 ms per token, 75.25 tokens per second) 0.24.986.317 I slot print_timing: id 0 | task 1171 | total time = 490.30 ms / 170 tokens 0.24.986.318 I slot print_timing: id 0 | task 1171 | graphs reused = 1029 0.24.986.318 I slot print_timing: id 0 | task 1171 | graph reallocs = 0 / 0 (same size) / (changed size) 0.24.986.343 I slot release: id 0 | task 1171 | stop processing: n_tokens = 169, truncated = 0 0.25.016.786 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 169, t_last = 24882733 0.25.038.303 I slot launch_slot_: id 0 | task 1204 | processing task, is_child = 0 0.25.569.108 I slot print_timing: id 0 | task 1204 | prompt eval time = 129.91 ms / 189 tokens ( 0.69 ms per token, 1454.86 tokens per second) 0.25.569.114 I slot print_timing: id 0 | task 1204 | eval time = 400.87 ms / 30 tokens ( 13.82 ms per token, 72.34 tokens per second) 0.25.569.115 I slot print_timing: id 0 | task 1204 | total time = 530.78 ms / 219 tokens 0.25.569.116 I slot print_timing: id 0 | task 1204 | graphs reused = 1057 0.25.569.117 I slot print_timing: id 0 | task 1204 | graph reallocs = 0 / 0 (same size) / (changed size) 0.25.569.140 I slot release: id 0 | task 1204 | stop processing: n_tokens = 218, truncated = 0 0.25.591.856 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 218, t_last = 25465529 0.25.618.465 I slot launch_slot_: id 0 | task 1237 | processing task, is_child = 0 0.26.005.567 I slot print_timing: id 0 | task 1237 | prompt eval time = 97.27 ms / 114 tokens ( 0.85 ms per token, 1172.01 tokens per second) 0.26.005.573 I slot print_timing: id 0 | task 1237 | eval time = 289.81 ms / 22 tokens ( 13.80 ms per token, 72.46 tokens per second) 0.26.005.574 I slot print_timing: id 0 | task 1237 | total time = 387.08 ms / 136 tokens 0.26.005.575 I slot print_timing: id 0 | task 1237 | graphs reused = 1077 0.26.005.576 I slot print_timing: id 0 | task 1237 | graph reallocs = 0 / 0 (same size) / (changed size) 0.26.005.596 I slot release: id 0 | task 1237 | stop processing: n_tokens = 135, truncated = 0 0.26.043.973 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 135, t_last = 25901985 0.26.062.551 I slot launch_slot_: id 0 | task 1262 | processing task, is_child = 0 0.26.531.354 I slot print_timing: id 0 | task 1262 | prompt eval time = 101.53 ms / 126 tokens ( 0.81 ms per token, 1241.06 tokens per second) 0.26.531.360 I slot print_timing: id 0 | task 1262 | eval time = 367.26 ms / 28 tokens ( 13.60 ms per token, 73.52 tokens per second) 0.26.531.361 I slot print_timing: id 0 | task 1262 | total time = 468.78 ms / 154 tokens 0.26.531.362 I slot print_timing: id 0 | task 1262 | graphs reused = 1103 0.26.531.363 I slot print_timing: id 0 | task 1262 | graph reallocs = 0 / 0 (same size) / (changed size) 0.26.531.382 I slot release: id 0 | task 1262 | stop processing: n_tokens = 153, truncated = 0 0.26.547.033 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 153, t_last = 26427771 0.26.565.798 I slot launch_slot_: id 0 | task 1293 | processing task, is_child = 0 0.26.936.389 I slot print_timing: id 0 | task 1293 | prompt eval time = 103.35 ms / 135 tokens ( 0.77 ms per token, 1306.25 tokens per second) 0.26.936.395 I slot print_timing: id 0 | task 1293 | eval time = 267.22 ms / 21 tokens ( 13.36 ms per token, 74.84 tokens per second) 0.26.936.396 I slot print_timing: id 0 | task 1293 | total time = 370.57 ms / 156 tokens 0.26.936.397 I slot print_timing: id 0 | task 1293 | graphs reused = 1122 0.26.936.398 I slot print_timing: id 0 | task 1293 | graph reallocs = 0 / 0 (same size) / (changed size) 0.26.936.417 I slot release: id 0 | task 1293 | stop processing: n_tokens = 155, truncated = 0 0.26.980.413 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 155, t_last = 26832806 0.27.000.396 I slot launch_slot_: id 0 | task 1317 | processing task, is_child = 0 0.27.473.660 I slot print_timing: id 0 | task 1317 | prompt eval time = 101.08 ms / 125 tokens ( 0.81 ms per token, 1236.68 tokens per second) 0.27.473.666 I slot print_timing: id 0 | task 1317 | eval time = 372.17 ms / 29 tokens ( 13.29 ms per token, 75.24 tokens per second) 0.27.473.667 I slot print_timing: id 0 | task 1317 | total time = 473.24 ms / 154 tokens 0.27.473.668 I slot print_timing: id 0 | task 1317 | graphs reused = 1149 0.27.473.669 I slot print_timing: id 0 | task 1317 | graph reallocs = 0 / 0 (same size) / (changed size) 0.27.473.688 I slot release: id 0 | task 1317 | stop processing: n_tokens = 153, truncated = 0 0.27.495.724 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 153, t_last = 27370078 0.27.514.414 I slot launch_slot_: id 0 | task 1349 | processing task, is_child = 0 0.28.014.920 I slot print_timing: id 0 | task 1349 | prompt eval time = 123.89 ms / 191 tokens ( 0.65 ms per token, 1541.72 tokens per second) 0.28.014.926 I slot print_timing: id 0 | task 1349 | eval time = 376.60 ms / 29 tokens ( 13.45 ms per token, 74.35 tokens per second) 0.28.014.927 I slot print_timing: id 0 | task 1349 | total time = 500.49 ms / 220 tokens 0.28.014.928 I slot print_timing: id 0 | task 1349 | graphs reused = 1176 0.28.014.928 I slot print_timing: id 0 | task 1349 | graph reallocs = 0 / 0 (same size) / (changed size) 0.28.014.952 I slot release: id 0 | task 1349 | stop processing: n_tokens = 219, truncated = 0 0.28.022.049 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 219, t_last = 27911341 0.28.049.280 I slot launch_slot_: id 0 | task 1381 | processing task, is_child = 0 0.28.818.296 I slot print_timing: id 0 | task 1381 | prompt eval time = 167.56 ms / 309 tokens ( 0.54 ms per token, 1844.16 tokens per second) 0.28.818.302 I slot print_timing: id 0 | task 1381 | eval time = 601.44 ms / 44 tokens ( 13.99 ms per token, 71.50 tokens per second) 0.28.818.303 I slot print_timing: id 0 | task 1381 | total time = 768.99 ms / 353 tokens 0.28.818.304 I slot print_timing: id 0 | task 1381 | graphs reused = 1218 0.28.818.305 I slot print_timing: id 0 | task 1381 | graph reallocs = 0 / 0 (same size) / (changed size) 0.28.818.337 I slot release: id 0 | task 1381 | stop processing: n_tokens = 352, truncated = 0 0.28.853.348 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 352, t_last = 28714726 0.28.895.287 I slot launch_slot_: id 0 | task 1428 | processing task, is_child = 0 0.29.364.437 I slot print_timing: id 0 | task 1428 | prompt eval time = 105.46 ms / 139 tokens ( 0.76 ms per token, 1318.09 tokens per second) 0.29.364.443 I slot print_timing: id 0 | task 1428 | eval time = 363.67 ms / 27 tokens ( 13.99 ms per token, 71.49 tokens per second) 0.29.364.444 I slot print_timing: id 0 | task 1428 | total time = 469.13 ms / 166 tokens 0.29.364.444 I slot print_timing: id 0 | task 1428 | graphs reused = 1243 0.29.364.445 I slot print_timing: id 0 | task 1428 | graph reallocs = 0 / 0 (same size) / (changed size) 0.29.364.468 I slot release: id 0 | task 1428 | stop processing: n_tokens = 165, truncated = 0 0.29.385.723 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 165, t_last = 29260857 0.29.406.215 I slot launch_slot_: id 0 | task 1458 | processing task, is_child = 0 0.29.945.936 I slot print_timing: id 0 | task 1458 | prompt eval time = 122.93 ms / 172 tokens ( 0.71 ms per token, 1399.19 tokens per second) 0.29.945.941 I slot print_timing: id 0 | task 1458 | eval time = 416.77 ms / 31 tokens ( 13.89 ms per token, 71.98 tokens per second) 0.29.945.942 I slot print_timing: id 0 | task 1458 | total time = 539.70 ms / 203 tokens 0.29.945.943 I slot print_timing: id 0 | task 1458 | graphs reused = 1272 0.29.945.944 I slot print_timing: id 0 | task 1458 | graph reallocs = 0 / 0 (same size) / (changed size) 0.29.945.968 I slot release: id 0 | task 1458 | stop processing: n_tokens = 202, truncated = 0 0.29.978.817 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 202, t_last = 29842358 0.30.003.437 I slot launch_slot_: id 0 | task 1492 | processing task, is_child = 0 0.30.679.202 I slot print_timing: id 0 | task 1492 | prompt eval time = 138.16 ms / 225 tokens ( 0.61 ms per token, 1628.53 tokens per second) 0.30.679.208 I slot print_timing: id 0 | task 1492 | eval time = 537.59 ms / 40 tokens ( 13.78 ms per token, 72.55 tokens per second) 0.30.679.209 I slot print_timing: id 0 | task 1492 | total time = 675.75 ms / 265 tokens 0.30.679.210 I slot print_timing: id 0 | task 1492 | graphs reused = 1309 0.30.679.211 I slot print_timing: id 0 | task 1492 | graph reallocs = 0 / 0 (same size) / (changed size) 0.30.679.236 I slot release: id 0 | task 1492 | stop processing: n_tokens = 264, truncated = 0 0.30.685.194 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 264, t_last = 30575625 0.30.716.641 I slot launch_slot_: id 0 | task 1535 | processing task, is_child = 0 0.31.339.491 I slot print_timing: id 0 | task 1535 | prompt eval time = 132.45 ms / 225 tokens ( 0.59 ms per token, 1698.78 tokens per second) 0.31.339.497 I slot print_timing: id 0 | task 1535 | eval time = 490.38 ms / 32 tokens ( 15.82 ms per token, 63.22 tokens per second) 0.31.339.497 I slot print_timing: id 0 | task 1535 | total time = 622.83 ms / 257 tokens 0.31.339.498 I slot print_timing: id 0 | task 1535 | graphs reused = 1339 0.31.339.499 I slot print_timing: id 0 | task 1535 | graph reallocs = 0 / 0 (same size) / (changed size) 0.31.339.525 I slot release: id 0 | task 1535 | stop processing: n_tokens = 256, truncated = 0 0.31.370.446 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 256, t_last = 31235914 0.31.401.547 I slot launch_slot_: id 0 | task 1570 | processing task, is_child = 0 0.31.873.747 I slot print_timing: id 0 | task 1570 | prompt eval time = 105.83 ms / 147 tokens ( 0.72 ms per token, 1388.99 tokens per second) 0.31.873.752 I slot print_timing: id 0 | task 1570 | eval time = 366.35 ms / 28 tokens ( 13.57 ms per token, 73.70 tokens per second) 0.31.873.753 I slot print_timing: id 0 | task 1570 | total time = 472.18 ms / 175 tokens 0.31.873.754 I slot print_timing: id 0 | task 1570 | graphs reused = 1365 0.31.873.755 I slot print_timing: id 0 | task 1570 | graph reallocs = 0 / 0 (same size) / (changed size) 0.31.873.777 I slot release: id 0 | task 1570 | stop processing: n_tokens = 174, truncated = 0 0.31.900.190 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 174, t_last = 31770166 0.31.922.818 I slot launch_slot_: id 0 | task 1601 | processing task, is_child = 0 0.32.470.671 I slot print_timing: id 0 | task 1601 | prompt eval time = 122.56 ms / 166 tokens ( 0.74 ms per token, 1354.45 tokens per second) 0.32.470.677 I slot print_timing: id 0 | task 1601 | eval time = 425.27 ms / 32 tokens ( 13.72 ms per token, 72.89 tokens per second) 0.32.470.678 I slot print_timing: id 0 | task 1601 | total time = 547.83 ms / 198 tokens 0.32.470.679 I slot print_timing: id 0 | task 1601 | graphs reused = 1395 0.32.470.680 I slot print_timing: id 0 | task 1601 | graph reallocs = 0 / 0 (same size) / (changed size) 0.32.470.701 I slot release: id 0 | task 1601 | stop processing: n_tokens = 197, truncated = 0 0.32.495.763 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 197, t_last = 32367090 0.32.519.959 I slot launch_slot_: id 0 | task 1636 | processing task, is_child = 0 0.32.997.398 I slot print_timing: id 0 | task 1636 | prompt eval time = 121.82 ms / 167 tokens ( 0.73 ms per token, 1370.88 tokens per second) 0.32.997.403 I slot print_timing: id 0 | task 1636 | eval time = 355.60 ms / 27 tokens ( 13.68 ms per token, 73.12 tokens per second) 0.32.997.405 I slot print_timing: id 0 | task 1636 | total time = 477.42 ms / 194 tokens 0.32.997.405 I slot print_timing: id 0 | task 1636 | graphs reused = 1420 0.32.997.406 I slot print_timing: id 0 | task 1636 | graph reallocs = 0 / 0 (same size) / (changed size) 0.32.997.429 I slot release: id 0 | task 1636 | stop processing: n_tokens = 193, truncated = 0 0.33.003.878 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 193, t_last = 32893818 0.33.028.421 I slot launch_slot_: id 0 | task 1666 | processing task, is_child = 0 0.33.720.400 I slot print_timing: id 0 | task 1666 | prompt eval time = 128.23 ms / 195 tokens ( 0.66 ms per token, 1520.75 tokens per second) 0.33.720.406 I slot print_timing: id 0 | task 1666 | eval time = 563.73 ms / 42 tokens ( 13.75 ms per token, 72.73 tokens per second) 0.33.720.407 I slot print_timing: id 0 | task 1666 | total time = 691.96 ms / 237 tokens 0.33.720.408 I slot print_timing: id 0 | task 1666 | graphs reused = 1460 0.33.720.409 I slot print_timing: id 0 | task 1666 | graph reallocs = 0 / 0 (same size) / (changed size) 0.33.720.434 I slot release: id 0 | task 1666 | stop processing: n_tokens = 236, truncated = 0 0.33.758.782 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 236, t_last = 33616823 0.33.758.832 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 149.417 MiB) 0.33.795.683 I slot launch_slot_: id 0 | task 1711 | processing task, is_child = 0 0.34.357.653 I slot print_timing: id 0 | task 1711 | prompt eval time = 107.67 ms / 144 tokens ( 0.75 ms per token, 1337.48 tokens per second) 0.34.357.659 I slot print_timing: id 0 | task 1711 | eval time = 454.29 ms / 34 tokens ( 13.77 ms per token, 72.64 tokens per second) 0.34.357.660 I slot print_timing: id 0 | task 1711 | total time = 561.95 ms / 178 tokens 0.34.357.661 I slot print_timing: id 0 | task 1711 | graphs reused = 1492 0.34.357.661 I slot print_timing: id 0 | task 1711 | graph reallocs = 0 / 0 (same size) / (changed size) 0.34.357.683 I slot release: id 0 | task 1711 | stop processing: n_tokens = 177, truncated = 0 0.34.381.774 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 177, t_last = 34254073 0.34.403.507 I slot launch_slot_: id 0 | task 1748 | processing task, is_child = 0 0.34.884.171 I slot print_timing: id 0 | task 1748 | prompt eval time = 132.93 ms / 208 tokens ( 0.64 ms per token, 1564.73 tokens per second) 0.34.884.176 I slot print_timing: id 0 | task 1748 | eval time = 347.71 ms / 27 tokens ( 13.37 ms per token, 74.77 tokens per second) 0.34.884.177 I slot print_timing: id 0 | task 1748 | total time = 480.64 ms / 235 tokens 0.34.884.178 I slot print_timing: id 0 | task 1748 | graphs reused = 1517 0.34.884.179 I slot print_timing: id 0 | task 1748 | graph reallocs = 0 / 0 (same size) / (changed size) 0.34.884.203 I slot release: id 0 | task 1748 | stop processing: n_tokens = 234, truncated = 0 0.34.921.172 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 234, t_last = 34780593 0.34.921.218 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 104.274 MiB) 0.34.922.828 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 142.120 MiB) 0.34.956.355 I slot launch_slot_: id 0 | task 1778 | processing task, is_child = 0 0.35.553.416 I slot print_timing: id 0 | task 1778 | prompt eval time = 118.76 ms / 164 tokens ( 0.72 ms per token, 1380.92 tokens per second) 0.35.553.422 I slot print_timing: id 0 | task 1778 | eval time = 478.28 ms / 37 tokens ( 13.29 ms per token, 75.27 tokens per second) 0.35.553.423 I slot print_timing: id 0 | task 1778 | total time = 597.04 ms / 201 tokens 0.35.553.424 I slot print_timing: id 0 | task 1778 | graphs reused = 1552 0.35.553.425 I slot print_timing: id 0 | task 1778 | graph reallocs = 0 / 0 (same size) / (changed size) 0.35.553.447 I slot release: id 0 | task 1778 | stop processing: n_tokens = 200, truncated = 0 0.35.594.808 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 200, t_last = 35449836 0.35.594.856 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 179.949 MiB) 0.35.622.187 I slot launch_slot_: id 0 | task 1818 | processing task, is_child = 0 0.36.117.762 I slot print_timing: id 0 | task 1818 | prompt eval time = 107.48 ms / 154 tokens ( 0.70 ms per token, 1432.88 tokens per second) 0.36.117.768 I slot print_timing: id 0 | task 1818 | eval time = 388.08 ms / 30 tokens ( 13.38 ms per token, 74.73 tokens per second) 0.36.117.769 I slot print_timing: id 0 | task 1818 | total time = 495.56 ms / 184 tokens 0.36.117.770 I slot print_timing: id 0 | task 1818 | graphs reused = 1580 0.36.117.771 I slot print_timing: id 0 | task 1818 | graph reallocs = 0 / 0 (same size) / (changed size) 0.36.117.794 I slot release: id 0 | task 1818 | stop processing: n_tokens = 183, truncated = 0 0.36.141.547 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 183, t_last = 36014183 0.36.141.591 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 161.636 MiB) 0.36.168.417 I slot launch_slot_: id 0 | task 1851 | processing task, is_child = 0 0.37.086.118 I slot print_timing: id 0 | task 1851 | prompt eval time = 160.39 ms / 284 tokens ( 0.56 ms per token, 1770.71 tokens per second) 0.37.086.124 I slot print_timing: id 0 | task 1851 | eval time = 757.29 ms / 56 tokens ( 13.77 ms per token, 72.63 tokens per second) 0.37.086.125 I slot print_timing: id 0 | task 1851 | total time = 917.68 ms / 340 tokens 0.37.086.125 I slot print_timing: id 0 | task 1851 | graphs reused = 1634 0.37.086.126 I slot print_timing: id 0 | task 1851 | graph reallocs = 0 / 0 (same size) / (changed size) 0.37.086.155 I slot release: id 0 | task 1851 | stop processing: n_tokens = 339, truncated = 0 0.37.092.367 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 339, t_last = 36982544 0.37.092.425 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 163.480 MiB) 0.37.094.722 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 198.060 MiB) 0.37.138.664 I slot launch_slot_: id 0 | task 1910 | processing task, is_child = 0 0.38.333.925 I slot print_timing: id 0 | task 1910 | prompt eval time = 154.33 ms / 258 tokens ( 0.60 ms per token, 1671.72 tokens per second) 0.38.333.931 I slot print_timing: id 0 | task 1910 | eval time = 1040.91 ms / 76 tokens ( 13.88 ms per token, 72.05 tokens per second) 0.38.333.932 I slot print_timing: id 0 | task 1910 | total time = 1195.24 ms / 334 tokens 0.38.333.933 I slot print_timing: id 0 | task 1910 | graphs reused = 1708 0.38.333.934 I slot print_timing: id 0 | task 1910 | graph reallocs = 0 / 0 (same size) / (changed size) 0.38.333.959 I slot release: id 0 | task 1910 | stop processing: n_tokens = 333, truncated = 0 0.38.376.960 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 333, t_last = 38230348 0.38.377.021 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 247.484 MiB) 0.38.420.147 I slot launch_slot_: id 0 | task 1989 | processing task, is_child = 0 0.38.951.699 I slot print_timing: id 0 | task 1989 | prompt eval time = 110.39 ms / 154 tokens ( 0.72 ms per token, 1395.09 tokens per second) 0.38.951.705 I slot print_timing: id 0 | task 1989 | eval time = 421.14 ms / 32 tokens ( 13.59 ms per token, 73.61 tokens per second) 0.38.951.706 I slot print_timing: id 0 | task 1989 | total time = 531.53 ms / 186 tokens 0.38.951.707 I slot print_timing: id 0 | task 1989 | graphs reused = 1738 0.38.951.708 I slot print_timing: id 0 | task 1989 | graph reallocs = 0 / 0 (same size) / (changed size) 0.38.951.728 I slot release: id 0 | task 1989 | stop processing: n_tokens = 185, truncated = 0 0.38.983.863 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 185, t_last = 38848117 0.39.007.349 I slot launch_slot_: id 0 | task 2024 | processing task, is_child = 0 0.39.489.883 I slot print_timing: id 0 | task 2024 | prompt eval time = 122.34 ms / 189 tokens ( 0.65 ms per token, 1544.84 tokens per second) 0.39.489.889 I slot print_timing: id 0 | task 2024 | eval time = 360.17 ms / 28 tokens ( 13.34 ms per token, 74.96 tokens per second) 0.39.489.890 I slot print_timing: id 0 | task 2024 | total time = 482.51 ms / 217 tokens 0.39.489.890 I slot print_timing: id 0 | task 2024 | graphs reused = 1764 0.39.489.891 I slot print_timing: id 0 | task 2024 | graph reallocs = 0 / 0 (same size) / (changed size) 0.39.489.915 I slot release: id 0 | task 2024 | stop processing: n_tokens = 216, truncated = 0 0.39.515.656 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 216, t_last = 39386305 0.39.515.701 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 131.400 MiB) 0.39.517.591 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 141.791 MiB) 0.39.548.627 I slot launch_slot_: id 0 | task 2055 | processing task, is_child = 0 0.40.026.800 I slot print_timing: id 0 | task 2055 | prompt eval time = 105.85 ms / 150 tokens ( 0.71 ms per token, 1417.14 tokens per second) 0.40.026.805 I slot print_timing: id 0 | task 2055 | eval time = 372.31 ms / 29 tokens ( 13.30 ms per token, 75.21 tokens per second) 0.40.026.806 I slot print_timing: id 0 | task 2055 | total time = 478.15 ms / 179 tokens 0.40.026.807 I slot print_timing: id 0 | task 2055 | graphs reused = 1791 0.40.026.807 I slot print_timing: id 0 | task 2055 | graph reallocs = 0 / 0 (same size) / (changed size) 0.40.026.828 I slot release: id 0 | task 2055 | stop processing: n_tokens = 178, truncated = 0 0.40.059.614 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 178, t_last = 39923217 0.40.059.656 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 159.355 MiB) 0.40.084.881 I slot launch_slot_: id 0 | task 2087 | processing task, is_child = 0 0.40.729.515 I slot print_timing: id 0 | task 2087 | prompt eval time = 134.93 ms / 212 tokens ( 0.64 ms per token, 1571.19 tokens per second) 0.40.729.521 I slot print_timing: id 0 | task 2087 | eval time = 509.68 ms / 38 tokens ( 13.78 ms per token, 72.59 tokens per second) 0.40.729.522 I slot print_timing: id 0 | task 2087 | total time = 644.61 ms / 250 tokens 0.40.729.523 I slot print_timing: id 0 | task 2087 | graphs reused = 1827 0.40.729.524 I slot print_timing: id 0 | task 2087 | graph reallocs = 0 / 0 (same size) / (changed size) 0.40.729.548 I slot release: id 0 | task 2087 | stop processing: n_tokens = 249, truncated = 0 0.40.761.850 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 249, t_last = 40625937 0.40.761.905 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 191.434 MiB) 0.40.795.097 I slot launch_slot_: id 0 | task 2128 | processing task, is_child = 0 0.41.378.567 I slot print_timing: id 0 | task 2128 | prompt eval time = 192.65 ms / 336 tokens ( 0.57 ms per token, 1744.10 tokens per second) 0.41.378.574 I slot print_timing: id 0 | task 2128 | eval time = 390.80 ms / 29 tokens ( 13.96 ms per token, 71.65 tokens per second) 0.41.378.575 I slot print_timing: id 0 | task 2128 | total time = 583.45 ms / 365 tokens 0.41.378.576 I slot print_timing: id 0 | task 2128 | graphs reused = 1854 0.41.378.577 I slot print_timing: id 0 | task 2128 | graph reallocs = 0 / 0 (same size) / (changed size) 0.41.378.607 I slot release: id 0 | task 2128 | stop processing: n_tokens = 364, truncated = 0 0.41.386.101 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 364, t_last = 41274996 0.41.386.160 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 159.152 MiB) 0.41.388.502 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 158.980 MiB) 0.41.436.438 I slot launch_slot_: id 0 | task 2160 | processing task, is_child = 0 0.42.043.671 I slot print_timing: id 0 | task 2160 | prompt eval time = 218.95 ms / 399 tokens ( 0.55 ms per token, 1822.36 tokens per second) 0.42.043.676 I slot print_timing: id 0 | task 2160 | eval time = 388.26 ms / 29 tokens ( 13.87 ms per token, 72.12 tokens per second) 0.42.043.677 I slot print_timing: id 0 | task 2160 | total time = 607.21 ms / 428 tokens 0.42.043.678 I slot print_timing: id 0 | task 2160 | graphs reused = 1881 0.42.043.679 I slot print_timing: id 0 | task 2160 | graph reallocs = 0 / 0 (same size) / (changed size) 0.42.043.710 I slot release: id 0 | task 2160 | stop processing: n_tokens = 427, truncated = 0 0.42.075.456 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 427, t_last = 41940099 0.42.075.529 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 161.964 MiB) 0.42.077.833 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 131.057 MiB) 0.42.133.876 I slot launch_slot_: id 0 | task 2192 | processing task, is_child = 0 0.42.822.667 I slot print_timing: id 0 | task 2192 | prompt eval time = 235.29 ms / 442 tokens ( 0.53 ms per token, 1878.56 tokens per second) 0.42.822.673 I slot print_timing: id 0 | task 2192 | eval time = 453.49 ms / 34 tokens ( 13.74 ms per token, 72.77 tokens per second) 0.42.822.674 I slot print_timing: id 0 | task 2192 | total time = 688.77 ms / 476 tokens 0.42.822.675 I slot print_timing: id 0 | task 2192 | graphs reused = 1913 0.42.822.676 I slot print_timing: id 0 | task 2192 | graph reallocs = 0 / 0 (same size) / (changed size) 0.42.822.710 I slot release: id 0 | task 2192 | stop processing: n_tokens = 475, truncated = 0 0.42.852.898 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 475, t_last = 42719100 0.42.852.965 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 149.729 MiB) 0.42.855.027 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 134.447 MiB) 0.42.856.819 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 129.634 MiB) 0.42.918.884 I slot launch_slot_: id 0 | task 2229 | processing task, is_child = 0 0.43.826.239 I slot print_timing: id 0 | task 2229 | prompt eval time = 225.80 ms / 430 tokens ( 0.53 ms per token, 1904.37 tokens per second) 0.43.826.245 I slot print_timing: id 0 | task 2229 | eval time = 681.54 ms / 52 tokens ( 13.36 ms per token, 74.83 tokens per second) 0.43.826.247 I slot print_timing: id 0 | task 2229 | total time = 907.34 ms / 482 tokens 0.43.826.248 I slot print_timing: id 0 | task 2229 | graphs reused = 1963 0.43.826.248 I slot print_timing: id 0 | task 2229 | graph reallocs = 0 / 0 (same size) / (changed size) 0.43.826.279 I slot release: id 0 | task 2229 | stop processing: n_tokens = 481, truncated = 0 0.43.848.864 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 481, t_last = 43722668 0.43.848.934 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 162.355 MiB) 0.43.851.177 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 148.292 MiB) 0.43.853.143 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 187.716 MiB) 0.43.916.768 I slot launch_slot_: id 0 | task 2284 | processing task, is_child = 0 0.44.417.586 I slot print_timing: id 0 | task 2284 | prompt eval time = 155.60 ms / 267 tokens ( 0.58 ms per token, 1715.97 tokens per second) 0.44.417.592 I slot print_timing: id 0 | task 2284 | eval time = 345.20 ms / 26 tokens ( 13.81 ms per token, 72.42 tokens per second) 0.44.417.593 I slot print_timing: id 0 | task 2284 | total time = 500.80 ms / 293 tokens 0.44.417.594 I slot print_timing: id 0 | task 2284 | graphs reused = 1987 0.44.417.594 I slot print_timing: id 0 | task 2284 | graph reallocs = 0 / 0 (same size) / (changed size) 0.44.417.621 I slot release: id 0 | task 2284 | stop processing: n_tokens = 292, truncated = 0 0.44.456.933 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 292, t_last = 44314011 0.44.456.986 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 173.980 MiB) 0.44.496.665 I slot launch_slot_: id 0 | task 2313 | processing task, is_child = 0 0.45.028.427 I slot print_timing: id 0 | task 2313 | prompt eval time = 211.86 ms / 405 tokens ( 0.52 ms per token, 1911.67 tokens per second) 0.45.028.434 I slot print_timing: id 0 | task 2313 | eval time = 319.88 ms / 24 tokens ( 13.91 ms per token, 71.90 tokens per second) 0.45.028.435 I slot print_timing: id 0 | task 2313 | total time = 531.74 ms / 429 tokens 0.45.028.436 I slot print_timing: id 0 | task 2313 | graphs reused = 2009 0.45.028.437 I slot print_timing: id 0 | task 2313 | graph reallocs = 0 / 0 (same size) / (changed size) 0.45.028.470 I slot release: id 0 | task 2313 | stop processing: n_tokens = 428, truncated = 0 0.45.048.149 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 428, t_last = 44924859 0.45.048.207 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 187.356 MiB) 0.45.050.855 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 216.076 MiB) 0.45.110.431 I slot launch_slot_: id 0 | task 2340 | processing task, is_child = 0 0.45.669.040 I slot print_timing: id 0 | task 2340 | prompt eval time = 212.18 ms / 387 tokens ( 0.55 ms per token, 1823.94 tokens per second) 0.45.669.045 I slot print_timing: id 0 | task 2340 | eval time = 346.41 ms / 26 tokens ( 13.86 ms per token, 72.17 tokens per second) 0.45.669.046 I slot print_timing: id 0 | task 2340 | total time = 558.59 ms / 413 tokens 0.45.669.047 I slot print_timing: id 0 | task 2340 | graphs reused = 2033 0.45.669.048 I slot print_timing: id 0 | task 2340 | graph reallocs = 0 / 0 (same size) / (changed size) 0.45.669.079 I slot release: id 0 | task 2340 | stop processing: n_tokens = 412, truncated = 0 0.45.703.293 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 412, t_last = 45565468 0.45.703.358 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 178.887 MiB) 0.45.705.944 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 141.245 MiB) 0.45.762.192 I slot launch_slot_: id 0 | task 2369 | processing task, is_child = 0 0.46.329.852 I slot print_timing: id 0 | task 2369 | prompt eval time = 179.67 ms / 301 tokens ( 0.60 ms per token, 1675.27 tokens per second) 0.46.329.858 I slot print_timing: id 0 | task 2369 | eval time = 387.97 ms / 29 tokens ( 13.86 ms per token, 72.17 tokens per second) 0.46.329.859 I slot print_timing: id 0 | task 2369 | total time = 567.64 ms / 330 tokens 0.46.329.860 I slot print_timing: id 0 | task 2369 | graphs reused = 2060 0.46.329.861 I slot print_timing: id 0 | task 2369 | graph reallocs = 0 / 0 (same size) / (changed size) 0.46.329.888 I slot release: id 0 | task 2369 | stop processing: n_tokens = 329, truncated = 0 0.46.356.653 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 329, t_last = 46226277 0.46.356.713 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 166.793 MiB) 0.46.359.130 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 192.107 MiB) 0.46.403.300 I slot launch_slot_: id 0 | task 2401 | processing task, is_child = 0 0.47.003.095 I slot print_timing: id 0 | task 2401 | prompt eval time = 178.59 ms / 295 tokens ( 0.61 ms per token, 1651.84 tokens per second) 0.47.003.100 I slot print_timing: id 0 | task 2401 | eval time = 421.19 ms / 32 tokens ( 13.59 ms per token, 73.60 tokens per second) 0.47.003.101 I slot print_timing: id 0 | task 2401 | total time = 599.78 ms / 327 tokens 0.47.003.103 I slot print_timing: id 0 | task 2401 | graphs reused = 2090 0.47.003.103 I slot print_timing: id 0 | task 2401 | graph reallocs = 0 / 0 (same size) / (changed size) 0.47.003.129 I slot release: id 0 | task 2401 | stop processing: n_tokens = 326, truncated = 0 0.47.022.903 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 326, t_last = 46899518 0.47.022.957 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 170.543 MiB) 0.47.025.296 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 147.323 MiB) 0.47.067.673 I slot launch_slot_: id 0 | task 2436 | processing task, is_child = 0 0.47.570.029 I slot print_timing: id 0 | task 2436 | prompt eval time = 219.03 ms / 361 tokens ( 0.61 ms per token, 1648.18 tokens per second) 0.47.570.034 I slot print_timing: id 0 | task 2436 | eval time = 283.31 ms / 22 tokens ( 13.49 ms per token, 74.12 tokens per second) 0.47.570.035 I slot print_timing: id 0 | task 2436 | total time = 502.34 ms / 383 tokens 0.47.570.036 I slot print_timing: id 0 | task 2436 | graphs reused = 2110 0.47.570.036 I slot print_timing: id 0 | task 2436 | graph reallocs = 0 / 0 (same size) / (changed size) 0.47.570.065 I slot release: id 0 | task 2436 | stop processing: n_tokens = 382, truncated = 0 0.47.597.216 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 382, t_last = 47466454 0.47.597.267 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 143.635 MiB) 0.47.599.352 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 173.090 MiB) 0.47.649.312 I slot launch_slot_: id 0 | task 2461 | processing task, is_child = 0 0.48.378.629 I slot print_timing: id 0 | task 2461 | prompt eval time = 175.87 ms / 316 tokens ( 0.56 ms per token, 1796.83 tokens per second) 0.48.378.634 I slot print_timing: id 0 | task 2461 | eval time = 553.43 ms / 42 tokens ( 13.50 ms per token, 74.08 tokens per second) 0.48.378.635 I slot print_timing: id 0 | task 2461 | total time = 729.30 ms / 358 tokens 0.48.378.636 I slot print_timing: id 0 | task 2461 | graphs reused = 2150 0.48.378.637 I slot print_timing: id 0 | task 2461 | graph reallocs = 0 / 0 (same size) / (changed size) 0.48.378.662 I slot release: id 0 | task 2461 | stop processing: n_tokens = 357, truncated = 0 0.48.396.188 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 357, t_last = 48275051 0.48.396.246 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 198.591 MiB) 0.48.442.166 I slot launch_slot_: id 0 | task 2506 | processing task, is_child = 0 0.48.847.398 I slot print_timing: id 0 | task 2506 | prompt eval time = 145.03 ms / 241 tokens ( 0.60 ms per token, 1661.70 tokens per second) 0.48.847.405 I slot print_timing: id 0 | task 2506 | eval time = 260.18 ms / 19 tokens ( 14.45 ms per token, 69.18 tokens per second) 0.48.847.406 I slot print_timing: id 0 | task 2506 | total time = 405.21 ms / 260 tokens 0.48.847.407 I slot print_timing: id 0 | task 2506 | graphs reused = 2166 0.48.847.408 I slot print_timing: id 0 | task 2506 | graph reallocs = 0 / 0 (same size) / (changed size) 0.48.847.435 I slot release: id 0 | task 2506 | stop processing: n_tokens = 259, truncated = 0 0.48.877.409 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 259, t_last = 48743824 0.48.877.458 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 134.213 MiB) 0.48.879.455 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 180.293 MiB) 0.48.915.315 I slot launch_slot_: id 0 | task 2528 | processing task, is_child = 0 0.49.620.961 I slot print_timing: id 0 | task 2528 | prompt eval time = 190.69 ms / 322 tokens ( 0.59 ms per token, 1688.65 tokens per second) 0.49.620.966 I slot print_timing: id 0 | task 2528 | eval time = 514.94 ms / 38 tokens ( 13.92 ms per token, 71.85 tokens per second) 0.49.620.967 I slot print_timing: id 0 | task 2528 | total time = 705.62 ms / 360 tokens 0.49.620.968 I slot print_timing: id 0 | task 2528 | graphs reused = 2202 0.49.620.969 I slot print_timing: id 0 | task 2528 | graph reallocs = 0 / 0 (same size) / (changed size) 0.49.620.997 I slot release: id 0 | task 2528 | stop processing: n_tokens = 359, truncated = 0 0.49.642.058 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 359, t_last = 49517386 0.49.642.111 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 107.430 MiB) 0.49.643.596 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 119.587 MiB) 0.49.689.958 I slot launch_slot_: id 0 | task 2569 | processing task, is_child = 0 0.50.269.617 I slot print_timing: id 0 | task 2569 | prompt eval time = 176.41 ms / 288 tokens ( 0.61 ms per token, 1632.59 tokens per second) 0.50.269.622 I slot print_timing: id 0 | task 2569 | eval time = 403.23 ms / 30 tokens ( 13.90 ms per token, 71.92 tokens per second) 0.50.269.623 I slot print_timing: id 0 | task 2569 | total time = 579.64 ms / 318 tokens 0.50.269.626 I slot print_timing: id 0 | task 2569 | graphs reused = 2230 0.50.269.626 I slot print_timing: id 0 | task 2569 | graph reallocs = 0 / 0 (same size) / (changed size) 0.50.269.653 I slot release: id 0 | task 2569 | stop processing: n_tokens = 317, truncated = 0 0.50.296.156 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 317, t_last = 50166042 0.50.296.211 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 127.119 MiB) 0.50.297.918 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 121.462 MiB) 0.50.299.501 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 174.996 MiB) 0.50.341.386 I slot launch_slot_: id 0 | task 2602 | processing task, is_child = 0 0.50.792.069 I slot print_timing: id 0 | task 2602 | prompt eval time = 147.20 ms / 237 tokens ( 0.62 ms per token, 1610.01 tokens per second) 0.50.792.075 I slot print_timing: id 0 | task 2602 | eval time = 303.46 ms / 22 tokens ( 14.45 ms per token, 69.20 tokens per second) 0.50.792.076 I slot print_timing: id 0 | task 2602 | total time = 450.66 ms / 259 tokens 0.50.792.077 I slot print_timing: id 0 | task 2602 | graphs reused = 2249 0.50.792.078 I slot print_timing: id 0 | task 2602 | graph reallocs = 0 / 0 (same size) / (changed size) 0.50.792.104 I slot release: id 0 | task 2602 | stop processing: n_tokens = 258, truncated = 0 0.50.821.849 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 258, t_last = 50688494 0.50.821.893 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 286.455 MiB) 0.50.857.995 I slot launch_slot_: id 0 | task 2627 | processing task, is_child = 0 0.51.296.751 I slot print_timing: id 0 | task 2627 | prompt eval time = 152.78 ms / 264 tokens ( 0.58 ms per token, 1727.94 tokens per second) 0.51.296.757 I slot print_timing: id 0 | task 2627 | eval time = 285.95 ms / 22 tokens ( 13.62 ms per token, 73.44 tokens per second) 0.51.296.758 I slot print_timing: id 0 | task 2627 | total time = 438.74 ms / 286 tokens 0.51.296.759 I slot print_timing: id 0 | task 2627 | graphs reused = 2269 0.51.296.759 I slot print_timing: id 0 | task 2627 | graph reallocs = 0 / 0 (same size) / (changed size) 0.51.296.784 I slot release: id 0 | task 2627 | stop processing: n_tokens = 285, truncated = 0 0.51.320.619 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 285, t_last = 51193173 0.51.320.670 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 131.338 MiB) 0.51.358.122 I slot launch_slot_: id 0 | task 2652 | processing task, is_child = 0 0.51.782.694 I slot print_timing: id 0 | task 2652 | prompt eval time = 150.89 ms / 255 tokens ( 0.59 ms per token, 1690.01 tokens per second) 0.51.782.700 I slot print_timing: id 0 | task 2652 | eval time = 273.66 ms / 21 tokens ( 13.68 ms per token, 73.08 tokens per second) 0.51.782.701 I slot print_timing: id 0 | task 2652 | total time = 424.55 ms / 276 tokens 0.51.782.701 I slot print_timing: id 0 | task 2652 | graphs reused = 2287 0.51.782.702 I slot print_timing: id 0 | task 2652 | graph reallocs = 0 / 0 (same size) / (changed size) 0.51.782.727 I slot release: id 0 | task 2652 | stop processing: n_tokens = 275, truncated = 0 0.51.809.784 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 275, t_last = 51679116 0.51.809.832 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 164.730 MiB) 0.51.847.000 I slot launch_slot_: id 0 | task 2676 | processing task, is_child = 0 0.52.393.668 I slot print_timing: id 0 | task 2676 | prompt eval time = 206.12 ms / 397 tokens ( 0.52 ms per token, 1926.08 tokens per second) 0.52.393.674 I slot print_timing: id 0 | task 2676 | eval time = 340.53 ms / 26 tokens ( 13.62 ms per token, 73.41 tokens per second) 0.52.393.675 I slot print_timing: id 0 | task 2676 | total time = 546.65 ms / 423 tokens 0.52.393.675 I slot print_timing: id 0 | task 2676 | graphs reused = 2311 0.52.393.676 I slot print_timing: id 0 | task 2676 | graph reallocs = 0 / 0 (same size) / (changed size) 0.52.393.708 I slot release: id 0 | task 2676 | stop processing: n_tokens = 422, truncated = 0 0.52.421.172 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 422, t_last = 52290097 0.52.421.236 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 212.889 MiB) 0.52.424.081 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 212.764 MiB) 0.52.479.018 I slot launch_slot_: id 0 | task 2705 | processing task, is_child = 0 0.52.890.972 I slot print_timing: id 0 | task 2705 | prompt eval time = 162.69 ms / 287 tokens ( 0.57 ms per token, 1764.12 tokens per second) 0.52.890.978 I slot print_timing: id 0 | task 2705 | eval time = 249.25 ms / 19 tokens ( 13.85 ms per token, 72.22 tokens per second) 0.52.890.979 I slot print_timing: id 0 | task 2705 | total time = 411.93 ms / 306 tokens 0.52.890.980 I slot print_timing: id 0 | task 2705 | graphs reused = 2328 0.52.890.980 I slot print_timing: id 0 | task 2705 | graph reallocs = 0 / 0 (same size) / (changed size) 0.52.891.008 I slot release: id 0 | task 2705 | stop processing: n_tokens = 305, truncated = 0 0.52.923.748 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 305, t_last = 52787397 0.52.923.792 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 141.166 MiB) 0.52.925.672 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 158.089 MiB) 0.52.966.183 I slot launch_slot_: id 0 | task 2727 | processing task, is_child = 0 0.53.785.684 I slot print_timing: id 0 | task 2727 | prompt eval time = 356.04 ms / 626 tokens ( 0.57 ms per token, 1758.25 tokens per second) 0.53.785.690 I slot print_timing: id 0 | task 2727 | eval time = 463.45 ms / 34 tokens ( 14.04 ms per token, 71.21 tokens per second) 0.53.785.691 I slot print_timing: id 0 | task 2727 | total time = 819.48 ms / 660 tokens 0.53.785.692 I slot print_timing: id 0 | task 2727 | graphs reused = 2360 0.53.785.693 I slot print_timing: id 0 | task 2727 | graph reallocs = 0 / 0 (same size) / (changed size) 0.53.785.741 I slot release: id 0 | task 2727 | stop processing: n_tokens = 659, truncated = 0 0.53.792.396 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 659, t_last = 53682131 0.53.792.485 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 158.652 MiB) 0.53.794.816 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 187.137 MiB) 0.53.797.493 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 138.401 MiB) 0.53.799.335 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 195.544 MiB) 0.53.896.941 I slot launch_slot_: id 0 | task 2765 | processing task, is_child = 0 0.54.328.765 I slot print_timing: id 0 | task 2765 | prompt eval time = 162.70 ms / 266 tokens ( 0.61 ms per token, 1634.93 tokens per second) 0.54.328.771 I slot print_timing: id 0 | task 2765 | eval time = 269.11 ms / 20 tokens ( 14.16 ms per token, 70.60 tokens per second) 0.54.328.772 I slot print_timing: id 0 | task 2765 | total time = 431.81 ms / 286 tokens 0.54.328.773 I slot print_timing: id 0 | task 2765 | graphs reused = 2378 0.54.328.774 I slot print_timing: id 0 | task 2765 | graph reallocs = 0 / 0 (same size) / (changed size) 0.54.328.800 I slot release: id 0 | task 2765 | stop processing: n_tokens = 285, truncated = 0 0.54.338.730 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 285, t_last = 54225189 0.54.338.780 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 160.011 MiB) 0.54.377.235 I slot launch_slot_: id 0 | task 2788 | processing task, is_child = 0 0.54.947.553 I slot print_timing: id 0 | task 2788 | prompt eval time = 237.96 ms / 481 tokens ( 0.49 ms per token, 2021.34 tokens per second) 0.54.947.558 I slot print_timing: id 0 | task 2788 | eval time = 332.34 ms / 25 tokens ( 13.85 ms per token, 72.22 tokens per second) 0.54.947.559 I slot print_timing: id 0 | task 2788 | total time = 570.30 ms / 506 tokens 0.54.947.560 I slot print_timing: id 0 | task 2788 | graphs reused = 2401 0.54.947.560 I slot print_timing: id 0 | task 2788 | graph reallocs = 0 / 0 (same size) / (changed size) 0.54.947.596 I slot release: id 0 | task 2788 | stop processing: n_tokens = 505, truncated = 0 0.54.981.410 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 505, t_last = 54843985 0.54.981.482 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 145.995 MiB) 0.54.983.593 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 273.751 MiB) 0.55.051.916 I slot launch_slot_: id 0 | task 2816 | processing task, is_child = 0 0.55.839.619 I slot print_timing: id 0 | task 2816 | prompt eval time = 285.95 ms / 553 tokens ( 0.52 ms per token, 1933.93 tokens per second) 0.55.839.626 I slot print_timing: id 0 | task 2816 | eval time = 501.73 ms / 38 tokens ( 13.56 ms per token, 73.74 tokens per second) 0.55.839.627 I slot print_timing: id 0 | task 2816 | total time = 787.68 ms / 591 tokens 0.55.839.629 I slot print_timing: id 0 | task 2816 | graphs reused = 2437 0.55.839.630 I slot print_timing: id 0 | task 2816 | graph reallocs = 0 / 0 (same size) / (changed size) 0.55.839.676 I slot release: id 0 | task 2816 | stop processing: n_tokens = 590, truncated = 0 0.55.867.772 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 590, t_last = 55736067 0.55.867.850 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 256.782 MiB) 0.55.871.390 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 146.964 MiB) 0.55.873.360 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 178.699 MiB) 0.55.954.057 I slot launch_slot_: id 0 | task 2858 | processing task, is_child = 0 0.56.696.769 I slot print_timing: id 0 | task 2858 | prompt eval time = 208.65 ms / 396 tokens ( 0.53 ms per token, 1897.89 tokens per second) 0.56.696.774 I slot print_timing: id 0 | task 2858 | eval time = 534.04 ms / 40 tokens ( 13.69 ms per token, 73.03 tokens per second) 0.56.696.775 I slot print_timing: id 0 | task 2858 | total time = 742.69 ms / 436 tokens 0.56.696.776 I slot print_timing: id 0 | task 2858 | graphs reused = 2475 0.56.696.777 I slot print_timing: id 0 | task 2858 | graph reallocs = 0 / 0 (same size) / (changed size) 0.56.696.809 I slot release: id 0 | task 2858 | stop processing: n_tokens = 435, truncated = 0 0.56.720.363 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 435, t_last = 56593198 0.56.720.428 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 142.791 MiB) 0.56.722.509 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 201.716 MiB) 0.56.779.070 I slot launch_slot_: id 0 | task 2901 | processing task, is_child = 0 0.57.387.079 I slot print_timing: id 0 | task 2901 | prompt eval time = 162.09 ms / 277 tokens ( 0.59 ms per token, 1708.96 tokens per second) 0.57.387.085 I slot print_timing: id 0 | task 2901 | eval time = 445.90 ms / 33 tokens ( 13.93 ms per token, 71.76 tokens per second) 0.57.387.086 I slot print_timing: id 0 | task 2901 | total time = 607.99 ms / 310 tokens 0.57.387.087 I slot print_timing: id 0 | task 2901 | graphs reused = 2506 0.57.387.088 I slot print_timing: id 0 | task 2901 | graph reallocs = 0 / 0 (same size) / (changed size) 0.57.387.113 I slot release: id 0 | task 2901 | stop processing: n_tokens = 309, truncated = 0 0.57.408.816 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 309, t_last = 57283502 0.57.408.872 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 316.644 MiB) 0.57.452.482 I slot launch_slot_: id 0 | task 2937 | processing task, is_child = 0 0.58.013.923 I slot print_timing: id 0 | task 2937 | prompt eval time = 229.06 ms / 424 tokens ( 0.54 ms per token, 1851.01 tokens per second) 0.58.013.930 I slot print_timing: id 0 | task 2937 | eval time = 332.36 ms / 25 tokens ( 13.85 ms per token, 72.21 tokens per second) 0.58.013.931 I slot print_timing: id 0 | task 2937 | total time = 561.42 ms / 449 tokens 0.58.013.931 I slot print_timing: id 0 | task 2937 | graphs reused = 2529 0.58.013.932 I slot print_timing: id 0 | task 2937 | graph reallocs = 0 / 0 (same size) / (changed size) 0.58.013.969 I slot release: id 0 | task 2937 | stop processing: n_tokens = 448, truncated = 0 0.58.050.231 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 448, t_last = 57910358 0.58.050.297 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 370.756 MiB) 0.58.113.529 I slot launch_slot_: id 0 | task 2965 | processing task, is_child = 0 0.58.927.992 I slot print_timing: id 0 | task 2965 | prompt eval time = 309.80 ms / 586 tokens ( 0.53 ms per token, 1891.54 tokens per second) 0.58.927.998 I slot print_timing: id 0 | task 2965 | eval time = 504.64 ms / 37 tokens ( 14.02 ms per token, 71.34 tokens per second) 0.58.927.999 I slot print_timing: id 0 | task 2965 | total time = 814.44 ms / 623 tokens 0.58.928.000 I slot print_timing: id 0 | task 2965 | graphs reused = 2564 0.58.928.001 I slot print_timing: id 0 | task 2965 | graph reallocs = 0 / 0 (same size) / (changed size) 0.58.928.042 I slot release: id 0 | task 2965 | stop processing: n_tokens = 622, truncated = 0 0.58.970.573 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 622, t_last = 58824432 0.58.970.656 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 414.945 MiB) 0.58.976.268 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 414.727 MiB) 0.59.089.046 I slot launch_slot_: id 0 | task 3006 | processing task, is_child = 0 0.59.727.421 I slot print_timing: id 0 | task 3006 | prompt eval time = 235.48 ms / 417 tokens ( 0.56 ms per token, 1770.84 tokens per second) 0.59.727.427 I slot print_timing: id 0 | task 3006 | eval time = 402.88 ms / 31 tokens ( 13.43 ms per token, 74.46 tokens per second) 0.59.727.429 I slot print_timing: id 0 | task 3006 | total time = 638.36 ms / 448 tokens 0.59.727.429 I slot print_timing: id 0 | task 3006 | graphs reused = 2593 0.59.727.430 I slot print_timing: id 0 | task 3006 | graph reallocs = 0 / 0 (same size) / (changed size) 0.59.727.463 I slot release: id 0 | task 3006 | stop processing: n_tokens = 447, truncated = 0 0.59.751.806 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 447, t_last = 59623853 0.59.806.473 I slot launch_slot_: id 0 | task 3040 | processing task, is_child = 0 1.00.348.725 I slot print_timing: id 0 | task 3040 | prompt eval time = 192.82 ms / 366 tokens ( 0.53 ms per token, 1898.13 tokens per second) 1.00.348.730 I slot print_timing: id 0 | task 3040 | eval time = 349.41 ms / 27 tokens ( 13.44 ms per token, 74.41 tokens per second) 1.00.348.731 I slot print_timing: id 0 | task 3040 | total time = 542.23 ms / 393 tokens 1.00.348.732 I slot print_timing: id 0 | task 3040 | graphs reused = 2618 1.00.348.732 I slot print_timing: id 0 | task 3040 | graph reallocs = 0 / 0 (same size) / (changed size) 1.00.348.762 I slot release: id 0 | task 3040 | stop processing: n_tokens = 392, truncated = 0 1.00.388.636 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 392, t_last = 60245151 1.00.388.696 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 250.515 MiB) 1.00.441.436 I slot launch_slot_: id 0 | task 3070 | processing task, is_child = 0 1.00.954.797 I slot print_timing: id 0 | task 3070 | prompt eval time = 156.29 ms / 254 tokens ( 0.62 ms per token, 1625.16 tokens per second) 1.00.954.803 I slot print_timing: id 0 | task 3070 | eval time = 357.05 ms / 26 tokens ( 14.28 ms per token, 70.02 tokens per second) 1.00.954.804 I slot print_timing: id 0 | task 3070 | total time = 513.34 ms / 280 tokens 1.00.954.805 I slot print_timing: id 0 | task 3070 | graphs reused = 2641 1.00.954.805 I slot print_timing: id 0 | task 3070 | graph reallocs = 0 / 0 (same size) / (changed size) 1.00.954.830 I slot release: id 0 | task 3070 | stop processing: n_tokens = 279, truncated = 0 1.00.995.835 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 279, t_last = 60851219 1.00.995.881 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 382.022 MiB) 1.01.041.332 I slot launch_slot_: id 0 | task 3099 | processing task, is_child = 0 1.01.710.901 I slot print_timing: id 0 | task 3099 | prompt eval time = 180.99 ms / 301 tokens ( 0.60 ms per token, 1663.04 tokens per second) 1.01.710.907 I slot print_timing: id 0 | task 3099 | eval time = 488.56 ms / 36 tokens ( 13.96 ms per token, 71.64 tokens per second) 1.01.710.908 I slot print_timing: id 0 | task 3099 | total time = 669.55 ms / 337 tokens 1.01.710.909 I slot print_timing: id 0 | task 3099 | graphs reused = 2675 1.01.710.910 I slot print_timing: id 0 | task 3099 | graph reallocs = 0 / 0 (same size) / (changed size) 1.01.710.936 I slot release: id 0 | task 3099 | stop processing: n_tokens = 336, truncated = 0 1.01.742.499 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 336, t_last = 61607325 1.01.783.108 I slot launch_slot_: id 0 | task 3138 | processing task, is_child = 0 1.02.363.956 I slot print_timing: id 0 | task 3138 | prompt eval time = 193.31 ms / 322 tokens ( 0.60 ms per token, 1665.74 tokens per second) 1.02.363.961 I slot print_timing: id 0 | task 3138 | eval time = 387.52 ms / 29 tokens ( 13.84 ms per token, 72.25 tokens per second) 1.02.363.962 I slot print_timing: id 0 | task 3138 | total time = 580.83 ms / 351 tokens 1.02.363.963 I slot print_timing: id 0 | task 3138 | graphs reused = 2702 1.02.363.964 I slot print_timing: id 0 | task 3138 | graph reallocs = 0 / 0 (same size) / (changed size) 1.02.363.993 I slot release: id 0 | task 3138 | stop processing: n_tokens = 350, truncated = 0 1.02.373.478 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 350, t_last = 62260382 1.02.373.524 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 365.521 MiB) 1.02.425.163 I slot launch_slot_: id 0 | task 3170 | processing task, is_child = 0 1.03.148.424 I slot print_timing: id 0 | task 3170 | prompt eval time = 229.01 ms / 428 tokens ( 0.54 ms per token, 1868.95 tokens per second) 1.03.148.429 I slot print_timing: id 0 | task 3170 | eval time = 494.24 ms / 37 tokens ( 13.73 ms per token, 72.84 tokens per second) 1.03.148.430 I slot print_timing: id 0 | task 3170 | total time = 723.24 ms / 465 tokens 1.03.148.432 I slot print_timing: id 0 | task 3170 | graphs reused = 2737 1.03.148.433 I slot print_timing: id 0 | task 3170 | graph reallocs = 0 / 0 (same size) / (changed size) 1.03.148.468 I slot release: id 0 | task 3170 | stop processing: n_tokens = 464, truncated = 0 1.03.193.431 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 464, t_last = 63044857 1.03.193.495 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 285.470 MiB) 1.03.273.634 I slot launch_slot_: id 0 | task 3210 | processing task, is_child = 0 1.03.866.476 I slot print_timing: id 0 | task 3210 | prompt eval time = 204.31 ms / 379 tokens ( 0.54 ms per token, 1855.03 tokens per second) 1.03.866.483 I slot print_timing: id 0 | task 3210 | eval time = 388.51 ms / 30 tokens ( 13.40 ms per token, 74.64 tokens per second) 1.03.866.484 I slot print_timing: id 0 | task 3210 | total time = 592.82 ms / 409 tokens 1.03.866.485 I slot print_timing: id 0 | task 3210 | graphs reused = 2765 1.03.866.486 I slot print_timing: id 0 | task 3210 | graph reallocs = 0 / 0 (same size) / (changed size) 1.03.866.522 I slot release: id 0 | task 3210 | stop processing: n_tokens = 408, truncated = 0 1.03.901.557 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 408, t_last = 63762911 1.03.901.617 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 281.048 MiB) 1.03.905.518 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 342.238 MiB) 1.03.960.708 I slot launch_slot_: id 0 | task 3243 | processing task, is_child = 0 1.04.644.569 I slot print_timing: id 0 | task 3243 | prompt eval time = 326.07 ms / 596 tokens ( 0.55 ms per token, 1827.85 tokens per second) 1.04.644.575 I slot print_timing: id 0 | task 3243 | eval time = 357.78 ms / 27 tokens ( 13.76 ms per token, 72.67 tokens per second) 1.04.644.576 I slot print_timing: id 0 | task 3243 | total time = 683.84 ms / 623 tokens 1.04.644.577 I slot print_timing: id 0 | task 3243 | graphs reused = 2790 1.04.644.578 I slot print_timing: id 0 | task 3243 | graph reallocs = 0 / 0 (same size) / (changed size) 1.04.644.620 I slot release: id 0 | task 3243 | stop processing: n_tokens = 622, truncated = 0 1.04.677.931 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 622, t_last = 64541009 1.04.678.014 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 304.346 MiB) 1.04.682.154 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 226.561 MiB) 1.04.766.732 I slot launch_slot_: id 0 | task 3274 | processing task, is_child = 0 1.05.272.875 I slot print_timing: id 0 | task 3274 | prompt eval time = 212.56 ms / 375 tokens ( 0.57 ms per token, 1764.20 tokens per second) 1.05.272.881 I slot print_timing: id 0 | task 3274 | eval time = 293.56 ms / 22 tokens ( 13.98 ms per token, 71.54 tokens per second) 1.05.272.882 I slot print_timing: id 0 | task 3274 | total time = 506.12 ms / 397 tokens 1.05.272.882 I slot print_timing: id 0 | task 3274 | graphs reused = 2810 1.05.272.883 I slot print_timing: id 0 | task 3274 | graph reallocs = 0 / 0 (same size) / (changed size) 1.05.272.915 I slot release: id 0 | task 3274 | stop processing: n_tokens = 396, truncated = 0 1.05.292.109 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 396, t_last = 65169305 1.05.292.172 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 308.753 MiB) 1.05.347.018 I slot launch_slot_: id 0 | task 3299 | processing task, is_child = 0 1.06.022.191 I slot print_timing: id 0 | task 3299 | prompt eval time = 232.16 ms / 420 tokens ( 0.55 ms per token, 1809.12 tokens per second) 1.06.022.196 I slot print_timing: id 0 | task 3299 | eval time = 443.00 ms / 33 tokens ( 13.84 ms per token, 72.24 tokens per second) 1.06.022.197 I slot print_timing: id 0 | task 3299 | total time = 675.15 ms / 453 tokens 1.06.022.198 I slot print_timing: id 0 | task 3299 | graphs reused = 2841 1.06.022.199 I slot print_timing: id 0 | task 3299 | graph reallocs = 0 / 0 (same size) / (changed size) 1.06.022.231 I slot release: id 0 | task 3299 | stop processing: n_tokens = 452, truncated = 0 1.06.052.983 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 452, t_last = 65918620 1.06.053.052 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 274.970 MiB) 1.06.112.401 I slot launch_slot_: id 0 | task 3335 | processing task, is_child = 0 1.06.781.135 I slot print_timing: id 0 | task 3335 | prompt eval time = 210.33 ms / 377 tokens ( 0.56 ms per token, 1792.44 tokens per second) 1.06.781.140 I slot print_timing: id 0 | task 3335 | eval time = 458.39 ms / 34 tokens ( 13.89 ms per token, 71.99 tokens per second) 1.06.781.141 I slot print_timing: id 0 | task 3335 | total time = 668.71 ms / 411 tokens 1.06.781.142 I slot print_timing: id 0 | task 3335 | graphs reused = 2873 1.06.781.143 I slot print_timing: id 0 | task 3335 | graph reallocs = 0 / 0 (same size) / (changed size) 1.06.781.176 I slot release: id 0 | task 3335 | stop processing: n_tokens = 410, truncated = 0 1.06.808.438 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 410, t_last = 66677565 1.06.808.490 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 222.483 MiB) 1.06.811.619 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 249.156 MiB) 1.06.865.056 I slot launch_slot_: id 0 | task 3372 | processing task, is_child = 0 1.07.561.663 I slot print_timing: id 0 | task 3372 | prompt eval time = 253.97 ms / 499 tokens ( 0.51 ms per token, 1964.76 tokens per second) 1.07.561.668 I slot print_timing: id 0 | task 3372 | eval time = 442.61 ms / 33 tokens ( 13.83 ms per token, 72.30 tokens per second) 1.07.561.669 I slot print_timing: id 0 | task 3372 | total time = 696.59 ms / 532 tokens 1.07.561.671 I slot print_timing: id 0 | task 3372 | graphs reused = 2903 1.07.561.672 I slot print_timing: id 0 | task 3372 | graph reallocs = 0 / 0 (same size) / (changed size) 1.07.561.709 I slot release: id 0 | task 3372 | stop processing: n_tokens = 531, truncated = 0 1.07.588.190 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 531, t_last = 67458098 1.07.588.260 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 239.624 MiB) 1.07.591.496 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 372.553 MiB) 1.07.662.961 I slot launch_slot_: id 0 | task 3408 | processing task, is_child = 0 1.08.812.052 I slot print_timing: id 0 | task 3408 | prompt eval time = 303.83 ms / 586 tokens ( 0.52 ms per token, 1928.70 tokens per second) 1.08.812.058 I slot print_timing: id 0 | task 3408 | eval time = 845.24 ms / 63 tokens ( 13.63 ms per token, 73.35 tokens per second) 1.08.812.059 I slot print_timing: id 0 | task 3408 | total time = 1149.07 ms / 649 tokens 1.08.812.060 I slot print_timing: id 0 | task 3408 | graphs reused = 2964 1.08.812.060 I slot print_timing: id 0 | task 3408 | graph reallocs = 0 / 0 (same size) / (changed size) 1.08.812.101 I slot release: id 0 | task 3408 | stop processing: n_tokens = 648, truncated = 0 1.08.840.685 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 648, t_last = 68708491 1.08.840.768 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 266.657 MiB) 1.08.844.403 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 620.956 MiB) 1.08.944.761 I slot launch_slot_: id 0 | task 3475 | processing task, is_child = 0 1.09.794.612 I slot print_timing: id 0 | task 3475 | prompt eval time = 133.04 ms / 179 tokens ( 0.74 ms per token, 1345.46 tokens per second) 1.09.794.617 I slot print_timing: id 0 | task 3475 | eval time = 716.79 ms / 53 tokens ( 13.78 ms per token, 72.55 tokens per second) 1.09.794.618 I slot print_timing: id 0 | task 3475 | total time = 849.83 ms / 232 tokens 1.09.794.619 I slot print_timing: id 0 | task 3475 | graphs reused = 3015 1.09.794.620 I slot print_timing: id 0 | task 3475 | graph reallocs = 0 / 0 (same size) / (changed size) 1.09.794.643 I slot release: id 0 | task 3475 | stop processing: n_tokens = 231, truncated = 0 1.09.825.330 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 231, t_last = 69691032 1.09.851.774 I slot launch_slot_: id 0 | task 3531 | processing task, is_child = 0 1.10.355.201 I slot print_timing: id 0 | task 3531 | prompt eval time = 130.19 ms / 201 tokens ( 0.65 ms per token, 1543.92 tokens per second) 1.10.355.208 I slot print_timing: id 0 | task 3531 | eval time = 373.22 ms / 28 tokens ( 13.82 ms per token, 72.34 tokens per second) 1.10.355.209 I slot print_timing: id 0 | task 3531 | total time = 503.41 ms / 229 tokens 1.10.355.210 I slot print_timing: id 0 | task 3531 | graphs reused = 3041 1.10.355.211 I slot print_timing: id 0 | task 3531 | graph reallocs = 0 / 0 (same size) / (changed size) 1.10.355.237 I slot release: id 0 | task 3531 | stop processing: n_tokens = 228, truncated = 0 1.10.371.528 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 228, t_last = 70251626 1.10.398.996 I slot launch_slot_: id 0 | task 3562 | processing task, is_child = 0 1.11.429.540 I slot print_timing: id 0 | task 3562 | prompt eval time = 128.57 ms / 193 tokens ( 0.67 ms per token, 1501.08 tokens per second) 1.11.429.546 I slot print_timing: id 0 | task 3562 | eval time = 901.95 ms / 67 tokens ( 13.67 ms per token, 73.17 tokens per second) 1.11.429.547 I slot print_timing: id 0 | task 3562 | total time = 1030.52 ms / 260 tokens 1.11.429.548 I slot print_timing: id 0 | task 3562 | graphs reused = 3105 1.11.429.549 I slot print_timing: id 0 | task 3562 | graph reallocs = 0 / 0 (same size) / (changed size) 1.11.429.572 I slot release: id 0 | task 3562 | stop processing: n_tokens = 259, truncated = 0 1.11.435.281 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 259, t_last = 71325962 1.11.464.271 I slot launch_slot_: id 0 | task 3632 | processing task, is_child = 0 1.12.512.109 I slot print_timing: id 0 | task 3632 | prompt eval time = 109.44 ms / 156 tokens ( 0.70 ms per token, 1425.40 tokens per second) 1.12.512.115 I slot print_timing: id 0 | task 3632 | eval time = 938.38 ms / 72 tokens ( 13.22 ms per token, 75.66 tokens per second) 1.12.512.116 I slot print_timing: id 0 | task 3632 | total time = 1047.82 ms / 228 tokens 1.12.512.117 I slot print_timing: id 0 | task 3632 | graphs reused = 3175 1.12.512.118 I slot print_timing: id 0 | task 3632 | graph reallocs = 0 / 0 (same size) / (changed size) 1.12.512.139 I slot release: id 0 | task 3632 | stop processing: n_tokens = 227, truncated = 0 1.12.532.240 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 227, t_last = 72408529 1.12.532.282 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 246.031 MiB) 1.12.561.117 I slot launch_slot_: id 0 | task 3707 | processing task, is_child = 0 1.13.689.907 I slot print_timing: id 0 | task 3707 | prompt eval time = 134.29 ms / 219 tokens ( 0.61 ms per token, 1630.79 tokens per second) 1.13.689.913 I slot print_timing: id 0 | task 3707 | eval time = 994.48 ms / 73 tokens ( 13.81 ms per token, 72.40 tokens per second) 1.13.689.914 I slot print_timing: id 0 | task 3707 | total time = 1128.77 ms / 292 tokens 1.13.689.915 I slot print_timing: id 0 | task 3707 | graphs reused = 3245 1.13.689.915 I slot print_timing: id 0 | task 3707 | graph reallocs = 0 / 0 (same size) / (changed size) 1.13.689.940 I slot release: id 0 | task 3707 | stop processing: n_tokens = 291, truncated = 0 1.13.717.576 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 291, t_last = 73586329 1.13.717.625 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 452.916 MiB) 1.13.759.796 I slot launch_slot_: id 0 | task 3783 | processing task, is_child = 0 1.15.729.355 I slot print_timing: id 0 | task 3783 | prompt eval time = 149.95 ms / 256 tokens ( 0.59 ms per token, 1707.26 tokens per second) 1.15.729.360 I slot print_timing: id 0 | task 3783 | eval time = 1819.59 ms / 135 tokens ( 13.58 ms per token, 73.64 tokens per second) 1.15.729.361 I slot print_timing: id 0 | task 3783 | total time = 1969.54 ms / 391 tokens 1.15.729.362 I slot print_timing: id 0 | task 3783 | graphs reused = 3378 1.15.729.363 I slot print_timing: id 0 | task 3783 | graph reallocs = 0 / 0 (same size) / (changed size) 1.15.729.388 I slot release: id 0 | task 3783 | stop processing: n_tokens = 390, truncated = 0 1.15.758.331 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 390, t_last = 75625777 1.15.797.689 I slot launch_slot_: id 0 | task 3921 | processing task, is_child = 0 1.17.855.211 I slot print_timing: id 0 | task 3921 | prompt eval time = 177.78 ms / 335 tokens ( 0.53 ms per token, 1884.33 tokens per second) 1.17.855.218 I slot print_timing: id 0 | task 3921 | eval time = 1879.72 ms / 140 tokens ( 13.52 ms per token, 73.95 tokens per second) 1.17.855.219 I slot print_timing: id 0 | task 3921 | total time = 2057.50 ms / 475 tokens 1.17.855.220 I slot print_timing: id 0 | task 3921 | graphs reused = 3516 1.17.855.221 I slot print_timing: id 0 | task 3921 | graph reallocs = 0 / 0 (same size) / (changed size) 1.17.855.251 I slot release: id 0 | task 3921 | stop processing: n_tokens = 474, truncated = 0 1.17.879.713 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 474, t_last = 77751640 1.17.879.768 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 536.124 MiB) 1.17.939.271 I slot launch_slot_: id 0 | task 4064 | processing task, is_child = 0 1.19.132.301 I slot print_timing: id 0 | task 4064 | prompt eval time = 115.92 ms / 166 tokens ( 0.70 ms per token, 1431.99 tokens per second) 1.19.132.307 I slot print_timing: id 0 | task 4064 | eval time = 1077.09 ms / 80 tokens ( 13.63 ms per token, 73.35 tokens per second) 1.19.132.308 I slot print_timing: id 0 | task 4064 | total time = 1193.01 ms / 246 tokens 1.19.132.310 I slot print_timing: id 0 | task 4064 | graphs reused = 3594 1.19.132.311 I slot print_timing: id 0 | task 4064 | graph reallocs = 0 / 0 (same size) / (changed size) 1.19.132.334 I slot release: id 0 | task 4064 | stop processing: n_tokens = 245, truncated = 0 1.19.154.331 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 245, t_last = 79028723 1.19.180.393 I slot launch_slot_: id 0 | task 4147 | processing task, is_child = 0 1.20.336.836 I slot print_timing: id 0 | task 4147 | prompt eval time = 112.39 ms / 168 tokens ( 0.67 ms per token, 1494.85 tokens per second) 1.20.336.842 I slot print_timing: id 0 | task 4147 | eval time = 1044.04 ms / 80 tokens ( 13.22 ms per token, 75.67 tokens per second) 1.20.336.843 I slot print_timing: id 0 | task 4147 | total time = 1156.43 ms / 248 tokens 1.20.336.843 I slot print_timing: id 0 | task 4147 | graphs reused = 3672 1.20.336.844 I slot print_timing: id 0 | task 4147 | graph reallocs = 0 / 0 (same size) / (changed size) 1.20.336.866 I slot release: id 0 | task 4147 | stop processing: n_tokens = 247, truncated = 0 1.20.354.036 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 247, t_last = 80233255 1.20.379.407 I slot launch_slot_: id 0 | task 4230 | processing task, is_child = 0 1.21.023.502 I slot print_timing: id 0 | task 4230 | prompt eval time = 132.56 ms / 220 tokens ( 0.60 ms per token, 1659.64 tokens per second) 1.21.023.508 I slot print_timing: id 0 | task 4230 | eval time = 511.51 ms / 38 tokens ( 13.82 ms per token, 72.33 tokens per second) 1.21.023.509 I slot print_timing: id 0 | task 4230 | total time = 644.07 ms / 258 tokens 1.21.023.509 I slot print_timing: id 0 | task 4230 | graphs reused = 3707 1.21.023.510 I slot print_timing: id 0 | task 4230 | graph reallocs = 0 / 0 (same size) / (changed size) 1.21.023.535 I slot release: id 0 | task 4230 | stop processing: n_tokens = 257, truncated = 0 1.21.045.031 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 257, t_last = 80919924 1.21.045.077 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 260.157 MiB) 1.21.080.102 I slot launch_slot_: id 0 | task 4271 | processing task, is_child = 0 1.21.815.034 I slot print_timing: id 0 | task 4271 | prompt eval time = 165.17 ms / 284 tokens ( 0.58 ms per token, 1719.46 tokens per second) 1.21.815.039 I slot print_timing: id 0 | task 4271 | eval time = 569.75 ms / 42 tokens ( 13.90 ms per token, 71.96 tokens per second) 1.21.815.040 I slot print_timing: id 0 | task 4271 | total time = 734.91 ms / 326 tokens 1.21.815.041 I slot print_timing: id 0 | task 4271 | graphs reused = 3747 1.21.815.042 I slot print_timing: id 0 | task 4271 | graph reallocs = 0 / 0 (same size) / (changed size) 1.21.815.070 I slot release: id 0 | task 4271 | stop processing: n_tokens = 325, truncated = 0 1.21.856.096 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 325, t_last = 81711459 1.21.856.151 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 402.335 MiB) 1.21.900.994 I slot launch_slot_: id 0 | task 4316 | processing task, is_child = 0 1.22.640.731 I slot print_timing: id 0 | task 4316 | prompt eval time = 149.25 ms / 237 tokens ( 0.63 ms per token, 1587.96 tokens per second) 1.22.640.737 I slot print_timing: id 0 | task 4316 | eval time = 590.47 ms / 43 tokens ( 14.06 ms per token, 71.13 tokens per second) 1.22.640.738 I slot print_timing: id 0 | task 4316 | total time = 739.72 ms / 280 tokens 1.22.640.739 I slot print_timing: id 0 | task 4316 | graphs reused = 3787 1.22.640.740 I slot print_timing: id 0 | task 4316 | graph reallocs = 0 / 0 (same size) / (changed size) 1.22.640.765 I slot release: id 0 | task 4316 | stop processing: n_tokens = 279, truncated = 0 1.22.661.277 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 279, t_last = 82537154 1.22.692.175 I slot launch_slot_: id 0 | task 4362 | processing task, is_child = 0 1.24.486.884 I slot print_timing: id 0 | task 4362 | prompt eval time = 143.96 ms / 228 tokens ( 0.63 ms per token, 1583.74 tokens per second) 1.24.486.890 I slot print_timing: id 0 | task 4362 | eval time = 1650.73 ms / 123 tokens ( 13.53 ms per token, 73.91 tokens per second) 1.24.486.891 I slot print_timing: id 0 | task 4362 | total time = 1794.69 ms / 351 tokens 1.24.486.892 I slot print_timing: id 0 | task 4362 | graphs reused = 3907 1.24.486.893 I slot print_timing: id 0 | task 4362 | graph reallocs = 0 / 0 (same size) / (changed size) 1.24.486.918 I slot release: id 0 | task 4362 | stop processing: n_tokens = 350, truncated = 0 1.24.492.963 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 350, t_last = 84383307 1.24.493.020 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 580.688 MiB) 1.24.542.206 I slot launch_slot_: id 0 | task 4488 | processing task, is_child = 0 1.25.216.619 I slot print_timing: id 0 | task 4488 | prompt eval time = 146.87 ms / 249 tokens ( 0.59 ms per token, 1695.35 tokens per second) 1.25.216.639 I slot print_timing: id 0 | task 4488 | eval time = 527.50 ms / 39 tokens ( 13.88 ms per token, 72.04 tokens per second) 1.25.216.641 I slot print_timing: id 0 | task 4488 | total time = 674.38 ms / 288 tokens 1.25.216.643 I slot print_timing: id 0 | task 4488 | graphs reused = 3943 1.25.216.645 I slot print_timing: id 0 | task 4488 | graph reallocs = 0 / 0 (same size) / (changed size) 1.25.216.706 I slot release: id 0 | task 4488 | stop processing: n_tokens = 287, truncated = 0 1.25.247.997 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 287, t_last = 85113095 1.25.279.901 I slot launch_slot_: id 0 | task 4530 | processing task, is_child = 0 1.26.302.018 I slot print_timing: id 0 | task 4530 | prompt eval time = 119.16 ms / 186 tokens ( 0.64 ms per token, 1560.89 tokens per second) 1.26.302.023 I slot print_timing: id 0 | task 4530 | eval time = 902.94 ms / 67 tokens ( 13.68 ms per token, 73.09 tokens per second) 1.26.302.024 I slot print_timing: id 0 | task 4530 | total time = 1022.10 ms / 253 tokens 1.26.302.025 I slot print_timing: id 0 | task 4530 | graphs reused = 4008 1.26.302.025 I slot print_timing: id 0 | task 4530 | graph reallocs = 0 / 0 (same size) / (changed size) 1.26.302.049 I slot release: id 0 | task 4530 | stop processing: n_tokens = 252, truncated = 0 1.26.326.239 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 252, t_last = 86198438 1.26.326.281 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 396.382 MiB) 1.26.358.814 I slot launch_slot_: id 0 | task 4600 | processing task, is_child = 0 1.28.066.533 I slot print_timing: id 0 | task 4600 | prompt eval time = 156.47 ms / 284 tokens ( 0.55 ms per token, 1815.02 tokens per second) 1.28.066.538 I slot print_timing: id 0 | task 4600 | eval time = 1551.23 ms / 115 tokens ( 13.61 ms per token, 73.49 tokens per second) 1.28.066.539 I slot print_timing: id 0 | task 4600 | total time = 1707.70 ms / 399 tokens 1.28.066.540 I slot print_timing: id 0 | task 4600 | graphs reused = 4121 1.28.066.541 I slot print_timing: id 0 | task 4600 | graph reallocs = 0 / 0 (same size) / (changed size) 1.28.066.568 I slot release: id 0 | task 4600 | stop processing: n_tokens = 398, truncated = 0 1.28.097.207 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 398, t_last = 87962957 1.28.137.305 I slot launch_slot_: id 0 | task 4718 | processing task, is_child = 0 1.30.009.680 I slot print_timing: id 0 | task 4718 | prompt eval time = 112.44 ms / 177 tokens ( 0.64 ms per token, 1574.16 tokens per second) 1.30.009.686 I slot print_timing: id 0 | task 4718 | eval time = 1759.92 ms / 131 tokens ( 13.54 ms per token, 73.87 tokens per second) 1.30.009.687 I slot print_timing: id 0 | task 4718 | total time = 1872.36 ms / 308 tokens 1.30.009.687 I slot print_timing: id 0 | task 4718 | graphs reused = 4249 1.30.009.688 I slot print_timing: id 0 | task 4718 | graph reallocs = 0 / 0 (same size) / (changed size) 1.30.009.711 I slot release: id 0 | task 4718 | stop processing: n_tokens = 307, truncated = 0 1.30.031.100 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 307, t_last = 89906100 1.30.031.155 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 344.270 MiB) 1.30.068.005 I slot launch_slot_: id 0 | task 4852 | processing task, is_child = 0 1.31.344.964 I slot print_timing: id 0 | task 4852 | prompt eval time = 112.44 ms / 162 tokens ( 0.69 ms per token, 1440.74 tokens per second) 1.31.344.970 I slot print_timing: id 0 | task 4852 | eval time = 1164.50 ms / 86 tokens ( 13.70 ms per token, 72.99 tokens per second) 1.31.344.971 I slot print_timing: id 0 | task 4852 | total time = 1276.94 ms / 248 tokens 1.31.344.972 I slot print_timing: id 0 | task 4852 | graphs reused = 4333 1.31.344.973 I slot print_timing: id 0 | task 4852 | graph reallocs = 0 / 0 (same size) / (changed size) 1.31.344.996 I slot release: id 0 | task 4852 | stop processing: n_tokens = 247, truncated = 0 1.31.363.657 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 247, t_last = 91241385 1.31.390.204 I slot launch_slot_: id 0 | task 4941 | processing task, is_child = 0 1.32.853.557 I slot print_timing: id 0 | task 4941 | prompt eval time = 149.74 ms / 248 tokens ( 0.60 ms per token, 1656.16 tokens per second) 1.32.853.562 I slot print_timing: id 0 | task 4941 | eval time = 1313.59 ms / 99 tokens ( 13.40 ms per token, 74.60 tokens per second) 1.32.853.564 I slot print_timing: id 0 | task 4941 | total time = 1463.34 ms / 347 tokens 1.32.853.564 I slot print_timing: id 0 | task 4941 | graphs reused = 4429 1.32.853.565 I slot print_timing: id 0 | task 4941 | graph reallocs = 0 / 0 (same size) / (changed size) 1.32.853.590 I slot release: id 0 | task 4941 | stop processing: n_tokens = 346, truncated = 0 1.32.882.637 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 346, t_last = 92749980 1.32.882.682 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 240.937 MiB) 1.32.927.942 I slot launch_slot_: id 0 | task 5043 | processing task, is_child = 0 1.33.853.574 I slot print_timing: id 0 | task 5043 | prompt eval time = 128.32 ms / 186 tokens ( 0.69 ms per token, 1449.51 tokens per second) 1.33.853.580 I slot print_timing: id 0 | task 5043 | eval time = 797.30 ms / 59 tokens ( 13.75 ms per token, 72.75 tokens per second) 1.33.853.581 I slot print_timing: id 0 | task 5043 | total time = 925.62 ms / 245 tokens 1.33.853.582 I slot print_timing: id 0 | task 5043 | graphs reused = 4486 1.33.853.583 I slot print_timing: id 0 | task 5043 | graph reallocs = 0 / 0 (same size) / (changed size) 1.33.853.606 I slot release: id 0 | task 5043 | stop processing: n_tokens = 244, truncated = 0 1.33.880.241 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 244, t_last = 93749996 1.33.880.289 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 283.705 MiB) 1.33.911.649 I slot launch_slot_: id 0 | task 5105 | processing task, is_child = 0 1.34.868.248 I slot print_timing: id 0 | task 5105 | prompt eval time = 169.18 ms / 282 tokens ( 0.60 ms per token, 1666.82 tokens per second) 1.34.868.253 I slot print_timing: id 0 | task 5105 | eval time = 787.39 ms / 53 tokens ( 15.14 ms per token, 66.04 tokens per second) 1.34.868.254 I slot print_timing: id 0 | task 5105 | total time = 956.58 ms / 335 tokens 1.34.868.255 I slot print_timing: id 0 | task 5105 | graphs reused = 4537 1.34.868.256 I slot print_timing: id 0 | task 5105 | graph reallocs = 0 / 0 (same size) / (changed size) 1.34.868.283 I slot release: id 0 | task 5105 | stop processing: n_tokens = 334, truncated = 0 1.34.912.044 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 334, t_last = 94764672 1.34.912.093 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 304.549 MiB) 1.34.956.515 I slot launch_slot_: id 0 | task 5161 | processing task, is_child = 0 1.36.054.694 I slot print_timing: id 0 | task 5161 | prompt eval time = 136.05 ms / 223 tokens ( 0.61 ms per token, 1639.08 tokens per second) 1.36.054.699 I slot print_timing: id 0 | task 5161 | eval time = 962.11 ms / 71 tokens ( 13.74 ms per token, 72.76 tokens per second) 1.36.054.700 I slot print_timing: id 0 | task 5161 | total time = 1098.16 ms / 294 tokens 1.36.054.701 I slot print_timing: id 0 | task 5161 | graphs reused = 4605 1.36.054.702 I slot print_timing: id 0 | task 5161 | graph reallocs = 0 / 0 (same size) / (changed size) 1.36.054.726 I slot release: id 0 | task 5161 | stop processing: n_tokens = 293, truncated = 0 1.36.080.710 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 293, t_last = 95951115 1.36.112.119 I slot launch_slot_: id 0 | task 5235 | processing task, is_child = 0 1.37.272.390 I slot print_timing: id 0 | task 5235 | prompt eval time = 155.90 ms / 283 tokens ( 0.55 ms per token, 1815.27 tokens per second) 1.37.272.395 I slot print_timing: id 0 | task 5235 | eval time = 1004.35 ms / 76 tokens ( 13.39 ms per token, 74.68 tokens per second) 1.37.272.396 I slot print_timing: id 0 | task 5235 | total time = 1160.25 ms / 359 tokens 1.37.272.397 I slot print_timing: id 0 | task 5235 | graphs reused = 4679 1.37.272.398 I slot print_timing: id 0 | task 5235 | graph reallocs = 0 / 0 (same size) / (changed size) 1.37.272.425 I slot release: id 0 | task 5235 | stop processing: n_tokens = 358, truncated = 0 1.37.293.933 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 358, t_last = 97168814 1.37.293.991 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 410.398 MiB) 1.37.338.110 I slot launch_slot_: id 0 | task 5314 | processing task, is_child = 0 1.37.965.472 I slot print_timing: id 0 | task 5314 | prompt eval time = 169.45 ms / 293 tokens ( 0.58 ms per token, 1729.13 tokens per second) 1.37.965.477 I slot print_timing: id 0 | task 5314 | eval time = 457.90 ms / 34 tokens ( 13.88 ms per token, 72.07 tokens per second) 1.37.965.478 I slot print_timing: id 0 | task 5314 | total time = 627.35 ms / 327 tokens 1.37.965.479 I slot print_timing: id 0 | task 5314 | graphs reused = 4711 1.37.965.480 I slot print_timing: id 0 | task 5314 | graph reallocs = 0 / 0 (same size) / (changed size) 1.37.965.506 I slot release: id 0 | task 5314 | stop processing: n_tokens = 326, truncated = 0 1.37.982.922 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 326, t_last = 97861895 1.37.982.968 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 361.083 MiB) 1.38.024.737 I slot launch_slot_: id 0 | task 5351 | processing task, is_child = 0 1.39.557.824 I slot print_timing: id 0 | task 5351 | prompt eval time = 160.91 ms / 278 tokens ( 0.58 ms per token, 1727.72 tokens per second) 1.39.557.830 I slot print_timing: id 0 | task 5351 | eval time = 1372.16 ms / 100 tokens ( 13.86 ms per token, 72.15 tokens per second) 1.39.557.831 I slot print_timing: id 0 | task 5351 | total time = 1533.07 ms / 378 tokens 1.39.557.832 I slot print_timing: id 0 | task 5351 | graphs reused = 4809 1.39.557.832 I slot print_timing: id 0 | task 5351 | graph reallocs = 0 / 0 (same size) / (changed size) 1.39.557.860 I slot release: id 0 | task 5351 | stop processing: n_tokens = 377, truncated = 0 1.39.563.594 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 377, t_last = 99454249 1.39.603.369 I slot launch_slot_: id 0 | task 5454 | processing task, is_child = 0 1.40.588.716 I slot print_timing: id 0 | task 5454 | prompt eval time = 148.67 ms / 233 tokens ( 0.64 ms per token, 1567.26 tokens per second) 1.40.588.721 I slot print_timing: id 0 | task 5454 | eval time = 836.66 ms / 63 tokens ( 13.49 ms per token, 74.10 tokens per second) 1.40.588.722 I slot print_timing: id 0 | task 5454 | total time = 985.33 ms / 296 tokens 1.40.588.722 I slot print_timing: id 0 | task 5454 | graphs reused = 4869 1.40.588.723 I slot print_timing: id 0 | task 5454 | graph reallocs = 0 / 0 (same size) / (changed size) 1.40.588.746 I slot release: id 0 | task 5454 | stop processing: n_tokens = 295, truncated = 0 1.40.608.037 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 295, t_last = 100485135 1.40.608.092 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 593.189 MiB) 1.40.648.709 I slot launch_slot_: id 0 | task 5520 | processing task, is_child = 0 1.41.499.982 I slot print_timing: id 0 | task 5520 | prompt eval time = 110.65 ms / 166 tokens ( 0.67 ms per token, 1500.23 tokens per second) 1.41.499.987 I slot print_timing: id 0 | task 5520 | eval time = 740.61 ms / 56 tokens ( 13.47 ms per token, 74.26 tokens per second) 1.41.499.988 I slot print_timing: id 0 | task 5520 | total time = 851.25 ms / 222 tokens 1.41.499.989 I slot print_timing: id 0 | task 5520 | graphs reused = 4923 1.41.499.990 I slot print_timing: id 0 | task 5520 | graph reallocs = 0 / 0 (same size) / (changed size) 1.41.500.011 I slot release: id 0 | task 5520 | stop processing: n_tokens = 221, truncated = 0 1.41.530.141 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 221, t_last = 101396400 1.41.555.262 I slot launch_slot_: id 0 | task 5579 | processing task, is_child = 0 1.42.024.076 I slot print_timing: id 0 | task 5579 | prompt eval time = 153.31 ms / 253 tokens ( 0.61 ms per token, 1650.26 tokens per second) 1.42.024.081 I slot print_timing: id 0 | task 5579 | eval time = 315.49 ms / 23 tokens ( 14.34 ms per token, 69.73 tokens per second) 1.42.024.082 I slot print_timing: id 0 | task 5579 | total time = 468.80 ms / 276 tokens 1.42.024.083 I slot print_timing: id 0 | task 5579 | graphs reused = 4943 1.42.024.084 I slot print_timing: id 0 | task 5579 | graph reallocs = 0 / 0 (same size) / (changed size) 1.42.024.107 I slot release: id 0 | task 5579 | stop processing: n_tokens = 275, truncated = 0 1.42.047.918 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 275, t_last = 101920496 1.42.078.914 I slot launch_slot_: id 0 | task 5605 | processing task, is_child = 0 1.42.827.731 I slot print_timing: id 0 | task 5605 | prompt eval time = 102.17 ms / 136 tokens ( 0.75 ms per token, 1331.06 tokens per second) 1.42.827.737 I slot print_timing: id 0 | task 5605 | eval time = 646.62 ms / 48 tokens ( 13.76 ms per token, 72.69 tokens per second) 1.42.827.738 I slot print_timing: id 0 | task 5605 | total time = 748.80 ms / 184 tokens 1.42.827.738 I slot print_timing: id 0 | task 5605 | graphs reused = 4989 1.42.827.739 I slot print_timing: id 0 | task 5605 | graph reallocs = 0 / 0 (same size) / (changed size) 1.42.827.760 I slot release: id 0 | task 5605 | stop processing: n_tokens = 183, truncated = 0 1.42.843.803 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 183, t_last = 102724150 1.42.843.844 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 353.083 MiB) 1.42.871.654 I slot launch_slot_: id 0 | task 5656 | processing task, is_child = 0 1.43.757.815 I slot print_timing: id 0 | task 5656 | prompt eval time = 118.92 ms / 178 tokens ( 0.67 ms per token, 1496.77 tokens per second) 1.43.757.823 I slot print_timing: id 0 | task 5656 | eval time = 767.21 ms / 57 tokens ( 13.70 ms per token, 72.99 tokens per second) 1.43.757.825 I slot print_timing: id 0 | task 5656 | total time = 886.14 ms / 235 tokens 1.43.757.825 I slot print_timing: id 0 | task 5656 | graphs reused = 5044 1.43.757.827 I slot print_timing: id 0 | task 5656 | graph reallocs = 0 / 0 (same size) / (changed size) 1.43.757.856 I slot release: id 0 | task 5656 | stop processing: n_tokens = 234, truncated = 0 1.43.794.032 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 234, t_last = 103654245 1.43.820.231 I slot launch_slot_: id 0 | task 5716 | processing task, is_child = 0 1.44.703.975 I slot print_timing: id 0 | task 5716 | prompt eval time = 148.51 ms / 257 tokens ( 0.58 ms per token, 1730.48 tokens per second) 1.44.703.980 I slot print_timing: id 0 | task 5716 | eval time = 735.21 ms / 56 tokens ( 13.37 ms per token, 74.81 tokens per second) 1.44.703.981 I slot print_timing: id 0 | task 5716 | total time = 883.72 ms / 313 tokens 1.44.703.982 I slot print_timing: id 0 | task 5716 | graphs reused = 5098 1.44.703.982 I slot print_timing: id 0 | task 5716 | graph reallocs = 0 / 0 (same size) / (changed size) 1.44.704.006 I slot release: id 0 | task 5716 | stop processing: n_tokens = 312, truncated = 0 1.44.730.423 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 312, t_last = 104600395 1.44.730.478 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 400.210 MiB) 1.44.772.392 I slot launch_slot_: id 0 | task 5775 | processing task, is_child = 0 1.45.202.600 I slot print_timing: id 0 | task 5775 | prompt eval time = 146.55 ms / 256 tokens ( 0.57 ms per token, 1746.82 tokens per second) 1.45.202.606 I slot print_timing: id 0 | task 5775 | eval time = 283.64 ms / 22 tokens ( 13.51 ms per token, 74.04 tokens per second) 1.45.202.607 I slot print_timing: id 0 | task 5775 | total time = 430.19 ms / 278 tokens 1.45.202.608 I slot print_timing: id 0 | task 5775 | graphs reused = 5118 1.45.202.608 I slot print_timing: id 0 | task 5775 | graph reallocs = 0 / 0 (same size) / (changed size) 1.45.202.633 I slot release: id 0 | task 5775 | stop processing: n_tokens = 277, truncated = 0 1.45.242.821 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 277, t_last = 105099022 1.45.277.504 I slot launch_slot_: id 0 | task 5800 | processing task, is_child = 0 1.46.053.851 I slot print_timing: id 0 | task 5800 | prompt eval time = 155.50 ms / 276 tokens ( 0.56 ms per token, 1774.89 tokens per second) 1.46.053.857 I slot print_timing: id 0 | task 5800 | eval time = 620.83 ms / 46 tokens ( 13.80 ms per token, 72.48 tokens per second) 1.46.053.858 I slot print_timing: id 0 | task 5800 | total time = 776.33 ms / 322 tokens 1.46.053.858 I slot print_timing: id 0 | task 5800 | graphs reused = 5162 1.46.053.859 I slot print_timing: id 0 | task 5800 | graph reallocs = 0 / 0 (same size) / (changed size) 1.46.053.885 I slot release: id 0 | task 5800 | stop processing: n_tokens = 321, truncated = 0 1.46.080.204 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 321, t_last = 105950274 1.46.080.259 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 360.489 MiB) 1.46.122.944 I slot launch_slot_: id 0 | task 5849 | processing task, is_child = 0 1.46.548.516 I slot print_timing: id 0 | task 5849 | prompt eval time = 172.72 ms / 283 tokens ( 0.61 ms per token, 1638.44 tokens per second) 1.46.548.522 I slot print_timing: id 0 | task 5849 | eval time = 252.83 ms / 19 tokens ( 14.05 ms per token, 71.19 tokens per second) 1.46.548.523 I slot print_timing: id 0 | task 5849 | total time = 425.55 ms / 302 tokens 1.46.548.523 I slot print_timing: id 0 | task 5849 | graphs reused = 5179 1.46.548.525 I slot print_timing: id 0 | task 5849 | graph reallocs = 0 / 0 (same size) / (changed size) 1.46.548.551 I slot release: id 0 | task 5849 | stop processing: n_tokens = 301, truncated = 0 1.46.595.124 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 301, t_last = 106444940 1.46.595.179 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 476.448 MiB) 1.46.638.679 I slot launch_slot_: id 0 | task 5871 | processing task, is_child = 0 1.47.742.073 I slot print_timing: id 0 | task 5871 | prompt eval time = 163.35 ms / 288 tokens ( 0.57 ms per token, 1763.05 tokens per second) 1.47.742.078 I slot print_timing: id 0 | task 5871 | eval time = 940.02 ms / 69 tokens ( 13.82 ms per token, 72.34 tokens per second) 1.47.742.079 I slot print_timing: id 0 | task 5871 | total time = 1103.37 ms / 357 tokens 1.47.742.080 I slot print_timing: id 0 | task 5871 | graphs reused = 5246 1.47.742.081 I slot print_timing: id 0 | task 5871 | graph reallocs = 0 / 0 (same size) / (changed size) 1.47.742.105 I slot release: id 0 | task 5871 | stop processing: n_tokens = 356, truncated = 0 1.47.758.646 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 356, t_last = 107638494 1.47.798.691 I slot launch_slot_: id 0 | task 5943 | processing task, is_child = 0 1.48.651.794 I slot print_timing: id 0 | task 5943 | prompt eval time = 147.57 ms / 237 tokens ( 0.62 ms per token, 1606.02 tokens per second) 1.48.651.799 I slot print_timing: id 0 | task 5943 | eval time = 705.51 ms / 53 tokens ( 13.57 ms per token, 73.71 tokens per second) 1.48.651.800 I slot print_timing: id 0 | task 5943 | total time = 853.08 ms / 290 tokens 1.48.651.801 I slot print_timing: id 0 | task 5943 | graphs reused = 5296 1.48.651.802 I slot print_timing: id 0 | task 5943 | graph reallocs = 0 / 0 (same size) / (changed size) 1.48.651.824 I slot release: id 0 | task 5943 | stop processing: n_tokens = 289, truncated = 0 1.48.694.295 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 289, t_last = 108548214 1.48.694.344 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 585.782 MiB) 1.48.745.903 I slot launch_slot_: id 0 | task 5999 | processing task, is_child = 0 1.49.615.189 I slot print_timing: id 0 | task 5999 | prompt eval time = 122.43 ms / 173 tokens ( 0.71 ms per token, 1413.05 tokens per second) 1.49.615.195 I slot print_timing: id 0 | task 5999 | eval time = 746.84 ms / 52 tokens ( 14.64 ms per token, 68.29 tokens per second) 1.49.615.196 I slot print_timing: id 0 | task 5999 | total time = 869.27 ms / 225 tokens 1.49.615.197 I slot print_timing: id 0 | task 5999 | graphs reused = 5346 1.49.615.198 I slot print_timing: id 0 | task 5999 | graph reallocs = 0 / 0 (same size) / (changed size) 1.49.615.218 I slot release: id 0 | task 5999 | stop processing: n_tokens = 224, truncated = 0 1.49.646.504 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 224, t_last = 109511608 1.49.672.470 I slot launch_slot_: id 0 | task 6054 | processing task, is_child = 0 1.50.906.238 I slot print_timing: id 0 | task 6054 | prompt eval time = 197.18 ms / 356 tokens ( 0.55 ms per token, 1805.49 tokens per second) 1.50.906.243 I slot print_timing: id 0 | task 6054 | eval time = 1036.57 ms / 76 tokens ( 13.82 ms per token, 72.35 tokens per second) 1.50.906.244 I slot print_timing: id 0 | task 6054 | total time = 1233.75 ms / 432 tokens 1.50.906.246 I slot print_timing: id 0 | task 6054 | graphs reused = 5420 1.50.906.246 I slot print_timing: id 0 | task 6054 | graph reallocs = 0 / 0 (same size) / (changed size) 1.50.906.281 I slot release: id 0 | task 6054 | stop processing: n_tokens = 431, truncated = 0 1.50.915.007 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 431, t_last = 110802671 1.50.915.074 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 173.309 MiB) 1.50.970.562 I slot launch_slot_: id 0 | task 6133 | processing task, is_child = 0 1.53.173.763 I slot print_timing: id 0 | task 6133 | prompt eval time = 294.47 ms / 580 tokens ( 0.51 ms per token, 1969.61 tokens per second) 1.53.173.768 I slot print_timing: id 0 | task 6133 | eval time = 1908.70 ms / 141 tokens ( 13.63 ms per token, 73.35 tokens per second) 1.53.173.770 I slot print_timing: id 0 | task 6133 | total time = 2203.18 ms / 721 tokens 1.53.173.770 I slot print_timing: id 0 | task 6133 | graphs reused = 5559 1.53.173.772 I slot print_timing: id 0 | task 6133 | graph reallocs = 0 / 0 (same size) / (changed size) 1.53.173.813 I slot release: id 0 | task 6133 | stop processing: n_tokens = 720, truncated = 0 1.53.210.629 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 720, t_last = 113070202 1.53.210.721 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 182.950 MiB) 1.53.213.193 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 190.310 MiB) 1.53.215.684 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 157.621 MiB) 1.53.299.957 I slot launch_slot_: id 0 | task 6278 | processing task, is_child = 0 1.54.899.151 I slot print_timing: id 0 | task 6278 | prompt eval time = 233.58 ms / 470 tokens ( 0.50 ms per token, 2012.14 tokens per second) 1.54.899.156 I slot print_timing: id 0 | task 6278 | eval time = 1365.59 ms / 99 tokens ( 13.93 ms per token, 71.76 tokens per second) 1.54.899.157 I slot print_timing: id 0 | task 6278 | total time = 1599.18 ms / 569 tokens 1.54.899.158 I slot print_timing: id 0 | task 6278 | graphs reused = 5655 1.54.899.159 I slot print_timing: id 0 | task 6278 | graph reallocs = 0 / 0 (same size) / (changed size) 1.54.899.198 I slot release: id 0 | task 6278 | stop processing: n_tokens = 568, truncated = 0 1.54.938.978 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 568, t_last = 114795587 1.54.939.061 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 219.561 MiB) 1.54.942.134 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 261.736 MiB) 1.55.013.455 I slot launch_slot_: id 0 | task 6380 | processing task, is_child = 0 1.55.588.532 I slot print_timing: id 0 | task 6380 | prompt eval time = 193.71 ms / 374 tokens ( 0.52 ms per token, 1930.71 tokens per second) 1.55.588.537 I slot print_timing: id 0 | task 6380 | eval time = 381.34 ms / 28 tokens ( 14.12 ms per token, 70.80 tokens per second) 1.55.588.538 I slot print_timing: id 0 | task 6380 | total time = 575.06 ms / 402 tokens 1.55.588.539 I slot print_timing: id 0 | task 6380 | graphs reused = 5681 1.55.588.540 I slot print_timing: id 0 | task 6380 | graph reallocs = 0 / 0 (same size) / (changed size) 1.55.588.571 I slot release: id 0 | task 6380 | stop processing: n_tokens = 401, truncated = 0 1.55.612.601 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 401, t_last = 115484961 1.55.612.664 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 330.239 MiB) 1.55.667.453 I slot launch_slot_: id 0 | task 6411 | processing task, is_child = 0 1.56.738.283 I slot print_timing: id 0 | task 6411 | prompt eval time = 183.34 ms / 318 tokens ( 0.58 ms per token, 1734.45 tokens per second) 1.56.738.289 I slot print_timing: id 0 | task 6411 | eval time = 887.47 ms / 67 tokens ( 13.45 ms per token, 74.37 tokens per second) 1.56.738.290 I slot print_timing: id 0 | task 6411 | total time = 1070.81 ms / 385 tokens 1.56.738.291 I slot print_timing: id 0 | task 6411 | graphs reused = 5746 1.56.738.293 I slot print_timing: id 0 | task 6411 | graph reallocs = 0 / 0 (same size) / (changed size) 1.56.738.322 I slot release: id 0 | task 6411 | stop processing: n_tokens = 384, truncated = 0 1.56.781.202 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 384, t_last = 116634711 1.56.781.259 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 161.027 MiB) 1.56.783.558 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 160.433 MiB) 1.56.829.765 I slot launch_slot_: id 0 | task 6481 | processing task, is_child = 0 1.58.568.408 I slot print_timing: id 0 | task 6481 | prompt eval time = 289.29 ms / 571 tokens ( 0.51 ms per token, 1973.83 tokens per second) 1.58.568.413 I slot print_timing: id 0 | task 6481 | eval time = 1449.34 ms / 106 tokens ( 13.80 ms per token, 72.45 tokens per second) 1.58.568.415 I slot print_timing: id 0 | task 6481 | total time = 1738.63 ms / 677 tokens 1.58.568.415 I slot print_timing: id 0 | task 6481 | graphs reused = 5850 1.58.568.416 I slot print_timing: id 0 | task 6481 | graph reallocs = 0 / 0 (same size) / (changed size) 1.58.568.455 I slot release: id 0 | task 6481 | stop processing: n_tokens = 676, truncated = 0 1.58.613.338 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 676, t_last = 118464844 1.58.613.429 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 191.216 MiB) 1.58.616.092 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 246.656 MiB) 1.58.700.329 I slot launch_slot_: id 0 | task 6591 | processing task, is_child = 0 2.00.268.361 I slot print_timing: id 0 | task 6591 | prompt eval time = 174.87 ms / 310 tokens ( 0.56 ms per token, 1772.75 tokens per second) 2.00.268.366 I slot print_timing: id 0 | task 6591 | eval time = 1393.14 ms / 102 tokens ( 13.79 ms per token, 72.50 tokens per second) 2.00.268.368 I slot print_timing: id 0 | task 6591 | total time = 1568.01 ms / 412 tokens 2.00.268.368 I slot print_timing: id 0 | task 6591 | graphs reused = 5950 2.00.268.369 I slot print_timing: id 0 | task 6591 | graph reallocs = 0 / 0 (same size) / (changed size) 2.00.268.397 I slot release: id 0 | task 6591 | stop processing: n_tokens = 411, truncated = 0 2.00.288.060 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 411, t_last = 120164787 2.00.288.124 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 205.623 MiB) 2.00.291.047 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 227.046 MiB) 2.00.344.486 I slot launch_slot_: id 0 | task 6696 | processing task, is_child = 0 2.00.952.796 I slot print_timing: id 0 | task 6696 | prompt eval time = 218.76 ms / 433 tokens ( 0.51 ms per token, 1979.31 tokens per second) 2.00.952.801 I slot print_timing: id 0 | task 6696 | eval time = 389.53 ms / 30 tokens ( 13.43 ms per token, 74.45 tokens per second) 2.00.952.802 I slot print_timing: id 0 | task 6696 | total time = 608.29 ms / 463 tokens 2.00.952.803 I slot print_timing: id 0 | task 6696 | graphs reused = 5978 2.00.952.804 I slot print_timing: id 0 | task 6696 | graph reallocs = 0 / 0 (same size) / (changed size) 2.00.952.839 I slot release: id 0 | task 6696 | stop processing: n_tokens = 462, truncated = 0 2.00.974.794 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 462, t_last = 120849228 2.00.974.865 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 213.873 MiB) 2.01.030.874 I slot launch_slot_: id 0 | task 6729 | processing task, is_child = 0 2.02.171.761 I slot print_timing: id 0 | task 6729 | prompt eval time = 131.88 ms / 201 tokens ( 0.66 ms per token, 1524.10 tokens per second) 2.02.171.767 I slot print_timing: id 0 | task 6729 | eval time = 1008.99 ms / 75 tokens ( 13.63 ms per token, 73.34 tokens per second) 2.02.171.768 I slot print_timing: id 0 | task 6729 | total time = 1140.87 ms / 276 tokens 2.02.171.769 I slot print_timing: id 0 | task 6729 | graphs reused = 6050 2.02.171.770 I slot print_timing: id 0 | task 6729 | graph reallocs = 0 / 0 (same size) / (changed size) 2.02.171.791 I slot release: id 0 | task 6729 | stop processing: n_tokens = 275, truncated = 0 2.02.206.065 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 275, t_last = 122068181 2.02.206.117 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 176.450 MiB) 2.02.208.616 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 266.548 MiB) 2.02.242.049 I slot launch_slot_: id 0 | task 6807 | processing task, is_child = 0 2.04.015.011 I slot print_timing: id 0 | task 6807 | prompt eval time = 210.87 ms / 402 tokens ( 0.52 ms per token, 1906.42 tokens per second) 2.04.015.017 I slot print_timing: id 0 | task 6807 | eval time = 1562.08 ms / 114 tokens ( 13.82 ms per token, 72.34 tokens per second) 2.04.015.018 I slot print_timing: id 0 | task 6807 | total time = 1772.94 ms / 516 tokens 2.04.015.019 I slot print_timing: id 0 | task 6807 | graphs reused = 6161 2.04.015.020 I slot print_timing: id 0 | task 6807 | graph reallocs = 0 / 0 (same size) / (changed size) 2.04.015.053 I slot release: id 0 | task 6807 | stop processing: n_tokens = 515, truncated = 0 2.04.022.585 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 515, t_last = 123911442 2.04.022.657 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 193.873 MiB) 2.04.084.503 I slot launch_slot_: id 0 | task 6924 | processing task, is_child = 0 2.05.988.313 I slot print_timing: id 0 | task 6924 | prompt eval time = 250.24 ms / 514 tokens ( 0.49 ms per token, 2054.00 tokens per second) 2.05.988.319 I slot print_timing: id 0 | task 6924 | eval time = 1653.55 ms / 123 tokens ( 13.55 ms per token, 73.78 tokens per second) 2.05.988.320 I slot print_timing: id 0 | task 6924 | total time = 1903.79 ms / 637 tokens 2.05.988.321 I slot print_timing: id 0 | task 6924 | graphs reused = 6282 2.05.988.322 I slot print_timing: id 0 | task 6924 | graph reallocs = 0 / 0 (same size) / (changed size) 2.05.988.359 I slot release: id 0 | task 6924 | stop processing: n_tokens = 636, truncated = 0 2.06.015.767 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 636, t_last = 125884748 2.06.015.873 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 169.496 MiB) 2.06.018.153 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 241.672 MiB) 2.06.096.379 I slot launch_slot_: id 0 | task 7050 | processing task, is_child = 0 2.07.387.190 I slot print_timing: id 0 | task 7050 | prompt eval time = 298.30 ms / 564 tokens ( 0.53 ms per token, 1890.70 tokens per second) 2.07.387.195 I slot print_timing: id 0 | task 7050 | eval time = 992.49 ms / 72 tokens ( 13.98 ms per token, 71.54 tokens per second) 2.07.387.196 I slot print_timing: id 0 | task 7050 | total time = 1290.79 ms / 636 tokens 2.07.387.197 I slot print_timing: id 0 | task 7050 | graphs reused = 6352 2.07.387.198 I slot print_timing: id 0 | task 7050 | graph reallocs = 0 / 0 (same size) / (changed size) 2.07.387.238 I slot release: id 0 | task 7050 | stop processing: n_tokens = 635, truncated = 0 2.07.406.496 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 635, t_last = 127283627 2.07.406.579 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 178.200 MiB) 2.07.409.050 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 240.234 MiB) 2.07.412.290 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 197.717 MiB) 2.07.494.569 I slot launch_slot_: id 0 | task 7126 | processing task, is_child = 0 2.08.715.096 I slot print_timing: id 0 | task 7126 | prompt eval time = 211.87 ms / 396 tokens ( 0.54 ms per token, 1869.06 tokens per second) 2.08.715.102 I slot print_timing: id 0 | task 7126 | eval time = 1008.64 ms / 75 tokens ( 13.63 ms per token, 73.37 tokens per second) 2.08.715.103 I slot print_timing: id 0 | task 7126 | total time = 1220.51 ms / 471 tokens 2.08.715.103 I slot print_timing: id 0 | task 7126 | graphs reused = 6425 2.08.715.104 I slot print_timing: id 0 | task 7126 | graph reallocs = 0 / 0 (same size) / (changed size) 2.08.715.136 I slot release: id 0 | task 7126 | stop processing: n_tokens = 470, truncated = 0 2.08.747.490 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 470, t_last = 128611526 2.08.747.557 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 260.923 MiB) 2.08.751.054 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 239.797 MiB) 2.08.808.417 I slot launch_slot_: id 0 | task 7204 | processing task, is_child = 0 2.10.978.252 I slot print_timing: id 0 | task 7204 | prompt eval time = 232.37 ms / 464 tokens ( 0.50 ms per token, 1996.80 tokens per second) 2.10.978.257 I slot print_timing: id 0 | task 7204 | eval time = 1937.44 ms / 142 tokens ( 13.74 ms per token, 72.78 tokens per second) 2.10.978.258 I slot print_timing: id 0 | task 7204 | total time = 2169.81 ms / 606 tokens 2.10.978.259 I slot print_timing: id 0 | task 7204 | graphs reused = 6564 2.10.978.260 I slot print_timing: id 0 | task 7204 | graph reallocs = 0 / 0 (same size) / (changed size) 2.10.978.295 I slot release: id 0 | task 7204 | stop processing: n_tokens = 605, truncated = 0 2.11.006.735 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 605, t_last = 130874684 2.11.006.817 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 261.220 MiB) 2.11.075.079 I slot launch_slot_: id 0 | task 7349 | processing task, is_child = 0 2.12.231.373 I slot print_timing: id 0 | task 7349 | prompt eval time = 232.34 ms / 420 tokens ( 0.55 ms per token, 1807.70 tokens per second) 2.12.231.379 I slot print_timing: id 0 | task 7349 | eval time = 923.93 ms / 68 tokens ( 13.79 ms per token, 72.52 tokens per second) 2.12.231.380 I slot print_timing: id 0 | task 7349 | total time = 1156.27 ms / 488 tokens 2.12.231.380 I slot print_timing: id 0 | task 7349 | graphs reused = 6630 2.12.231.381 I slot print_timing: id 0 | task 7349 | graph reallocs = 0 / 0 (same size) / (changed size) 2.12.231.415 I slot release: id 0 | task 7349 | stop processing: n_tokens = 487, truncated = 0 2.12.261.924 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 487, t_last = 132127805 2.12.261.994 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 208.686 MiB) 2.12.264.730 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 161.589 MiB) 2.12.323.507 I slot launch_slot_: id 0 | task 7420 | processing task, is_child = 0 2.14.053.437 I slot print_timing: id 0 | task 7420 | prompt eval time = 293.04 ms / 578 tokens ( 0.51 ms per token, 1972.46 tokens per second) 2.14.053.443 I slot print_timing: id 0 | task 7420 | eval time = 1436.87 ms / 107 tokens ( 13.56 ms per token, 73.77 tokens per second) 2.14.053.444 I slot print_timing: id 0 | task 7420 | total time = 1729.91 ms / 685 tokens 2.14.053.445 I slot print_timing: id 0 | task 7420 | graphs reused = 6735 2.14.053.446 I slot print_timing: id 0 | task 7420 | graph reallocs = 0 / 0 (same size) / (changed size) 2.14.053.493 I slot release: id 0 | task 7420 | stop processing: n_tokens = 684, truncated = 0 2.14.085.261 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 684, t_last = 133949883 2.14.085.350 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 203.998 MiB) 2.14.088.200 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 130.369 MiB) 2.14.089.965 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 166.793 MiB) 2.14.092.113 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 247.390 MiB) 2.14.178.191 I slot launch_slot_: id 0 | task 7531 | processing task, is_child = 0 2.16.221.153 I slot print_timing: id 0 | task 7531 | prompt eval time = 333.72 ms / 662 tokens ( 0.50 ms per token, 1983.69 tokens per second) 2.16.221.159 I slot print_timing: id 0 | task 7531 | eval time = 1709.22 ms / 123 tokens ( 14.01 ms per token, 71.38 tokens per second) 2.16.221.160 I slot print_timing: id 0 | task 7531 | total time = 2042.94 ms / 785 tokens 2.16.221.161 I slot print_timing: id 0 | task 7531 | graphs reused = 6855 2.16.221.162 I slot print_timing: id 0 | task 7531 | graph reallocs = 0 / 0 (same size) / (changed size) 2.16.221.207 I slot release: id 0 | task 7531 | stop processing: n_tokens = 784, truncated = 0 2.16.230.275 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 784, t_last = 136117597 2.16.230.373 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 237.780 MiB) 2.16.233.761 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 255.344 MiB) 2.16.328.793 I slot launch_slot_: id 0 | task 7658 | processing task, is_child = 0 2.17.531.183 I slot print_timing: id 0 | task 7658 | prompt eval time = 241.97 ms / 470 tokens ( 0.51 ms per token, 1942.41 tokens per second) 2.17.531.188 I slot print_timing: id 0 | task 7658 | eval time = 960.40 ms / 72 tokens ( 13.53 ms per token, 73.93 tokens per second) 2.17.531.189 I slot print_timing: id 0 | task 7658 | total time = 1202.37 ms / 542 tokens 2.17.531.190 I slot print_timing: id 0 | task 7658 | graphs reused = 6924 2.17.531.191 I slot print_timing: id 0 | task 7658 | graph reallocs = 0 / 0 (same size) / (changed size) 2.17.531.230 I slot release: id 0 | task 7658 | stop processing: n_tokens = 541, truncated = 0 2.17.558.176 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 541, t_last = 137427619 2.17.558.237 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 257.219 MiB) 2.17.561.838 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 270.892 MiB) 2.17.627.697 I slot launch_slot_: id 0 | task 7733 | processing task, is_child = 0 2.19.660.725 I slot print_timing: id 0 | task 7733 | prompt eval time = 278.39 ms / 534 tokens ( 0.52 ms per token, 1918.17 tokens per second) 2.19.660.731 I slot print_timing: id 0 | task 7733 | eval time = 1754.62 ms / 127 tokens ( 13.93 ms per token, 71.81 tokens per second) 2.19.660.732 I slot print_timing: id 0 | task 7733 | total time = 2033.01 ms / 661 tokens 2.19.660.733 I slot print_timing: id 0 | task 7733 | graphs reused = 7049 2.19.660.734 I slot print_timing: id 0 | task 7733 | graph reallocs = 0 / 0 (same size) / (changed size) 2.19.660.773 I slot release: id 0 | task 7733 | stop processing: n_tokens = 660, truncated = 0 2.19.692.279 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 660, t_last = 139557162 2.19.692.350 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 229.843 MiB) 2.19.695.827 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 166.637 MiB) 2.19.782.856 I slot launch_slot_: id 0 | task 7864 | processing task, is_child = 0 2.21.599.451 I slot print_timing: id 0 | task 7864 | prompt eval time = 177.46 ms / 319 tokens ( 0.56 ms per token, 1797.60 tokens per second) 2.21.599.457 I slot print_timing: id 0 | task 7864 | eval time = 1639.09 ms / 123 tokens ( 13.44 ms per token, 74.43 tokens per second) 2.21.599.458 I slot print_timing: id 0 | task 7864 | total time = 1816.54 ms / 442 tokens 2.21.599.459 I slot print_timing: id 0 | task 7864 | graphs reused = 7170 2.21.599.460 I slot print_timing: id 0 | task 7864 | graph reallocs = 0 / 0 (same size) / (changed size) 2.21.599.492 I slot release: id 0 | task 7864 | stop processing: n_tokens = 441, truncated = 0 2.21.634.441 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 441, t_last = 141495881 2.21.634.511 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 348.005 MiB) 2.21.687.596 I slot launch_slot_: id 0 | task 7990 | processing task, is_child = 0 2.23.940.897 I slot print_timing: id 0 | task 7990 | prompt eval time = 211.27 ms / 395 tokens ( 0.53 ms per token, 1869.65 tokens per second) 2.23.940.905 I slot print_timing: id 0 | task 7990 | eval time = 2042.01 ms / 149 tokens ( 13.80 ms per token, 72.48 tokens per second) 2.23.940.906 I slot print_timing: id 0 | task 7990 | total time = 2253.28 ms / 544 tokens 2.23.940.907 I slot print_timing: id 0 | task 7990 | graphs reused = 7316 2.23.940.908 I slot print_timing: id 0 | task 7990 | graph reallocs = 0 / 0 (same size) / (changed size) 2.23.940.943 I slot release: id 0 | task 7990 | stop processing: n_tokens = 543, truncated = 0 2.23.965.946 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 543, t_last = 143837332 2.23.966.020 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 559.720 MiB) 2.24.041.541 I slot launch_slot_: id 0 | task 8142 | processing task, is_child = 0 2.25.992.339 I slot print_timing: id 0 | task 8142 | prompt eval time = 356.90 ms / 711 tokens ( 0.50 ms per token, 1992.17 tokens per second) 2.25.992.345 I slot print_timing: id 0 | task 8142 | eval time = 1593.88 ms / 118 tokens ( 13.62 ms per token, 73.41 tokens per second) 2.25.992.346 I slot print_timing: id 0 | task 8142 | total time = 1950.78 ms / 829 tokens 2.25.992.347 I slot print_timing: id 0 | task 8142 | graphs reused = 7431 2.25.992.347 I slot print_timing: id 0 | task 8142 | graph reallocs = 0 / 0 (same size) / (changed size) 2.25.992.394 I slot release: id 0 | task 8142 | stop processing: n_tokens = 828, truncated = 0 2.26.035.258 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 828, t_last = 145888784 2.26.035.359 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 444.838 MiB) 2.26.041.392 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 325.035 MiB) 2.26.155.070 I slot launch_slot_: id 0 | task 8264 | processing task, is_child = 0 2.28.613.219 I slot print_timing: id 0 | task 8264 | prompt eval time = 356.12 ms / 667 tokens ( 0.53 ms per token, 1872.95 tokens per second) 2.28.613.225 I slot print_timing: id 0 | task 8264 | eval time = 2102.01 ms / 151 tokens ( 14.01 ms per token, 71.36 tokens per second) 2.28.613.226 I slot print_timing: id 0 | task 8264 | total time = 2458.13 ms / 818 tokens 2.28.613.227 I slot print_timing: id 0 | task 8264 | graphs reused = 7579 2.28.613.228 I slot print_timing: id 0 | task 8264 | graph reallocs = 0 / 0 (same size) / (changed size) 2.28.613.272 I slot release: id 0 | task 8264 | stop processing: n_tokens = 817, truncated = 0 2.28.634.270 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 817, t_last = 148509662 2.28.634.373 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 307.268 MiB) 2.28.638.461 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 543.719 MiB) 2.28.748.299 I slot launch_slot_: id 0 | task 8419 | processing task, is_child = 0 2.30.958.824 I slot print_timing: id 0 | task 8419 | prompt eval time = 143.75 ms / 227 tokens ( 0.63 ms per token, 1579.17 tokens per second) 2.30.958.830 I slot print_timing: id 0 | task 8419 | eval time = 2066.76 ms / 154 tokens ( 13.51 ms per token, 74.03 tokens per second) 2.30.958.831 I slot print_timing: id 0 | task 8419 | total time = 2210.51 ms / 381 tokens 2.30.958.832 I slot print_timing: id 0 | task 8419 | graphs reused = 7730 2.30.958.833 I slot print_timing: id 0 | task 8419 | graph reallocs = 0 / 0 (same size) / (changed size) 2.30.958.856 I slot release: id 0 | task 8419 | stop processing: n_tokens = 380, truncated = 0 2.30.981.095 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 380, t_last = 150855246 2.31.019.984 I slot launch_slot_: id 0 | task 8576 | processing task, is_child = 0 2.31.962.884 I slot print_timing: id 0 | task 8576 | prompt eval time = 119.88 ms / 158 tokens ( 0.76 ms per token, 1317.94 tokens per second) 2.31.962.890 I slot print_timing: id 0 | task 8576 | eval time = 823.00 ms / 61 tokens ( 13.72 ms per token, 72.90 tokens per second) 2.31.962.891 I slot print_timing: id 0 | task 8576 | total time = 942.88 ms / 219 tokens 2.31.962.892 I slot print_timing: id 0 | task 8576 | graphs reused = 7789 2.31.962.892 I slot print_timing: id 0 | task 8576 | graph reallocs = 0 / 0 (same size) / (changed size) 2.31.962.913 I slot release: id 0 | task 8576 | stop processing: n_tokens = 218, truncated = 0 2.31.991.613 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 218, t_last = 151859302 2.32.017.059 I slot launch_slot_: id 0 | task 8640 | processing task, is_child = 0 2.32.472.060 I slot print_timing: id 0 | task 8640 | prompt eval time = 124.73 ms / 175 tokens ( 0.71 ms per token, 1403.03 tokens per second) 2.32.472.065 I slot print_timing: id 0 | task 8640 | eval time = 330.25 ms / 25 tokens ( 13.76 ms per token, 72.67 tokens per second) 2.32.472.067 I slot print_timing: id 0 | task 8640 | total time = 454.98 ms / 200 tokens 2.32.472.067 I slot print_timing: id 0 | task 8640 | graphs reused = 7812 2.32.472.069 I slot print_timing: id 0 | task 8640 | graph reallocs = 0 / 0 (same size) / (changed size) 2.32.472.091 I slot release: id 0 | task 8640 | stop processing: n_tokens = 199, truncated = 0 2.32.490.835 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 199, t_last = 152368480 2.32.490.874 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 303.628 MiB) 2.32.526.354 I slot launch_slot_: id 0 | task 8668 | processing task, is_child = 0 2.33.767.974 I slot print_timing: id 0 | task 8668 | prompt eval time = 106.48 ms / 135 tokens ( 0.79 ms per token, 1267.89 tokens per second) 2.33.767.980 I slot print_timing: id 0 | task 8668 | eval time = 1135.13 ms / 87 tokens ( 13.20 ms per token, 75.76 tokens per second) 2.33.767.981 I slot print_timing: id 0 | task 8668 | total time = 1241.60 ms / 222 tokens 2.33.767.981 I slot print_timing: id 0 | task 8668 | graphs reused = 7897 2.33.767.982 I slot print_timing: id 0 | task 8668 | graph reallocs = 0 / 0 (same size) / (changed size) 2.33.768.002 I slot release: id 0 | task 8668 | stop processing: n_tokens = 221, truncated = 0 2.33.808.187 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 221, t_last = 153664391 2.33.832.189 I slot launch_slot_: id 0 | task 8758 | processing task, is_child = 0 2.34.412.054 I slot print_timing: id 0 | task 8758 | prompt eval time = 133.76 ms / 210 tokens ( 0.64 ms per token, 1569.92 tokens per second) 2.34.412.060 I slot print_timing: id 0 | task 8758 | eval time = 446.08 ms / 34 tokens ( 13.52 ms per token, 73.98 tokens per second) 2.34.412.062 I slot print_timing: id 0 | task 8758 | total time = 579.85 ms / 244 tokens 2.34.412.062 I slot print_timing: id 0 | task 8758 | graphs reused = 7929 2.34.412.063 I slot print_timing: id 0 | task 8758 | graph reallocs = 0 / 0 (same size) / (changed size) 2.34.412.086 I slot release: id 0 | task 8758 | stop processing: n_tokens = 243, truncated = 0 2.34.447.350 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 243, t_last = 154308476 2.34.447.389 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 381.616 MiB) 2.34.481.633 I slot launch_slot_: id 0 | task 8795 | processing task, is_child = 0 2.34.786.763 I slot print_timing: id 0 | task 8795 | prompt eval time = 95.64 ms / 111 tokens ( 0.86 ms per token, 1160.64 tokens per second) 2.34.786.768 I slot print_timing: id 0 | task 8795 | eval time = 209.47 ms / 16 tokens ( 13.96 ms per token, 71.61 tokens per second) 2.34.786.769 I slot print_timing: id 0 | task 8795 | total time = 305.11 ms / 127 tokens 2.34.786.770 I slot print_timing: id 0 | task 8795 | graphs reused = 7943 2.34.786.771 I slot print_timing: id 0 | task 8795 | graph reallocs = 0 / 0 (same size) / (changed size) 2.34.786.789 I slot release: id 0 | task 8795 | stop processing: n_tokens = 126, truncated = 0 2.34.792.138 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 126, t_last = 154683179 2.34.809.522 I slot launch_slot_: id 0 | task 8814 | processing task, is_child = 0 2.36.409.553 I slot print_timing: id 0 | task 8814 | prompt eval time = 117.84 ms / 151 tokens ( 0.78 ms per token, 1281.36 tokens per second) 2.36.409.558 I slot print_timing: id 0 | task 8814 | eval time = 1482.17 ms / 109 tokens ( 13.72 ms per token, 72.87 tokens per second) 2.36.409.559 I slot print_timing: id 0 | task 8814 | total time = 1600.01 ms / 260 tokens 2.36.409.560 I slot print_timing: id 0 | task 8814 | graphs reused = 8049 2.36.409.561 I slot print_timing: id 0 | task 8814 | graph reallocs = 0 / 0 (same size) / (changed size) 2.36.409.583 I slot release: id 0 | task 8814 | stop processing: n_tokens = 259, truncated = 0 2.36.441.681 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 259, t_last = 156305972 2.36.441.730 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 197.748 MiB) 2.36.473.014 I slot launch_slot_: id 0 | task 8926 | processing task, is_child = 0 2.37.042.238 I slot print_timing: id 0 | task 8926 | prompt eval time = 108.25 ms / 150 tokens ( 0.72 ms per token, 1385.72 tokens per second) 2.37.042.243 I slot print_timing: id 0 | task 8926 | eval time = 460.96 ms / 35 tokens ( 13.56 ms per token, 73.76 tokens per second) 2.37.042.244 I slot print_timing: id 0 | task 8926 | total time = 569.20 ms / 185 tokens 2.37.042.246 I slot print_timing: id 0 | task 8926 | graphs reused = 8082 2.37.042.246 I slot print_timing: id 0 | task 8926 | graph reallocs = 0 / 0 (same size) / (changed size) 2.37.042.267 I slot release: id 0 | task 8926 | stop processing: n_tokens = 184, truncated = 0 2.37.068.462 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 184, t_last = 156938656 2.37.068.501 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 387.757 MiB) 2.37.097.900 I slot launch_slot_: id 0 | task 8964 | processing task, is_child = 0 2.37.625.967 I slot print_timing: id 0 | task 8964 | prompt eval time = 87.14 ms / 89 tokens ( 0.98 ms per token, 1021.39 tokens per second) 2.37.625.973 I slot print_timing: id 0 | task 8964 | eval time = 440.91 ms / 34 tokens ( 13.36 ms per token, 74.84 tokens per second) 2.37.625.974 I slot print_timing: id 0 | task 8964 | total time = 528.05 ms / 123 tokens 2.37.625.975 I slot print_timing: id 0 | task 8964 | graphs reused = 8114 2.37.625.976 I slot print_timing: id 0 | task 8964 | graph reallocs = 0 / 0 (same size) / (changed size) 2.37.625.992 I slot release: id 0 | task 8964 | stop processing: n_tokens = 122, truncated = 0 2.37.640.715 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 122, t_last = 157522381 2.37.655.508 I slot launch_slot_: id 0 | task 9001 | processing task, is_child = 0 2.38.331.883 I slot print_timing: id 0 | task 9001 | prompt eval time = 116.86 ms / 159 tokens ( 0.73 ms per token, 1360.60 tokens per second) 2.38.331.888 I slot print_timing: id 0 | task 9001 | eval time = 559.50 ms / 43 tokens ( 13.32 ms per token, 75.07 tokens per second) 2.38.331.889 I slot print_timing: id 0 | task 9001 | total time = 676.36 ms / 202 tokens 2.38.331.890 I slot print_timing: id 0 | task 9001 | graphs reused = 8155 2.38.331.891 I slot print_timing: id 0 | task 9001 | graph reallocs = 0 / 0 (same size) / (changed size) 2.38.331.914 I slot release: id 0 | task 9001 | stop processing: n_tokens = 201, truncated = 0 2.38.359.836 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 201, t_last = 158228303 2.38.383.363 I slot launch_slot_: id 0 | task 9047 | processing task, is_child = 0 2.39.145.694 I slot print_timing: id 0 | task 9047 | prompt eval time = 121.11 ms / 155 tokens ( 0.78 ms per token, 1279.80 tokens per second) 2.39.145.700 I slot print_timing: id 0 | task 9047 | eval time = 641.20 ms / 48 tokens ( 13.64 ms per token, 73.30 tokens per second) 2.39.145.701 I slot print_timing: id 0 | task 9047 | total time = 762.31 ms / 203 tokens 2.39.145.702 I slot print_timing: id 0 | task 9047 | graphs reused = 8201 2.39.145.702 I slot print_timing: id 0 | task 9047 | graph reallocs = 0 / 0 (same size) / (changed size) 2.39.145.723 I slot release: id 0 | task 9047 | stop processing: n_tokens = 202, truncated = 0 2.39.171.057 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 202, t_last = 159042112 2.39.171.099 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 470.902 MiB) 2.39.212.681 I slot launch_slot_: id 0 | task 9098 | processing task, is_child = 0 2.39.825.001 I slot print_timing: id 0 | task 9098 | prompt eval time = 117.12 ms / 170 tokens ( 0.69 ms per token, 1451.55 tokens per second) 2.39.825.006 I slot print_timing: id 0 | task 9098 | eval time = 495.15 ms / 37 tokens ( 13.75 ms per token, 72.70 tokens per second) 2.39.825.007 I slot print_timing: id 0 | task 9098 | total time = 612.27 ms / 207 tokens 2.39.825.008 I slot print_timing: id 0 | task 9098 | graphs reused = 8236 2.39.825.008 I slot print_timing: id 0 | task 9098 | graph reallocs = 0 / 0 (same size) / (changed size) 2.39.825.032 I slot release: id 0 | task 9098 | stop processing: n_tokens = 206, truncated = 0 2.39.856.336 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 206, t_last = 159721421 2.39.880.321 I slot launch_slot_: id 0 | task 9138 | processing task, is_child = 0 2.40.223.215 I slot print_timing: id 0 | task 9138 | prompt eval time = 105.80 ms / 141 tokens ( 0.75 ms per token, 1332.69 tokens per second) 2.40.223.220 I slot print_timing: id 0 | task 9138 | eval time = 237.08 ms / 18 tokens ( 13.95 ms per token, 71.71 tokens per second) 2.40.223.221 I slot print_timing: id 0 | task 9138 | total time = 342.88 ms / 159 tokens 2.40.223.221 I slot print_timing: id 0 | task 9138 | graphs reused = 8252 2.40.223.222 I slot print_timing: id 0 | task 9138 | graph reallocs = 0 / 0 (same size) / (changed size) 2.40.223.242 I slot release: id 0 | task 9138 | stop processing: n_tokens = 158, truncated = 0 2.40.261.078 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 158, t_last = 160119631 2.40.281.346 I slot launch_slot_: id 0 | task 9159 | processing task, is_child = 0 2.43.412.594 I slot print_timing: id 0 | task 9159 | n_gen = 225, tg = 74.39 t/s, tg_3s = 74.72 t/s 2.46.365.834 I slot print_timing: id 0 | task 9159 | prompt eval time = 120.01 ms / 150 tokens ( 0.80 ms per token, 1249.94 tokens per second) 2.46.365.839 I slot print_timing: id 0 | task 9159 | eval time = 5964.46 ms / 443 tokens ( 13.49 ms per token, 74.11 tokens per second) 2.46.365.840 I slot print_timing: id 0 | task 9159 | total time = 6084.47 ms / 593 tokens 2.46.365.841 I slot print_timing: id 0 | task 9159 | graphs reused = 8691 2.46.365.842 I slot print_timing: id 0 | task 9159 | graph reallocs = 0 / 0 (same size) / (changed size) 2.46.365.864 I slot release: id 0 | task 9159 | stop processing: n_tokens = 592, truncated = 0 2.46.371.295 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 592, t_last = 166262253 2.46.371.374 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 534.327 MiB) 2.46.430.989 I slot launch_slot_: id 0 | task 9605 | processing task, is_child = 0 2.49.560.677 I slot print_timing: id 0 | task 9605 | n_gen = 222, tg = 73.50 t/s, tg_3s = 73.83 t/s 2.52.565.693 I slot print_timing: id 0 | task 9605 | n_gen = 447, tg = 74.19 t/s, tg_3s = 74.87 t/s 2.54.265.427 I slot print_timing: id 0 | task 9605 | prompt eval time = 122.94 ms / 171 tokens ( 0.72 ms per token, 1390.95 tokens per second) 2.54.265.433 I slot print_timing: id 0 | task 9605 | eval time = 7711.48 ms / 574 tokens ( 13.46 ms per token, 74.30 tokens per second) 2.54.265.434 I slot print_timing: id 0 | task 9605 | total time = 7834.42 ms / 745 tokens 2.54.265.435 I slot print_timing: id 0 | task 9605 | graphs reused = 9261 2.54.265.436 I slot print_timing: id 0 | task 9605 | graph reallocs = 0 / 0 (same size) / (changed size) 2.54.265.464 I slot release: id 0 | task 9605 | stop processing: n_tokens = 744, truncated = 0 2.54.295.767 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 744, t_last = 174161854 2.54.353.711 I slot launch_slot_: id 0 | task 10182 | processing task, is_child = 0 2.57.474.690 I slot print_timing: id 0 | task 10182 | n_gen = 228, tg = 75.61 t/s, tg_3s = 75.94 t/s 3.00.483.662 I slot print_timing: id 0 | task 10182 | n_gen = 454, tg = 75.36 t/s, tg_3s = 75.11 t/s 3.01.848.071 I slot print_timing: id 0 | task 10182 | prompt eval time = 118.55 ms / 164 tokens ( 0.72 ms per token, 1383.37 tokens per second) 3.01.848.076 I slot print_timing: id 0 | task 10182 | eval time = 7375.79 ms / 556 tokens ( 13.29 ms per token, 75.25 tokens per second) 3.01.848.077 I slot print_timing: id 0 | task 10182 | total time = 7494.34 ms / 720 tokens 3.01.848.078 I slot print_timing: id 0 | task 10182 | graphs reused = 9813 3.01.848.079 I slot print_timing: id 0 | task 10182 | graph reallocs = 0 / 0 (same size) / (changed size) 3.01.848.107 I slot release: id 0 | task 10182 | stop processing: n_tokens = 719, truncated = 0 3.01.877.988 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 719, t_last = 181744496 3.01.878.076 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 376.116 MiB) 3.01.940.116 I slot launch_slot_: id 0 | task 10741 | processing task, is_child = 0 3.02.551.572 I slot print_timing: id 0 | task 10741 | prompt eval time = 117.13 ms / 156 tokens ( 0.75 ms per token, 1331.86 tokens per second) 3.02.551.578 I slot print_timing: id 0 | task 10741 | eval time = 494.31 ms / 38 tokens ( 13.36 ms per token, 74.85 tokens per second) 3.02.551.579 I slot print_timing: id 0 | task 10741 | total time = 611.44 ms / 194 tokens 3.02.551.580 I slot print_timing: id 0 | task 10741 | graphs reused = 9849 3.02.551.580 I slot print_timing: id 0 | task 10741 | graph reallocs = 0 / 0 (same size) / (changed size) 3.02.551.603 I slot release: id 0 | task 10741 | stop processing: n_tokens = 193, truncated = 0 3.02.579.063 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 193, t_last = 182447993 3.02.579.105 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 443.854 MiB) 3.02.608.142 I slot launch_slot_: id 0 | task 10782 | processing task, is_child = 0 3.03.346.651 I slot print_timing: id 0 | task 10782 | prompt eval time = 117.48 ms / 162 tokens ( 0.73 ms per token, 1378.95 tokens per second) 3.03.346.657 I slot print_timing: id 0 | task 10782 | eval time = 621.01 ms / 48 tokens ( 13.21 ms per token, 75.68 tokens per second) 3.03.346.657 I slot print_timing: id 0 | task 10782 | total time = 738.49 ms / 210 tokens 3.03.346.659 I slot print_timing: id 0 | task 10782 | graphs reused = 9895 3.03.346.659 I slot print_timing: id 0 | task 10782 | graph reallocs = 0 / 0 (same size) / (changed size) 3.03.346.683 I slot release: id 0 | task 10782 | stop processing: n_tokens = 209, truncated = 0 3.03.386.934 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 209, t_last = 183243073 3.03.411.221 I slot launch_slot_: id 0 | task 10833 | processing task, is_child = 0 3.04.162.531 I slot print_timing: id 0 | task 10833 | prompt eval time = 104.66 ms / 144 tokens ( 0.73 ms per token, 1375.86 tokens per second) 3.04.162.537 I slot print_timing: id 0 | task 10833 | eval time = 646.63 ms / 50 tokens ( 13.20 ms per token, 75.78 tokens per second) 3.04.162.538 I slot print_timing: id 0 | task 10833 | total time = 751.30 ms / 194 tokens 3.04.162.539 I slot print_timing: id 0 | task 10833 | graphs reused = 9943 3.04.162.539 I slot print_timing: id 0 | task 10833 | graph reallocs = 0 / 0 (same size) / (changed size) 3.04.162.563 I slot release: id 0 | task 10833 | stop processing: n_tokens = 193, truncated = 0 3.04.185.955 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 193, t_last = 184058952 3.04.209.674 I slot launch_slot_: id 0 | task 10886 | processing task, is_child = 0 3.04.706.290 I slot print_timing: id 0 | task 10886 | prompt eval time = 97.48 ms / 122 tokens ( 0.80 ms per token, 1251.56 tokens per second) 3.04.706.295 I slot print_timing: id 0 | task 10886 | eval time = 399.12 ms / 31 tokens ( 13.30 ms per token, 75.17 tokens per second) 3.04.706.296 I slot print_timing: id 0 | task 10886 | total time = 496.60 ms / 153 tokens 3.04.706.297 I slot print_timing: id 0 | task 10886 | graphs reused = 9972 3.04.706.298 I slot print_timing: id 0 | task 10886 | graph reallocs = 0 / 0 (same size) / (changed size) 3.04.706.317 I slot release: id 0 | task 10886 | stop processing: n_tokens = 152, truncated = 0 3.04.722.195 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 152, t_last = 184602706 3.04.722.231 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 384.819 MiB) 3.04.748.309 I slot launch_slot_: id 0 | task 10920 | processing task, is_child = 0 3.07.871.586 I slot print_timing: id 0 | task 10920 | n_gen = 228, tg = 75.54 t/s, tg_3s = 75.87 t/s 3.08.759.485 I slot print_timing: id 0 | task 10920 | prompt eval time = 118.04 ms / 166 tokens ( 0.71 ms per token, 1406.35 tokens per second) 3.08.759.490 I slot print_timing: id 0 | task 10920 | eval time = 3893.12 ms / 295 tokens ( 13.24 ms per token, 75.52 tokens per second) 3.08.759.491 I slot print_timing: id 0 | task 10920 | total time = 4011.16 ms / 461 tokens 3.08.759.494 I slot print_timing: id 0 | task 10920 | graphs reused = 10264 3.08.759.494 I slot print_timing: id 0 | task 10920 | graph reallocs = 0 / 0 (same size) / (changed size) 3.08.759.521 I slot release: id 0 | task 10920 | stop processing: n_tokens = 460, truncated = 0 3.08.794.314 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 460, t_last = 188655911 3.08.833.411 I slot launch_slot_: id 0 | task 11218 | processing task, is_child = 0 3.11.967.868 I slot print_timing: id 0 | task 11218 | n_gen = 228, tg = 75.49 t/s, tg_3s = 75.82 t/s 3.13.869.544 I slot print_timing: id 0 | task 11218 | prompt eval time = 127.48 ms / 185 tokens ( 0.69 ms per token, 1451.22 tokens per second) 3.13.869.549 I slot print_timing: id 0 | task 11218 | eval time = 4908.64 ms / 371 tokens ( 13.27 ms per token, 75.38 tokens per second) 3.13.869.550 I slot print_timing: id 0 | task 11218 | total time = 5036.12 ms / 556 tokens 3.13.869.551 I slot print_timing: id 0 | task 11218 | graphs reused = 10631 3.13.869.552 I slot print_timing: id 0 | task 11218 | graph reallocs = 0 / 0 (same size) / (changed size) 3.13.869.581 I slot release: id 0 | task 11218 | stop processing: n_tokens = 555, truncated = 0 3.13.892.278 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 555, t_last = 193765970 3.13.892.352 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 561.970 MiB) 3.13.950.465 I slot launch_slot_: id 0 | task 11592 | processing task, is_child = 0 3.15.954.661 I slot print_timing: id 0 | task 11592 | prompt eval time = 99.43 ms / 123 tokens ( 0.81 ms per token, 1237.03 tokens per second) 3.15.954.666 I slot print_timing: id 0 | task 11592 | eval time = 1904.75 ms / 145 tokens ( 13.23 ms per token, 75.60 tokens per second) 3.15.954.667 I slot print_timing: id 0 | task 11592 | total time = 2004.18 ms / 268 tokens 3.15.954.668 I slot print_timing: id 0 | task 11592 | graphs reused = 10773 3.15.954.669 I slot print_timing: id 0 | task 11592 | graph reallocs = 0 / 0 (same size) / (changed size) 3.15.954.688 I slot release: id 0 | task 11592 | stop processing: n_tokens = 267, truncated = 0 3.15.979.245 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 267, t_last = 195851077 3.16.004.875 I slot launch_slot_: id 0 | task 11740 | processing task, is_child = 0 3.16.745.280 I slot print_timing: id 0 | task 11740 | prompt eval time = 102.68 ms / 139 tokens ( 0.74 ms per token, 1353.71 tokens per second) 3.16.745.286 I slot print_timing: id 0 | task 11740 | eval time = 637.70 ms / 49 tokens ( 13.29 ms per token, 75.27 tokens per second) 3.16.745.287 I slot print_timing: id 0 | task 11740 | total time = 740.38 ms / 188 tokens 3.16.745.288 I slot print_timing: id 0 | task 11740 | graphs reused = 10820 3.16.745.288 I slot print_timing: id 0 | task 11740 | graph reallocs = 0 / 0 (same size) / (changed size) 3.16.745.309 I slot release: id 0 | task 11740 | stop processing: n_tokens = 187, truncated = 0 3.16.765.543 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 187, t_last = 196641698 3.16.787.120 I slot launch_slot_: id 0 | task 11792 | processing task, is_child = 0 3.18.946.871 I slot print_timing: id 0 | task 11792 | prompt eval time = 100.19 ms / 132 tokens ( 0.76 ms per token, 1317.48 tokens per second) 3.18.946.877 I slot print_timing: id 0 | task 11792 | eval time = 2059.55 ms / 157 tokens ( 13.20 ms per token, 75.74 tokens per second) 3.18.946.878 I slot print_timing: id 0 | task 11792 | total time = 2159.74 ms / 289 tokens 3.18.946.879 I slot print_timing: id 0 | task 11792 | graphs reused = 10974 3.18.946.880 I slot print_timing: id 0 | task 11792 | graph reallocs = 0 / 0 (same size) / (changed size) 3.18.946.901 I slot release: id 0 | task 11792 | stop processing: n_tokens = 288, truncated = 0 3.18.974.143 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 288, t_last = 198843290 3.18.974.185 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 657.912 MiB) 3.19.010.385 I slot launch_slot_: id 0 | task 11952 | processing task, is_child = 0 3.19.504.962 I slot print_timing: id 0 | task 11952 | prompt eval time = 105.18 ms / 146 tokens ( 0.72 ms per token, 1388.12 tokens per second) 3.19.504.968 I slot print_timing: id 0 | task 11952 | eval time = 389.38 ms / 30 tokens ( 13.43 ms per token, 74.48 tokens per second) 3.19.504.969 I slot print_timing: id 0 | task 11952 | total time = 494.56 ms / 176 tokens 3.19.504.970 I slot print_timing: id 0 | task 11952 | graphs reused = 11002 3.19.504.971 I slot print_timing: id 0 | task 11952 | graph reallocs = 0 / 0 (same size) / (changed size) 3.19.504.992 I slot release: id 0 | task 11952 | stop processing: n_tokens = 175, truncated = 0 3.19.519.945 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 175, t_last = 199401381 3.19.541.335 I slot launch_slot_: id 0 | task 11985 | processing task, is_child = 0 3.19.912.488 I slot print_timing: id 0 | task 11985 | prompt eval time = 116.31 ms / 150 tokens ( 0.78 ms per token, 1289.62 tokens per second) 3.19.912.494 I slot print_timing: id 0 | task 11985 | eval time = 254.83 ms / 20 tokens ( 13.41 ms per token, 74.56 tokens per second) 3.19.912.495 I slot print_timing: id 0 | task 11985 | total time = 371.14 ms / 170 tokens 3.19.912.495 I slot print_timing: id 0 | task 11985 | graphs reused = 11020 3.19.912.496 I slot print_timing: id 0 | task 11985 | graph reallocs = 0 / 0 (same size) / (changed size) 3.19.912.519 I slot release: id 0 | task 11985 | stop processing: n_tokens = 169, truncated = 0 3.19.940.624 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 169, t_last = 199808908 3.19.962.163 I slot launch_slot_: id 0 | task 12008 | processing task, is_child = 0 3.20.439.222 I slot print_timing: id 0 | task 12008 | prompt eval time = 104.50 ms / 142 tokens ( 0.74 ms per token, 1358.84 tokens per second) 3.20.439.229 I slot print_timing: id 0 | task 12008 | eval time = 372.54 ms / 29 tokens ( 13.30 ms per token, 75.16 tokens per second) 3.20.439.230 I slot print_timing: id 0 | task 12008 | total time = 477.04 ms / 171 tokens 3.20.439.230 I slot print_timing: id 0 | task 12008 | graphs reused = 11047 3.20.439.231 I slot print_timing: id 0 | task 12008 | graph reallocs = 0 / 0 (same size) / (changed size) 3.20.439.255 I slot release: id 0 | task 12008 | stop processing: n_tokens = 170, truncated = 0 3.20.458.053 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 170, t_last = 200335644 3.20.478.983 I slot launch_slot_: id 0 | task 12040 | processing task, is_child = 0 3.23.594.369 I slot print_timing: id 0 | task 12040 | n_gen = 229, tg = 75.70 t/s, tg_3s = 76.03 t/s 3.26.602.122 I slot print_timing: id 0 | task 12040 | n_gen = 451, tg = 74.75 t/s, tg_3s = 73.81 t/s 3.29.614.195 I slot print_timing: id 0 | task 12040 | n_gen = 671, tg = 74.18 t/s, tg_3s = 73.04 t/s 3.29.881.091 I slot print_timing: id 0 | task 12040 | prompt eval time = 103.29 ms / 144 tokens ( 0.72 ms per token, 1394.16 tokens per second) 3.29.881.097 I slot print_timing: id 0 | task 12040 | eval time = 9298.80 ms / 690 tokens ( 13.50 ms per token, 74.10 tokens per second) 3.29.881.098 I slot print_timing: id 0 | task 12040 | total time = 9402.09 ms / 834 tokens 3.29.881.098 I slot print_timing: id 0 | task 12040 | graphs reused = 11732 3.29.881.099 I slot print_timing: id 0 | task 12040 | graph reallocs = 0 / 0 (same size) / (changed size) 3.29.881.127 I slot release: id 0 | task 12040 | stop processing: n_tokens = 833, truncated = 0 3.29.908.593 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 833, t_last = 209777516 3.29.908.694 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 432.853 MiB) 3.29.977.909 I slot launch_slot_: id 0 | task 12733 | processing task, is_child = 0 3.31.608.350 I slot print_timing: id 0 | task 12733 | prompt eval time = 118.54 ms / 148 tokens ( 0.80 ms per token, 1248.52 tokens per second) 3.31.608.360 I slot print_timing: id 0 | task 12733 | eval time = 1511.88 ms / 111 tokens ( 13.74 ms per token, 72.76 tokens per second) 3.31.608.361 I slot print_timing: id 0 | task 12733 | total time = 1630.42 ms / 259 tokens 3.31.608.362 I slot print_timing: id 0 | task 12733 | graphs reused = 11840 3.31.608.364 I slot print_timing: id 0 | task 12733 | graph reallocs = 0 / 0 (same size) / (changed size) 3.31.608.388 I slot release: id 0 | task 12733 | stop processing: n_tokens = 258, truncated = 0 3.31.614.838 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 258, t_last = 211504777 3.31.642.876 I slot launch_slot_: id 0 | task 12847 | processing task, is_child = 0 3.32.197.060 I slot print_timing: id 0 | task 12847 | prompt eval time = 122.33 ms / 173 tokens ( 0.71 ms per token, 1414.18 tokens per second) 3.32.197.065 I slot print_timing: id 0 | task 12847 | eval time = 431.83 ms / 33 tokens ( 13.49 ms per token, 74.10 tokens per second) 3.32.197.066 I slot print_timing: id 0 | task 12847 | total time = 554.16 ms / 206 tokens 3.32.197.067 I slot print_timing: id 0 | task 12847 | graphs reused = 11871 3.32.197.067 I slot print_timing: id 0 | task 12847 | graph reallocs = 0 / 0 (same size) / (changed size) 3.32.197.093 I slot release: id 0 | task 12847 | stop processing: n_tokens = 205, truncated = 0 3.32.214.433 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 205, t_last = 212093482 3.32.214.475 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 511.280 MiB) 3.32.254.071 I slot launch_slot_: id 0 | task 12883 | processing task, is_child = 0 3.32.758.014 I slot print_timing: id 0 | task 12883 | prompt eval time = 117.77 ms / 153 tokens ( 0.77 ms per token, 1299.13 tokens per second) 3.32.758.020 I slot print_timing: id 0 | task 12883 | eval time = 386.15 ms / 30 tokens ( 13.32 ms per token, 75.10 tokens per second) 3.32.758.021 I slot print_timing: id 0 | task 12883 | total time = 503.92 ms / 183 tokens 3.32.758.022 I slot print_timing: id 0 | task 12883 | graphs reused = 11899 3.32.758.023 I slot print_timing: id 0 | task 12883 | graph reallocs = 0 / 0 (same size) / (changed size) 3.32.758.046 I slot release: id 0 | task 12883 | stop processing: n_tokens = 182, truncated = 0 3.32.779.686 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 182, t_last = 212654435 3.32.805.240 I slot launch_slot_: id 0 | task 12916 | processing task, is_child = 0 3.33.484.757 I slot print_timing: id 0 | task 12916 | prompt eval time = 105.52 ms / 151 tokens ( 0.70 ms per token, 1431.02 tokens per second) 3.33.484.763 I slot print_timing: id 0 | task 12916 | eval time = 573.98 ms / 44 tokens ( 13.35 ms per token, 74.92 tokens per second) 3.33.484.764 I slot print_timing: id 0 | task 12916 | total time = 679.50 ms / 195 tokens 3.33.484.764 I slot print_timing: id 0 | task 12916 | graphs reused = 11941 3.33.484.765 I slot print_timing: id 0 | task 12916 | graph reallocs = 0 / 0 (same size) / (changed size) 3.33.484.786 I slot release: id 0 | task 12916 | stop processing: n_tokens = 194, truncated = 0 3.33.530.245 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 194, t_last = 213381175 3.33.553.360 I slot launch_slot_: id 0 | task 12963 | processing task, is_child = 0 3.34.434.651 I slot print_timing: id 0 | task 12963 | prompt eval time = 119.39 ms / 165 tokens ( 0.72 ms per token, 1381.99 tokens per second) 3.34.434.656 I slot print_timing: id 0 | task 12963 | eval time = 761.88 ms / 57 tokens ( 13.61 ms per token, 73.50 tokens per second) 3.34.434.657 I slot print_timing: id 0 | task 12963 | total time = 881.27 ms / 222 tokens 3.34.434.658 I slot print_timing: id 0 | task 12963 | graphs reused = 11996 3.34.434.659 I slot print_timing: id 0 | task 12963 | graph reallocs = 0 / 0 (same size) / (changed size) 3.34.434.685 I slot release: id 0 | task 12963 | stop processing: n_tokens = 221, truncated = 0 3.34.440.228 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 221, t_last = 214331075 3.34.440.271 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 311.285 MiB) 3.34.473.807 I slot launch_slot_: id 0 | task 13023 | processing task, is_child = 0 3.34.777.859 I slot print_timing: id 0 | task 13023 | prompt eval time = 122.20 ms / 165 tokens ( 0.74 ms per token, 1350.29 tokens per second) 3.34.777.865 I slot print_timing: id 0 | task 13023 | eval time = 181.83 ms / 14 tokens ( 13.99 ms per token, 71.49 tokens per second) 3.34.777.866 I slot print_timing: id 0 | task 13023 | total time = 304.03 ms / 179 tokens 3.34.777.867 I slot print_timing: id 0 | task 13023 | graphs reused = 12008 3.34.777.869 I slot print_timing: id 0 | task 13023 | graph reallocs = 0 / 0 (same size) / (changed size) 3.34.777.897 I slot release: id 0 | task 13023 | stop processing: n_tokens = 178, truncated = 0 3.34.800.101 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 178, t_last = 214674286 3.34.823.004 I slot launch_slot_: id 0 | task 13040 | processing task, is_child = 0 3.37.953.664 I slot print_timing: id 0 | task 13040 | n_gen = 225, tg = 74.39 t/s, tg_3s = 74.73 t/s 3.40.963.049 I slot print_timing: id 0 | task 13040 | n_gen = 446, tg = 73.92 t/s, tg_3s = 73.44 t/s 3.43.966.125 I slot print_timing: id 0 | task 13040 | n_gen = 663, tg = 73.36 t/s, tg_3s = 72.26 t/s 3.46.971.835 I slot print_timing: id 0 | task 13040 | n_gen = 881, tg = 73.16 t/s, tg_3s = 72.53 t/s 3.48.088.607 I slot print_timing: id 0 | task 13040 | prompt eval time = 119.62 ms / 153 tokens ( 0.78 ms per token, 1279.02 tokens per second) 3.48.088.613 I slot print_timing: id 0 | task 13040 | eval time = 13145.96 ms / 960 tokens ( 13.71 ms per token, 72.95 tokens per second) 3.48.088.614 I slot print_timing: id 0 | task 13040 | total time = 13265.58 ms / 1113 tokens 3.48.088.615 I slot print_timing: id 0 | task 13040 | graphs reused = 12962 3.48.088.616 I slot print_timing: id 0 | task 13040 | graph reallocs = 0 / 0 (same size) / (changed size) 3.48.088.640 I slot release: id 0 | task 13040 | stop processing: n_tokens = 1112, truncated = 0 3.48.095.448 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 1112, t_last = 227985029 3.48.095.573 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 391.320 MiB) 3.48.176.775 I slot launch_slot_: id 0 | task 14003 | processing task, is_child = 0 3.51.302.210 I slot print_timing: id 0 | task 14003 | n_gen = 224, tg = 74.17 t/s, tg_3s = 74.51 t/s 3.54.311.210 I slot print_timing: id 0 | task 14003 | n_gen = 446, tg = 73.98 t/s, tg_3s = 73.78 t/s 3.54.825.773 I slot print_timing: id 0 | task 14003 | prompt eval time = 118.94 ms / 166 tokens ( 0.72 ms per token, 1395.67 tokens per second) 3.54.825.778 I slot print_timing: id 0 | task 14003 | eval time = 6530.04 ms / 483 tokens ( 13.55 ms per token, 73.81 tokens per second) 3.54.825.779 I slot print_timing: id 0 | task 14003 | total time = 6648.98 ms / 649 tokens 3.54.825.780 I slot print_timing: id 0 | task 14003 | graphs reused = 13441 3.54.825.780 I slot print_timing: id 0 | task 14003 | graph reallocs = 0 / 0 (same size) / (changed size) 3.54.825.809 I slot release: id 0 | task 14003 | stop processing: n_tokens = 648, truncated = 0 3.54.865.127 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 648, t_last = 234722198 3.54.865.212 W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 716.102 MiB) 3.54.938.126 I slot launch_slot_: id 0 | task 14489 | processing task, is_child = 0 3.55.558.097 I slot print_timing: id 0 | task 14489 | prompt eval time = 120.30 ms / 172 tokens ( 0.70 ms per token, 1429.78 tokens per second) 3.55.558.103 I slot print_timing: id 0 | task 14489 | eval time = 499.65 ms / 37 tokens ( 13.88 ms per token, 72.05 tokens per second) 3.55.558.104 I slot print_timing: id 0 | task 14489 | total time = 619.95 ms / 209 tokens 3.55.558.105 I slot print_timing: id 0 | task 14489 | graphs reused = 13476 3.55.558.105 I slot print_timing: id 0 | task 14489 | graph reallocs = 0 / 0 (same size) / (changed size) 3.55.558.126 I slot release: id 0 | task 14489 | stop processing: n_tokens = 208, truncated = 0 3.55.599.968 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 208, t_last = 235454515 3.55.625.182 I slot launch_slot_: id 0 | task 14529 | processing task, is_child = 0 3.56.764.056 I slot print_timing: id 0 | task 14529 | prompt eval time = 133.01 ms / 204 tokens ( 0.65 ms per token, 1533.67 tokens per second) 3.56.764.062 I slot print_timing: id 0 | task 14529 | eval time = 1005.84 ms / 75 tokens ( 13.59 ms per token, 73.57 tokens per second) 3.56.764.063 I slot print_timing: id 0 | task 14529 | total time = 1138.86 ms / 279 tokens 3.56.764.063 I slot print_timing: id 0 | task 14529 | graphs reused = 13548 3.56.764.064 I slot print_timing: id 0 | task 14529 | graph reallocs = 0 / 0 (same size) / (changed size) 3.56.764.093 I slot release: id 0 | task 14529 | stop processing: n_tokens = 278, truncated = 0 3.56.787.276 I slot get_availabl: id 0 | task -1 | selected slot by LRU, n_tokens = 278, t_last = 236660483 3.56.818.926 I slot launch_slot_: id 0 | task 14607 | processing task, is_child = 0 3.57.366.478 I slot print_timing: id 0 | task 14607 | prompt eval time = 106.70 ms / 152 tokens ( 0.70 ms per token, 1424.54 tokens per second) 3.57.366.484 I slot print_timing: id 0 | task 14607 | eval time = 440.83 ms / 34 tokens ( 13.36 ms per token, 74.86 tokens per second) 3.57.366.485 I slot print_timing: id 0 | task 14607 | total time = 547.53 ms / 186 tokens 3.57.366.486 I slot print_timing: id 0 | task 14607 | graphs reused = 13580 3.57.366.486 I slot print_timing: id 0 | task 14607 | graph reallocs = 0 / 0 (same size) / (changed size) 3.57.366.505 I slot release: id 0 | task 14607 | stop processing: n_tokens = 185, truncated = 0