[S 03/12 20:36] PVFS2 Server on node da3 version 2.7.1pre1-2008-03-12-025908 starting... [D 20:36:19.889762] BMI_ib_initialize: init. [D 20:36:19.889791] openib_ib_initialize: init. [D 20:36:19.892100] openib_ib_initialize: max 65408 completion queue entries. [D 20:36:19.892534] BMI_ib_initialize: done. [D 20:36:19.892558] [BMI CONTROL]: BMI_set_info: set_info: 0 option: 11 [D 20:36:19.892570] [BMI CONTROL]: BMI_set_info: set_info: 0 option: 12 [S 03/12 20:36] PVFS2 Server ready. [D 20:41:02.153960] [BMI CONTROL]: BMI_set_info: set_info: 6662784 option: 5 [D 20:41:02.154021] [BMI CONTROL]: BMI_set_info: searching for ref 6662784 [D 20:41:02.154031] [BMI CONTROL]: BMI_set_info: incremented ref 6662784 to: 1 [D 20:41:02.154250] BMI_post_send_list: addr: 6662784, count: 1, total_size: 1104, tag: 4 [D 20:41:02.154268] element 0: offset: 0x66e880, size: 1104 [D 20:41:02.154281] openib_post_sr: 10.1.4.240:38246 bh 0 len 1120 wr 0/70. [D 20:41:02.156644] [BMI CONTROL]: BMI_set_info: set_info: 6662784 option: 6 [D 20:41:02.156658] [BMI CONTROL]: BMI_set_info: searching for ref 6662784 [D 20:41:02.156667] [BMI CONTROL]: BMI_set_info: decremented ref 6662784 to: 0 [D 20:41:07.124989] [BMI CONTROL]: BMI_set_info: set_info: 6661680 option: 5 [D 20:41:07.125059] [BMI CONTROL]: BMI_set_info: searching for ref 6661680 [D 20:41:07.125073] [BMI CONTROL]: BMI_set_info: incremented ref 6661680 to: 1 [D 20:41:07.125120] BMI_post_send_list: addr: 6661680, count: 1, total_size: 1104, tag: 4 [D 20:41:07.125139] element 0: offset: 0x66e880, size: 1104 [D 20:41:07.125154] openib_post_sr: 10.1.4.240:38249 bh 0 len 1120 wr 1/70. [D 20:41:07.130236] [BMI CONTROL]: BMI_set_info: set_info: 6661680 option: 6 [D 20:41:07.130356] [BMI CONTROL]: BMI_set_info: searching for ref 6661680 [D 20:41:07.130371] [BMI CONTROL]: BMI_set_info: decremented ref 6661680 to: 0 [D 20:41:09.896959] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 5 [D 20:41:09.897018] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.897029] [BMI CONTROL]: BMI_set_info: incremented ref 6653168 to: 1 [D 20:41:09.897061] BMI_post_send_list: addr: 6653168, count: 1, total_size: 1104, tag: 4 [D 20:41:09.897072] element 0: offset: 0x66e880, size: 1104 [D 20:41:09.897085] openib_post_sr: 10.1.4.240:38252 bh 0 len 1120 wr 2/70. [D 20:41:09.897267] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 6 [D 20:41:09.897281] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.897290] [BMI CONTROL]: BMI_set_info: decremented ref 6653168 to: 0 [D 20:41:09.899371] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 5 [D 20:41:09.899384] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.899393] [BMI CONTROL]: BMI_set_info: incremented ref 6653168 to: 1 [D 20:41:09.899758] BMI_post_send_list: addr: 6653168, count: 1, total_size: 72, tag: 9 [D 20:41:09.899792] element 0: offset: 0x65d000, size: 72 [D 20:41:09.899806] openib_post_sr: 10.1.4.240:38252 bh 1 len 88 wr 3/70. [D 20:41:09.901875] [BMI CONTROL]: BMI_set_info: set_info: 6653168 option: 6 [D 20:41:09.901889] [BMI CONTROL]: BMI_set_info: searching for ref 6653168 [D 20:41:09.901900] [BMI CONTROL]: BMI_set_info: decremented ref 6653168 to: 0 [D 20:41:15.046671] [BMI CONTROL]: BMI_set_info: set_info: 6658032 option: 5 [D 20:41:15.046720] [BMI CONTROL]: BMI_set_info: searching for ref 6658032 [D 20:41:15.046730] [BMI CONTROL]: BMI_set_info: incremented ref 6658032 to: 1 [D 20:41:15.046756] BMI_post_send_list: addr: 6658032, count: 1, total_size: 1104, tag: 4 [D 20:41:15.046767] element 0: offset: 0x66e880, size: 1104 [D 20:41:15.046781] openib_post_sr: 10.1.4.240:38255 bh 0 len 1120 wr 4/70. [D 20:41:15.046907] [BMI CONTROL]: BMI_set_info: set_info: 6658032 option: 6 [D 20:41:15.046917] [BMI CONTROL]: BMI_set_info: searching for ref 6658032 [D 20:41:15.046926] [BMI CONTROL]: BMI_set_info: decremented ref 6658032 to: 0 [D 20:41:26.991775] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:26.991814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:26.991825] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:26.991899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 4 [D 20:41:26.991910] element 0: offset: 0x61e700, size: 104 [D 20:41:26.991923] openib_post_sr: 10.1.4.240:38258 bh 0 len 120 wr 5/70. [D 20:41:26.992035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:26.992046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:26.992054] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:26.994806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:26.994816] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:26.994824] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:26.994846] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 10 [D 20:41:26.994855] element 0: offset: 0x6231d0, size: 104 [D 20:41:26.994865] openib_post_sr: 10.1.4.240:38258 bh 1 len 120 wr 6/70. [D 20:41:26.995021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:26.995033] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:26.995041] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.008434] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.008448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.008456] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.008790] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 19 [D 20:41:27.008802] element 0: offset: 0x61f100, size: 24 [D 20:41:27.008812] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 7/70. [D 20:41:27.008868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.008878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.008887] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.020494] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.020506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.020515] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.020535] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 23 [D 20:41:27.020545] element 0: offset: 0x659860, size: 24 [D 20:41:27.020555] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 8/70. [D 20:41:27.022293] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 23 [D 20:41:27.022344] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 9/70. [D 20:41:27.023453] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 23 [D 20:41:27.023469] element 0: offset: 0x659860, size: 24 [D 20:41:27.023481] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 10/70. [D 20:41:27.023572] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.023586] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.023601] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.086172] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.086186] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.086194] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.086290] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 30 [D 20:41:27.086301] element 0: offset: 0x65d000, size: 72 [D 20:41:27.086311] openib_post_sr: 10.1.4.240:38258 bh 6 len 88 wr 11/70. [D 20:41:27.086395] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.086407] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.086416] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.091877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.091891] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.091899] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.091917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 33 [D 20:41:27.091927] element 0: offset: 0x6151c0, size: 24 [D 20:41:27.091937] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 12/70. [D 20:41:27.092137] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 33 [D 20:41:27.092164] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 13/70. [D 20:41:27.092254] openib_post_sr_rdmaw: ibv_post_send wr_id 61f970 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.092409] openib_check_cq: completed rdma wr_id 61f970, nic_wr_credit 70. [D 20:41:27.092421] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 14/70. [D 20:41:27.092472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.092486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.092494] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.092695] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.092705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.092713] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.092729] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 34 [D 20:41:27.092738] element 0: offset: 0x61f0b0, size: 24 [D 20:41:27.092748] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 15/70. [D 20:41:27.092918] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 34 [D 20:41:27.092934] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 16/70. [D 20:41:27.092996] openib_post_sr_rdmaw: ibv_post_send wr_id 61f970 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.093116] openib_check_cq: completed rdma wr_id 61f970, nic_wr_credit 70. [D 20:41:27.093127] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 17/70. [D 20:41:27.093170] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.093184] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.093193] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.095598] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.095610] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.095619] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.095633] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 38 [D 20:41:27.095642] element 0: offset: 0x659860, size: 24 [D 20:41:27.095652] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 18/70. [D 20:41:27.097770] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 38 [D 20:41:27.097786] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 19/70. [D 20:41:27.097840] openib_post_sr_rdmaw: ibv_post_send wr_id 629f60 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.097916] openib_check_cq: completed rdma wr_id 629f60, nic_wr_credit 70. [D 20:41:27.097929] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 20/70. [D 20:41:27.097971] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.097982] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.097990] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.098078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.098090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098100] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.098116] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 40 [D 20:41:27.098128] element 0: offset: 0x65d000, size: 72 [D 20:41:27.098138] openib_post_sr: 10.1.4.240:38258 bh 16 len 88 wr 21/70. [D 20:41:27.098176] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.098188] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098197] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.098444] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.098456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.098480] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 41 [D 20:41:27.098489] element 0: offset: 0x6151c0, size: 24 [D 20:41:27.098499] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 22/70. [D 20:41:27.098544] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.098557] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098567] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.098652] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.098664] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098674] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.098689] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 43 [D 20:41:27.098702] element 0: offset: 0x65d000, size: 72 [D 20:41:27.098712] openib_post_sr: 10.1.4.240:38258 bh 18 len 88 wr 23/70. [D 20:41:27.098746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.098756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.098765] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.185192] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.185244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.185254] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.185288] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 50 [D 20:41:27.185298] element 0: offset: 0x65d000, size: 72 [D 20:41:27.185310] openib_post_sr: 10.1.4.240:38258 bh 19 len 88 wr 24/70. [D 20:41:27.189210] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.189253] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.189262] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.201888] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.201903] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.201917] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.201946] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 57 [D 20:41:27.201956] element 0: offset: 0x659860, size: 24 [D 20:41:27.201968] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 25/70. [D 20:41:27.204391] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 57 [D 20:41:27.204408] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 26/70. [D 20:41:27.204561] openib_post_sr_rdmaw: ibv_post_send wr_id 62e9d0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.205326] openib_check_cq: completed rdma wr_id 62e9d0, nic_wr_credit 70. [D 20:41:27.205341] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 27/70. [D 20:41:27.207354] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.207368] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.207382] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.207396] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.207405] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.207418] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.207432] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 59 [D 20:41:27.207442] element 0: offset: 0x61ee20, size: 24 [D 20:41:27.208430] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 28/70. [D 20:41:27.208689] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 59 [D 20:41:27.208705] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 29/70. [D 20:41:27.208884] openib_post_sr_rdmaw: ibv_post_send wr_id 61f590 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.209742] openib_check_cq: completed rdma wr_id 61f590, nic_wr_credit 70. [D 20:41:27.209760] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 30/70. [D 20:41:27.209911] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.209924] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.209933] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.217169] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.217183] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.217191] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.217207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 63 [D 20:41:27.217216] element 0: offset: 0x6151c0, size: 24 [D 20:41:27.217227] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 31/70. [D 20:41:27.217417] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 63 [D 20:41:27.217431] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 32/70. [D 20:41:27.217593] openib_post_sr_rdmaw: ibv_post_send wr_id 61f470 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.218310] openib_check_cq: completed rdma wr_id 61f470, nic_wr_credit 70. [D 20:41:27.218328] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 33/70. [D 20:41:27.218482] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.218495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.218503] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.218568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.218578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.218586] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.218605] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 65 [D 20:41:27.218614] element 0: offset: 0x65d000, size: 72 [D 20:41:27.218625] openib_post_sr: 10.1.4.240:38258 bh 9 len 88 wr 34/70. [D 20:41:27.218754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.218766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.218774] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.220916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.220926] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.220934] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.220949] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 67 [D 20:41:27.220958] element 0: offset: 0x659860, size: 24 [D 20:41:27.220968] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 35/70. [D 20:41:27.223213] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.223227] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.223235] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:27.223251] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.223261] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.223270] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:27.223286] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 69 [D 20:41:27.223296] element 0: offset: 0x65d000, size: 72 [D 20:41:27.223315] openib_post_sr: 10.1.4.240:38258 bh 11 len 88 wr 36/70. [D 20:41:27.223472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.223482] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.225821] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.235352] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.235366] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.235374] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.235391] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 76 [D 20:41:27.235400] element 0: offset: 0x65d000, size: 72 [D 20:41:27.235410] openib_post_sr: 10.1.4.240:38258 bh 12 len 88 wr 37/70. [D 20:41:27.235571] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.235581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.235590] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.245513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.245527] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.245536] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.245551] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 80 [D 20:41:27.245561] element 0: offset: 0x61f0b0, size: 24 [D 20:41:27.245571] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 38/70. [D 20:41:27.245782] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 80 [D 20:41:27.245795] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 39/70. [D 20:41:27.245974] openib_post_sr_rdmaw: ibv_post_send wr_id 637fb0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.246735] openib_check_cq: completed rdma wr_id 637fb0, nic_wr_credit 70. [D 20:41:27.246750] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 40/70. [D 20:41:27.246921] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.246934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.246942] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.247097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.247107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.247115] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.247131] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 81 [D 20:41:27.247140] element 0: offset: 0x61ee20, size: 24 [D 20:41:27.247151] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 41/70. [D 20:41:27.248642] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 81 [D 20:41:27.248655] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 42/70. [D 20:41:27.248841] openib_post_sr_rdmaw: ibv_post_send wr_id 636b50 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.249688] openib_check_cq: completed rdma wr_id 636b50, nic_wr_credit 70. [D 20:41:27.249703] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 43/70. [D 20:41:27.249857] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.249870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.249878] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.256141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.256155] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.256164] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.256179] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 85 [D 20:41:27.256189] element 0: offset: 0x6151c0, size: 24 [D 20:41:27.256199] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 44/70. [D 20:41:27.256575] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 85 [D 20:41:27.256599] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 45/70. [D 20:41:27.256769] openib_post_sr_rdmaw: ibv_post_send wr_id 61f4e0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:27.257366] openib_check_cq: completed rdma wr_id 61f4e0, nic_wr_credit 70. [D 20:41:27.257385] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 46/70. [D 20:41:27.257532] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.257544] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.257553] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.257623] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.257632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.257641] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.257657] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 87 [D 20:41:27.257667] element 0: offset: 0x65d000, size: 72 [D 20:41:27.257677] openib_post_sr: 10.1.4.240:38258 bh 2 len 88 wr 47/70. [D 20:41:27.257833] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.257844] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.257853] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.258133] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.258143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.258151] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.258165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 88 [D 20:41:27.258174] element 0: offset: 0x659860, size: 24 [D 20:41:27.258185] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 48/70. [D 20:41:27.258229] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.258239] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.258247] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:27.258323] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:27.258333] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.258341] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:27.258356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 90 [D 20:41:27.258366] element 0: offset: 0x65d000, size: 72 [D 20:41:27.258376] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 49/70. [D 20:41:27.258424] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:27.258435] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:27.258443] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:30.026527] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:30.026575] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:30.026585] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:30.026637] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 94 [D 20:41:30.026648] element 0: offset: 0x6400c0, size: 104 [D 20:41:30.026661] openib_post_sr: 10.1.4.240:38258 bh 5 len 120 wr 50/70. [D 20:41:30.026706] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:30.026716] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:30.026725] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.846181] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.846219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.846230] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.846282] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 100 [D 20:41:36.846292] element 0: offset: 0x63ea70, size: 104 [D 20:41:36.846305] openib_post_sr: 10.1.4.240:38258 bh 6 len 120 wr 51/70. [D 20:41:36.846353] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.846363] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.846371] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.852212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.852225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.852234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.852257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 106 [D 20:41:36.852266] element 0: offset: 0x65d000, size: 72 [D 20:41:36.852277] openib_post_sr: 10.1.4.240:38258 bh 7 len 88 wr 52/70. [D 20:41:36.852331] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.852341] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.852349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.853186] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.853196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.853204] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.855480] BMI_post_send_list: addr: 6416064, count: 1, total_size: 16, tag: 108 [D 20:41:36.855491] element 0: offset: 0x630f20, size: 16 [D 20:41:36.855501] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 53/70. [D 20:41:36.855570] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.855582] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.855590] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.860911] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.860923] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.860931] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.860946] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 112 [D 20:41:36.860955] element 0: offset: 0x65d000, size: 72 [D 20:41:36.860965] openib_post_sr: 10.1.4.240:38258 bh 9 len 88 wr 54/70. [D 20:41:36.861017] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.861027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.861036] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.861941] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.861951] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.861959] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.861976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 114 [D 20:41:36.861985] element 0: offset: 0x659860, size: 24 [D 20:41:36.861997] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 55/70. [D 20:41:36.862092] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 114 [D 20:41:36.862112] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 56/70. [D 20:41:36.862938] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 114 [D 20:41:36.862950] element 0: offset: 0x659860, size: 24 [D 20:41:36.862961] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 57/70. [D 20:41:36.863043] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.863056] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.863065] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.930036] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.930050] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.930058] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.932322] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 121 [D 20:41:36.932335] element 0: offset: 0x65d000, size: 72 [D 20:41:36.932346] openib_post_sr: 10.1.4.240:38258 bh 13 len 88 wr 58/70. [D 20:41:36.932409] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.932421] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.932429] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.941087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.941100] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.941108] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.941123] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 127 [D 20:41:36.941133] element 0: offset: 0x65d000, size: 72 [D 20:41:36.941142] openib_post_sr: 10.1.4.240:38258 bh 14 len 88 wr 59/70. [D 20:41:36.941195] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.941205] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.941213] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.943100] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.943110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.943119] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.943133] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 130 [D 20:41:36.943142] element 0: offset: 0x61ee20, size: 24 [D 20:41:36.943152] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 60/70. [D 20:41:36.943327] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 130 [D 20:41:36.943345] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 0/70. [D 20:41:36.943415] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecc0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:36.943596] openib_check_cq: completed rdma wr_id 63ecc0, nic_wr_credit 70. [D 20:41:36.943610] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 1/70. [D 20:41:36.943656] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.943669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.943677] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.943867] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.943877] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.943886] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.943901] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 131 [D 20:41:36.943910] element 0: offset: 0x61f0b0, size: 24 [D 20:41:36.943922] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 2/70. [D 20:41:36.944113] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 131 [D 20:41:36.944131] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 3/70. [D 20:41:36.944194] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecf0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:36.944315] openib_check_cq: completed rdma wr_id 63ecf0, nic_wr_credit 70. [D 20:41:36.944326] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 4/70. [D 20:41:36.944364] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.944377] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.944386] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.945954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.945964] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.945972] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.945987] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 134 [D 20:41:36.945996] element 0: offset: 0x6151c0, size: 24 [D 20:41:36.946007] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 5/70. [D 20:41:36.946161] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 134 [D 20:41:36.946176] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 6/70. [D 20:41:36.946238] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecf0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:36.946325] openib_check_cq: completed rdma wr_id 63ecf0, nic_wr_credit 70. [D 20:41:36.946336] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 7/70. [D 20:41:36.946374] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.946387] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.946396] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.946461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.946471] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.946479] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.946495] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 136 [D 20:41:36.946504] element 0: offset: 0x65d000, size: 72 [D 20:41:36.946515] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 8/70. [D 20:41:36.946613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.946625] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.946634] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:36.949299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.949311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.949319] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:36.949333] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 138 [D 20:41:36.949342] element 0: offset: 0x630f20, size: 24 [D 20:41:36.949352] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 9/70. [D 20:41:36.951515] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:36.951528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.951538] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:36.951554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.951566] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.951575] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:36.951591] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 140 [D 20:41:36.951601] element 0: offset: 0x65d000, size: 72 [D 20:41:36.951610] openib_post_sr: 10.1.4.240:38258 bh 6 len 88 wr 10/70. [D 20:41:36.951658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:36.951670] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:36.951680] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.047654] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.047705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.047715] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.047748] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 147 [D 20:41:37.047759] element 0: offset: 0x65d000, size: 72 [D 20:41:37.047772] openib_post_sr: 10.1.4.240:38258 bh 7 len 88 wr 11/70. [D 20:41:37.047961] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.047971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.047980] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.068593] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.068627] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.068636] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.068663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 153 [D 20:41:37.068674] element 0: offset: 0x65d000, size: 72 [D 20:41:37.068686] openib_post_sr: 10.1.4.240:38258 bh 8 len 88 wr 12/70. [D 20:41:37.070931] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.070944] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.070954] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.081735] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.081749] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.081757] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.081776] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 157 [D 20:41:37.081785] element 0: offset: 0x62ea30, size: 24 [D 20:41:37.081795] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 13/70. [D 20:41:37.081963] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 157 [D 20:41:37.081978] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 14/70. [D 20:41:37.082067] openib_post_sr_rdmaw: ibv_post_send wr_id 63eb20 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.082552] openib_check_cq: completed rdma wr_id 63eb20, nic_wr_credit 70. [D 20:41:37.082589] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 15/70. [D 20:41:37.082744] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.082757] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.082766] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.088603] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.088617] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.088626] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.088642] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 159 [D 20:41:37.088652] element 0: offset: 0x62a060, size: 24 [D 20:41:37.088662] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 16/70. [D 20:41:37.088873] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 159 [D 20:41:37.088886] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 17/70. [D 20:41:37.089047] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecf0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.089806] openib_check_cq: completed rdma wr_id 63ecf0, nic_wr_credit 70. [D 20:41:37.089820] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 18/70. [D 20:41:37.089972] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.089986] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.089994] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.123852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.123900] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.123910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.123939] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 164 [D 20:41:37.123949] element 0: offset: 0x61f9b0, size: 24 [D 20:41:37.123971] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 19/70. [D 20:41:37.124222] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 164 [D 20:41:37.124237] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 20/70. [D 20:41:37.124405] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecf0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.124855] openib_check_cq: completed rdma wr_id 63ecf0, nic_wr_credit 70. [D 20:41:37.124868] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 21/70. [D 20:41:37.125030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.125043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.125054] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.125103] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.125113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.125121] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.125141] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 166 [D 20:41:37.125150] element 0: offset: 0x65d000, size: 72 [D 20:41:37.125159] openib_post_sr: 10.1.4.240:38258 bh 18 len 88 wr 22/70. [D 20:41:37.125274] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.125286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.125345] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.128623] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.128636] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.128644] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.128659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 167 [D 20:41:37.128668] element 0: offset: 0x61f0b0, size: 24 [D 20:41:37.128677] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 23/70. [D 20:41:37.128871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.128884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.128892] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.128939] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.128948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.128956] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.128971] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 169 [D 20:41:37.128980] element 0: offset: 0x65d000, size: 72 [D 20:41:37.128990] openib_post_sr: 10.1.4.240:38258 bh 0 len 88 wr 24/70. [D 20:41:37.129128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.129138] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.129146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.157516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.157532] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.157541] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.157557] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 176 [D 20:41:37.157566] element 0: offset: 0x65d000, size: 72 [D 20:41:37.157576] openib_post_sr: 10.1.4.240:38258 bh 1 len 88 wr 25/70. [D 20:41:37.157728] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.157738] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.157746] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.172988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.173003] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.173012] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.173027] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 183 [D 20:41:37.173036] element 0: offset: 0x691f20, size: 24 [D 20:41:37.173061] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 26/70. [D 20:41:37.173283] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 183 [D 20:41:37.173298] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 27/70. [D 20:41:37.173493] openib_post_sr_rdmaw: ibv_post_send wr_id 662a40 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.174304] openib_check_cq: completed rdma wr_id 662a40, nic_wr_credit 70. [D 20:41:37.174322] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 28/70. [D 20:41:37.174491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.174505] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.174513] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.174683] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.174693] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.174701] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.174716] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 184 [D 20:41:37.174725] element 0: offset: 0x623260, size: 24 [D 20:41:37.174736] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 29/70. [D 20:41:37.174951] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 184 [D 20:41:37.174967] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 30/70. [D 20:41:37.175135] openib_post_sr_rdmaw: ibv_post_send wr_id 662a40 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.175899] openib_check_cq: completed rdma wr_id 662a40, nic_wr_credit 70. [D 20:41:37.175922] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 31/70. [D 20:41:37.176074] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.176088] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.176096] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.183013] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.183026] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.183035] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.183050] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 189 [D 20:41:37.183059] element 0: offset: 0x630f20, size: 24 [D 20:41:37.183069] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 32/70. [D 20:41:37.183175] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 189 [D 20:41:37.183188] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 33/70. [D 20:41:37.183229] openib_post_sr_rdmaw: ibv_post_send wr_id 662a40 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.183308] openib_check_cq: completed rdma wr_id 662a40, nic_wr_credit 70. [D 20:41:37.183319] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 34/70. [D 20:41:37.183357] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.183370] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.183378] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.183441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.183450] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.183459] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.183474] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 191 [D 20:41:37.183484] element 0: offset: 0x65d000, size: 72 [D 20:41:37.183494] openib_post_sr: 10.1.4.240:38258 bh 11 len 88 wr 35/70. [D 20:41:37.183568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.183578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.183586] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.183904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.183914] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.183922] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.183936] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 192 [D 20:41:37.183945] element 0: offset: 0x63ead0, size: 24 [D 20:41:37.183954] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 36/70. [D 20:41:37.184035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.184046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.184054] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.184106] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.184116] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.184124] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.184139] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 194 [D 20:41:37.184148] element 0: offset: 0x65d000, size: 72 [D 20:41:37.184158] openib_post_sr: 10.1.4.240:38258 bh 13 len 88 wr 37/70. [D 20:41:37.186267] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.186280] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.186290] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.313405] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.313456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.313466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.313499] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 201 [D 20:41:37.313509] element 0: offset: 0x65d000, size: 72 [D 20:41:37.313522] openib_post_sr: 10.1.4.240:38258 bh 14 len 88 wr 38/70. [D 20:41:37.313688] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.313699] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.313707] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.333797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.333811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.333820] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.333838] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 209 [D 20:41:37.333848] element 0: offset: 0x62ea30, size: 24 [D 20:41:37.333858] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 39/70. [D 20:41:37.334194] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 209 [D 20:41:37.334211] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 40/70. [D 20:41:37.334384] openib_post_sr_rdmaw: ibv_post_send wr_id 662a40 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.335369] openib_check_cq: completed rdma wr_id 662a40, nic_wr_credit 70. [D 20:41:37.335401] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 41/70. [D 20:41:37.335588] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.335602] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.335611] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.335787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.335797] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.335805] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.335821] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 210 [D 20:41:37.335830] element 0: offset: 0x61f9b0, size: 24 [D 20:41:37.335841] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 42/70. [D 20:41:37.337326] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 32768, tag: 210 [D 20:41:37.337343] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 43/70. [D 20:41:37.337512] openib_post_sr_rdmaw: ibv_post_send wr_id 63ecf0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.338332] openib_check_cq: completed rdma wr_id 63ecf0, nic_wr_credit 70. [D 20:41:37.338350] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 44/70. [D 20:41:37.338554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.338568] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.338577] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.344705] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.344719] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.344727] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.344743] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 215 [D 20:41:37.344753] element 0: offset: 0x61f570, size: 24 [D 20:41:37.344763] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 45/70. [D 20:41:37.344986] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 19912, tag: 215 [D 20:41:37.345000] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 46/70. [D 20:41:37.345178] openib_post_sr_rdmaw: ibv_post_send wr_id 62a120 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.345614] openib_check_cq: completed rdma wr_id 62a120, nic_wr_credit 70. [D 20:41:37.345631] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 47/70. [D 20:41:37.345772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.345786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.345794] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.345855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.345864] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.345872] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.345889] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 217 [D 20:41:37.345899] element 0: offset: 0x65d000, size: 72 [D 20:41:37.345909] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 48/70. [D 20:41:37.346041] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.346053] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.346062] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.346346] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.346356] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.346365] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.346380] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 218 [D 20:41:37.346389] element 0: offset: 0x659860, size: 24 [D 20:41:37.346399] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 49/70. [D 20:41:37.346803] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.346813] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.346822] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:37.346848] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.346857] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.346873] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:37.346891] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 220 [D 20:41:37.346900] element 0: offset: 0x65d000, size: 72 [D 20:41:37.346911] openib_post_sr: 10.1.4.240:38258 bh 6 len 88 wr 50/70. [D 20:41:37.347613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.347623] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.347631] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.443021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.443071] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.443080] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.443113] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 237 [D 20:41:37.443123] element 0: offset: 0x65d000, size: 72 [D 20:41:37.443144] openib_post_sr: 10.1.4.240:38258 bh 7 len 88 wr 51/70. [D 20:41:37.443263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.443273] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.443282] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.445467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.445478] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.445486] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.445505] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 239 [D 20:41:37.445514] element 0: offset: 0x61f7d0, size: 24 [D 20:41:37.445524] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 52/70. [D 20:41:37.447945] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 239 [D 20:41:37.447963] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 53/70. [D 20:41:37.448142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 70. [D 20:41:37.448158] openib_post_sr_rdmaw: ibv_post_send wr_id 62b240 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 71. [D 20:41:37.450286] openib_check_cq: completed rdma wr_id 62b240, nic_wr_credit 71. [D 20:41:37.450299] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 54/70. [D 20:41:37.450460] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.450470] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.450479] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.460049] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.460063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.460209] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.460319] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 242 [D 20:41:37.460331] element 0: offset: 0x61f2e0, size: 24 [D 20:41:37.460352] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 55/70. [D 20:41:37.462634] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 242 [D 20:41:37.462653] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 56/70. [D 20:41:37.462697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 71. [D 20:41:37.462710] openib_post_sr_rdmaw: ibv_post_send wr_id 62b240 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 72. [D 20:41:37.462966] openib_check_cq: completed rdma wr_id 62b240, nic_wr_credit 72. [D 20:41:37.462978] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 57/70. [D 20:41:37.463032] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.463050] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.463059] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.488872] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.488946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.488968] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.489013] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 245 [D 20:41:37.489027] element 0: offset: 0x63ead0, size: 24 [D 20:41:37.489048] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 58/70. [D 20:41:37.491643] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.491657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.491666] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.494666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.494704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.494713] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.494742] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 248 [D 20:41:37.494753] element 0: offset: 0x61f0e0, size: 24 [D 20:41:37.494765] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 59/70. [D 20:41:37.498915] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 248 [D 20:41:37.498975] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 60/70. [D 20:41:37.499296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 72. [D 20:41:37.499416] openib_post_sr_rdmaw: ibv_post_send wr_id 62b240 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 73. [D 20:41:37.501229] openib_check_cq: completed rdma wr_id 62b240, nic_wr_credit 73. [D 20:41:37.501247] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 0/70. [D 20:41:37.504645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.504666] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.504688] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.518508] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.518630] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.518644] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.518686] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 251 [D 20:41:37.518701] element 0: offset: 0x61ee50, size: 24 [D 20:41:37.518718] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 1/70. [D 20:41:37.523219] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.523320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.523332] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.527134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.527185] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.527222] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.527300] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 254 [D 20:41:37.527314] element 0: offset: 0x6151c0, size: 24 [D 20:41:37.527331] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 2/70. [D 20:41:37.530870] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 254 [D 20:41:37.530924] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 3/70. [D 20:41:37.531871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 73. [D 20:41:37.531968] openib_post_sr_rdmaw: ibv_post_send wr_id 62b240 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 74. [D 20:41:37.533770] openib_check_cq: completed rdma wr_id 62b240, nic_wr_credit 74. [D 20:41:37.533792] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 4/70. [D 20:41:37.536895] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.536915] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.536925] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.550712] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.550794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.550809] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.550855] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 257 [D 20:41:37.550867] element 0: offset: 0x61f570, size: 24 [D 20:41:37.550899] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 5/70. [D 20:41:37.556102] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.556148] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.556157] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:37.556191] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.556201] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.556209] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:37.556232] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 260 [D 20:41:37.556242] element 0: offset: 0x61f570, size: 24 [D 20:41:37.556255] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 6/70. [D 20:41:37.557419] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 260 [D 20:41:37.557446] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 7/70. [D 20:41:37.557637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 74. [D 20:41:37.557749] openib_post_sr_rdmaw: ibv_post_send wr_id 6333c0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 75. [D 20:41:37.559804] openib_check_cq: completed rdma wr_id 6333c0, nic_wr_credit 75. [D 20:41:37.559836] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 8/70. [D 20:41:37.560000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.560016] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.560025] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.575906] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.575956] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.575966] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.575997] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 263 [D 20:41:37.576008] element 0: offset: 0x623260, size: 24 [D 20:41:37.576020] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 9/70. [D 20:41:37.579208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.579331] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.579348] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.583523] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.583612] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.583623] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.583676] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 265 [D 20:41:37.584455] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.584493] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 10/70. [D 20:41:37.587985] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 265 [D 20:41:37.588007] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 11/70. [D 20:41:37.588167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 75. [D 20:41:37.588194] openib_post_sr_rdmaw: ibv_post_send wr_id 635890 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 76. [D 20:41:37.590386] openib_check_cq: completed rdma wr_id 635890, nic_wr_credit 76. [D 20:41:37.590415] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 12/70. [D 20:41:37.592484] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.592505] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.592515] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.606472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.606548] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.606564] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.606604] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 268 [D 20:41:37.606614] element 0: offset: 0x61f7d0, size: 24 [D 20:41:37.606628] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 13/70. [D 20:41:37.609412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.609428] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.609439] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.612079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.612125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.612134] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.612164] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 271 [D 20:41:37.612174] element 0: offset: 0x61f2e0, size: 24 [D 20:41:37.612188] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 14/70. [D 20:41:37.612499] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 271 [D 20:41:37.612518] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 15/70. [D 20:41:37.612583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 76. [D 20:41:37.612651] openib_post_sr_rdmaw: ibv_post_send wr_id 62e8a0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 77. [D 20:41:37.614777] openib_check_cq: completed rdma wr_id 62e8a0, nic_wr_credit 77. [D 20:41:37.614833] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 16/70. [D 20:41:37.615021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.615037] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.615046] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.630739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.630792] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.630801] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.630832] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 274 [D 20:41:37.630843] element 0: offset: 0x63ead0, size: 24 [D 20:41:37.630856] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 17/70. [D 20:41:37.631057] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.631078] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.631087] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.682078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.682135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.682145] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.735652] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 282 [D 20:41:37.735704] element 0: offset: 0x61ee50, size: 24 [D 20:41:37.735719] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 18/70. [D 20:41:37.735925] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.735940] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.735953] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.749690] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.749741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.749750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.749781] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 287 [D 20:41:37.749791] element 0: offset: 0x6151c0, size: 24 [D 20:41:37.749804] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 19/70. [D 20:41:37.750141] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 287 [D 20:41:37.750158] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 20/70. [D 20:41:37.750387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 77. [D 20:41:37.750463] openib_post_sr_rdmaw: ibv_post_send wr_id 629f30 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 78. [D 20:41:37.752591] openib_check_cq: completed rdma wr_id 629f30, nic_wr_credit 78. [D 20:41:37.752622] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 21/70. [D 20:41:37.752802] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.752818] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.752827] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.778075] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.778126] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.778135] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.778165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 290 [D 20:41:37.778175] element 0: offset: 0x61f9e0, size: 24 [D 20:41:37.778188] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 22/70. [D 20:41:37.778373] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.778386] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.778394] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.789338] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.789370] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.789379] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.789404] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 293 [D 20:41:37.789414] element 0: offset: 0x61f570, size: 24 [D 20:41:37.789426] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 23/70. [D 20:41:37.789761] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 293 [D 20:41:37.789779] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 24/70. [D 20:41:37.789938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 78. [D 20:41:37.790042] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 79. [D 20:41:37.791895] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 79. [D 20:41:37.791916] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 25/70. [D 20:41:37.792137] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.792154] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.792162] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.818204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.818258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.818267] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.818298] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 296 [D 20:41:37.818309] element 0: offset: 0x623260, size: 24 [D 20:41:37.818322] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 26/70. [D 20:41:37.821508] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.821593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.821603] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.830858] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.830983] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.831000] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.831046] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 299 [D 20:41:37.831063] element 0: offset: 0x691fe0, size: 24 [D 20:41:37.831077] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 27/70. [D 20:41:37.835545] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 299 [D 20:41:37.835597] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 28/70. [D 20:41:37.836223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 79. [D 20:41:37.836316] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 80. [D 20:41:37.838283] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 80. [D 20:41:37.838305] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 29/70. [D 20:41:37.840091] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.840109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.840117] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.856423] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.856474] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.856483] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.856513] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 302 [D 20:41:37.856523] element 0: offset: 0x61f7d0, size: 24 [D 20:41:37.856536] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 30/70. [D 20:41:37.857255] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.857269] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.857278] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.866878] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.866892] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.866901] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.866916] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 305 [D 20:41:37.866926] element 0: offset: 0x622f70, size: 24 [D 20:41:37.866936] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 31/70. [D 20:41:37.867249] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 305 [D 20:41:37.867266] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 32/70. [D 20:41:37.867425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 80. [D 20:41:37.867514] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 81. [D 20:41:37.869450] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 81. [D 20:41:37.869467] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 33/70. [D 20:41:37.869586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.869618] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.869633] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.899830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.899882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.899891] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.899922] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 308 [D 20:41:37.899932] element 0: offset: 0x657210, size: 24 [D 20:41:37.899945] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 34/70. [D 20:41:37.903771] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 308 [D 20:41:37.903790] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 35/70. [D 20:41:37.904026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 81. [D 20:41:37.904150] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 82. [D 20:41:37.906191] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 82. [D 20:41:37.906210] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 36/70. [D 20:41:37.906404] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.906420] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.906429] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.930339] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.930390] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.930400] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.930429] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 311 [D 20:41:37.930439] element 0: offset: 0x61ee50, size: 24 [D 20:41:37.930452] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 37/70. [D 20:41:37.930652] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.930666] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.930675] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.944769] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.944784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.944792] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.944807] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 314 [D 20:41:37.944816] element 0: offset: 0x6151c0, size: 24 [D 20:41:37.944827] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 38/70. [D 20:41:37.945117] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 314 [D 20:41:37.945134] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 39/70. [D 20:41:37.945307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 82. [D 20:41:37.945384] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 83. [D 20:41:37.947410] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 83. [D 20:41:37.947444] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 40/70. [D 20:41:37.947655] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.947670] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.947679] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.966569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.966622] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.966630] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.966660] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 317 [D 20:41:37.966670] element 0: offset: 0x61f9e0, size: 24 [D 20:41:37.966683] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 41/70. [D 20:41:37.966870] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.966882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.966891] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:37.976010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:37.976024] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.976033] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:37.976048] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 320 [D 20:41:37.976057] element 0: offset: 0x61f570, size: 24 [D 20:41:37.976067] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 42/70. [D 20:41:37.976373] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 320 [D 20:41:37.976391] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 43/70. [D 20:41:37.976607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 83. [D 20:41:37.976701] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 84. [D 20:41:37.978817] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 84. [D 20:41:37.978861] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 44/70. [D 20:41:37.979029] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:37.979044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:37.979053] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.000691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.000741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.000751] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.000780] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 323 [D 20:41:38.000790] element 0: offset: 0x623260, size: 24 [D 20:41:38.000803] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 45/70. [D 20:41:38.000981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.000994] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.001002] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.004236] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.004281] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.004290] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.004320] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 325 [D 20:41:38.004330] element 0: offset: 0x691fe0, size: 24 [D 20:41:38.004343] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 46/70. [D 20:41:38.004697] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 325 [D 20:41:38.004715] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 47/70. [D 20:41:38.004900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 84. [D 20:41:38.004974] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 85. [D 20:41:38.007094] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 85. [D 20:41:38.007128] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 48/70. [D 20:41:38.007364] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.007399] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.007409] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.027626] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.027677] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.027686] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.027716] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 328 [D 20:41:38.027726] element 0: offset: 0x657210, size: 24 [D 20:41:38.027739] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 49/70. [D 20:41:38.027948] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.027961] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.027969] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.030946] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.030960] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.030968] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.030984] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 330 [D 20:41:38.030994] element 0: offset: 0x61f0e0, size: 24 [D 20:41:38.031005] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 50/70. [D 20:41:38.031289] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 330 [D 20:41:38.031322] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 51/70. [D 20:41:38.031507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 85. [D 20:41:38.031587] openib_post_sr_rdmaw: ibv_post_send wr_id 629fb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 86. [D 20:41:38.033819] openib_check_cq: completed rdma wr_id 629fb0, nic_wr_credit 86. [D 20:41:38.033909] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 52/70. [D 20:41:38.034085] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.034101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.034110] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.055500] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.055552] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.055561] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.055590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 333 [D 20:41:38.055600] element 0: offset: 0x61ee50, size: 24 [D 20:41:38.055614] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 53/70. [D 20:41:38.055795] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.055808] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.055817] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.058495] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.058509] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.058518] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.058533] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 335 [D 20:41:38.058543] element 0: offset: 0x6151c0, size: 24 [D 20:41:38.058553] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 54/70. [D 20:41:38.059632] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 335 [D 20:41:38.059650] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 55/70. [D 20:41:38.059827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 86. [D 20:41:38.059917] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 87. [D 20:41:38.061927] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 87. [D 20:41:38.061949] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 56/70. [D 20:41:38.062138] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.062154] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.062163] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.082583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.082636] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.082645] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.082676] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 338 [D 20:41:38.082687] element 0: offset: 0x659890, size: 24 [D 20:41:38.082700] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 57/70. [D 20:41:38.083348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.083362] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.083371] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.094003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.094017] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.094025] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.094041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 341 [D 20:41:38.094050] element 0: offset: 0x61f9e0, size: 24 [D 20:41:38.094060] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 58/70. [D 20:41:38.094383] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 341 [D 20:41:38.094400] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 59/70. [D 20:41:38.094619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 87. [D 20:41:38.094745] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 88. [D 20:41:38.096581] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 88. [D 20:41:38.096601] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 60/70. [D 20:41:38.096757] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.096773] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.096781] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.117651] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.117692] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.117701] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.117730] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 344 [D 20:41:38.117741] element 0: offset: 0x61f310, size: 24 [D 20:41:38.117754] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 0/70. [D 20:41:38.117932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.117949] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.117958] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.126863] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.126898] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.126906] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.126934] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 347 [D 20:41:38.126944] element 0: offset: 0x623260, size: 24 [D 20:41:38.126956] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 1/70. [D 20:41:38.127258] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 347 [D 20:41:38.127277] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 2/70. [D 20:41:38.127441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 88. [D 20:41:38.127535] openib_post_sr_rdmaw: ibv_post_send wr_id 629fb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 89. [D 20:41:38.129466] openib_check_cq: completed rdma wr_id 629fb0, nic_wr_credit 89. [D 20:41:38.129487] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 3/70. [D 20:41:38.129660] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.129689] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.129704] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:38.150244] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:38.150258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.150266] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:38.150284] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 350 [D 20:41:38.150293] element 0: offset: 0x622f70, size: 24 [D 20:41:38.150304] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 4/70. [D 20:41:38.150364] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:38.150376] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:38.150384] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.639817] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.639866] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.639876] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.639906] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 353 [D 20:41:39.639917] element 0: offset: 0x61f800, size: 24 [D 20:41:39.639930] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 5/70. [D 20:41:39.640257] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 353 [D 20:41:39.640275] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 6/70. [D 20:41:39.640328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 89. [D 20:41:39.640395] openib_post_sr_rdmaw: ibv_post_send wr_id 629fb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 90. [D 20:41:39.640722] openib_check_cq: completed rdma wr_id 629fb0, nic_wr_credit 90. [D 20:41:39.640738] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 7/70. [D 20:41:39.640805] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.640819] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.640828] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.663205] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.663235] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.663244] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.663272] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 356 [D 20:41:39.663282] element 0: offset: 0x63eb00, size: 24 [D 20:41:39.663293] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 8/70. [D 20:41:39.663441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.663454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.663463] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.671402] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.671416] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.671424] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.671440] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 359 [D 20:41:39.671449] element 0: offset: 0x62e870, size: 24 [D 20:41:39.671462] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 9/70. [D 20:41:39.671682] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 359 [D 20:41:39.671699] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 10/70. [D 20:41:39.671744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 90. [D 20:41:39.671788] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 91. [D 20:41:39.672104] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 91. [D 20:41:39.672119] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 11/70. [D 20:41:39.672182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.672196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.672205] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.694050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.694063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.694072] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.694087] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 362 [D 20:41:39.694097] element 0: offset: 0x62ea60, size: 24 [D 20:41:39.694107] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 12/70. [D 20:41:39.694164] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.694175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.694184] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.702350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.702363] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.702372] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.702387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 365 [D 20:41:39.702396] element 0: offset: 0x6151c0, size: 24 [D 20:41:39.702408] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 13/70. [D 20:41:39.702566] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 365 [D 20:41:39.702582] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 14/70. [D 20:41:39.702626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 91. [D 20:41:39.702645] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 92. [D 20:41:39.702961] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 92. [D 20:41:39.702975] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 15/70. [D 20:41:39.703020] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.703035] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.703043] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.721828] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.721843] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.721851] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.721869] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 368 [D 20:41:39.721879] element 0: offset: 0x64b8e0, size: 24 [D 20:41:39.721889] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 16/70. [D 20:41:39.721950] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.721962] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.721970] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.729424] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.729438] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.729446] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.729461] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 371 [D 20:41:39.729471] element 0: offset: 0x61f310, size: 24 [D 20:41:39.729481] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 17/70. [D 20:41:39.729644] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 371 [D 20:41:39.729661] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 18/70. [D 20:41:39.729703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 92. [D 20:41:39.729728] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 93. [D 20:41:39.730056] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 93. [D 20:41:39.730070] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 19/70. [D 20:41:39.730127] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.730141] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.730150] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.748687] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.748700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.748708] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.748724] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 374 [D 20:41:39.748733] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.748743] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 20/70. [D 20:41:39.748800] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.748812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.748820] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.756620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.756634] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.756643] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.756658] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 377 [D 20:41:39.756668] element 0: offset: 0x657310, size: 24 [D 20:41:39.756678] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 21/70. [D 20:41:39.756834] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 377 [D 20:41:39.756851] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 22/70. [D 20:41:39.756895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 93. [D 20:41:39.756913] openib_post_sr_rdmaw: ibv_post_send wr_id 640300 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 94. [D 20:41:39.757243] openib_check_cq: completed rdma wr_id 640300, nic_wr_credit 94. [D 20:41:39.757256] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 23/70. [D 20:41:39.757301] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.757315] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.757324] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.774348] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.774362] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.774370] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.774386] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 380 [D 20:41:39.774395] element 0: offset: 0x61f800, size: 24 [D 20:41:39.774406] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 24/70. [D 20:41:39.774462] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.774474] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.774482] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.779355] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.779369] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.779377] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.779393] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 382 [D 20:41:39.779402] element 0: offset: 0x62e870, size: 24 [D 20:41:39.779412] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 25/70. [D 20:41:39.779562] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 382 [D 20:41:39.779578] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 26/70. [D 20:41:39.779624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 94. [D 20:41:39.779643] openib_post_sr_rdmaw: ibv_post_send wr_id 62eb20 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 95. [D 20:41:39.779975] openib_check_cq: completed rdma wr_id 62eb20, nic_wr_credit 95. [D 20:41:39.779988] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 27/70. [D 20:41:39.780033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.780048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.780057] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.794214] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.794228] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.794236] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.794252] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 385 [D 20:41:39.794261] element 0: offset: 0x64b8e0, size: 24 [D 20:41:39.794271] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 28/70. [D 20:41:39.794328] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.794339] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.794348] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.796998] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.797011] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.797019] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.797034] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 387 [D 20:41:39.797044] element 0: offset: 0x61f310, size: 24 [D 20:41:39.797054] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 29/70. [D 20:41:39.797208] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 387 [D 20:41:39.797225] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 30/70. [D 20:41:39.797267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 95. [D 20:41:39.797285] openib_post_sr_rdmaw: ibv_post_send wr_id 62eb20 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 96. [D 20:41:39.797630] openib_check_cq: completed rdma wr_id 62eb20, nic_wr_credit 96. [D 20:41:39.797644] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 31/70. [D 20:41:39.797689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.797704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.797712] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.812016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.812065] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.812075] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.812105] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 390 [D 20:41:39.812116] element 0: offset: 0x61fad0, size: 24 [D 20:41:39.812129] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 32/70. [D 20:41:39.815212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.815290] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.815301] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.820957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.820973] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.820983] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.821015] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 393 [D 20:41:39.821027] element 0: offset: 0x63a360, size: 24 [D 20:41:39.821040] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 33/70. [D 20:41:39.821282] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 393 [D 20:41:39.821303] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 34/70. [D 20:41:39.821348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 96. [D 20:41:39.821369] openib_post_sr_rdmaw: ibv_post_send wr_id 62fb80 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 97. [D 20:41:39.821709] openib_check_cq: completed rdma wr_id 62fb80, nic_wr_credit 97. [D 20:41:39.821724] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 35/70. [D 20:41:39.821762] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.821772] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.821782] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.837773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.837790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.837802] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.837820] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 396 [D 20:41:39.837831] element 0: offset: 0x657310, size: 24 [D 20:41:39.837841] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 36/70. [D 20:41:39.837920] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.837934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.837944] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.843013] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.843028] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.843039] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.843055] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 399 [D 20:41:39.843066] element 0: offset: 0x655ea0, size: 24 [D 20:41:39.843077] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 37/70. [D 20:41:39.844384] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 399 [D 20:41:39.844405] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 38/70. [D 20:41:39.844447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 97. [D 20:41:39.844476] openib_post_sr_rdmaw: ibv_post_send wr_id 62fb80 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 98. [D 20:41:39.844789] openib_check_cq: completed rdma wr_id 62fb80, nic_wr_credit 98. [D 20:41:39.844802] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 39/70. [D 20:41:39.844844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.844854] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.844864] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.861075] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.861109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.861119] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.861151] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 402 [D 20:41:39.861162] element 0: offset: 0x61f800, size: 24 [D 20:41:39.861174] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 40/70. [D 20:41:39.861257] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.861271] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.861281] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.865919] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.865933] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.865943] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.865958] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 404 [D 20:41:39.865971] element 0: offset: 0x623260, size: 24 [D 20:41:39.865981] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 41/70. [D 20:41:39.866191] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 404 [D 20:41:39.866243] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 42/70. [D 20:41:39.866291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 98. [D 20:41:39.866311] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 99. [D 20:41:39.866644] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 99. [D 20:41:39.866658] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 43/70. [D 20:41:39.866696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.866707] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.866716] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.883595] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.883609] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.883620] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.883635] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 407 [D 20:41:39.883646] element 0: offset: 0x61f0e0, size: 24 [D 20:41:39.883655] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 44/70. [D 20:41:39.883709] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.883721] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.883748] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.888569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.888583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.888594] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.888608] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 409 [D 20:41:39.888619] element 0: offset: 0x64b8e0, size: 24 [D 20:41:39.888628] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 45/70. [D 20:41:39.888753] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 409 [D 20:41:39.888774] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 46/70. [D 20:41:39.888950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 99. [D 20:41:39.888968] openib_post_sr_rdmaw: ibv_post_send wr_id 654bb0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 100. [D 20:41:39.889467] openib_check_cq: completed rdma wr_id 654bb0, nic_wr_credit 100. [D 20:41:39.889480] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 47/70. [D 20:41:39.889518] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.889528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.889538] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.906195] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.906279] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.906294] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.906374] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 412 [D 20:41:39.906389] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.906404] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 48/70. [D 20:41:39.912303] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.912328] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.912345] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:39.912444] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.912485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.912494] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:39.912518] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 415 [D 20:41:39.912528] element 0: offset: 0x691fe0, size: 24 [D 20:41:39.912542] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 49/70. [D 20:41:39.912853] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 415 [D 20:41:39.912873] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 50/70. [D 20:41:39.912924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 100. [D 20:41:39.912958] openib_post_sr_rdmaw: ibv_post_send wr_id 6548d0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 101. [D 20:41:39.913279] openib_check_cq: completed rdma wr_id 6548d0, nic_wr_credit 101. [D 20:41:39.913295] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 51/70. [D 20:41:39.913360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.913374] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.913383] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.926557] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.926571] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.926579] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.926596] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 418 [D 20:41:39.926605] element 0: offset: 0x61fad0, size: 24 [D 20:41:39.926616] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 52/70. [D 20:41:39.926675] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.926686] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.926695] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.931212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.931225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.931234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.933710] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 425 [D 20:41:39.933725] element 0: offset: 0x657310, size: 24 [D 20:41:39.933735] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 53/70. [D 20:41:39.933796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.933808] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.933817] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.935715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.935728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.935737] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.938005] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 430 [D 20:41:39.938019] element 0: offset: 0x61f800, size: 24 [D 20:41:39.938030] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 54/70. [D 20:41:39.938091] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.938103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.938111] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.940121] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.940135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.940143] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.942356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 438 [D 20:41:39.942371] element 0: offset: 0x62e870, size: 24 [D 20:41:39.942381] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 55/70. [D 20:41:39.942440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.942453] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.942461] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.944229] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.944243] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.944254] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.946474] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 444 [D 20:41:39.946488] element 0: offset: 0x64b8e0, size: 24 [D 20:41:39.946498] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 56/70. [D 20:41:39.946560] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.946579] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.946588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.948924] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.948938] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.948948] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.948976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 449 [D 20:41:39.948987] element 0: offset: 0x61f310, size: 24 [D 20:41:39.948998] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 57/70. [D 20:41:39.951233] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 449 [D 20:41:39.951251] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 58/70. [D 20:41:39.952228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 449 [D 20:41:39.952243] element 0: offset: 0x61f310, size: 24 [D 20:41:39.952258] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 59/70. [D 20:41:39.954729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.954743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.954753] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.954767] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.954776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.954785] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.954842] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 451 [D 20:41:39.954856] element 0: offset: 0x61fad0, size: 24 [D 20:41:39.954867] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 60/70. [D 20:41:39.955050] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 131072, tag: 451 [D 20:41:39.955071] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 0/70. [D 20:41:39.955111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fe4030 rkey 4a40042 nic_wr_credit 101. [D 20:41:39.955127] openib_post_sr_rdmaw: ibv_post_send wr_id 655e20 to 10.1.4.240:38258 remote addr f4004030 rkey 4a40044 nic_wr_credit 102. [D 20:41:39.956056] openib_check_cq: completed rdma wr_id 655e20, nic_wr_credit 102. [D 20:41:39.956069] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 1/70. [D 20:41:39.956107] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.956118] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.956126] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:39.964263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:39.964277] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.964288] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:39.964304] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 454 [D 20:41:39.964317] element 0: offset: 0x657310, size: 24 [D 20:41:39.966149] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 2/70. [D 20:41:39.966200] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 454 [D 20:41:39.966225] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 3/70. [D 20:41:39.968045] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 454 [D 20:41:39.968059] element 0: offset: 0x657310, size: 24 [D 20:41:39.969790] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 4/70. [D 20:41:39.969840] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:39.969852] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:39.969862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.059722] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.059741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.059750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.059855] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 459 [D 20:41:40.059867] element 0: offset: 0x630f60, size: 24 [D 20:41:40.059878] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 5/70. [D 20:41:40.059927] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 459 [D 20:41:40.059953] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 6/70. [D 20:41:40.060978] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 459 [D 20:41:40.060993] element 0: offset: 0x630f60, size: 24 [D 20:41:40.061003] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 7/70. [D 20:41:40.063120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.063134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.063143] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.068148] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.068162] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.068172] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.068231] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 463 [D 20:41:40.068245] element 0: offset: 0x64b8e0, size: 24 [D 20:41:40.068255] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 8/70. [D 20:41:40.068318] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 463 [D 20:41:40.068334] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 9/70. [D 20:41:40.069300] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 463 [D 20:41:40.069314] element 0: offset: 0x64b8e0, size: 24 [D 20:41:40.069326] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 10/70. [D 20:41:40.069361] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.069372] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.069381] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.070874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.070887] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.070897] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.070956] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 466 [D 20:41:40.070969] element 0: offset: 0x6151c0, size: 24 [D 20:41:40.070979] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 11/70. [D 20:41:40.071016] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 466 [D 20:41:40.071048] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 12/70. [D 20:41:40.072156] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 466 [D 20:41:40.072170] element 0: offset: 0x6151c0, size: 24 [D 20:41:40.072182] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 13/70. [D 20:41:40.072216] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.072226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.072236] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.073227] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.073241] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.073251] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.073266] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 469 [D 20:41:40.073280] element 0: offset: 0x61ee50, size: 24 [D 20:41:40.073289] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 14/70. [D 20:41:40.075528] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 469 [D 20:41:40.075578] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 15/70. [D 20:41:40.075622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 102. [D 20:41:40.075640] openib_post_sr_rdmaw: ibv_post_send wr_id 643470 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 103. [D 20:41:40.076145] openib_check_cq: completed rdma wr_id 643470, nic_wr_credit 103. [D 20:41:40.076158] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 16/70. [D 20:41:40.076197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.076208] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.076217] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.091220] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.091235] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.091246] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.091261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 472 [D 20:41:40.091271] element 0: offset: 0x62c430, size: 24 [D 20:41:40.091281] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 17/70. [D 20:41:40.091334] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.091347] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.091371] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.096860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.096874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.096884] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.096899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 475 [D 20:41:40.096909] element 0: offset: 0x657310, size: 24 [D 20:41:40.096918] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 18/70. [D 20:41:40.097035] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 475 [D 20:41:40.097054] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 19/70. [D 20:41:40.097097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 103. [D 20:41:40.097115] openib_post_sr_rdmaw: ibv_post_send wr_id 643470 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 104. [D 20:41:40.097360] openib_check_cq: completed rdma wr_id 643470, nic_wr_credit 104. [D 20:41:40.097373] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 20/70. [D 20:41:40.097411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.097422] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.097431] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.112174] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.112188] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.112199] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.112214] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 478 [D 20:41:40.112224] element 0: offset: 0x623260, size: 24 [D 20:41:40.112234] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 21/70. [D 20:41:40.112299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.112327] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.112336] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.118246] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.118260] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.118270] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.118331] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 482 [D 20:41:40.118345] element 0: offset: 0x630f60, size: 24 [D 20:41:40.118355] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 22/70. [D 20:41:40.118656] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 262144, tag: 482 [D 20:41:40.118683] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 23/70. [D 20:41:40.118728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fe4630 rkey 4a40042 nic_wr_credit 104. [D 20:41:40.118745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4004630 rkey 4a40044 nic_wr_credit 105. [D 20:41:40.118755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4024630 rkey 4a40044 nic_wr_credit 106. [D 20:41:40.118765] openib_post_sr_rdmaw: ibv_post_send wr_id 654c20 to 10.1.4.240:38258 remote addr f4044630 rkey 4a40044 nic_wr_credit 107. [D 20:41:40.119714] openib_check_cq: completed rdma wr_id 654c20, nic_wr_credit 107. [D 20:41:40.119727] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 24/70. [D 20:41:40.119766] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.119776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.119785] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.125725] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.125739] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.125749] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.125765] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 485 [D 20:41:40.125778] element 0: offset: 0x691fe0, size: 24 [D 20:41:40.125788] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 25/70. [D 20:41:40.126420] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 655360, tag: 485 [D 20:41:40.126472] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 26/70. [D 20:41:40.126515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc1e0 rkey 4a40042 nic_wr_credit 107. [D 20:41:40.126531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc1e0 rkey 4a40042 nic_wr_credit 108. [D 20:41:40.126542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c1e0 rkey 4a40044 nic_wr_credit 109. [D 20:41:40.126552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c1e0 rkey 4a40044 nic_wr_credit 110. [D 20:41:40.126562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c1e0 rkey 4a40044 nic_wr_credit 111. [D 20:41:40.126572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c1e0 rkey 4a40044 nic_wr_credit 112. [D 20:41:40.126582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c1e0 rkey 4a40044 nic_wr_credit 113. [D 20:41:40.126592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc1e0 rkey 4a40044 nic_wr_credit 114. [D 20:41:40.126605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc1e0 rkey 4a40044 nic_wr_credit 115. [D 20:41:40.126615] openib_post_sr_rdmaw: ibv_post_send wr_id 643680 to 10.1.4.240:38258 remote addr f40fc1e0 rkey 4a40044 nic_wr_credit 116. [D 20:41:40.129226] openib_check_cq: completed rdma wr_id 643680, nic_wr_credit 116. [D 20:41:40.129240] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 27/70. [D 20:41:40.131419] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.131433] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.131443] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.326568] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.326583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.326594] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.326609] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 488 [D 20:41:40.326619] element 0: offset: 0x63fda0, size: 24 [D 20:41:40.326630] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 28/70. [D 20:41:40.326676] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 488 [D 20:41:40.326706] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 29/70. [D 20:41:40.328620] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 488 [D 20:41:40.328635] element 0: offset: 0x63fda0, size: 24 [D 20:41:40.330334] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 30/70. [D 20:41:40.330382] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.330395] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.330405] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.330904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.330917] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.330927] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.330942] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 491 [D 20:41:40.330955] element 0: offset: 0x61ee50, size: 24 [D 20:41:40.330965] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 31/70. [D 20:41:40.332397] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 85448, tag: 491 [D 20:41:40.332419] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 32/70. [D 20:41:40.332460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 116. [D 20:41:40.332476] openib_post_sr_rdmaw: ibv_post_send wr_id 643470 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40042 nic_wr_credit 117. [D 20:41:40.332912] openib_check_cq: completed rdma wr_id 643470, nic_wr_credit 117. [D 20:41:40.332925] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 33/70. [D 20:41:40.332963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.332973] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.332983] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.510152] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.510167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.510177] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.510239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 495 [D 20:41:40.510254] element 0: offset: 0x62c430, size: 24 [D 20:41:40.510264] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 34/70. [D 20:41:40.510312] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 495 [D 20:41:40.510336] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 35/70. [D 20:41:40.511694] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 495 [D 20:41:40.511709] element 0: offset: 0x62c430, size: 24 [D 20:41:40.511721] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 36/70. [D 20:41:40.513852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.513865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.513876] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.514089] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.514102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.514115] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.514173] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 499 [D 20:41:40.514186] element 0: offset: 0x630f60, size: 24 [D 20:41:40.516427] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 37/70. [D 20:41:40.516477] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 499 [D 20:41:40.516502] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 38/70. [D 20:41:40.517870] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 499 [D 20:41:40.517884] element 0: offset: 0x630f60, size: 24 [D 20:41:40.517896] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 39/70. [D 20:41:40.520327] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.520341] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.520351] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.520365] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.520375] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.520384] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.520442] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 503 [D 20:41:40.520470] element 0: offset: 0x6151c0, size: 24 [D 20:41:40.520481] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 40/70. [D 20:41:40.523126] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 461824, tag: 503 [D 20:41:40.523173] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 41/70. [D 20:41:40.523303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 117. [D 20:41:40.523320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fecc00 rkey 4a40044 nic_wr_credit 118. [D 20:41:40.523332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400cc00 rkey 4a40044 nic_wr_credit 119. [D 20:41:40.523342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402cc00 rkey 4a40044 nic_wr_credit 120. [D 20:41:40.523356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404cc00 rkey 4a40044 nic_wr_credit 121. [D 20:41:40.523366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406cc00 rkey 4a40044 nic_wr_credit 122. [D 20:41:40.523376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408cc00 rkey 4a40044 nic_wr_credit 123. [D 20:41:40.523386] openib_post_sr_rdmaw: ibv_post_send wr_id 63dfc0 to 10.1.4.240:38258 remote addr f40acc00 rkey 4a40044 nic_wr_credit 124. [D 20:41:40.525481] openib_check_cq: completed rdma wr_id 63dfc0, nic_wr_credit 124. [D 20:41:40.525495] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 42/70. [D 20:41:40.525535] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.525546] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.525557] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.608307] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.608324] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.608335] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.608350] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 506 [D 20:41:40.608360] element 0: offset: 0x61ee50, size: 24 [D 20:41:40.608370] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 43/70. [D 20:41:40.608419] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 506 [D 20:41:40.608445] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 44/70. [D 20:41:40.609688] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 506 [D 20:41:40.609702] element 0: offset: 0x61ee50, size: 24 [D 20:41:40.609714] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 45/70. [D 20:41:40.609748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.609759] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.609768] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.616050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.616064] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.616073] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.616142] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 509 [D 20:41:40.616156] element 0: offset: 0x657310, size: 24 [D 20:41:40.616166] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 46/70. [D 20:41:40.616570] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 461824, tag: 509 [D 20:41:40.616615] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 47/70. [D 20:41:40.616659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 124. [D 20:41:40.616677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fecc00 rkey 4a40042 nic_wr_credit 125. [D 20:41:40.616687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400cc00 rkey 4a40044 nic_wr_credit 126. [D 20:41:40.616697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402cc00 rkey 4a40044 nic_wr_credit 127. [D 20:41:40.616707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404cc00 rkey 4a40044 nic_wr_credit 128. [D 20:41:40.616717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406cc00 rkey 4a40044 nic_wr_credit 129. [D 20:41:40.616727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408cc00 rkey 4a40044 nic_wr_credit 130. [D 20:41:40.616737] openib_post_sr_rdmaw: ibv_post_send wr_id 654d10 to 10.1.4.240:38258 remote addr f40acc00 rkey 4a40044 nic_wr_credit 131. [D 20:41:40.618863] openib_check_cq: completed rdma wr_id 654d10, nic_wr_credit 131. [D 20:41:40.618877] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 48/70. [D 20:41:40.619026] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.619038] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.619058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.628322] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.628336] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.628346] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.628361] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 512 [D 20:41:40.628371] element 0: offset: 0x623260, size: 24 [D 20:41:40.628381] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 49/70. [D 20:41:40.631522] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 983040, tag: 512 [D 20:41:40.631576] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 50/70. [D 20:41:40.631716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fe4630 rkey 4a40042 nic_wr_credit 131. [D 20:41:40.631734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4004630 rkey 4a40044 nic_wr_credit 132. [D 20:41:40.631746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4024630 rkey 4a40044 nic_wr_credit 133. [D 20:41:40.631760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4044630 rkey 4a40044 nic_wr_credit 134. [D 20:41:40.631770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4064630 rkey 4a40044 nic_wr_credit 135. [D 20:41:40.631792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4084630 rkey 4a40044 nic_wr_credit 136. [D 20:41:40.631803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40a4630 rkey 4a40044 nic_wr_credit 137. [D 20:41:40.631813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40c4630 rkey 4a40044 nic_wr_credit 138. [D 20:41:40.631823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40e4630 rkey 4a40044 nic_wr_credit 139. [D 20:41:40.631835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4104630 rkey 4a40044 nic_wr_credit 140. [D 20:41:40.631852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4124630 rkey 4a40044 nic_wr_credit 141. [D 20:41:40.631862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4144630 rkey 4a40044 nic_wr_credit 142. [D 20:41:40.631872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4164630 rkey 4a40044 nic_wr_credit 143. [D 20:41:40.631882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4184630 rkey 4a40044 nic_wr_credit 144. [D 20:41:40.631892] openib_post_sr_rdmaw: ibv_post_send wr_id 655d70 to 10.1.4.240:38258 remote addr f41a4630 rkey 4a40044 nic_wr_credit 145. [D 20:41:40.637871] openib_check_cq: completed rdma wr_id 655d70, nic_wr_credit 145. [D 20:41:40.637886] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 51/70. [D 20:41:40.640128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.640142] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.640151] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.651211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.651226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.651237] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.651252] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 515 [D 20:41:40.651262] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.651272] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 52/70. [D 20:41:40.651316] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 515 [D 20:41:40.651340] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 53/70. [D 20:41:40.651671] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 515 [D 20:41:40.651685] element 0: offset: 0x61f0e0, size: 24 [D 20:41:40.651697] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 54/70. [D 20:41:40.653838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.653852] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.653862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.696244] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.696258] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.696269] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.696339] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 519 [D 20:41:40.696353] element 0: offset: 0x61f670, size: 24 [D 20:41:40.696364] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 55/70. [D 20:41:40.698709] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 519 [D 20:41:40.698724] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 56/70. [D 20:41:40.699954] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 519 [D 20:41:40.699968] element 0: offset: 0x61f670, size: 24 [D 20:41:40.701884] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 57/70. [D 20:41:40.701933] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.701945] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.701955] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.702787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.702800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.702810] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.702869] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 522 [D 20:41:40.702883] element 0: offset: 0x63b5b0, size: 24 [D 20:41:40.702893] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 58/70. [D 20:41:40.702930] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 522 [D 20:41:40.702962] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 59/70. [D 20:41:40.704044] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 522 [D 20:41:40.704057] element 0: offset: 0x63b5b0, size: 24 [D 20:41:40.704070] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 60/70. [D 20:41:40.704104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.704114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.704123] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.705922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.705935] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.705945] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.706004] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 524 [D 20:41:40.706018] element 0: offset: 0x62c430, size: 24 [D 20:41:40.706028] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 0/70. [D 20:41:40.708389] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 524 [D 20:41:40.708406] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 1/70. [D 20:41:40.708692] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 524 [D 20:41:40.708706] element 0: offset: 0x62c430, size: 24 [D 20:41:40.708718] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 2/70. [D 20:41:40.710840] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.710853] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.710862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.775165] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.775180] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.775190] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.775213] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 530 [D 20:41:40.775224] element 0: offset: 0x65d000, size: 72 [D 20:41:40.775234] openib_post_sr: 10.1.4.240:38258 bh 3 len 88 wr 3/70. [D 20:41:40.775249] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.775259] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.775271] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:40.777378] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 532 [D 20:41:40.777392] element 0: offset: 0x662670, size: 72 [D 20:41:40.777404] openib_post_sr: 10.1.4.240:38258 bh 4 len 88 wr 4/70. [D 20:41:40.777419] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.777435] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.777444] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:40.779664] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 533 [D 20:41:40.779679] element 0: offset: 0x665b20, size: 72 [D 20:41:40.779689] openib_post_sr: 10.1.4.240:38258 bh 5 len 88 wr 5/70. [D 20:41:40.779704] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.779721] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.779730] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:40.780348] BMI_post_send_list: addr: 6416064, count: 1, total_size: 72, tag: 536 [D 20:41:40.780363] element 0: offset: 0x668fd0, size: 72 [D 20:41:40.780374] openib_post_sr: 10.1.4.240:38258 bh 6 len 88 wr 6/70. [D 20:41:40.780394] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.780403] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.780412] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:40.780426] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.780436] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.780444] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:40.780455] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.780468] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.782680] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:40.782696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.782705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.782717] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:40.823426] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:40.823440] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.823451] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:40.823515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 540 [D 20:41:40.823529] element 0: offset: 0x630f60, size: 24 [D 20:41:40.823539] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 7/70. [D 20:41:40.825922] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 540 [D 20:41:40.838442] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 540 [D 20:41:40.838456] element 0: offset: 0x630f60, size: 24 [D 20:41:40.838468] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 8/70. [D 20:41:40.838513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:40.838525] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:40.838535] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:41.576344] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.576360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.576371] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:41.576387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 543 [D 20:41:41.576401] element 0: offset: 0x657310, size: 24 [D 20:41:41.576411] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 9/70. [D 20:41:41.576508] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 543 [D 20:41:41.576583] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 10/70. [D 20:41:41.592574] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 543 [D 20:41:41.592589] element 0: offset: 0x657310, size: 24 [D 20:41:41.592599] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 11/70. [D 20:41:41.594867] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.594880] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.594891] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:41.602943] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.602957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.602968] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:41.602984] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 546 [D 20:41:41.602997] element 0: offset: 0x61fad0, size: 24 [D 20:41:41.603007] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 12/70. [D 20:41:41.603059] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 546 [D 20:41:41.605070] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.605084] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.605093] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:41.605153] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 549 [D 20:41:41.605167] element 0: offset: 0x61f800, size: 24 [D 20:41:41.606548] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 13/70. [D 20:41:41.608737] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 14/70. [D 20:41:41.612472] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 549 [D 20:41:41.619842] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 15/70. [D 20:41:41.622363] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.622379] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.622389] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.622424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 552 [D 20:41:41.622435] element 0: offset: 0x62c430, size: 24 [D 20:41:41.622447] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 16/70. [D 20:41:41.626603] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 552 [D 20:41:41.626691] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 546 [D 20:41:41.626703] element 0: offset: 0x61fad0, size: 24 [D 20:41:41.626717] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 17/70. [D 20:41:41.629017] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.629033] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.629044] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.632853] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 18/70. [D 20:41:41.635103] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.635117] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.635126] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.635155] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 555 [D 20:41:41.635165] element 0: offset: 0x643500, size: 24 [D 20:41:41.635175] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 19/70. [D 20:41:41.635275] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 555 [D 20:41:41.635986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 549 [D 20:41:41.635999] element 0: offset: 0x61f800, size: 24 [D 20:41:41.636009] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 20/70. [D 20:41:41.636098] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.636110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.636120] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.642795] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 21/70. [D 20:41:41.645846] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 552 [D 20:41:41.645862] element 0: offset: 0x62c430, size: 24 [D 20:41:41.645873] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 22/70. [D 20:41:41.648249] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.648263] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.648273] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:41.659914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.659928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.659936] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:41.659957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.659967] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.659975] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.660062] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 557 [D 20:41:41.660073] element 0: offset: 0x6151c0, size: 24 [D 20:41:41.660083] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 23/70. [D 20:41:41.660096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 561 [D 20:41:41.660106] element 0: offset: 0x657310, size: 24 [D 20:41:41.660115] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 24/70. [D 20:41:41.662672] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 557 [D 20:41:41.662688] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 25/70. [D 20:41:41.662713] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 561 [D 20:41:41.662724] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 26/70. [D 20:41:41.662738] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 555 [D 20:41:41.662748] element 0: offset: 0x643500, size: 24 [D 20:41:41.662758] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 27/70. [D 20:41:41.662860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.662881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.662891] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.685715] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 557 [D 20:41:41.685742] element 0: offset: 0x6151c0, size: 24 [D 20:41:41.685754] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 28/70. [D 20:41:41.687843] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.687857] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.687867] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:41.690127] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 561 [D 20:41:41.690183] element 0: offset: 0x657310, size: 24 [D 20:41:41.690200] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 29/70. [D 20:41:41.692378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.692393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.692403] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:41.857042] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.857058] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.857069] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:41.857196] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 564 [D 20:41:41.857210] element 0: offset: 0x61f310, size: 24 [D 20:41:41.857222] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 30/70. [D 20:41:41.859661] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 564 [D 20:41:41.859679] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 31/70. [D 20:41:41.876289] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.876304] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.876313] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:41.877187] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 567 [D 20:41:41.877200] element 0: offset: 0x64dde0, size: 24 [D 20:41:41.877210] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 32/70. [D 20:41:41.877224] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 564 [D 20:41:41.877233] element 0: offset: 0x61f310, size: 24 [D 20:41:41.877246] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 33/70. [D 20:41:41.879612] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 567 [D 20:41:41.879628] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 34/70. [D 20:41:41.879644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.879657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.879667] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:41.897080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.897094] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.897105] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:41.897123] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.897136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.897145] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.900038] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 567 [D 20:41:41.900093] element 0: offset: 0x64dde0, size: 24 [D 20:41:41.900107] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 35/70. [D 20:41:41.900133] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 569 [D 20:41:41.900144] element 0: offset: 0x623260, size: 24 [D 20:41:41.900154] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 36/70. [D 20:41:41.902412] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 573 [D 20:41:41.902426] element 0: offset: 0x61f670, size: 24 [D 20:41:41.902438] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 37/70. [D 20:41:41.902464] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.902475] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.902483] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.902529] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 569 [D 20:41:41.902560] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 38/70. [D 20:41:41.904818] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 573 [D 20:41:41.904834] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 39/70. [D 20:41:41.929315] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.929331] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.929339] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.929365] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.929375] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.929384] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:41.930296] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 569 [D 20:41:41.930345] element 0: offset: 0x623260, size: 24 [D 20:41:41.930361] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 40/70. [D 20:41:41.932393] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 573 [D 20:41:41.932408] element 0: offset: 0x61f670, size: 24 [D 20:41:41.932418] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 41/70. [D 20:41:41.932506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.932519] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.932528] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:41.932543] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.932551] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.932560] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.934652] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 576 [D 20:41:41.934666] element 0: offset: 0x61f670, size: 24 [D 20:41:41.934677] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 42/70. [D 20:41:41.934690] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 579 [D 20:41:41.934699] element 0: offset: 0x623260, size: 24 [D 20:41:41.934709] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 43/70. [D 20:41:41.934803] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 576 [D 20:41:41.934844] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 579 [D 20:41:41.934854] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 44/70. [D 20:41:41.934940] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 45/70. [D 20:41:41.962516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.962564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.962574] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.962610] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.962619] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.962628] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:41.962705] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 576 [D 20:41:41.962717] element 0: offset: 0x61f670, size: 24 [D 20:41:41.962729] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 46/70. [D 20:41:41.964636] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 581 [D 20:41:41.964651] element 0: offset: 0x2aaaab2008d0, size: 24 [D 20:41:41.964661] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 47/70. [D 20:41:41.964692] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.964702] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.964710] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:41.964750] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 585 [D 20:41:41.964760] element 0: offset: 0x2aaaab200b80, size: 24 [D 20:41:41.964769] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 48/70. [D 20:41:41.965096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 579 [D 20:41:41.965109] element 0: offset: 0x2aaaab200ba0, size: 24 [D 20:41:41.965120] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 49/70. [D 20:41:41.965164] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 581 [D 20:41:41.965178] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 50/70. [D 20:41:41.965210] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 585 [D 20:41:41.965222] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 51/70. [D 20:41:41.965246] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.965255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.965264] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:41.993969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.994020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.994030] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:41.994066] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:41.994075] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.994083] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:41.994199] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 588 [D 20:41:41.994210] element 0: offset: 0x64dde0, size: 24 [D 20:41:41.994223] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 52/70. [D 20:41:41.994241] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 591 [D 20:41:41.994250] element 0: offset: 0x63b5b0, size: 24 [D 20:41:41.994259] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 53/70. [D 20:41:41.994308] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 581 [D 20:41:41.994318] element 0: offset: 0x61f310, size: 24 [D 20:41:41.994328] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 54/70. [D 20:41:41.994372] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 588 [D 20:41:41.994387] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 55/70. [D 20:41:41.994420] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 591 [D 20:41:41.994453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.994463] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.994466] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 56/70. [D 20:41:41.994472] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:41.998977] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 585 [D 20:41:41.998991] element 0: offset: 0x2aaaab200b80, size: 24 [D 20:41:41.999002] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 57/70. [D 20:41:41.999122] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:41.999136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:41.999144] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.024657] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.024705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.024715] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.024750] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.024759] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.024767] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:42.024877] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 593 [D 20:41:42.024888] element 0: offset: 0x2aaaab203890, size: 24 [D 20:41:42.024901] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 58/70. [D 20:41:42.024919] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 597 [D 20:41:42.024928] element 0: offset: 0x2aaaab209250, size: 24 [D 20:41:42.024938] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 59/70. [D 20:41:42.025126] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 593 [D 20:41:42.025145] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 60/70. [D 20:41:42.026976] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 597 [D 20:41:42.027028] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 0/70. [D 20:41:42.028928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 591 [D 20:41:42.028943] element 0: offset: 0x2aaaab203af0, size: 24 [D 20:41:42.028955] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 1/70. [D 20:41:42.028973] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 588 [D 20:41:42.028982] element 0: offset: 0x2aaaab203c10, size: 24 [D 20:41:42.028992] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 2/70. [D 20:41:42.029077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.029090] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.029099] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:42.029119] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.029128] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.029137] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.053287] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.053339] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.053349] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.053383] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.053392] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.053400] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:42.053508] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 600 [D 20:41:42.053520] element 0: offset: 0x2aaaab207c50, size: 24 [D 20:41:42.053532] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 3/70. [D 20:41:42.053550] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 603 [D 20:41:42.053559] element 0: offset: 0x2aaaab203800, size: 24 [D 20:41:42.053568] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 4/70. [D 20:41:42.053616] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 593 [D 20:41:42.053627] element 0: offset: 0x2aaaab203890, size: 24 [D 20:41:42.053637] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 5/70. [D 20:41:42.053687] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 600 [D 20:41:42.053702] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 6/70. [D 20:41:42.053739] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 603 [D 20:41:42.053770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.053780] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.053783] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 7/70. [D 20:41:42.053788] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:42.058201] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 597 [D 20:41:42.058215] element 0: offset: 0x61ee50, size: 24 [D 20:41:42.058226] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 8/70. [D 20:41:42.058345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.058359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.058368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.082167] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.082214] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.082223] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.082258] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.082268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.082276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:42.082387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 605 [D 20:41:42.082399] element 0: offset: 0x623260, size: 24 [D 20:41:42.082412] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 9/70. [D 20:41:42.082430] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 609 [D 20:41:42.082440] element 0: offset: 0x61f670, size: 24 [D 20:41:42.082449] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 10/70. [D 20:41:42.082498] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 600 [D 20:41:42.082510] element 0: offset: 0x61fad0, size: 24 [D 20:41:42.082520] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 11/70. [D 20:41:42.082563] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 605 [D 20:41:42.082579] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 12/70. [D 20:41:42.082613] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 609 [D 20:41:42.082646] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.082655] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.082663] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:42.082665] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 13/70. [D 20:41:42.086859] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 603 [D 20:41:42.086874] element 0: offset: 0x655e00, size: 24 [D 20:41:42.086884] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 14/70. [D 20:41:42.086996] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.087010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.087018] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.109964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.110011] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.110020] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.112844] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 609 [D 20:41:42.112898] element 0: offset: 0x61f670, size: 24 [D 20:41:42.112915] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 15/70. [D 20:41:42.112962] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 612 [D 20:41:42.112973] element 0: offset: 0x61f800, size: 24 [D 20:41:42.112983] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 16/70. [D 20:41:42.117019] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 605 [D 20:41:42.117033] element 0: offset: 0x623260, size: 24 [D 20:41:42.117045] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 17/70. [D 20:41:42.117076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.117086] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.117096] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.117138] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 612 [D 20:41:42.117171] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 18/70. [D 20:41:42.117194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.117204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.117228] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.119456] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.119469] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.119479] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.119490] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 615 [D 20:41:42.119500] element 0: offset: 0x623260, size: 24 [D 20:41:42.119512] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 19/70. [D 20:41:42.119605] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 615 [D 20:41:42.129839] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 20/70. [D 20:41:42.132663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 612 [D 20:41:42.132678] element 0: offset: 0x61f800, size: 24 [D 20:41:42.132689] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 21/70. [D 20:41:42.135069] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.135082] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.135092] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:42.148313] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.148327] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.148336] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:42.148361] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.148371] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.148379] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.148394] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 615 [D 20:41:42.148403] element 0: offset: 0x623260, size: 24 [D 20:41:42.148413] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 22/70. [D 20:41:42.148524] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.148543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.148551] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.148563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 617 [D 20:41:42.150699] element 0: offset: 0x623260, size: 24 [D 20:41:42.150711] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 23/70. [D 20:41:42.150724] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 621 [D 20:41:42.150737] element 0: offset: 0x643500, size: 24 [D 20:41:42.150747] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 24/70. [D 20:41:42.150803] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 617 [D 20:41:42.150880] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 25/70. [D 20:41:42.153348] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 621 [D 20:41:42.153363] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 26/70. [D 20:41:42.176116] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.176131] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.176140] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:42.176252] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 624 [D 20:41:42.176263] element 0: offset: 0x61ee50, size: 24 [D 20:41:42.176273] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 27/70. [D 20:41:42.178608] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 624 [D 20:41:42.178624] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 28/70. [D 20:41:42.178640] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.178650] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.178659] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:42.178678] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 617 [D 20:41:42.178688] element 0: offset: 0x623260, size: 24 [D 20:41:42.178703] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 29/70. [D 20:41:42.178721] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 627 [D 20:41:42.178730] element 0: offset: 0x2aaaab200af0, size: 24 [D 20:41:42.178740] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 30/70. [D 20:41:42.185627] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 621 [D 20:41:42.185701] element 0: offset: 0x2aaaab200c90, size: 24 [D 20:41:42.185717] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 31/70. [D 20:41:42.185753] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.185764] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.185774] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:42.185825] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 627 [D 20:41:42.188107] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.188122] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.188132] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:42.192538] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 32/70. [D 20:41:42.195376] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 624 [D 20:41:42.195390] element 0: offset: 0x2aaaab201060, size: 24 [D 20:41:42.195401] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 33/70. [D 20:41:42.197771] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.197784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.197795] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:42.208511] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.208527] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.208537] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:42.208679] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 629 [D 20:41:42.208693] element 0: offset: 0x2aaaab208ff0, size: 24 [D 20:41:42.208704] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 34/70. [D 20:41:42.211188] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 629 [D 20:41:42.211204] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 35/70. [D 20:41:42.216332] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 627 [D 20:41:42.216395] element 0: offset: 0x2aaaab200af0, size: 24 [D 20:41:42.216410] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 36/70. [D 20:41:42.218700] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.218714] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.218725] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:42.226153] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 629 [D 20:41:42.226170] element 0: offset: 0x2aaaab208ff0, size: 24 [D 20:41:42.226182] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 37/70. [D 20:41:42.228371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.228385] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.228395] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:42.232499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.232545] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.232554] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:42.232586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.232596] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.232604] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:42.232700] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 633 [D 20:41:42.232712] element 0: offset: 0x2aaaab2024e0, size: 24 [D 20:41:42.232725] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 38/70. [D 20:41:42.232746] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 636 [D 20:41:42.232755] element 0: offset: 0x2aaaab203b20, size: 24 [D 20:41:42.232766] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 39/70. [D 20:41:42.232815] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 633 [D 20:41:42.232839] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 40/70. [D 20:41:42.232853] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 636 [D 20:41:42.232923] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 41/70. [D 20:41:42.264005] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 633 [D 20:41:42.264053] element 0: offset: 0x64dde0, size: 24 [D 20:41:42.264068] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 42/70. [D 20:41:42.264217] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.264230] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.264239] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:42.264349] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 636 [D 20:41:42.264362] element 0: offset: 0x629cb0, size: 24 [D 20:41:42.264373] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 43/70. [D 20:41:42.264415] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:42.264426] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.264435] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:42.998871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:42.998885] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:42.998894] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:42.999003] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 639 [D 20:41:42.999013] element 0: offset: 0x61f800, size: 24 [D 20:41:42.999023] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 44/70. [D 20:41:42.999088] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 639 [D 20:41:42.999162] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 45/70. [D 20:41:43.012854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.012871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.012880] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:43.012933] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 641 [D 20:41:43.012944] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.012954] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 46/70. [D 20:41:43.015724] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 641 [D 20:41:43.015768] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 47/70. [D 20:41:43.015987] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 639 [D 20:41:43.016003] element 0: offset: 0x61f800, size: 24 [D 20:41:43.016014] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 48/70. [D 20:41:43.016748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.016762] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.016771] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:43.031028] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.031042] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.031051] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:43.031078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.031088] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.031096] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.033976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 641 [D 20:41:43.034014] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.034026] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 49/70. [D 20:41:43.034047] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 645 [D 20:41:43.034056] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.034067] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 50/70. [D 20:41:43.034084] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 648 [D 20:41:43.034094] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.034104] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 51/70. [D 20:41:43.034138] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.034148] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.034157] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.034192] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 645 [D 20:41:43.034207] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 52/70. [D 20:41:43.034239] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 648 [D 20:41:43.034260] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 53/70. [D 20:41:43.061588] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.061643] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.061653] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.061773] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 650 [D 20:41:43.061786] element 0: offset: 0x629cb0, size: 24 [D 20:41:43.061799] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 54/70. [D 20:41:43.061857] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 645 [D 20:41:43.061868] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.061878] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 55/70. [D 20:41:43.061943] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 650 [D 20:41:43.061981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.061990] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.061999] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.062017] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 56/70. [D 20:41:43.066647] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 648 [D 20:41:43.066662] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.066673] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 57/70. [D 20:41:43.066788] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.066802] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.066810] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:43.073931] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.073945] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.073953] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:43.076873] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 650 [D 20:41:43.076909] element 0: offset: 0x629cb0, size: 24 [D 20:41:43.076922] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 58/70. [D 20:41:43.076948] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 654 [D 20:41:43.076958] element 0: offset: 0x657310, size: 24 [D 20:41:43.076968] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 59/70. [D 20:41:43.076999] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.077009] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.077017] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:43.077058] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 654 [D 20:41:43.077072] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 60/70. [D 20:41:43.094029] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.094044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.094052] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:43.094204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.094218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.094226] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.096255] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 658 [D 20:41:43.096269] element 0: offset: 0x64dea0, size: 24 [D 20:41:43.096280] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 0/70. [D 20:41:43.096293] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 660 [D 20:41:43.096302] element 0: offset: 0x623260, size: 24 [D 20:41:43.096312] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 1/70. [D 20:41:43.096392] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 658 [D 20:41:43.096430] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 660 [D 20:41:43.096436] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 2/70. [D 20:41:43.096548] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 3/70. [D 20:41:43.101538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 654 [D 20:41:43.101553] element 0: offset: 0x657310, size: 24 [D 20:41:43.101563] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 4/70. [D 20:41:43.101665] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.101678] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.101686] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.124574] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.124623] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.124632] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.128472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.128538] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.128548] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.128628] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 662 [D 20:41:43.128643] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.128656] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 5/70. [D 20:41:43.128681] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 658 [D 20:41:43.128691] element 0: offset: 0x64dea0, size: 24 [D 20:41:43.128701] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 6/70. [D 20:41:43.131161] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 666 [D 20:41:43.131175] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.131186] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 7/70. [D 20:41:43.131222] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 662 [D 20:41:43.131236] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 8/70. [D 20:41:43.131268] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.131278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.131287] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.133693] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 666 [D 20:41:43.133710] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 9/70. [D 20:41:43.133761] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 660 [D 20:41:43.133773] element 0: offset: 0x623260, size: 24 [D 20:41:43.133788] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 10/70. [D 20:41:43.133868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.133882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.133892] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.160618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.160639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.160649] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.160677] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.160687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.160696] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.162114] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 662 [D 20:41:43.162133] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.162147] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 11/70. [D 20:41:43.162164] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 669 [D 20:41:43.162173] element 0: offset: 0x62c430, size: 24 [D 20:41:43.162183] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 12/70. [D 20:41:43.167979] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 672 [D 20:41:43.168028] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.168042] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 13/70. [D 20:41:43.168068] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 666 [D 20:41:43.168084] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.168097] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 14/70. [D 20:41:43.168125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.168136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.168145] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.168188] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 669 [D 20:41:43.168204] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 15/70. [D 20:41:43.170466] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 672 [D 20:41:43.170482] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 16/70. [D 20:41:43.170498] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.170516] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.170525] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.194308] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.194324] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.194333] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.194366] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.194376] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.194385] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.194462] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 674 [D 20:41:43.194474] element 0: offset: 0x623260, size: 24 [D 20:41:43.194483] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 17/70. [D 20:41:43.194497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 678 [D 20:41:43.194506] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.194516] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 18/70. [D 20:41:43.196947] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 674 [D 20:41:43.196963] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 19/70. [D 20:41:43.196987] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 678 [D 20:41:43.196999] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 20/70. [D 20:41:43.197013] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 669 [D 20:41:43.197023] element 0: offset: 0x62c430, size: 24 [D 20:41:43.197033] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 21/70. [D 20:41:43.197132] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.197158] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.197167] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.202509] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 672 [D 20:41:43.202565] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.202588] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 22/70. [D 20:41:43.204561] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.204576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.204586] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.223797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.223812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.223821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.223854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.223864] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.223872] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.225408] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 681 [D 20:41:43.225425] element 0: offset: 0x691fe0, size: 24 [D 20:41:43.225443] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 23/70. [D 20:41:43.225457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 684 [D 20:41:43.225467] element 0: offset: 0x61f670, size: 24 [D 20:41:43.225477] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 24/70. [D 20:41:43.225494] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 674 [D 20:41:43.225508] element 0: offset: 0x623260, size: 24 [D 20:41:43.227905] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 25/70. [D 20:41:43.227949] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 681 [D 20:41:43.227963] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 26/70. [D 20:41:43.227991] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 684 [D 20:41:43.228004] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 27/70. [D 20:41:43.231837] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.231855] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.231864] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.231882] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 678 [D 20:41:43.231892] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.231901] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 28/70. [D 20:41:43.231992] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.232005] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.232014] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.259048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.259063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.259072] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.259099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.259109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.259118] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.260602] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 687 [D 20:41:43.260629] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.260643] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 29/70. [D 20:41:43.260661] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 689 [D 20:41:43.260673] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.260683] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 30/70. [D 20:41:43.265553] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 681 [D 20:41:43.265596] element 0: offset: 0x691fe0, size: 24 [D 20:41:43.265610] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 31/70. [D 20:41:43.265633] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 684 [D 20:41:43.265643] element 0: offset: 0x61f670, size: 24 [D 20:41:43.265653] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 32/70. [D 20:41:43.265703] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 687 [D 20:41:43.265721] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 33/70. [D 20:41:43.265747] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 689 [D 20:41:43.265759] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 34/70. [D 20:41:43.268026] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.268041] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.268051] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.268067] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.268077] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.268085] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.295042] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.295057] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.295095] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.295129] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.295138] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.295147] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.295257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 693 [D 20:41:43.295276] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.295286] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 35/70. [D 20:41:43.295298] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 696 [D 20:41:43.295312] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.295321] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 36/70. [D 20:41:43.297665] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 693 [D 20:41:43.297681] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 37/70. [D 20:41:43.297706] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 696 [D 20:41:43.297718] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 38/70. [D 20:41:43.297731] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 687 [D 20:41:43.297741] element 0: offset: 0x61fad0, size: 24 [D 20:41:43.297750] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 39/70. [D 20:41:43.297846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.297872] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.297882] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.303106] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 689 [D 20:41:43.303164] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.303181] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 40/70. [D 20:41:43.305640] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.305654] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.305664] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.328498] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.328513] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.328544] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.328583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.328592] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.328601] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.328751] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 699 [D 20:41:43.328767] element 0: offset: 0x61f310, size: 24 [D 20:41:43.328777] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 41/70. [D 20:41:43.328790] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 701 [D 20:41:43.328804] element 0: offset: 0x63e0a0, size: 24 [D 20:41:43.328813] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 42/70. [D 20:41:43.331249] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 699 [D 20:41:43.331267] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 43/70. [D 20:41:43.331292] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 701 [D 20:41:43.331304] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 44/70. [D 20:41:43.331317] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 693 [D 20:41:43.331327] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.331337] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 45/70. [D 20:41:43.331440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.331454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.331464] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.336330] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 696 [D 20:41:43.336390] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.336406] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 46/70. [D 20:41:43.336580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.336594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.336604] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.358013] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.358029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.358038] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.358071] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.358081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.358089] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.358239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 705 [D 20:41:43.358253] element 0: offset: 0x623260, size: 24 [D 20:41:43.358262] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 47/70. [D 20:41:43.358276] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 708 [D 20:41:43.358289] element 0: offset: 0x62c430, size: 24 [D 20:41:43.358298] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 48/70. [D 20:41:43.360746] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 705 [D 20:41:43.360764] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 49/70. [D 20:41:43.360789] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 708 [D 20:41:43.360800] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 50/70. [D 20:41:43.360814] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 699 [D 20:41:43.360824] element 0: offset: 0x61f310, size: 24 [D 20:41:43.360902] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 51/70. [D 20:41:43.361030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.361045] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.361054] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.366077] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 701 [D 20:41:43.366091] element 0: offset: 0x63e0a0, size: 24 [D 20:41:43.366102] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 52/70. [D 20:41:43.366213] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.366226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.366235] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.387143] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.387157] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.387166] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.387194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.387204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.387213] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.387272] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 711 [D 20:41:43.387283] element 0: offset: 0x61f670, size: 24 [D 20:41:43.387294] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 53/70. [D 20:41:43.387311] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 713 [D 20:41:43.387321] element 0: offset: 0x691fe0, size: 24 [D 20:41:43.387330] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 54/70. [D 20:41:43.387443] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 711 [D 20:41:43.387461] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 55/70. [D 20:41:43.387491] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 713 [D 20:41:43.387532] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 56/70. [D 20:41:43.390573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 708 [D 20:41:43.390624] element 0: offset: 0x62c430, size: 24 [D 20:41:43.390638] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 57/70. [D 20:41:43.390778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.390791] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.390800] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.395170] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 705 [D 20:41:43.395184] element 0: offset: 0x623260, size: 24 [D 20:41:43.395195] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 58/70. [D 20:41:43.395299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.395313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.395321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.414086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.414100] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.414108] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.414142] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.414152] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.414161] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.414250] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 717 [D 20:41:43.414260] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.414271] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 59/70. [D 20:41:43.414288] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 720 [D 20:41:43.414298] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.414308] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 60/70. [D 20:41:43.414420] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 717 [D 20:41:43.414437] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 0/70. [D 20:41:43.414467] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 720 [D 20:41:43.414508] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 1/70. [D 20:41:43.417561] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 713 [D 20:41:43.417610] element 0: offset: 0x691fe0, size: 24 [D 20:41:43.417624] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 2/70. [D 20:41:43.418922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.418937] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.418946] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.424066] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 711 [D 20:41:43.424080] element 0: offset: 0x61f670, size: 24 [D 20:41:43.424090] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 3/70. [D 20:41:43.424209] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.424225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.424234] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.442790] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.442803] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.442812] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.442846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.442856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.442864] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:43.442952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 722 [D 20:41:43.442963] element 0: offset: 0x633550, size: 24 [D 20:41:43.442973] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 4/70. [D 20:41:43.442991] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 726 [D 20:41:43.443000] element 0: offset: 0x657310, size: 24 [D 20:41:43.443010] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 5/70. [D 20:41:43.443121] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 722 [D 20:41:43.443139] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 6/70. [D 20:41:43.443169] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 726 [D 20:41:43.443215] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 7/70. [D 20:41:43.446275] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 720 [D 20:41:43.446327] element 0: offset: 0x61ee50, size: 24 [D 20:41:43.446341] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 8/70. [D 20:41:43.446481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.446494] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.446502] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:43.451083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 717 [D 20:41:43.451097] element 0: offset: 0x6151c0, size: 24 [D 20:41:43.451107] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 9/70. [D 20:41:43.451226] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.451240] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.451249] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.471824] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.471838] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.471846] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:43.471937] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 729 [D 20:41:43.471948] element 0: offset: 0x61f670, size: 24 [D 20:41:43.471959] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 10/70. [D 20:41:43.472054] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 729 [D 20:41:43.472109] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 11/70. [D 20:41:43.475000] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 722 [D 20:41:43.475049] element 0: offset: 0x633550, size: 24 [D 20:41:43.475063] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 12/70. [D 20:41:43.475207] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.475219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.475228] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:43.479648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 726 [D 20:41:43.479662] element 0: offset: 0x657310, size: 24 [D 20:41:43.479673] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 13/70. [D 20:41:43.479783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.479797] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.479805] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:43.484417] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 729 [D 20:41:43.484461] element 0: offset: 0x61f670, size: 24 [D 20:41:43.484476] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 14/70. [D 20:41:43.484586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.484598] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.484606] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:43.496977] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:43.496992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.497000] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:43.497095] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 732 [D 20:41:43.497106] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.497116] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 15/70. [D 20:41:43.497181] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 732 [D 20:41:43.497230] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 16/70. [D 20:41:43.516757] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 732 [D 20:41:43.516772] element 0: offset: 0x5b0030, size: 24 [D 20:41:43.516782] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 17/70. [D 20:41:43.516860] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:43.516873] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:43.516882] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:44.172728] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.172742] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.172750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:44.172799] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 735 [D 20:41:44.172810] element 0: offset: 0x61ee50, size: 24 [D 20:41:44.172820] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 18/70. [D 20:41:44.172874] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 735 [D 20:41:44.172945] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 19/70. [D 20:41:44.186526] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 735 [D 20:41:44.186573] element 0: offset: 0x61ee50, size: 24 [D 20:41:44.186586] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 20/70. [D 20:41:44.186727] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.186740] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.186748] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:44.204836] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.204849] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.204858] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:44.204951] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 738 [D 20:41:44.204962] element 0: offset: 0x61f310, size: 24 [D 20:41:44.204972] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 21/70. [D 20:41:44.205035] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 738 [D 20:41:44.205085] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 22/70. [D 20:41:44.220947] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 738 [D 20:41:44.220962] element 0: offset: 0x61f310, size: 24 [D 20:41:44.220972] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 23/70. [D 20:41:44.221092] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.221106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.221114] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:44.240014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.240027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.240036] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:44.240086] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 741 [D 20:41:44.240096] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.240108] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 24/70. [D 20:41:44.240144] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.240155] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.240163] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.240191] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 741 [D 20:41:44.240238] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 25/70. [D 20:41:44.240241] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 744 [D 20:41:44.240312] element 0: offset: 0x629de0, size: 24 [D 20:41:44.240324] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 26/70. [D 20:41:44.240417] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 744 [D 20:41:44.254850] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 27/70. [D 20:41:44.257720] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 741 [D 20:41:44.257767] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.257782] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 28/70. [D 20:41:44.257922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.257934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.257943] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.271837] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.271851] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.271860] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.271961] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 747 [D 20:41:44.271972] element 0: offset: 0x61f310, size: 24 [D 20:41:44.271981] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 29/70. [D 20:41:44.274398] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 747 [D 20:41:44.274415] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 30/70. [D 20:41:44.276648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 744 [D 20:41:44.276659] element 0: offset: 0x629de0, size: 24 [D 20:41:44.276669] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 31/70. [D 20:41:44.276787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.276800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.276815] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.288352] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.288396] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.288405] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.288515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 749 [D 20:41:44.288527] element 0: offset: 0x6151c0, size: 24 [D 20:41:44.288540] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 32/70. [D 20:41:44.288645] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 749 [D 20:41:44.288716] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 33/70. [D 20:41:44.290244] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 747 [D 20:41:44.290285] element 0: offset: 0x61f310, size: 24 [D 20:41:44.290298] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 34/70. [D 20:41:44.291425] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.291439] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.291448] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.300032] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.300046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.300055] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.300085] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.300094] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.300102] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.300190] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 753 [D 20:41:44.300201] element 0: offset: 0x657310, size: 24 [D 20:41:44.300211] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 35/70. [D 20:41:44.300228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 756 [D 20:41:44.300238] element 0: offset: 0x61ee50, size: 24 [D 20:41:44.300249] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 36/70. [D 20:41:44.300287] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 753 [D 20:41:44.300313] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 37/70. [D 20:41:44.300341] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 756 [D 20:41:44.300469] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 38/70. [D 20:41:44.305614] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 749 [D 20:41:44.305628] element 0: offset: 0x2aaaab200af0, size: 24 [D 20:41:44.305638] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 39/70. [D 20:41:44.305764] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.305778] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.305787] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.329168] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.329182] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.329190] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.329245] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 759 [D 20:41:44.329256] element 0: offset: 0x2aaaab209430, size: 24 [D 20:41:44.329266] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 40/70. [D 20:41:44.329364] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 759 [D 20:41:44.329423] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 41/70. [D 20:41:44.332290] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 756 [D 20:41:44.332328] element 0: offset: 0x2aaaab209410, size: 24 [D 20:41:44.332341] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 42/70. [D 20:41:44.332445] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.332459] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.332468] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.337051] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 753 [D 20:41:44.337066] element 0: offset: 0x2aaaab209410, size: 24 [D 20:41:44.337075] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 43/70. [D 20:41:44.337183] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.337197] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.337205] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.342551] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.342565] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.342574] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.342668] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 761 [D 20:41:44.342679] element 0: offset: 0x2aaaab209410, size: 24 [D 20:41:44.342689] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 44/70. [D 20:41:44.342742] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 761 [D 20:41:44.342806] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 45/70. [D 20:41:44.345898] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 759 [D 20:41:44.345937] element 0: offset: 0x2aaaab209430, size: 24 [D 20:41:44.345951] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 46/70. [D 20:41:44.348218] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.348238] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.348249] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.362883] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.362942] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.362952] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.362992] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.363002] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.363011] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.363874] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 766 [D 20:41:44.363896] element 0: offset: 0x2aaaab209430, size: 24 [D 20:41:44.363910] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 47/70. [D 20:41:44.363929] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 768 [D 20:41:44.363940] element 0: offset: 0x2aaaab202210, size: 24 [D 20:41:44.363949] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 48/70. [D 20:41:44.363969] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 761 [D 20:41:44.363979] element 0: offset: 0x2aaaab209410, size: 24 [D 20:41:44.366536] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 49/70. [D 20:41:44.366581] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 766 [D 20:41:44.366597] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 50/70. [D 20:41:44.366628] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 768 [D 20:41:44.366640] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 51/70. [D 20:41:44.369012] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.369027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.369037] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.395870] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.395885] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.395894] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.395919] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.395928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.395936] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.396014] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 771 [D 20:41:44.396026] element 0: offset: 0x2aaaab2035b0, size: 24 [D 20:41:44.396035] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 52/70. [D 20:41:44.396048] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 773 [D 20:41:44.396058] element 0: offset: 0x2aaaab2009d0, size: 24 [D 20:41:44.396071] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 53/70. [D 20:41:44.396666] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 766 [D 20:41:44.396682] element 0: offset: 0x2aaaab209430, size: 24 [D 20:41:44.396697] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 54/70. [D 20:41:44.399017] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 771 [D 20:41:44.399032] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 55/70. [D 20:41:44.399058] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 773 [D 20:41:44.399074] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 56/70. [D 20:41:44.399093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.399103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.399112] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.403638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 768 [D 20:41:44.403683] element 0: offset: 0x2aaaab202210, size: 24 [D 20:41:44.403698] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 57/70. [D 20:41:44.403798] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.403812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.403836] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.428353] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.428368] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.428377] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.428412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.428421] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.428430] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.431456] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 777 [D 20:41:44.431517] element 0: offset: 0x2aaaab2093c0, size: 24 [D 20:41:44.431533] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 58/70. [D 20:41:44.431555] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 780 [D 20:41:44.431573] element 0: offset: 0x2aaaab20bc30, size: 24 [D 20:41:44.431584] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 59/70. [D 20:41:44.431599] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 771 [D 20:41:44.431609] element 0: offset: 0x2aaaab2035b0, size: 24 [D 20:41:44.431619] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 60/70. [D 20:41:44.432689] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 777 [D 20:41:44.434075] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 0/70. [D 20:41:44.434119] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 780 [D 20:41:44.434134] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 1/70. [D 20:41:44.434161] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.434173] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.434182] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.436497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 773 [D 20:41:44.436511] element 0: offset: 0x2aaaab2009d0, size: 24 [D 20:41:44.436523] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 2/70. [D 20:41:44.436605] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.436618] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.436627] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.462279] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.462294] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.462303] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.462333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.462342] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.462351] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.462428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 782 [D 20:41:44.462440] element 0: offset: 0x2aaaab207700, size: 24 [D 20:41:44.462450] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 3/70. [D 20:41:44.462463] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 786 [D 20:41:44.462472] element 0: offset: 0x2aaaab2009d0, size: 24 [D 20:41:44.462486] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 4/70. [D 20:41:44.463106] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 777 [D 20:41:44.463122] element 0: offset: 0x2aaaab2093c0, size: 24 [D 20:41:44.463139] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 5/70. [D 20:41:44.467712] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 780 [D 20:41:44.467758] element 0: offset: 0x2aaaab20bc30, size: 24 [D 20:41:44.467771] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 6/70. [D 20:41:44.467820] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 782 [D 20:41:44.467836] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 7/70. [D 20:41:44.467870] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 786 [D 20:41:44.467882] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 8/70. [D 20:41:44.467910] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.467922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.467931] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.470408] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.470422] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.470433] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.495919] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.495933] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.495942] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.495983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.495993] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.496001] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.499075] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 789 [D 20:41:44.499135] element 0: offset: 0x2aaaab2035b0, size: 24 [D 20:41:44.499150] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 9/70. [D 20:41:44.499171] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 792 [D 20:41:44.499182] element 0: offset: 0x2aaaab2093c0, size: 24 [D 20:41:44.499191] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 10/70. [D 20:41:44.499210] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 782 [D 20:41:44.499221] element 0: offset: 0x2aaaab207700, size: 24 [D 20:41:44.499237] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 11/70. [D 20:41:44.501650] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 789 [D 20:41:44.501670] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 12/70. [D 20:41:44.501708] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 792 [D 20:41:44.501721] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 13/70. [D 20:41:44.501757] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.501768] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.501820] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.504017] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 786 [D 20:41:44.504032] element 0: offset: 0x2aaaab2009d0, size: 24 [D 20:41:44.504046] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 14/70. [D 20:41:44.504149] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.504163] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.504171] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.528995] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.529009] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.529017] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.529048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.529057] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.529066] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.529128] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 794 [D 20:41:44.529140] element 0: offset: 0x2aaaab210c10, size: 24 [D 20:41:44.529150] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 15/70. [D 20:41:44.529168] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 798 [D 20:41:44.529178] element 0: offset: 0x2aaaab2009d0, size: 24 [D 20:41:44.529188] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 16/70. [D 20:41:44.529309] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 794 [D 20:41:44.529328] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 17/70. [D 20:41:44.529364] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 798 [D 20:41:44.529377] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 18/70. [D 20:41:44.532270] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 792 [D 20:41:44.532316] element 0: offset: 0x2aaaab2093c0, size: 24 [D 20:41:44.532330] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 19/70. [D 20:41:44.532473] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.532485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.532494] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.536721] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 789 [D 20:41:44.536735] element 0: offset: 0x2aaaab2035b0, size: 24 [D 20:41:44.536745] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 20/70. [D 20:41:44.536864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.536877] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.536886] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.556048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.556062] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.556071] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.556104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.556113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.556121] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.556207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 801 [D 20:41:44.556217] element 0: offset: 0x2aaaab207700, size: 24 [D 20:41:44.556227] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 21/70. [D 20:41:44.556245] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 804 [D 20:41:44.556255] element 0: offset: 0x2aaaab2035b0, size: 24 [D 20:41:44.556267] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 22/70. [D 20:41:44.556309] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 801 [D 20:41:44.556341] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 23/70. [D 20:41:44.556347] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 804 [D 20:41:44.556430] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 24/70. [D 20:41:44.559293] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 794 [D 20:41:44.559338] element 0: offset: 0x61f670, size: 24 [D 20:41:44.559353] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 25/70. [D 20:41:44.559492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.559506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.559514] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.563993] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 798 [D 20:41:44.564007] element 0: offset: 0x61f670, size: 24 [D 20:41:44.564018] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 26/70. [D 20:41:44.564134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.564148] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.564157] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.583512] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.583526] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.583535] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.583563] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.583572] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.583580] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:44.583667] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 806 [D 20:41:44.583678] element 0: offset: 0x629de0, size: 24 [D 20:41:44.583689] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 27/70. [D 20:41:44.583707] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 810 [D 20:41:44.583716] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.583726] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 28/70. [D 20:41:44.583787] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 806 [D 20:41:44.583825] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 810 [D 20:41:44.583855] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 29/70. [D 20:41:44.583926] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 30/70. [D 20:41:44.587014] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 801 [D 20:41:44.587052] element 0: offset: 0x657310, size: 24 [D 20:41:44.587066] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 31/70. [D 20:41:44.587182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.587196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.587205] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:44.591711] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 804 [D 20:41:44.591725] element 0: offset: 0x657310, size: 24 [D 20:41:44.591736] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 32/70. [D 20:41:44.591852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.591865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.591874] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.609977] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.609996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.610005] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:44.610099] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 813 [D 20:41:44.610110] element 0: offset: 0x643500, size: 24 [D 20:41:44.610120] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 33/70. [D 20:41:44.612723] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 806 [D 20:41:44.612756] element 0: offset: 0x629de0, size: 24 [D 20:41:44.612769] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 34/70. [D 20:41:44.612813] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 813 [D 20:41:44.612828] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 35/70. [D 20:41:44.612864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.612874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.612883] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:44.615783] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 810 [D 20:41:44.615797] element 0: offset: 0x5b0030, size: 24 [D 20:41:44.615808] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 36/70. [D 20:41:44.615905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.615918] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.615927] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.628752] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 813 [D 20:41:44.628796] element 0: offset: 0x643500, size: 24 [D 20:41:44.628810] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 37/70. [D 20:41:44.628972] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.628985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.628994] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:44.633780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.633794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.633802] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:44.633899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 815 [D 20:41:44.633910] element 0: offset: 0x61f800, size: 24 [D 20:41:44.633920] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 38/70. [D 20:41:44.633985] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 815 [D 20:41:44.634034] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 39/70. [D 20:41:44.646567] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.646583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.646591] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.646642] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 819 [D 20:41:44.646653] element 0: offset: 0x61ee50, size: 24 [D 20:41:44.646663] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 40/70. [D 20:41:44.649701] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 815 [D 20:41:44.649715] element 0: offset: 0x61f800, size: 24 [D 20:41:44.649728] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 41/70. [D 20:41:44.649757] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 819 [D 20:41:44.649770] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 42/70. [D 20:41:44.649844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.649856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.649864] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.663776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.663790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.663798] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.663852] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 822 [D 20:41:44.663863] element 0: offset: 0x61fad0, size: 24 [D 20:41:44.663873] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 43/70. [D 20:41:44.663969] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 822 [D 20:41:44.664066] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 44/70. [D 20:41:44.666983] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 819 [D 20:41:44.667026] element 0: offset: 0x61ee50, size: 24 [D 20:41:44.667040] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 45/70. [D 20:41:44.669439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.669458] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.669468] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.683384] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 822 [D 20:41:44.683447] element 0: offset: 0x61fad0, size: 24 [D 20:41:44.683463] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 46/70. [D 20:41:44.685596] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.685611] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.685621] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:44.692560] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.692574] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.692584] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:44.692717] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 825 [D 20:41:44.692731] element 0: offset: 0x61f310, size: 24 [D 20:41:44.692741] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 47/70. [D 20:41:44.695107] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 825 [D 20:41:44.695125] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 48/70. [D 20:41:44.710432] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:44.710447] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.710456] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:44.710553] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 828 [D 20:41:44.710563] element 0: offset: 0x643500, size: 24 [D 20:41:44.710573] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 49/70. [D 20:41:44.712977] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 828 [D 20:41:44.712993] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 50/70. [D 20:41:44.713008] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 825 [D 20:41:44.713017] element 0: offset: 0x61f310, size: 24 [D 20:41:44.713046] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 51/70. [D 20:41:44.713140] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.713153] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.713162] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:44.739287] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 828 [D 20:41:44.739349] element 0: offset: 0x643500, size: 24 [D 20:41:44.739366] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 52/70. [D 20:41:44.741667] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:44.741681] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:44.741692] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.246040] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.246106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.246116] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.246204] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 831 [D 20:41:45.246218] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.246232] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 53/70. [D 20:41:45.248737] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 831 [D 20:41:45.248756] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 54/70. [D 20:41:45.264846] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 831 [D 20:41:45.264876] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.264887] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 55/70. [D 20:41:45.267263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.267278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.267288] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.274161] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.274175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.274185] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.274300] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 834 [D 20:41:45.274317] element 0: offset: 0x66db70, size: 24 [D 20:41:45.274328] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 56/70. [D 20:41:45.274390] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 834 [D 20:41:45.274446] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 57/70. [D 20:41:45.293577] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 834 [D 20:41:45.293640] element 0: offset: 0x66db70, size: 24 [D 20:41:45.293655] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 58/70. [D 20:41:45.295899] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.295914] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.295924] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.304725] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.304752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.304762] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.306853] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 837 [D 20:41:45.306867] element 0: offset: 0x61f800, size: 24 [D 20:41:45.306879] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 59/70. [D 20:41:45.306950] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 837 [D 20:41:45.306999] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 60/70. [D 20:41:45.323376] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 837 [D 20:41:45.323393] element 0: offset: 0x61f800, size: 24 [D 20:41:45.323403] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 0/70. [D 20:41:45.325715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.325728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.325739] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.335954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.335968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.335979] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.336062] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 840 [D 20:41:45.336080] element 0: offset: 0x61fad0, size: 24 [D 20:41:45.336090] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 1/70. [D 20:41:45.336140] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 840 [D 20:41:45.336204] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 2/70. [D 20:41:45.352878] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 840 [D 20:41:45.352940] element 0: offset: 0x61fad0, size: 24 [D 20:41:45.352954] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 3/70. [D 20:41:45.355134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.355149] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.355159] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.365293] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.365308] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.365319] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.365402] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 843 [D 20:41:45.365415] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.365426] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 4/70. [D 20:41:45.365493] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 843 [D 20:41:45.365539] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 5/70. [D 20:41:45.380683] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 843 [D 20:41:45.380699] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.380709] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 6/70. [D 20:41:45.382987] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.383001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.383011] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.390087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.390102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.390110] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.392144] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 846 [D 20:41:45.392158] element 0: offset: 0x657310, size: 24 [D 20:41:45.392168] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 7/70. [D 20:41:45.392225] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 846 [D 20:41:45.392284] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 8/70. [D 20:41:45.411546] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 846 [D 20:41:45.411615] element 0: offset: 0x657310, size: 24 [D 20:41:45.411630] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 9/70. [D 20:41:45.412739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.412753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.412764] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.419984] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.419999] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.420009] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.420089] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 849 [D 20:41:45.420102] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.420112] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 10/70. [D 20:41:45.420179] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 849 [D 20:41:45.420222] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 11/70. [D 20:41:45.435722] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 849 [D 20:41:45.435737] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.435747] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 12/70. [D 20:41:45.439536] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.439550] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.439560] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:45.439575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.439585] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.439594] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:45.439711] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 851 [D 20:41:45.439725] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.439748] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 13/70. [D 20:41:45.439801] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 851 [D 20:41:45.443693] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 14/70. [D 20:41:45.460379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.460394] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.460404] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.463486] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 855 [D 20:41:45.463547] element 0: offset: 0x66db70, size: 24 [D 20:41:45.463561] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 15/70. [D 20:41:45.463589] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 851 [D 20:41:45.463599] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.463610] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 16/70. [D 20:41:45.465905] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 855 [D 20:41:45.465922] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 17/70. [D 20:41:45.465951] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.465962] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.465971] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.483608] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.483641] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.483651] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.483685] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.483695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.483703] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.484198] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 855 [D 20:41:45.484210] element 0: offset: 0x66db70, size: 24 [D 20:41:45.484228] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 18/70. [D 20:41:45.484244] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 857 [D 20:41:45.484253] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.484267] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 19/70. [D 20:41:45.484280] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 861 [D 20:41:45.484290] element 0: offset: 0x61f800, size: 24 [D 20:41:45.484299] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 20/70. [D 20:41:45.486668] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.486683] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.486693] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.486725] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 857 [D 20:41:45.486751] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 861 [D 20:41:45.487593] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 21/70. [D 20:41:45.487638] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 22/70. [D 20:41:45.519731] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.519749] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.519758] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.520463] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 864 [D 20:41:45.520478] element 0: offset: 0x629e10, size: 24 [D 20:41:45.520491] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 23/70. [D 20:41:45.520758] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 864 [D 20:41:45.524767] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 24/70. [D 20:41:45.524858] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 857 [D 20:41:45.524872] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.524885] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 25/70. [D 20:41:45.527145] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.527160] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.527170] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.527543] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 861 [D 20:41:45.527557] element 0: offset: 0x61f800, size: 24 [D 20:41:45.527570] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 26/70. [D 20:41:45.529939] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.529952] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.529963] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.539730] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.539745] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.539754] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.539788] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.539797] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.539806] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.540424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 864 [D 20:41:45.540436] element 0: offset: 0x629e10, size: 24 [D 20:41:45.540457] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 27/70. [D 20:41:45.540472] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 866 [D 20:41:45.540482] element 0: offset: 0x66db70, size: 24 [D 20:41:45.540492] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 28/70. [D 20:41:45.540504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 870 [D 20:41:45.540514] element 0: offset: 0x61f310, size: 24 [D 20:41:45.540523] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 29/70. [D 20:41:45.542883] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.542897] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.542908] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.542943] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 866 [D 20:41:45.542968] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 870 [D 20:41:45.544699] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 30/70. [D 20:41:45.544765] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 31/70. [D 20:41:45.571790] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.571805] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.571814] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.572445] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 873 [D 20:41:45.572460] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.572471] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 32/70. [D 20:41:45.572489] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 866 [D 20:41:45.572503] element 0: offset: 0x66db70, size: 24 [D 20:41:45.572518] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 33/70. [D 20:41:45.577034] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 873 [D 20:41:45.577098] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 34/70. [D 20:41:45.577136] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.577147] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.577158] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.577180] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 870 [D 20:41:45.577198] element 0: offset: 0x61f310, size: 24 [D 20:41:45.577210] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 35/70. [D 20:41:45.579480] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.579494] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.579504] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.592155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.592169] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.592178] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.592208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.592218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.592226] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.592907] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 873 [D 20:41:45.592919] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.592929] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 36/70. [D 20:41:45.592945] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 875 [D 20:41:45.592960] element 0: offset: 0x629e10, size: 24 [D 20:41:45.592970] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 37/70. [D 20:41:45.592986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 879 [D 20:41:45.592995] element 0: offset: 0x657310, size: 24 [D 20:41:45.593008] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 38/70. [D 20:41:45.595620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.595634] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.595644] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.595666] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 875 [D 20:41:45.595678] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 39/70. [D 20:41:45.595702] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 879 [D 20:41:45.595714] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 40/70. [D 20:41:45.623471] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.623485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.623494] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.624319] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 882 [D 20:41:45.624336] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.624347] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 41/70. [D 20:41:45.624365] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 875 [D 20:41:45.624375] element 0: offset: 0x629e10, size: 24 [D 20:41:45.624392] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 42/70. [D 20:41:45.626734] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 882 [D 20:41:45.626750] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 43/70. [D 20:41:45.626772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.626783] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.626793] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.631258] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 879 [D 20:41:45.631312] element 0: offset: 0x657310, size: 24 [D 20:41:45.631328] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 44/70. [D 20:41:45.631435] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.631475] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.631485] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.641379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.641394] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.641402] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.641435] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.641445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.641454] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.641545] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 884 [D 20:41:45.641557] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.641575] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 45/70. [D 20:41:45.641588] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 888 [D 20:41:45.641597] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.641607] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 46/70. [D 20:41:45.641682] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 884 [D 20:41:45.641734] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 47/70. [D 20:41:45.644066] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 888 [D 20:41:45.644081] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 48/70. [D 20:41:45.644096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 882 [D 20:41:45.644105] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.644116] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 49/70. [D 20:41:45.644184] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.644197] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.644206] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.669439] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.669454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.669463] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.669573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 891 [D 20:41:45.669585] element 0: offset: 0x629e10, size: 24 [D 20:41:45.669594] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 50/70. [D 20:41:45.671948] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 891 [D 20:41:45.671964] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 51/70. [D 20:41:45.671979] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 884 [D 20:41:45.671988] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.671998] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 52/70. [D 20:41:45.676895] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 888 [D 20:41:45.676948] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.676963] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 53/70. [D 20:41:45.676997] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.677010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.677020] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.679251] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.679265] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.679275] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.688920] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.688935] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.688951] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.689065] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 893 [D 20:41:45.689079] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.689088] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 54/70. [D 20:41:45.689129] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.689139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.689147] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.691632] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 893 [D 20:41:45.691650] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 55/70. [D 20:41:45.691665] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 897 [D 20:41:45.691674] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.691684] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 56/70. [D 20:41:45.691698] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 891 [D 20:41:45.691707] element 0: offset: 0x629e10, size: 24 [D 20:41:45.691724] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 57/70. [D 20:41:45.691783] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 897 [D 20:41:45.692754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.692768] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.692777] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.705906] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 58/70. [D 20:41:45.708974] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.708990] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.709002] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.709060] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 900 [D 20:41:45.709072] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.709083] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 59/70. [D 20:41:45.714443] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 893 [D 20:41:45.714502] element 0: offset: 0x61ee50, size: 24 [D 20:41:45.714517] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 60/70. [D 20:41:45.714567] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 900 [D 20:41:45.716912] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.716927] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.716938] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.718403] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 0/70. [D 20:41:45.721554] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 897 [D 20:41:45.721569] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.721579] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 1/70. [D 20:41:45.724008] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.724022] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.724038] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.732748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.732763] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.732774] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.732805] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.732815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.732823] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.733016] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 902 [D 20:41:45.733030] element 0: offset: 0x61f310, size: 24 [D 20:41:45.733040] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 2/70. [D 20:41:45.733053] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 906 [D 20:41:45.733063] element 0: offset: 0x629e10, size: 24 [D 20:41:45.733076] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 3/70. [D 20:41:45.738414] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 900 [D 20:41:45.738462] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.738476] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 4/70. [D 20:41:45.738530] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 902 [D 20:41:45.738547] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 5/70. [D 20:41:45.738574] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 906 [D 20:41:45.738587] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 6/70. [D 20:41:45.740904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.740919] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.740929] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.767886] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.767901] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.767910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.768040] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 909 [D 20:41:45.768052] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.768061] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 7/70. [D 20:41:45.770524] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 909 [D 20:41:45.770541] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 8/70. [D 20:41:45.770556] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 902 [D 20:41:45.770565] element 0: offset: 0x61f310, size: 24 [D 20:41:45.772820] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 9/70. [D 20:41:45.775105] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.775120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.775129] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.775647] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 906 [D 20:41:45.775662] element 0: offset: 0x629e10, size: 24 [D 20:41:45.775675] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 10/70. [D 20:41:45.776747] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.776761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.776772] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.784120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.784134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.784143] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.784177] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.784187] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.784195] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.784271] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 911 [D 20:41:45.784282] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.784291] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 11/70. [D 20:41:45.784304] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 915 [D 20:41:45.784313] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.784323] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 12/70. [D 20:41:45.784409] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 911 [D 20:41:45.784447] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 13/70. [D 20:41:45.787537] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 915 [D 20:41:45.787554] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 14/70. [D 20:41:45.787570] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 909 [D 20:41:45.787579] element 0: offset: 0x691fe0, size: 24 [D 20:41:45.787589] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 15/70. [D 20:41:45.789998] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.790012] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.790022] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.814767] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.814784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.814793] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:45.814918] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 918 [D 20:41:45.814930] element 0: offset: 0x61f310, size: 24 [D 20:41:45.814940] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 16/70. [D 20:41:45.815208] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 911 [D 20:41:45.815222] element 0: offset: 0x6151c0, size: 24 [D 20:41:45.815250] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 17/70. [D 20:41:45.820406] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 915 [D 20:41:45.820462] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.820476] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 18/70. [D 20:41:45.820529] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 918 [D 20:41:45.820546] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 19/70. [D 20:41:45.820576] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.820587] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.820596] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:45.822822] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.822837] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.822846] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.832586] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.832600] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.832609] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.832734] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 921 [D 20:41:45.832748] element 0: offset: 0x633550, size: 24 [D 20:41:45.832758] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 20/70. [D 20:41:45.832854] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 921 [D 20:41:45.832950] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 918 [D 20:41:45.832963] element 0: offset: 0x61f310, size: 24 [D 20:41:45.832976] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 21/70. [D 20:41:45.832996] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 22/70. [D 20:41:45.833099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.833112] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.833135] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.847685] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:45.847699] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.847711] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:45.850538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 924 [D 20:41:45.850597] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.850612] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 23/70. [D 20:41:45.850636] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 921 [D 20:41:45.850646] element 0: offset: 0x633550, size: 24 [D 20:41:45.850656] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 24/70. [D 20:41:45.852787] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 924 [D 20:41:45.852994] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 25/70. [D 20:41:45.853026] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.853039] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.853048] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:45.868826] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 924 [D 20:41:45.868841] element 0: offset: 0x5b0030, size: 24 [D 20:41:45.868852] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 26/70. [D 20:41:45.871134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:45.871147] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:45.871157] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.170151] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.170215] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.170225] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.170368] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 927 [D 20:41:46.170383] element 0: offset: 0x629e10, size: 24 [D 20:41:46.170397] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 27/70. [D 20:41:46.172852] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 927 [D 20:41:46.172870] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 28/70. [D 20:41:46.189465] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 927 [D 20:41:46.189530] element 0: offset: 0x629e10, size: 24 [D 20:41:46.189544] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 29/70. [D 20:41:46.191912] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.191927] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.191938] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.204080] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.204095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.204106] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.204190] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 930 [D 20:41:46.204203] element 0: offset: 0x691fe0, size: 24 [D 20:41:46.204214] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 30/70. [D 20:41:46.204281] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 930 [D 20:41:46.204350] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 31/70. [D 20:41:46.219924] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 930 [D 20:41:46.219946] element 0: offset: 0x691fe0, size: 24 [D 20:41:46.219957] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 32/70. [D 20:41:46.220785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.220799] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.220810] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.233745] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.233760] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.233770] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.233866] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 933 [D 20:41:46.233878] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.233887] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 33/70. [D 20:41:46.233942] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 933 [D 20:41:46.233997] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 34/70. [D 20:41:46.250503] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 933 [D 20:41:46.250567] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.250582] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 35/70. [D 20:41:46.252821] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.252836] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.252847] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.263341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.263355] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.263367] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.263449] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 936 [D 20:41:46.263462] element 0: offset: 0x633550, size: 24 [D 20:41:46.263473] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 36/70. [D 20:41:46.263553] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 936 [D 20:41:46.263584] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 37/70. [D 20:41:46.280676] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 936 [D 20:41:46.280713] element 0: offset: 0x633550, size: 24 [D 20:41:46.280725] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 38/70. [D 20:41:46.280788] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.280800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.280808] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.292467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.292482] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.292493] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.292611] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 939 [D 20:41:46.292625] element 0: offset: 0x61f310, size: 24 [D 20:41:46.292635] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 39/70. [D 20:41:46.295096] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 939 [D 20:41:46.295113] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 40/70. [D 20:41:46.311875] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 939 [D 20:41:46.311936] element 0: offset: 0x61f310, size: 24 [D 20:41:46.311951] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 41/70. [D 20:41:46.312805] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.312820] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.312831] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.320412] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.320426] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.320436] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.320516] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 942 [D 20:41:46.320529] element 0: offset: 0x657310, size: 24 [D 20:41:46.320540] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 42/70. [D 20:41:46.322946] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 942 [D 20:41:46.322964] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 43/70. [D 20:41:46.337899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 942 [D 20:41:46.337915] element 0: offset: 0x657310, size: 24 [D 20:41:46.337926] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 44/70. [D 20:41:46.340079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.340092] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.340103] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.344787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.344801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.344812] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.346430] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 945 [D 20:41:46.346443] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.346454] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 45/70. [D 20:41:46.346506] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 945 [D 20:41:46.346558] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 46/70. [D 20:41:46.364148] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 945 [D 20:41:46.364212] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.364227] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 47/70. [D 20:41:46.366422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.366436] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.366446] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.372796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.372811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.372823] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.373581] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 948 [D 20:41:46.373595] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.373606] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 48/70. [D 20:41:46.373671] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 948 [D 20:41:46.373713] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 49/70. [D 20:41:46.388272] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 948 [D 20:41:46.388304] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.388317] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 50/70. [D 20:41:46.390712] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.390727] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.390738] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.510461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.510515] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.510525] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.510654] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 951 [D 20:41:46.510669] element 0: offset: 0x6151c0, size: 24 [D 20:41:46.510683] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 51/70. [D 20:41:46.512825] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 951 [D 20:41:46.512843] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 52/70. [D 20:41:46.527826] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.527841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.527852] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.530733] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 953 [D 20:41:46.530792] element 0: offset: 0x61f310, size: 24 [D 20:41:46.530806] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 53/70. [D 20:41:46.530830] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 951 [D 20:41:46.530840] element 0: offset: 0x6151c0, size: 24 [D 20:41:46.530850] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 54/70. [D 20:41:46.533156] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 953 [D 20:41:46.533174] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 55/70. [D 20:41:46.533231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.533244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.533258] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.548146] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.548161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.548170] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.548659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 953 [D 20:41:46.548671] element 0: offset: 0x61f310, size: 24 [D 20:41:46.548687] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 56/70. [D 20:41:46.548700] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 957 [D 20:41:46.548709] element 0: offset: 0x657310, size: 24 [D 20:41:46.548722] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 57/70. [D 20:41:46.551227] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.551241] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.551251] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.551274] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 957 [D 20:41:46.551286] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 58/70. [D 20:41:46.567599] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.567613] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.567624] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.570427] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 959 [D 20:41:46.570486] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.570501] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 59/70. [D 20:41:46.570524] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 957 [D 20:41:46.570534] element 0: offset: 0x657310, size: 24 [D 20:41:46.570543] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 60/70. [D 20:41:46.572873] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 959 [D 20:41:46.572892] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 0/70. [D 20:41:46.572920] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.572931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.572940] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.584809] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.584823] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.584832] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.586388] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 963 [D 20:41:46.586401] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.586412] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 1/70. [D 20:41:46.586428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 959 [D 20:41:46.586443] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.586453] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 2/70. [D 20:41:46.588759] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 963 [D 20:41:46.588774] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 3/70. [D 20:41:46.588791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.588804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.588813] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.602377] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.602391] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.602403] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.602422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.602432] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.602441] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.602463] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 967 [D 20:41:46.602474] element 0: offset: 0x61f800, size: 24 [D 20:41:46.602483] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 4/70. [D 20:41:46.607620] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 968 [D 20:41:46.607669] element 0: offset: 0x63dae0, size: 24 [D 20:41:46.607683] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 5/70. [D 20:41:46.607704] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 963 [D 20:41:46.607715] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.607724] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 6/70. [D 20:41:46.607770] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 967 [D 20:41:46.607785] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 7/70. [D 20:41:46.610076] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 968 [D 20:41:46.610092] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 8/70. [D 20:41:46.610120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.610133] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.610144] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.637936] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.637951] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.637960] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.638769] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 972 [D 20:41:46.638794] element 0: offset: 0x61f310, size: 24 [D 20:41:46.638804] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 9/70. [D 20:41:46.640827] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 972 [D 20:41:46.643375] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 10/70. [D 20:41:46.643452] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 967 [D 20:41:46.643467] element 0: offset: 0x61f800, size: 24 [D 20:41:46.643479] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 11/70. [D 20:41:46.643501] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 968 [D 20:41:46.643512] element 0: offset: 0x63dae0, size: 24 [D 20:41:46.643522] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 12/70. [D 20:41:46.645807] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.645822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.645832] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.645849] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.645861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.645869] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.656211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.656226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.656234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.656266] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.656276] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.656284] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.656362] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 974 [D 20:41:46.656373] element 0: offset: 0x657310, size: 24 [D 20:41:46.656382] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 13/70. [D 20:41:46.656395] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 978 [D 20:41:46.656404] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.656413] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 14/70. [D 20:41:46.659027] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 974 [D 20:41:46.659043] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 15/70. [D 20:41:46.659068] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 978 [D 20:41:46.659080] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 16/70. [D 20:41:46.659094] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 972 [D 20:41:46.659125] element 0: offset: 0x61f310, size: 24 [D 20:41:46.659137] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 17/70. [D 20:41:46.659214] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.659228] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.659237] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.687825] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.687839] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.687848] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.687960] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 981 [D 20:41:46.687971] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.687981] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 18/70. [D 20:41:46.688826] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 981 [D 20:41:46.688845] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 19/70. [D 20:41:46.688859] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 974 [D 20:41:46.688869] element 0: offset: 0x657310, size: 24 [D 20:41:46.688879] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 20/70. [D 20:41:46.691137] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.691151] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.691160] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.694143] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 978 [D 20:41:46.694195] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.694211] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 21/70. [D 20:41:46.696486] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.696501] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.696511] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.702711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.702725] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.702733] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.702766] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.702776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.702785] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.702866] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 983 [D 20:41:46.702876] element 0: offset: 0x61f800, size: 24 [D 20:41:46.702885] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 22/70. [D 20:41:46.702898] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 987 [D 20:41:46.702907] element 0: offset: 0x66e860, size: 24 [D 20:41:46.702916] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 23/70. [D 20:41:46.705514] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 983 [D 20:41:46.705532] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 24/70. [D 20:41:46.705557] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 987 [D 20:41:46.705569] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 25/70. [D 20:41:46.705583] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 981 [D 20:41:46.705593] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.705603] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 26/70. [D 20:41:46.705692] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.705705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.705726] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.734729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.734744] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.734753] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.734873] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 990 [D 20:41:46.734885] element 0: offset: 0x61fad0, size: 24 [D 20:41:46.734895] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 27/70. [D 20:41:46.735628] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 983 [D 20:41:46.735646] element 0: offset: 0x61f800, size: 24 [D 20:41:46.735662] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 28/70. [D 20:41:46.739097] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 990 [D 20:41:46.739138] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 29/70. [D 20:41:46.739178] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.739190] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.739207] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.740839] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 987 [D 20:41:46.740872] element 0: offset: 0x66e860, size: 24 [D 20:41:46.742784] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 30/70. [D 20:41:46.742885] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.742898] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.742912] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.753894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.753928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.753937] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.753971] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.753981] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.753989] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.754064] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 992 [D 20:41:46.754075] element 0: offset: 0x657310, size: 24 [D 20:41:46.754086] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 31/70. [D 20:41:46.754100] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 996 [D 20:41:46.754109] element 0: offset: 0x629ed0, size: 24 [D 20:41:46.754123] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 32/70. [D 20:41:46.756824] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 992 [D 20:41:46.756843] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 33/70. [D 20:41:46.756869] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 996 [D 20:41:46.756881] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 34/70. [D 20:41:46.756896] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 990 [D 20:41:46.756906] element 0: offset: 0x61fad0, size: 24 [D 20:41:46.756919] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 35/70. [D 20:41:46.757016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.757048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.757058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.785557] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.785576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.785585] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.785709] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 999 [D 20:41:46.785721] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.785731] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 36/70. [D 20:41:46.787287] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 992 [D 20:41:46.787377] element 0: offset: 0x657310, size: 24 [D 20:41:46.787392] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 37/70. [D 20:41:46.791163] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 996 [D 20:41:46.791219] element 0: offset: 0x629ed0, size: 24 [D 20:41:46.791233] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 38/70. [D 20:41:46.791286] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 999 [D 20:41:46.791303] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 39/70. [D 20:41:46.791333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.791344] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.791353] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.793702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.793715] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.793726] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.806076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.806091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.806100] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:46.806133] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.806143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.806151] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.806220] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1001 [D 20:41:46.806231] element 0: offset: 0x61f800, size: 24 [D 20:41:46.806240] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 40/70. [D 20:41:46.806253] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1005 [D 20:41:46.806263] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.806276] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 41/70. [D 20:41:46.809001] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1001 [D 20:41:46.809017] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 42/70. [D 20:41:46.809041] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1005 [D 20:41:46.809058] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 43/70. [D 20:41:46.809071] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 999 [D 20:41:46.809082] element 0: offset: 0x63e0a0, size: 24 [D 20:41:46.809095] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 44/70. [D 20:41:46.809193] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.809206] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.809216] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.836302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.836317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.836326] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.836455] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1008 [D 20:41:46.836466] element 0: offset: 0x629ed0, size: 24 [D 20:41:46.836476] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 45/70. [D 20:41:46.837539] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1001 [D 20:41:46.837569] element 0: offset: 0x61f800, size: 24 [D 20:41:46.837585] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 46/70. [D 20:41:46.845041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1005 [D 20:41:46.845100] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.845114] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 47/70. [D 20:41:46.845163] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1008 [D 20:41:46.845179] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 48/70. [D 20:41:46.845262] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.845276] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.845286] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.845318] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.845329] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.845357] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.845484] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.845495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.845504] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.845522] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1010 [D 20:41:46.845531] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.845544] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 49/70. [D 20:41:46.845677] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1010 [D 20:41:46.859648] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 50/70. [D 20:41:46.859713] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.859728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.859737] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:46.859788] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1014 [D 20:41:46.859799] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.859809] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 51/70. [D 20:41:46.859891] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1014 [D 20:41:46.863396] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1008 [D 20:41:46.863433] element 0: offset: 0x629ed0, size: 24 [D 20:41:46.863446] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 52/70. [D 20:41:46.865787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.865805] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.865816] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:46.872066] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 53/70. [D 20:41:46.877334] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1010 [D 20:41:46.877391] element 0: offset: 0x5b0030, size: 24 [D 20:41:46.877407] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 54/70. [D 20:41:46.879811] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.879826] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.879836] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:46.884382] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1014 [D 20:41:46.884397] element 0: offset: 0x61ee50, size: 24 [D 20:41:46.884408] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 55/70. [D 20:41:46.886686] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.886700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.886710] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.912107] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.912121] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.912133] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.912252] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1017 [D 20:41:46.912271] element 0: offset: 0x61f800, size: 24 [D 20:41:46.912281] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 56/70. [D 20:41:46.914702] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1017 [D 20:41:46.914720] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 57/70. [D 20:41:46.931102] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1017 [D 20:41:46.931167] element 0: offset: 0x61f800, size: 24 [D 20:41:46.931182] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 58/70. [D 20:41:46.933406] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.933421] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.933433] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:46.939234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:46.939260] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.939270] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:46.939353] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1020 [D 20:41:46.939366] element 0: offset: 0x657310, size: 24 [D 20:41:46.939379] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 59/70. [D 20:41:46.939519] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1020 [D 20:41:46.939550] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 60/70. [D 20:41:46.955460] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1020 [D 20:41:46.955480] element 0: offset: 0x657310, size: 24 [D 20:41:46.955491] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 0/70. [D 20:41:46.956847] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:46.956861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:46.956871] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.282253] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.282319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.282329] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.282495] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1023 [D 20:41:47.282511] element 0: offset: 0x63e0a0, size: 24 [D 20:41:47.282525] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 1/70. [D 20:41:47.285029] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1023 [D 20:41:47.285048] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 2/70. [D 20:41:47.301446] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1023 [D 20:41:47.301507] element 0: offset: 0x63e0a0, size: 24 [D 20:41:47.301521] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 3/70. [D 20:41:47.303695] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.303711] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.303721] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.312873] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.312888] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.312898] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.314599] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1026 [D 20:41:47.314612] element 0: offset: 0x61fad0, size: 24 [D 20:41:47.314623] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 4/70. [D 20:41:47.314737] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1026 [D 20:41:47.314772] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 5/70. [D 20:41:47.331041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1026 [D 20:41:47.331059] element 0: offset: 0x61fad0, size: 24 [D 20:41:47.331069] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 6/70. [D 20:41:47.333267] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.333280] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.333291] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.339922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.339936] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.339947] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.340029] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1029 [D 20:41:47.340046] element 0: offset: 0x61f800, size: 24 [D 20:41:47.340055] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 7/70. [D 20:41:47.340156] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1029 [D 20:41:47.340218] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 8/70. [D 20:41:47.357364] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1029 [D 20:41:47.357426] element 0: offset: 0x61f800, size: 24 [D 20:41:47.357441] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 9/70. [D 20:41:47.359618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.359632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.359642] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.365904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.365918] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.365929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.366010] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1032 [D 20:41:47.366022] element 0: offset: 0x657310, size: 24 [D 20:41:47.366033] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 10/70. [D 20:41:47.366140] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1032 [D 20:41:47.366204] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 11/70. [D 20:41:47.382373] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1032 [D 20:41:47.382389] element 0: offset: 0x657310, size: 24 [D 20:41:47.382400] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 12/70. [D 20:41:47.384624] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.384638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.384648] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.388872] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.388886] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.388898] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.390776] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1035 [D 20:41:47.390790] element 0: offset: 0x63e0a0, size: 24 [D 20:41:47.390801] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 13/70. [D 20:41:47.390899] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1035 [D 20:41:47.390960] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 14/70. [D 20:41:47.409587] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1035 [D 20:41:47.409651] element 0: offset: 0x63e0a0, size: 24 [D 20:41:47.409667] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 15/70. [D 20:41:47.411974] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.411989] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.411999] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.417916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.417929] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.417940] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.418021] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1038 [D 20:41:47.418034] element 0: offset: 0x61fad0, size: 24 [D 20:41:47.418044] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 16/70. [D 20:41:47.418155] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1038 [D 20:41:47.418203] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 17/70. [D 20:41:47.434484] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1038 [D 20:41:47.434500] element 0: offset: 0x61fad0, size: 24 [D 20:41:47.434510] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 18/70. [D 20:41:47.436681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.436695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.436705] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.442529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.442542] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.442553] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.442637] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1041 [D 20:41:47.442656] element 0: offset: 0x61f800, size: 24 [D 20:41:47.442665] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 19/70. [D 20:41:47.442759] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1041 [D 20:41:47.442829] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 20/70. [D 20:41:47.463508] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1041 [D 20:41:47.463579] element 0: offset: 0x61f800, size: 24 [D 20:41:47.463594] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 21/70. [D 20:41:47.465855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.465870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.465881] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.471556] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.471571] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.471582] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.471663] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1044 [D 20:41:47.471676] element 0: offset: 0x657310, size: 24 [D 20:41:47.471686] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 22/70. [D 20:41:47.471802] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1044 [D 20:41:47.471850] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 23/70. [D 20:41:47.488041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1044 [D 20:41:47.488060] element 0: offset: 0x657310, size: 24 [D 20:41:47.488071] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 24/70. [D 20:41:47.490365] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.490379] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.490390] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.562046] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.562064] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.562075] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.562202] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1046 [D 20:41:47.562215] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.562227] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 25/70. [D 20:41:47.564671] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1046 [D 20:41:47.564688] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 26/70. [D 20:41:47.582002] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1046 [D 20:41:47.582065] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.582080] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 27/70. [D 20:41:47.582156] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.582170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.582180] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.590422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.590437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.590448] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.590484] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.590494] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.590502] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:47.590544] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1050 [D 20:41:47.590557] element 0: offset: 0x5b0030, size: 24 [D 20:41:47.590566] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 28/70. [D 20:41:47.590585] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1052 [D 20:41:47.590595] element 0: offset: 0x61f800, size: 24 [D 20:41:47.592925] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 29/70. [D 20:41:47.592968] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1050 [D 20:41:47.592982] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 30/70. [D 20:41:47.595369] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1052 [D 20:41:47.595385] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 31/70. [D 20:41:47.623319] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1050 [D 20:41:47.623363] element 0: offset: 0x5b0030, size: 24 [D 20:41:47.623375] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 32/70. [D 20:41:47.625571] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.625585] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.625596] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:47.627595] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1052 [D 20:41:47.627644] element 0: offset: 0x61f800, size: 24 [D 20:41:47.627659] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 33/70. [D 20:41:47.629838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.629853] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.629863] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.643607] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.643622] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.643633] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.643669] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.643679] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.643687] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:47.643760] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1057 [D 20:41:47.643773] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.643782] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 34/70. [D 20:41:47.643800] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1058 [D 20:41:47.646226] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.646240] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 35/70. [D 20:41:47.646281] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1057 [D 20:41:47.646295] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 36/70. [D 20:41:47.648687] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1058 [D 20:41:47.648702] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 37/70. [D 20:41:47.676254] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1057 [D 20:41:47.676290] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.676302] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 38/70. [D 20:41:47.678453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.678467] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.678478] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:47.680544] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1058 [D 20:41:47.680596] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.680611] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 39/70. [D 20:41:47.682789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.682803] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.682814] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.688904] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.688919] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.688929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.688965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.688975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.688984] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:47.689584] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1062 [D 20:41:47.689598] element 0: offset: 0x5b0030, size: 24 [D 20:41:47.689609] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 40/70. [D 20:41:47.689622] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1064 [D 20:41:47.689635] element 0: offset: 0x657310, size: 24 [D 20:41:47.689645] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 41/70. [D 20:41:47.689721] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1062 [D 20:41:47.689780] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 42/70. [D 20:41:47.692187] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1064 [D 20:41:47.692202] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 43/70. [D 20:41:47.719543] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1062 [D 20:41:47.719581] element 0: offset: 0x5b0030, size: 24 [D 20:41:47.719593] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 44/70. [D 20:41:47.721798] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.721812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.721824] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:47.723898] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1064 [D 20:41:47.723945] element 0: offset: 0x657310, size: 24 [D 20:41:47.723959] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 45/70. [D 20:41:47.724916] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.724930] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.724941] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:47.731153] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.731167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.731178] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:47.731270] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.731281] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.731290] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:47.731323] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1068 [D 20:41:47.731333] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.731343] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 46/70. [D 20:41:47.731361] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1071 [D 20:41:47.731373] element 0: offset: 0x61f800, size: 24 [D 20:41:47.731382] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 47/70. [D 20:41:47.733819] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1068 [D 20:41:47.733836] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 48/70. [D 20:41:47.733865] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1071 [D 20:41:47.733878] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 49/70. [D 20:41:47.764371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.764386] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.764394] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.764513] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1073 [D 20:41:47.764525] element 0: offset: 0x691fe0, size: 24 [D 20:41:47.764534] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 50/70. [D 20:41:47.766880] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1073 [D 20:41:47.766896] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 51/70. [D 20:41:47.766910] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1068 [D 20:41:47.766920] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.766929] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 52/70. [D 20:41:47.771152] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.771203] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.771213] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.780936] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.780987] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.780997] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.781091] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1077 [D 20:41:47.781105] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.781126] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 53/70. [D 20:41:47.783452] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1077 [D 20:41:47.783470] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 54/70. [D 20:41:47.815127] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1071 [D 20:41:47.815192] element 0: offset: 0x61f800, size: 24 [D 20:41:47.815207] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 55/70. [D 20:41:47.816927] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.816942] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.816953] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.823773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.823788] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.823798] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.823931] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1080 [D 20:41:47.823942] element 0: offset: 0x61f310, size: 24 [D 20:41:47.823951] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 56/70. [D 20:41:47.826305] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1080 [D 20:41:47.826323] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 57/70. [D 20:41:47.845001] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1080 [D 20:41:47.845065] element 0: offset: 0x61f310, size: 24 [D 20:41:47.845081] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 58/70. [D 20:41:47.847197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.847211] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.847221] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.852921] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.852935] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.852945] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.854873] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1083 [D 20:41:47.854888] element 0: offset: 0x657310, size: 24 [D 20:41:47.854899] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 59/70. [D 20:41:47.854966] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1083 [D 20:41:47.855005] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 60/70. [D 20:41:47.872714] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1083 [D 20:41:47.872773] element 0: offset: 0x657310, size: 24 [D 20:41:47.872788] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 0/70. [D 20:41:47.874914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.874928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.874939] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.881701] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.881715] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.881726] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.881805] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1086 [D 20:41:47.881818] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.881829] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 1/70. [D 20:41:47.881938] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1086 [D 20:41:47.881983] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 2/70. [D 20:41:47.900575] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1086 [D 20:41:47.900640] element 0: offset: 0x629ed0, size: 24 [D 20:41:47.900655] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 3/70. [D 20:41:47.903008] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.903023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.903035] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.908789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.908804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.908814] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.908937] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1089 [D 20:41:47.908966] element 0: offset: 0x61f800, size: 24 [D 20:41:47.908977] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 4/70. [D 20:41:47.911473] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1089 [D 20:41:47.911491] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 5/70. [D 20:41:47.927835] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1089 [D 20:41:47.927899] element 0: offset: 0x61f800, size: 24 [D 20:41:47.927914] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 6/70. [D 20:41:47.930216] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.930231] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.930242] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.936082] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.936095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.936106] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.936186] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1092 [D 20:41:47.936199] element 0: offset: 0x61f310, size: 24 [D 20:41:47.936209] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 7/70. [D 20:41:47.936319] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1092 [D 20:41:47.936370] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 8/70. [D 20:41:47.951936] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1073 [D 20:41:47.951998] element 0: offset: 0x691fe0, size: 24 [D 20:41:47.952013] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 9/70. [D 20:41:47.954263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.954278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.954289] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.960620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.960676] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.960686] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.960938] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1094 [D 20:41:47.960954] element 0: offset: 0x63e0d0, size: 24 [D 20:41:47.960969] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 10/70. [D 20:41:47.963555] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1094 [D 20:41:47.963573] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 11/70. [D 20:41:47.978302] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1094 [D 20:41:47.978353] element 0: offset: 0x63e0d0, size: 24 [D 20:41:47.978367] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 12/70. [D 20:41:47.978433] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.978445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.978454] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.986309] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:47.986373] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.986383] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:47.986543] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1077 [D 20:41:47.986558] element 0: offset: 0x61ee50, size: 24 [D 20:41:47.986572] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 13/70. [D 20:41:47.986593] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1097 [D 20:41:47.986604] element 0: offset: 0x63e0d0, size: 24 [D 20:41:47.986613] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 14/70. [D 20:41:47.989051] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:47.989065] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:47.989075] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:47.989115] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1097 [D 20:41:47.992104] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 15/70. [D 20:41:48.008119] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.008135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.008143] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:48.008250] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1101 [D 20:41:48.008261] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.008270] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 16/70. [D 20:41:48.008326] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1101 [D 20:41:48.008369] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 17/70. [D 20:41:48.010631] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1097 [D 20:41:48.010646] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.010657] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 18/70. [D 20:41:48.010747] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.010760] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.010770] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:48.020137] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.020152] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.020160] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:48.020265] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1103 [D 20:41:48.020275] element 0: offset: 0x61ee50, size: 24 [D 20:41:48.020284] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 19/70. [D 20:41:48.022702] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1103 [D 20:41:48.022717] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 20/70. [D 20:41:48.022731] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1101 [D 20:41:48.022741] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.022773] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 21/70. [D 20:41:48.022852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.022881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.022900] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:48.035978] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.035992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.036004] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:48.036063] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1107 [D 20:41:48.036077] element 0: offset: 0x6151c0, size: 24 [D 20:41:48.036087] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 22/70. [D 20:41:48.036176] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1107 [D 20:41:48.036229] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 23/70. [D 20:41:48.200864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.200878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.200890] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:48.200955] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1110 [D 20:41:48.200967] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.200976] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 24/70. [D 20:41:48.201044] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1110 [D 20:41:48.201080] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 25/70. [D 20:41:48.249504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1092 [D 20:41:48.249566] element 0: offset: 0x61f310, size: 24 [D 20:41:48.249581] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 26/70. [D 20:41:48.252179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.252195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.252204] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:48.257720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.257735] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.257746] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:48.257966] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1113 [D 20:41:48.257980] element 0: offset: 0x657310, size: 24 [D 20:41:48.257992] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 27/70. [D 20:41:48.260483] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1113 [D 20:41:48.260501] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 28/70. [D 20:41:48.277165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1113 [D 20:41:48.277230] element 0: offset: 0x657310, size: 24 [D 20:41:48.277245] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 29/70. [D 20:41:48.279601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.279616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.279625] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:48.285083] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.285098] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.285109] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:48.285236] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1116 [D 20:41:48.285249] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.285260] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 30/70. [D 20:41:48.287786] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1116 [D 20:41:48.287805] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 31/70. [D 20:41:48.304409] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1116 [D 20:41:48.304472] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.304487] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 32/70. [D 20:41:48.306836] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.306851] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.306862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:48.386003] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1103 [D 20:41:48.386039] element 0: offset: 0x61ee50, size: 24 [D 20:41:48.386053] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 33/70. [D 20:41:48.388598] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.388613] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.388623] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:48.453260] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1107 [D 20:41:48.453275] element 0: offset: 0x6151c0, size: 24 [D 20:41:48.453286] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 34/70. [D 20:41:48.455699] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.455713] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.455724] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:48.461806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.461822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.461833] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:48.461952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1119 [D 20:41:48.461970] element 0: offset: 0x61f310, size: 24 [D 20:41:48.461981] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 35/70. [D 20:41:48.464422] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1119 [D 20:41:48.464440] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 36/70. [D 20:41:48.478254] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1110 [D 20:41:48.478272] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.478283] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 37/70. [D 20:41:48.483578] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.483628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.483638] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:48.483897] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1119 [D 20:41:48.483913] element 0: offset: 0x61f310, size: 24 [D 20:41:48.483927] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 38/70. [D 20:41:48.484964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.484979] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.484988] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.496303] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.496320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.496331] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.496532] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1122 [D 20:41:48.496546] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.496558] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 39/70. [D 20:41:48.499088] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1122 [D 20:41:48.499106] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 40/70. [D 20:41:48.514224] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1122 [D 20:41:48.514239] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.514250] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 41/70. [D 20:41:48.516543] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.516556] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.516566] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.523127] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.523142] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.523153] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.523238] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1125 [D 20:41:48.523254] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.523263] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 42/70. [D 20:41:48.525645] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1125 [D 20:41:48.525660] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 43/70. [D 20:41:48.540601] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1125 [D 20:41:48.540617] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.540628] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 44/70. [D 20:41:48.542880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.542894] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.542904] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.549033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.549048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.549059] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.549177] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1128 [D 20:41:48.549191] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.549201] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 45/70. [D 20:41:48.551824] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1128 [D 20:41:48.551840] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 46/70. [D 20:41:48.567209] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1128 [D 20:41:48.567229] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.567240] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 47/70. [D 20:41:48.569602] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.569616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.569627] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.575559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.575574] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.575585] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.575722] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1131 [D 20:41:48.575736] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.575747] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 48/70. [D 20:41:48.578301] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1131 [D 20:41:48.578318] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 49/70. [D 20:41:48.594427] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1131 [D 20:41:48.594489] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.594504] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 50/70. [D 20:41:48.596684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.596699] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.596709] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.602743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.602757] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.602767] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.602848] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1134 [D 20:41:48.602861] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.602872] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 51/70. [D 20:41:48.602982] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1134 [D 20:41:48.603028] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 52/70. [D 20:41:48.619719] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1134 [D 20:41:48.619736] element 0: offset: 0x61fad0, size: 24 [D 20:41:48.619746] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 53/70. [D 20:41:48.621957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.621971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.621982] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.627874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.627889] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.627900] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.627985] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1137 [D 20:41:48.627999] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.628009] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 54/70. [D 20:41:48.628060] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1137 [D 20:41:48.628118] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 55/70. [D 20:41:48.645620] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1137 [D 20:41:48.645637] element 0: offset: 0x63e0d0, size: 24 [D 20:41:48.645648] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 56/70. [D 20:41:48.648044] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.648058] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.648068] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:48.655976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:48.655991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.656002] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:48.656097] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1140 [D 20:41:48.656112] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.656121] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 57/70. [D 20:41:48.656228] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1140 [D 20:41:48.656271] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 58/70. [D 20:41:48.672091] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1140 [D 20:41:48.672111] element 0: offset: 0x691fe0, size: 24 [D 20:41:48.672122] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 59/70. [D 20:41:48.674477] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:48.674491] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:48.674502] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.078141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.078190] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.078200] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.078364] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1143 [D 20:41:49.078379] element 0: offset: 0x629f90, size: 24 [D 20:41:49.078392] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 60/70. [D 20:41:49.080879] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1143 [D 20:41:49.080897] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 0/70. [D 20:41:49.097928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1143 [D 20:41:49.097989] element 0: offset: 0x629f90, size: 24 [D 20:41:49.098004] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 1/70. [D 20:41:49.100186] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.100200] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.100210] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.109094] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.109108] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.109119] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.109202] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1146 [D 20:41:49.109230] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.109250] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 2/70. [D 20:41:49.111758] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1146 [D 20:41:49.111776] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 3/70. [D 20:41:49.126728] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1146 [D 20:41:49.126742] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.126753] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 4/70. [D 20:41:49.128908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.128921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.128932] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.137029] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.137043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.137053] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.138616] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1149 [D 20:41:49.138630] element 0: offset: 0x61f310, size: 24 [D 20:41:49.138640] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 5/70. [D 20:41:49.138733] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1149 [D 20:41:49.138798] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 6/70. [D 20:41:49.155471] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1149 [D 20:41:49.155487] element 0: offset: 0x61f310, size: 24 [D 20:41:49.155497] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 7/70. [D 20:41:49.157705] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.157718] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.157729] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.164027] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.164040] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.164051] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.164134] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1152 [D 20:41:49.164152] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.164162] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 8/70. [D 20:41:49.164256] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1152 [D 20:41:49.164320] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 9/70. [D 20:41:49.181394] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1152 [D 20:41:49.181410] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.181421] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 10/70. [D 20:41:49.183739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.183752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.183762] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.189771] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.189785] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.189796] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.189881] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1155 [D 20:41:49.189899] element 0: offset: 0x629f90, size: 24 [D 20:41:49.189909] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 11/70. [D 20:41:49.189960] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1155 [D 20:41:49.190013] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 12/70. [D 20:41:49.207101] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1155 [D 20:41:49.207166] element 0: offset: 0x629f90, size: 24 [D 20:41:49.207183] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 13/70. [D 20:41:49.209401] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.209416] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.209427] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.219746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.219761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.219773] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.219874] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1158 [D 20:41:49.219887] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.219898] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 14/70. [D 20:41:49.220040] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1158 [D 20:41:49.220106] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 15/70. [D 20:41:49.234373] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.234387] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.234396] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.235917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1160 [D 20:41:49.235929] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.235938] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 16/70. [D 20:41:49.237080] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1160 [D 20:41:49.237132] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 17/70. [D 20:41:49.237159] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1158 [D 20:41:49.237170] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.237181] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 18/70. [D 20:41:49.237273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.237287] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.237296] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.251874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.251888] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.251896] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.255540] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1164 [D 20:41:49.255581] element 0: offset: 0x66e860, size: 24 [D 20:41:49.255594] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 19/70. [D 20:41:49.255614] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1160 [D 20:41:49.255623] element 0: offset: 0x691fe0, size: 24 [D 20:41:49.255635] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 20/70. [D 20:41:49.255678] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1164 [D 20:41:49.255701] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 21/70. [D 20:41:49.255716] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.255728] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.255737] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.268549] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.268564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.268573] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.272424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1164 [D 20:41:49.272463] element 0: offset: 0x66e860, size: 24 [D 20:41:49.272476] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 22/70. [D 20:41:49.272498] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1166 [D 20:41:49.272507] element 0: offset: 0x61f310, size: 24 [D 20:41:49.272517] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 23/70. [D 20:41:49.272550] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.272560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.272568] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.272609] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1166 [D 20:41:49.272624] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 24/70. [D 20:41:49.284869] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.284884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.284892] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.284953] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1170 [D 20:41:49.284964] element 0: offset: 0x629f90, size: 24 [D 20:41:49.284974] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 25/70. [D 20:41:49.285089] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1170 [D 20:41:49.285144] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 26/70. [D 20:41:49.290359] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1166 [D 20:41:49.290374] element 0: offset: 0x61f310, size: 24 [D 20:41:49.290384] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 27/70. [D 20:41:49.290511] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.290524] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.290533] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.299134] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1170 [D 20:41:49.299179] element 0: offset: 0x629f90, size: 24 [D 20:41:49.299193] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 28/70. [D 20:41:49.299353] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.299366] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.299375] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:49.302303] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.302317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.302326] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:49.302424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1172 [D 20:41:49.302434] element 0: offset: 0x61fad0, size: 24 [D 20:41:49.302445] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 29/70. [D 20:41:49.302545] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1172 [D 20:41:49.302612] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 30/70. [D 20:41:49.319021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.319070] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.319080] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.319196] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1172 [D 20:41:49.319208] element 0: offset: 0x61fad0, size: 24 [D 20:41:49.319220] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 31/70. [D 20:41:49.319239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1176 [D 20:41:49.319249] element 0: offset: 0x66e860, size: 24 [D 20:41:49.319258] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 32/70. [D 20:41:49.321072] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.321091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.321103] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.321148] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1176 [D 20:41:49.321165] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 33/70. [D 20:41:49.336178] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.336193] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.336204] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.336288] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1178 [D 20:41:49.336301] element 0: offset: 0x63e0d0, size: 24 [D 20:41:49.336328] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 34/70. [D 20:41:49.336431] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1178 [D 20:41:49.336493] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 35/70. [D 20:41:49.351429] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1178 [D 20:41:49.351491] element 0: offset: 0x63e0d0, size: 24 [D 20:41:49.351506] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 36/70. [D 20:41:49.353846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.353860] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.353872] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.369407] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.369422] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.369433] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.369515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1181 [D 20:41:49.369528] element 0: offset: 0x620d50, size: 24 [D 20:41:49.369538] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 37/70. [D 20:41:49.371892] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1181 [D 20:41:49.371910] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 38/70. [D 20:41:49.387387] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1181 [D 20:41:49.387402] element 0: offset: 0x620d50, size: 24 [D 20:41:49.387412] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 39/70. [D 20:41:49.389564] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.389578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.389588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.395452] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.395465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.395476] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.395557] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1184 [D 20:41:49.395574] element 0: offset: 0x6151c0, size: 24 [D 20:41:49.395583] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 40/70. [D 20:41:49.395679] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1184 [D 20:41:49.395738] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 41/70. [D 20:41:49.412397] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1184 [D 20:41:49.412412] element 0: offset: 0x6151c0, size: 24 [D 20:41:49.412422] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 42/70. [D 20:41:49.413055] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.413069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.413079] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.420125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.420139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.420149] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.420232] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1187 [D 20:41:49.420251] element 0: offset: 0x63c930, size: 24 [D 20:41:49.420260] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 43/70. [D 20:41:49.422581] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1187 [D 20:41:49.422596] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 44/70. [D 20:41:49.439509] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1187 [D 20:41:49.439570] element 0: offset: 0x63c930, size: 24 [D 20:41:49.439585] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 45/70. [D 20:41:49.441770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.441785] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.441795] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.447223] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.447238] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.447249] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.447329] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1190 [D 20:41:49.447342] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.447353] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 46/70. [D 20:41:49.447461] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1190 [D 20:41:49.447506] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 47/70. [D 20:41:49.463441] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1190 [D 20:41:49.463457] element 0: offset: 0x5b0030, size: 24 [D 20:41:49.463467] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 48/70. [D 20:41:49.465626] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.465639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.465649] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.492441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.492455] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.492466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.492552] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1194 [D 20:41:49.492571] element 0: offset: 0x61ee50, size: 24 [D 20:41:49.492580] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 49/70. [D 20:41:49.494957] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1194 [D 20:41:49.494972] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 50/70. [D 20:41:49.721324] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1176 [D 20:41:49.721354] element 0: offset: 0x66e860, size: 24 [D 20:41:49.721365] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 51/70. [D 20:41:49.724020] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.724034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.724045] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.729097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.729128] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.729139] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.731649] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1197 [D 20:41:49.731672] element 0: offset: 0x657310, size: 24 [D 20:41:49.731685] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 52/70. [D 20:41:49.734247] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1197 [D 20:41:49.734265] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 53/70. [D 20:41:49.750345] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1197 [D 20:41:49.750409] element 0: offset: 0x657310, size: 24 [D 20:41:49.750423] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 54/70. [D 20:41:49.752555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.752570] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.752581] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.758719] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.758733] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.758744] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.758826] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1200 [D 20:41:49.758852] element 0: offset: 0x63e0d0, size: 24 [D 20:41:49.758871] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 55/70. [D 20:41:49.761338] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1200 [D 20:41:49.761356] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 56/70. [D 20:41:49.777022] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1200 [D 20:41:49.777037] element 0: offset: 0x63e0d0, size: 24 [D 20:41:49.777048] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 57/70. [D 20:41:49.779326] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:49.779340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.779349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:49.785093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.785106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.785117] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:49.785301] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1203 [D 20:41:49.785317] element 0: offset: 0x61fad0, size: 24 [D 20:41:49.785328] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 58/70. [D 20:41:49.785422] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1203 [D 20:41:49.785476] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 59/70. [D 20:41:49.994845] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:49.994860] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:49.994872] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:49.994927] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1206 [D 20:41:49.994940] element 0: offset: 0x62aff0, size: 24 [D 20:41:49.994950] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 60/70. [D 20:41:49.995051] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1206 [D 20:41:49.995101] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 0/70. [D 20:41:50.059486] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1194 [D 20:41:50.059554] element 0: offset: 0x61ee50, size: 24 [D 20:41:50.059722] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 1/70. [D 20:41:50.061137] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.061152] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.061164] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:50.068565] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.068581] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.068592] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:50.069125] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1209 [D 20:41:50.069140] element 0: offset: 0x61f310, size: 24 [D 20:41:50.069153] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 2/70. [D 20:41:50.071665] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1209 [D 20:41:50.071683] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 3/70. [D 20:41:50.087374] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1209 [D 20:41:50.087404] element 0: offset: 0x61f310, size: 24 [D 20:41:50.087415] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 4/70. [D 20:41:50.089638] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.089653] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.089664] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:50.095691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.095705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.095716] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:50.095839] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1212 [D 20:41:50.095852] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.095863] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 5/70. [D 20:41:50.098239] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1212 [D 20:41:50.098254] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 6/70. [D 20:41:50.115165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1212 [D 20:41:50.115229] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.115244] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 7/70. [D 20:41:50.117429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.117444] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.117454] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:50.123684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.123698] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.123708] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:50.123792] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1215 [D 20:41:50.123805] element 0: offset: 0x63c930, size: 24 [D 20:41:50.123816] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 8/70. [D 20:41:50.123881] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1215 [D 20:41:50.123922] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 9/70. [D 20:41:50.138492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.138507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.138515] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.140072] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1217 [D 20:41:50.140084] element 0: offset: 0x61ee50, size: 24 [D 20:41:50.140095] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 10/70. [D 20:41:50.142432] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1217 [D 20:41:50.142447] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 11/70. [D 20:41:50.483290] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1203 [D 20:41:50.483359] element 0: offset: 0x61fad0, size: 24 [D 20:41:50.483374] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 12/70. [D 20:41:50.485726] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.485742] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.485753] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.489170] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.489185] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.489196] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.491647] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1221 [D 20:41:50.491661] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.491671] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 13/70. [D 20:41:50.491740] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1221 [D 20:41:50.491772] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 14/70. [D 20:41:50.508889] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1221 [D 20:41:50.508955] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.508970] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 15/70. [D 20:41:50.511221] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.511236] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.511247] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.521125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.521139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.521150] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.521254] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1224 [D 20:41:50.521266] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.521277] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 16/70. [D 20:41:50.523738] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1224 [D 20:41:50.523756] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 17/70. [D 20:41:50.540541] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1224 [D 20:41:50.540606] element 0: offset: 0x5b0030, size: 24 [D 20:41:50.540621] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 18/70. [D 20:41:50.542756] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.542771] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.542782] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.548395] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.548409] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.548420] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.548500] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1227 [D 20:41:50.548513] element 0: offset: 0x657310, size: 24 [D 20:41:50.548524] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 19/70. [D 20:41:50.550882] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1227 [D 20:41:50.550899] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 20/70. [D 20:41:50.567098] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1227 [D 20:41:50.567160] element 0: offset: 0x657310, size: 24 [D 20:41:50.567175] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 21/70. [D 20:41:50.569189] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.569204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.569213] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.574957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.574971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.574982] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.575064] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1230 [D 20:41:50.575077] element 0: offset: 0x61fad0, size: 24 [D 20:41:50.575088] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 22/70. [D 20:41:50.577376] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1230 [D 20:41:50.577394] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 23/70. [D 20:41:50.882885] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1206 [D 20:41:50.882954] element 0: offset: 0x62aff0, size: 24 [D 20:41:50.882970] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 24/70. [D 20:41:50.885318] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.885334] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.885345] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.891417] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.891431] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.891442] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.891521] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1233 [D 20:41:50.891533] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.891544] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 25/70. [D 20:41:50.891658] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1233 [D 20:41:50.891695] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 26/70. [D 20:41:50.909835] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1233 [D 20:41:50.909897] element 0: offset: 0x691fe0, size: 24 [D 20:41:50.909912] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 27/70. [D 20:41:50.912088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.912102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.912112] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.918010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.918023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.918034] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.918112] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1236 [D 20:41:50.918125] element 0: offset: 0x620d50, size: 24 [D 20:41:50.918135] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 28/70. [D 20:41:50.918201] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1236 [D 20:41:50.918241] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 29/70. [D 20:41:50.937556] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1236 [D 20:41:50.937619] element 0: offset: 0x620d50, size: 24 [D 20:41:50.937634] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 30/70. [D 20:41:50.939801] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.939815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.939824] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.945208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.945222] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.945233] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.945763] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1239 [D 20:41:50.945776] element 0: offset: 0x6347e0, size: 24 [D 20:41:50.945787] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 31/70. [D 20:41:50.945897] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1239 [D 20:41:50.945940] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 32/70. [D 20:41:50.964489] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1239 [D 20:41:50.964550] element 0: offset: 0x6347e0, size: 24 [D 20:41:50.964565] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 33/70. [D 20:41:50.966741] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.966755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.966765] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.972467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:50.972481] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.972491] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:50.972569] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1242 [D 20:41:50.972582] element 0: offset: 0x62aff0, size: 24 [D 20:41:50.972593] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 34/70. [D 20:41:50.972701] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1242 [D 20:41:50.972742] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 35/70. [D 20:41:50.989651] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1215 [D 20:41:50.989667] element 0: offset: 0x63c930, size: 24 [D 20:41:50.989678] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 36/70. [D 20:41:50.992190] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.992204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.992216] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:50.992228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1242 [D 20:41:50.992238] element 0: offset: 0x62aff0, size: 24 [D 20:41:50.992250] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 37/70. [D 20:41:50.992293] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:50.992306] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:50.992316] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:51.001459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.001477] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.001488] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:51.001513] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.001523] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.001531] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:51.001611] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1245 [D 20:41:51.001624] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.001634] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 38/70. [D 20:41:51.001649] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1248 [D 20:41:51.001663] element 0: offset: 0x620d50, size: 24 [D 20:41:51.001672] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 39/70. [D 20:41:51.011631] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1245 [D 20:41:51.011699] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 40/70. [D 20:41:51.011739] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1248 [D 20:41:51.011752] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 41/70. [D 20:41:51.014752] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1217 [D 20:41:51.014769] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.014783] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 42/70. [D 20:41:51.014887] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.014901] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.014917] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:51.037217] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.037233] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.037242] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:51.037381] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1250 [D 20:41:51.037393] element 0: offset: 0x62aff0, size: 24 [D 20:41:51.037402] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 43/70. [D 20:41:51.040663] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1250 [D 20:41:51.040693] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 44/70. [D 20:41:51.314564] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1230 [D 20:41:51.314633] element 0: offset: 0x61fad0, size: 24 [D 20:41:51.314649] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 45/70. [D 20:41:51.316969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.316985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.316996] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:51.531351] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1245 [D 20:41:51.531413] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.531428] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 46/70. [D 20:41:51.533730] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.533744] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.533756] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:51.539636] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.539651] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.539660] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:51.539789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1254 [D 20:41:51.539803] element 0: offset: 0x6347e0, size: 24 [D 20:41:51.539814] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 47/70. [D 20:41:51.542273] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1254 [D 20:41:51.542291] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 48/70. [D 20:41:51.560567] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1254 [D 20:41:51.560628] element 0: offset: 0x6347e0, size: 24 [D 20:41:51.560643] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 49/70. [D 20:41:51.561281] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.561296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.561306] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:51.570087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.570101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.570113] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:51.570195] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1257 [D 20:41:51.570221] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.570240] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 50/70. [D 20:41:51.570308] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1257 [D 20:41:51.570339] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 51/70. [D 20:41:51.586327] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1257 [D 20:41:51.586342] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.586353] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 52/70. [D 20:41:51.588666] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.588679] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.588689] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:51.596453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.596467] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.596478] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:51.596565] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1260 [D 20:41:51.596581] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.596590] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 53/70. [D 20:41:51.596641] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1260 [D 20:41:51.596680] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 54/70. [D 20:41:51.613391] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1260 [D 20:41:51.613452] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.613467] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 55/70. [D 20:41:51.615641] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.615656] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.615665] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:51.714320] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1248 [D 20:41:51.714387] element 0: offset: 0x620d50, size: 24 [D 20:41:51.714401] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 56/70. [D 20:41:51.716696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.716712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.716722] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:51.723453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.723468] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.723477] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:51.723552] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1263 [D 20:41:51.723564] element 0: offset: 0x5b0030, size: 24 [D 20:41:51.723573] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 57/70. [D 20:41:51.723643] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1263 [D 20:41:51.723677] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 58/70. [D 20:41:51.728969] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1250 [D 20:41:51.728983] element 0: offset: 0x62aff0, size: 24 [D 20:41:51.728993] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 59/70. [D 20:41:51.731378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.731392] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.731402] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:51.738272] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.738286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.738294] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:51.738391] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1265 [D 20:41:51.738402] element 0: offset: 0x66e860, size: 24 [D 20:41:51.738411] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 60/70. [D 20:41:51.738505] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1265 [D 20:41:51.738563] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 0/70. [D 20:41:51.739829] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1263 [D 20:41:51.739842] element 0: offset: 0x5b0030, size: 24 [D 20:41:51.739854] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 1/70. [D 20:41:51.739935] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.739948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.739958] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:51.756219] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.756280] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.756290] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:51.757538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1265 [D 20:41:51.757554] element 0: offset: 0x66e860, size: 24 [D 20:41:51.757570] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 2/70. [D 20:41:51.757591] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1269 [D 20:41:51.757607] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.757618] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 3/70. [D 20:41:51.757669] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.757682] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.757692] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:51.759907] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1269 [D 20:41:51.759926] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 4/70. [D 20:41:51.775026] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.775041] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.775052] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:51.775107] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1271 [D 20:41:51.775118] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.775127] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 5/70. [D 20:41:51.780266] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1269 [D 20:41:51.780318] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.780331] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 6/70. [D 20:41:51.780379] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1271 [D 20:41:51.780396] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 7/70. [D 20:41:51.781320] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.781336] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.781346] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:51.796131] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1271 [D 20:41:51.796148] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.796158] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 8/70. [D 20:41:51.798308] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.798321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.798332] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:51.804969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.804983] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.804994] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:51.805108] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1274 [D 20:41:51.805126] element 0: offset: 0x5b0030, size: 24 [D 20:41:51.805136] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 9/70. [D 20:41:51.805188] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1274 [D 20:41:51.805244] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 10/70. [D 20:41:51.820693] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1274 [D 20:41:51.820708] element 0: offset: 0x5b0030, size: 24 [D 20:41:51.820718] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 11/70. [D 20:41:51.821286] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.821300] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.821308] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:51.833741] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.833754] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.833765] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:51.833851] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1277 [D 20:41:51.833869] element 0: offset: 0x657310, size: 24 [D 20:41:51.833878] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 12/70. [D 20:41:51.836254] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1277 [D 20:41:51.836269] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 13/70. [D 20:41:51.853586] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1277 [D 20:41:51.853645] element 0: offset: 0x657310, size: 24 [D 20:41:51.853660] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 14/70. [D 20:41:51.855784] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.855799] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.855808] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:51.861294] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.861308] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.861319] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:51.861782] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1280 [D 20:41:51.861796] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.861807] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 15/70. [D 20:41:51.861930] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1280 [D 20:41:51.861976] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 16/70. [D 20:41:51.880283] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1280 [D 20:41:51.880344] element 0: offset: 0x61ee50, size: 24 [D 20:41:51.880358] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 17/70. [D 20:41:51.882637] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.882651] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.882662] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:51.888462] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:51.888476] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.888487] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:51.888581] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1283 [D 20:41:51.888609] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.888621] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 18/70. [D 20:41:51.891085] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1283 [D 20:41:51.891103] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 19/70. [D 20:41:51.906357] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1283 [D 20:41:51.906372] element 0: offset: 0x691fe0, size: 24 [D 20:41:51.906383] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 20/70. [D 20:41:51.908673] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:51.908687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:51.908697] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.023077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.023109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.023120] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.023224] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1287 [D 20:41:52.023236] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.023247] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 21/70. [D 20:41:52.025663] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1287 [D 20:41:52.025680] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 22/70. [D 20:41:52.040789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1287 [D 20:41:52.040805] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.040815] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 23/70. [D 20:41:52.043117] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.043130] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.043140] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.050636] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.050650] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.050661] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.050751] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1290 [D 20:41:52.050767] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.050776] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 24/70. [D 20:41:52.050871] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1290 [D 20:41:52.050943] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 25/70. [D 20:41:52.103371] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1290 [D 20:41:52.103486] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.103502] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 26/70. [D 20:41:52.106006] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.106021] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.106032] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.111761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.111776] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.111787] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.111870] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1293 [D 20:41:52.111883] element 0: offset: 0x691fe0, size: 24 [D 20:41:52.111894] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 27/70. [D 20:41:52.112010] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1293 [D 20:41:52.112066] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 28/70. [D 20:41:52.130477] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1293 [D 20:41:52.130539] element 0: offset: 0x691fe0, size: 24 [D 20:41:52.130553] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 29/70. [D 20:41:52.132680] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.132695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.132705] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.138611] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.138626] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.138637] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.138717] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1296 [D 20:41:52.138730] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.138741] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 30/70. [D 20:41:52.141102] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1296 [D 20:41:52.141120] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 31/70. [D 20:41:52.155819] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1296 [D 20:41:52.155834] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.155844] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 32/70. [D 20:41:52.158003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.158017] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.158028] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.164086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.164099] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.164109] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.164194] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1299 [D 20:41:52.164211] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.164220] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 33/70. [D 20:41:52.164276] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1299 [D 20:41:52.164334] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 34/70. [D 20:41:52.373986] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.374001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.374011] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:52.374156] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1302 [D 20:41:52.374167] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.374182] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 35/70. [D 20:41:52.376703] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1302 [D 20:41:52.376719] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 36/70. [D 20:41:52.393525] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1302 [D 20:41:52.393590] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.393617] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 37/70. [D 20:41:52.395837] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.395850] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.395859] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:52.399162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1299 [D 20:41:52.399175] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.399193] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 38/70. [D 20:41:52.401350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.401364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.401376] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:52.401395] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.401407] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.401423] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:52.402504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1305 [D 20:41:52.402518] element 0: offset: 0x620d50, size: 24 [D 20:41:52.402529] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 39/70. [D 20:41:52.402595] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1305 [D 20:41:52.402734] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 40/70. [D 20:41:52.418783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.418798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.418809] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:52.421804] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1308 [D 20:41:52.421858] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.421874] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 41/70. [D 20:41:52.421897] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1305 [D 20:41:52.421914] element 0: offset: 0x620d50, size: 24 [D 20:41:52.421926] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 42/70. [D 20:41:52.424264] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1308 [D 20:41:52.424282] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 43/70. [D 20:41:52.424311] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.424335] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.424344] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:52.439507] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.439522] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.439532] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:52.440526] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1311 [D 20:41:52.440538] element 0: offset: 0x691fe0, size: 24 [D 20:41:52.440550] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 44/70. [D 20:41:52.440568] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1308 [D 20:41:52.440582] element 0: offset: 0x2aaaab2033d0, size: 24 [D 20:41:52.440603] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 45/70. [D 20:41:52.441388] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1311 [D 20:41:52.441440] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 46/70. [D 20:41:52.441476] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.441486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.441495] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:52.453708] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.453722] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.453731] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:52.453794] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1314 [D 20:41:52.453805] element 0: offset: 0x61fad0, size: 24 [D 20:41:52.453818] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 47/70. [D 20:41:52.453920] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1314 [D 20:41:52.453974] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 48/70. [D 20:41:52.535684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.535700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.535709] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:52.535759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1317 [D 20:41:52.535770] element 0: offset: 0x620d50, size: 24 [D 20:41:52.535780] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 49/70. [D 20:41:52.535838] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1317 [D 20:41:52.535879] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 50/70. [D 20:41:52.808832] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.808871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.808881] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:52.808976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1319 [D 20:41:52.808988] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.809000] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 51/70. [D 20:41:52.809062] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1319 [D 20:41:52.809113] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 52/70. [D 20:41:52.825804] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1319 [D 20:41:52.825853] element 0: offset: 0x61ee50, size: 24 [D 20:41:52.825867] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 53/70. [D 20:41:52.826015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.826029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.826037] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:52.832806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.832821] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.832830] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:52.832928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1322 [D 20:41:52.832939] element 0: offset: 0x61f310, size: 24 [D 20:41:52.832949] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 54/70. [D 20:41:52.833013] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1322 [D 20:41:52.833056] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 55/70. [D 20:41:52.851024] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1322 [D 20:41:52.851071] element 0: offset: 0x61f310, size: 24 [D 20:41:52.851084] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 56/70. [D 20:41:52.851148] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:52.851159] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.851168] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:52.857569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:52.857583] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:52.857592] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:52.857685] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1325 [D 20:41:52.857696] element 0: offset: 0x657310, size: 24 [D 20:41:52.857706] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 57/70. [D 20:41:52.857769] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1325 [D 20:41:52.857811] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 58/70. [D 20:41:53.003462] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1314 [D 20:41:53.003512] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.003526] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 59/70. [D 20:41:53.005744] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.005803] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.005814] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:53.011573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.011587] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.011599] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:53.011732] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1329 [D 20:41:53.011748] element 0: offset: 0x61f800, size: 24 [D 20:41:53.011762] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 60/70. [D 20:41:53.014217] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1329 [D 20:41:53.014235] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 0/70. [D 20:41:53.030288] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1329 [D 20:41:53.030303] element 0: offset: 0x61f800, size: 24 [D 20:41:53.030314] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 1/70. [D 20:41:53.032633] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.032647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.032657] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:53.190375] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1317 [D 20:41:53.190440] element 0: offset: 0x620d50, size: 24 [D 20:41:53.190455] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 2/70. [D 20:41:53.192729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.192744] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.192754] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.197414] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.197430] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.197441] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.199745] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1332 [D 20:41:53.199759] element 0: offset: 0x66e670, size: 24 [D 20:41:53.199770] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 3/70. [D 20:41:53.199837] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1332 [D 20:41:53.199905] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 4/70. [D 20:41:53.207486] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1325 [D 20:41:53.207501] element 0: offset: 0x657310, size: 24 [D 20:41:53.207512] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 5/70. [D 20:41:53.209908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.209922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.209933] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.215418] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.215432] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.215440] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.215569] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1334 [D 20:41:53.215581] element 0: offset: 0x61f800, size: 24 [D 20:41:53.215592] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 6/70. [D 20:41:53.215609] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1332 [D 20:41:53.215624] element 0: offset: 0x66e670, size: 24 [D 20:41:53.215647] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 7/70. [D 20:41:53.217418] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1334 [D 20:41:53.218050] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 8/70. [D 20:41:53.218070] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.218083] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.218092] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.232621] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.232637] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.232649] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.233497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1338 [D 20:41:53.233521] element 0: offset: 0x634810, size: 24 [D 20:41:53.233533] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 9/70. [D 20:41:53.236066] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1338 [D 20:41:53.236083] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 10/70. [D 20:41:53.240798] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1334 [D 20:41:53.240850] element 0: offset: 0x61f800, size: 24 [D 20:41:53.240865] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 11/70. [D 20:41:53.240969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.240980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.240989] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.245154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1311 [D 20:41:53.245167] element 0: offset: 0x691fe0, size: 24 [D 20:41:53.245181] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 12/70. [D 20:41:53.247696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.247710] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.247722] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:53.253422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.253437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.253446] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:53.253480] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.253490] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.253498] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.254500] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1341 [D 20:41:53.254511] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.254520] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 13/70. [D 20:41:53.254533] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1344 [D 20:41:53.254543] element 0: offset: 0x66e670, size: 24 [D 20:41:53.254556] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 14/70. [D 20:41:53.257187] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1341 [D 20:41:53.257206] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 15/70. [D 20:41:53.257235] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1344 [D 20:41:53.257248] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 16/70. [D 20:41:53.257262] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1338 [D 20:41:53.257328] element 0: offset: 0x634810, size: 24 [D 20:41:53.257342] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 17/70. [D 20:41:53.257421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.257434] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.257452] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.286423] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.286438] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.286446] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.286563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1347 [D 20:41:53.286575] element 0: offset: 0x657310, size: 24 [D 20:41:53.286585] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 18/70. [D 20:41:53.289014] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1347 [D 20:41:53.289028] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 19/70. [D 20:41:53.669854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1341 [D 20:41:53.669917] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.669932] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 20/70. [D 20:41:53.672537] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.672552] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.672563] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.677905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.677921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.677929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.678045] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1349 [D 20:41:53.678056] element 0: offset: 0x646960, size: 24 [D 20:41:53.678065] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 21/70. [D 20:41:53.678134] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1349 [D 20:41:53.678265] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 22/70. [D 20:41:53.694106] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1349 [D 20:41:53.694125] element 0: offset: 0x646960, size: 24 [D 20:41:53.694136] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 23/70. [D 20:41:53.696432] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.696446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.696455] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.706111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.706125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.706136] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.706240] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1352 [D 20:41:53.706252] element 0: offset: 0x5b0030, size: 24 [D 20:41:53.706261] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 24/70. [D 20:41:53.706315] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1352 [D 20:41:53.706370] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 25/70. [D 20:41:53.722736] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1352 [D 20:41:53.722753] element 0: offset: 0x5b0030, size: 24 [D 20:41:53.722763] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 26/70. [D 20:41:53.725099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.725113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.725123] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.731760] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.731786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.731797] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.733529] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1355 [D 20:41:53.733586] element 0: offset: 0x691fe0, size: 24 [D 20:41:53.733602] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 27/70. [D 20:41:53.736117] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1355 [D 20:41:53.736135] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 28/70. [D 20:41:53.739811] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1344 [D 20:41:53.739850] element 0: offset: 0x66e670, size: 24 [D 20:41:53.739865] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 29/70. [D 20:41:53.739965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.740001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.740019] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.749469] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.749485] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.749495] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.751603] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1359 [D 20:41:53.751615] element 0: offset: 0x61ee50, size: 24 [D 20:41:53.751624] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 30/70. [D 20:41:53.751691] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1359 [D 20:41:53.751718] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 31/70. [D 20:41:53.758465] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1347 [D 20:41:53.758482] element 0: offset: 0x657310, size: 24 [D 20:41:53.758493] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 32/70. [D 20:41:53.761096] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.761110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.761122] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.761154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1355 [D 20:41:53.761164] element 0: offset: 0x691fe0, size: 24 [D 20:41:53.761174] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 33/70. [D 20:41:53.763742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.763756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.763767] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:53.772141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.772155] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.772164] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:53.772264] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1362 [D 20:41:53.772275] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.772284] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 34/70. [D 20:41:53.772338] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1362 [D 20:41:53.772390] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 35/70. [D 20:41:53.772679] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1359 [D 20:41:53.772693] element 0: offset: 0x61ee50, size: 24 [D 20:41:53.772704] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 36/70. [D 20:41:53.772778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.772791] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.772800] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:53.788120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.788135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.788146] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:53.788214] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1365 [D 20:41:53.788227] element 0: offset: 0x620d50, size: 24 [D 20:41:53.788238] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 37/70. [D 20:41:53.793194] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1362 [D 20:41:53.793248] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.793262] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 38/70. [D 20:41:53.793317] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1365 [D 20:41:53.793335] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 39/70. [D 20:41:53.795516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.795530] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.795540] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:53.808118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.808134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.808142] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:53.808175] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.808185] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.808193] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.808269] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1368 [D 20:41:53.808280] element 0: offset: 0x61f800, size: 24 [D 20:41:53.808289] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 40/70. [D 20:41:53.808302] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1371 [D 20:41:53.808311] element 0: offset: 0x66e670, size: 24 [D 20:41:53.808321] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 41/70. [D 20:41:53.810766] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1368 [D 20:41:53.810781] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 42/70. [D 20:41:53.810806] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1371 [D 20:41:53.810818] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 43/70. [D 20:41:53.810831] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1365 [D 20:41:53.810857] element 0: offset: 0x620d50, size: 24 [D 20:41:53.810869] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 44/70. [D 20:41:53.810941] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.810954] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.810964] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.838597] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.838612] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.838621] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.838730] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1374 [D 20:41:53.838742] element 0: offset: 0x657310, size: 24 [D 20:41:53.838751] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 45/70. [D 20:41:53.838805] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1374 [D 20:41:53.838861] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 46/70. [D 20:41:53.847073] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1368 [D 20:41:53.847091] element 0: offset: 0x61f800, size: 24 [D 20:41:53.847102] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 47/70. [D 20:41:53.849494] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.849507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.849518] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.853481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.853495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.853503] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.853612] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1377 [D 20:41:53.853655] element 0: offset: 0x61ee50, size: 24 [D 20:41:53.853669] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 48/70. [D 20:41:53.853776] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1377 [D 20:41:53.853835] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 49/70. [D 20:41:53.922251] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1371 [D 20:41:53.922298] element 0: offset: 0x66e670, size: 24 [D 20:41:53.922312] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 50/70. [D 20:41:53.922467] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.922480] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.922489] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.928157] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.928171] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.928179] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.928274] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1380 [D 20:41:53.928285] element 0: offset: 0x691fe0, size: 24 [D 20:41:53.928295] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 51/70. [D 20:41:53.928359] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1380 [D 20:41:53.928481] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 52/70. [D 20:41:53.942165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1380 [D 20:41:53.942212] element 0: offset: 0x691fe0, size: 24 [D 20:41:53.942226] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 53/70. [D 20:41:53.942369] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:53.942382] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.942391] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:53.955828] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:53.955842] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:53.955850] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:53.955945] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1383 [D 20:41:53.955956] element 0: offset: 0x61fad0, size: 24 [D 20:41:53.955966] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 54/70. [D 20:41:53.956031] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1383 [D 20:41:53.956061] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 55/70. [D 20:41:54.401941] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1374 [D 20:41:54.401990] element 0: offset: 0x657310, size: 24 [D 20:41:54.402004] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 56/70. [D 20:41:54.402182] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.402196] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.402205] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.408215] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.408229] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.408238] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.408338] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1386 [D 20:41:54.408349] element 0: offset: 0x6151c0, size: 24 [D 20:41:54.408359] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 57/70. [D 20:41:54.408422] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1386 [D 20:41:54.408474] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 58/70. [D 20:41:54.413800] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1377 [D 20:41:54.413841] element 0: offset: 0x61ee50, size: 24 [D 20:41:54.413854] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 59/70. [D 20:41:54.416118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.416137] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.416147] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.423240] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.423255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.423266] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.423402] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1389 [D 20:41:54.423418] element 0: offset: 0x66e670, size: 24 [D 20:41:54.423431] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 60/70. [D 20:41:54.425882] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1389 [D 20:41:54.425900] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 0/70. [D 20:41:54.430972] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1386 [D 20:41:54.431018] element 0: offset: 0x6151c0, size: 24 [D 20:41:54.431033] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 1/70. [D 20:41:54.431145] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.431175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.431185] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.441481] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1389 [D 20:41:54.441495] element 0: offset: 0x66e670, size: 24 [D 20:41:54.441506] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 2/70. [D 20:41:54.443827] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.443840] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.443850] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:54.453528] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.453543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.453554] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:54.455004] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1392 [D 20:41:54.455017] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.455027] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 3/70. [D 20:41:54.455136] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1392 [D 20:41:54.455182] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 4/70. [D 20:41:54.473448] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1392 [D 20:41:54.473523] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.473538] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 5/70. [D 20:41:54.475778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.475793] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.475802] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:54.481880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.481894] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.481906] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:54.481987] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1395 [D 20:41:54.482000] element 0: offset: 0x620d50, size: 24 [D 20:41:54.482011] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 6/70. [D 20:41:54.482119] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1395 [D 20:41:54.482179] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 7/70. [D 20:41:54.497737] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.497752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.497760] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.497867] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1397 [D 20:41:54.497879] element 0: offset: 0x6151c0, size: 24 [D 20:41:54.497888] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 8/70. [D 20:41:54.497942] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1397 [D 20:41:54.498001] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 9/70. [D 20:41:54.499479] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1395 [D 20:41:54.499492] element 0: offset: 0x620d50, size: 24 [D 20:41:54.499506] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 10/70. [D 20:41:54.499583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.499596] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.499607] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.511212] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.511226] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.511238] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.511315] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1401 [D 20:41:54.511328] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.511341] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 11/70. [D 20:41:54.513734] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1401 [D 20:41:54.513750] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 12/70. [D 20:41:54.516605] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1397 [D 20:41:54.516659] element 0: offset: 0x6151c0, size: 24 [D 20:41:54.516674] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 13/70. [D 20:41:54.518885] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.518899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.518910] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.529541] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.529556] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.529565] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.529603] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1401 [D 20:41:54.529613] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.529623] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 14/70. [D 20:41:54.531825] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.531840] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.531849] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.531864] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1403 [D 20:41:54.531874] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.531884] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 15/70. [D 20:41:54.531998] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1403 [D 20:41:54.532023] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 16/70. [D 20:41:54.545796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.545814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.545822] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.545975] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1407 [D 20:41:54.545987] element 0: offset: 0x61ee50, size: 24 [D 20:41:54.545997] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 17/70. [D 20:41:54.546114] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1407 [D 20:41:54.546138] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 18/70. [D 20:41:54.560219] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1407 [D 20:41:54.560237] element 0: offset: 0x61ee50, size: 24 [D 20:41:54.560248] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 19/70. [D 20:41:54.561534] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.561549] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.561560] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.578446] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:54.578460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.578472] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:54.578563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1410 [D 20:41:54.578579] element 0: offset: 0x691fe0, size: 24 [D 20:41:54.578588] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 20/70. [D 20:41:54.581071] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1410 [D 20:41:54.581087] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 21/70. [D 20:41:54.596019] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1410 [D 20:41:54.596035] element 0: offset: 0x691fe0, size: 24 [D 20:41:54.596045] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 22/70. [D 20:41:54.598256] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.598270] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.598281] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:54.791563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1383 [D 20:41:54.791626] element 0: offset: 0x61fad0, size: 24 [D 20:41:54.791643] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 23/70. [D 20:41:54.793559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.793575] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.793586] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:54.994855] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1403 [D 20:41:54.994898] element 0: offset: 0x5b0030, size: 24 [D 20:41:54.994914] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 24/70. [D 20:41:54.995019] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:54.995032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:54.995041] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:55.002002] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.002017] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.002026] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:55.002121] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1412 [D 20:41:55.002132] element 0: offset: 0x61f800, size: 24 [D 20:41:55.002143] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 25/70. [D 20:41:55.002208] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1412 [D 20:41:55.002265] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 26/70. [D 20:41:55.018928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1412 [D 20:41:55.018975] element 0: offset: 0x61f800, size: 24 [D 20:41:55.018989] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 27/70. [D 20:41:55.019138] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.019152] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.019160] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:55.026584] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.026598] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.026607] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:55.026702] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1415 [D 20:41:55.026713] element 0: offset: 0x66e670, size: 24 [D 20:41:55.026724] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 28/70. [D 20:41:55.026788] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1415 [D 20:41:55.026836] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 29/70. [D 20:41:55.044599] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1415 [D 20:41:55.044646] element 0: offset: 0x66e670, size: 24 [D 20:41:55.044660] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 30/70. [D 20:41:55.044722] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.044733] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.044742] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:55.052605] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.052620] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.052628] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:55.052722] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1418 [D 20:41:55.052734] element 0: offset: 0x61ee50, size: 24 [D 20:41:55.052744] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 31/70. [D 20:41:55.052808] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1418 [D 20:41:55.052856] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 32/70. [D 20:41:55.071584] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1418 [D 20:41:55.071599] element 0: offset: 0x61ee50, size: 24 [D 20:41:55.071610] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 33/70. [D 20:41:55.071688] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.071700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.071709] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:55.077966] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.077980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.077988] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:55.078037] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1421 [D 20:41:55.078048] element 0: offset: 0x61fad0, size: 24 [D 20:41:55.078058] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 34/70. [D 20:41:55.078110] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1421 [D 20:41:55.078175] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 35/70. [D 20:41:55.093825] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.093842] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.093850] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:55.097580] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1425 [D 20:41:55.097623] element 0: offset: 0x691fe0, size: 24 [D 20:41:55.097637] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 36/70. [D 20:41:55.097657] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1421 [D 20:41:55.097667] element 0: offset: 0x61fad0, size: 24 [D 20:41:55.097677] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 37/70. [D 20:41:55.097719] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1425 [D 20:41:55.097752] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 38/70. [D 20:41:55.097755] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.097785] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.097794] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:55.108461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.108476] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.108485] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:55.112228] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1427 [D 20:41:55.112272] element 0: offset: 0x61f800, size: 24 [D 20:41:55.112285] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 39/70. [D 20:41:55.112306] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1425 [D 20:41:55.112316] element 0: offset: 0x691fe0, size: 24 [D 20:41:55.112325] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 40/70. [D 20:41:55.114673] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1427 [D 20:41:55.114696] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 41/70. [D 20:41:55.114732] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.114743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.114753] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:55.128673] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.128688] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.128699] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:55.134403] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1431 [D 20:41:55.134470] element 0: offset: 0x66e670, size: 24 [D 20:41:55.134485] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 42/70. [D 20:41:55.136730] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1431 [D 20:41:55.136749] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 43/70. [D 20:41:55.207979] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.208029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.208039] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.210005] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1434 [D 20:41:55.210025] element 0: offset: 0x635870, size: 24 [D 20:41:55.210039] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 44/70. [D 20:41:55.212508] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1434 [D 20:41:55.212526] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 45/70. [D 20:41:55.230322] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1434 [D 20:41:55.230338] element 0: offset: 0x635870, size: 24 [D 20:41:55.230349] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 46/70. [D 20:41:55.232648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.232662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.232675] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.239982] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.239996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.240007] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.240097] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1437 [D 20:41:55.240113] element 0: offset: 0x657310, size: 24 [D 20:41:55.240122] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 47/70. [D 20:41:55.240175] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1437 [D 20:41:55.240234] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 48/70. [D 20:41:55.257426] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1437 [D 20:41:55.257440] element 0: offset: 0x657310, size: 24 [D 20:41:55.257450] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 49/70. [D 20:41:55.259743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.259757] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.259766] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.268703] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.268718] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.268729] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.268815] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1440 [D 20:41:55.268832] element 0: offset: 0x61fad0, size: 24 [D 20:41:55.268842] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 50/70. [D 20:41:55.271207] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1440 [D 20:41:55.271223] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 51/70. [D 20:41:55.286347] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1440 [D 20:41:55.286362] element 0: offset: 0x61fad0, size: 24 [D 20:41:55.286373] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 52/70. [D 20:41:55.288684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.288698] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.288708] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.293581] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.293594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.293603] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.293726] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1443 [D 20:41:55.293765] element 0: offset: 0x655e70, size: 24 [D 20:41:55.293779] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 53/70. [D 20:41:55.293904] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1443 [D 20:41:55.293932] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 54/70. [D 20:41:55.310966] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1443 [D 20:41:55.311011] element 0: offset: 0x655e70, size: 24 [D 20:41:55.311025] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 55/70. [D 20:41:55.311086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.311098] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.311107] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.316885] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.316899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.316908] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.317006] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1446 [D 20:41:55.317017] element 0: offset: 0x6151c0, size: 24 [D 20:41:55.317027] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 56/70. [D 20:41:55.317091] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1446 [D 20:41:55.317129] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 57/70. [D 20:41:55.416974] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1427 [D 20:41:55.417015] element 0: offset: 0x61f800, size: 24 [D 20:41:55.417028] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 58/70. [D 20:41:55.417125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.417137] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.417146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.423009] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.423024] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.423032] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.423124] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1448 [D 20:41:55.423135] element 0: offset: 0x61ee50, size: 24 [D 20:41:55.423145] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 59/70. [D 20:41:55.423204] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1448 [D 20:41:55.423313] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 60/70. [D 20:41:55.433728] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1431 [D 20:41:55.433773] element 0: offset: 0x66e670, size: 24 [D 20:41:55.433787] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 0/70. [D 20:41:55.433969] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.433984] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.433993] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.439234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.439248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.439257] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.441356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1452 [D 20:41:55.441370] element 0: offset: 0x620d50, size: 24 [D 20:41:55.441381] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 1/70. [D 20:41:55.441633] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1452 [D 20:41:55.441652] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 2/70. [D 20:41:55.446361] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1448 [D 20:41:55.446376] element 0: offset: 0x61ee50, size: 24 [D 20:41:55.446386] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 3/70. [D 20:41:55.446491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.446504] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.446513] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.453896] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.453910] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.453918] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.456202] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1455 [D 20:41:55.456244] element 0: offset: 0x61fad0, size: 24 [D 20:41:55.456257] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 4/70. [D 20:41:55.457196] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1455 [D 20:41:55.457216] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 5/70. [D 20:41:55.457424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1452 [D 20:41:55.457438] element 0: offset: 0x620d50, size: 24 [D 20:41:55.457449] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 6/70. [D 20:41:55.457534] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.457548] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.457557] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.480963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.480977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.480986] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.483136] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1458 [D 20:41:55.483150] element 0: offset: 0x691fe0, size: 24 [D 20:41:55.483160] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 7/70. [D 20:41:55.483270] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1458 [D 20:41:55.483332] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 8/70. [D 20:41:55.857052] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1446 [D 20:41:55.857103] element 0: offset: 0x6151c0, size: 24 [D 20:41:55.857117] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 9/70. [D 20:41:55.857273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.857286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.857294] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.862855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.862868] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.862877] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.865081] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1461 [D 20:41:55.865096] element 0: offset: 0x66e670, size: 24 [D 20:41:55.865106] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 10/70. [D 20:41:55.865190] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1461 [D 20:41:55.865226] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 11/70. [D 20:41:55.880208] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1461 [D 20:41:55.880255] element 0: offset: 0x66e670, size: 24 [D 20:41:55.880269] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 12/70. [D 20:41:55.880416] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:55.880429] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.880438] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:55.890580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:55.890594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:55.890603] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:55.892804] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1464 [D 20:41:55.892818] element 0: offset: 0x655e70, size: 24 [D 20:41:55.892829] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 13/70. [D 20:41:55.892912] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1464 [D 20:41:55.892943] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 14/70. [D 20:41:56.105914] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.105957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.105966] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.108079] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1466 [D 20:41:56.108094] element 0: offset: 0x62b130, size: 24 [D 20:41:56.108106] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 15/70. [D 20:41:56.108224] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1466 [D 20:41:56.108269] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 16/70. [D 20:41:56.124091] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1466 [D 20:41:56.124138] element 0: offset: 0x62b130, size: 24 [D 20:41:56.124152] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 17/70. [D 20:41:56.124299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.124312] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.124321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.129559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.129573] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.129582] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.131662] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1469 [D 20:41:56.131677] element 0: offset: 0x6151c0, size: 24 [D 20:41:56.131687] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 18/70. [D 20:41:56.131794] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1469 [D 20:41:56.131830] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 19/70. [D 20:41:56.148657] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1469 [D 20:41:56.148704] element 0: offset: 0x6151c0, size: 24 [D 20:41:56.148718] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 20/70. [D 20:41:56.148866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.148878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.148887] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.153794] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.153807] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.153816] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.156016] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1472 [D 20:41:56.156030] element 0: offset: 0x657310, size: 24 [D 20:41:56.156040] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 21/70. [D 20:41:56.156148] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1472 [D 20:41:56.156191] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 22/70. [D 20:41:56.172807] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1472 [D 20:41:56.172853] element 0: offset: 0x657310, size: 24 [D 20:41:56.172867] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 23/70. [D 20:41:56.173014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.173027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.173035] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.177873] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.177887] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.177896] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.180100] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1475 [D 20:41:56.180115] element 0: offset: 0x620d50, size: 24 [D 20:41:56.180125] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 24/70. [D 20:41:56.180234] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1475 [D 20:41:56.180276] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 25/70. [D 20:41:56.196101] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1475 [D 20:41:56.196148] element 0: offset: 0x620d50, size: 24 [D 20:41:56.196161] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 26/70. [D 20:41:56.196308] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.196320] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.196329] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.200880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.200893] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.200902] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.203111] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1478 [D 20:41:56.203126] element 0: offset: 0x66e670, size: 24 [D 20:41:56.203136] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 27/70. [D 20:41:56.203253] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1478 [D 20:41:56.203281] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 28/70. [D 20:41:56.460673] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1455 [D 20:41:56.460708] element 0: offset: 0x61fad0, size: 24 [D 20:41:56.460721] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 29/70. [D 20:41:56.460884] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.460897] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.460906] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.467111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.467125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.467133] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.469501] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1482 [D 20:41:56.469515] element 0: offset: 0x5b0030, size: 24 [D 20:41:56.469525] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 30/70. [D 20:41:56.469639] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1482 [D 20:41:56.469693] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 31/70. [D 20:41:56.477101] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1458 [D 20:41:56.477153] element 0: offset: 0x691fe0, size: 24 [D 20:41:56.477168] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 32/70. [D 20:41:56.477320] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.477333] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.477341] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.483751] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.483765] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.483774] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.485688] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1485 [D 20:41:56.485702] element 0: offset: 0x620d50, size: 24 [D 20:41:56.485713] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 33/70. [D 20:41:56.488505] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1482 [D 20:41:56.488519] element 0: offset: 0x5b0030, size: 24 [D 20:41:56.488529] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 34/70. [D 20:41:56.488566] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1485 [D 20:41:56.488583] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 35/70. [D 20:41:56.488610] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.488619] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.488627] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.500879] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.500895] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.500904] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.500955] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1488 [D 20:41:56.500966] element 0: offset: 0x61fad0, size: 24 [D 20:41:56.500976] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 36/70. [D 20:41:56.501041] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1488 [D 20:41:56.501088] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 37/70. [D 20:41:56.504901] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1485 [D 20:41:56.504940] element 0: offset: 0x620d50, size: 24 [D 20:41:56.504953] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 38/70. [D 20:41:56.505067] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.505081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.505090] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.514087] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.514101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.514110] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.516359] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1491 [D 20:41:56.516374] element 0: offset: 0x61ee50, size: 24 [D 20:41:56.516385] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 39/70. [D 20:41:56.516489] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1491 [D 20:41:56.516531] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 40/70. [D 20:41:56.666590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1464 [D 20:41:56.666641] element 0: offset: 0x655e70, size: 24 [D 20:41:56.666656] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 41/70. [D 20:41:56.666815] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.666828] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.666837] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:56.672427] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:56.672441] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.672450] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:56.674674] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1494 [D 20:41:56.674688] element 0: offset: 0x691fe0, size: 24 [D 20:41:56.674699] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 42/70. [D 20:41:56.674819] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1494 [D 20:41:56.674859] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 43/70. [D 20:41:56.691226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1494 [D 20:41:56.691272] element 0: offset: 0x691fe0, size: 24 [D 20:41:56.691286] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 44/70. [D 20:41:56.691433] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:56.691446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:56.691454] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:57.061041] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1478 [D 20:41:57.061093] element 0: offset: 0x66e670, size: 24 [D 20:41:57.061109] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 45/70. [D 20:41:57.061277] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.061291] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.061300] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:57.067648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.067663] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.067671] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:57.069737] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1496 [D 20:41:57.069752] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.069762] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 46/70. [D 20:41:57.069875] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1496 [D 20:41:57.069923] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 47/70. [D 20:41:57.087083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1496 [D 20:41:57.087129] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.087143] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 48/70. [D 20:41:57.087288] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.087301] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.087309] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:57.092648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.092661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.092670] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:57.094771] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1499 [D 20:41:57.094786] element 0: offset: 0x646f40, size: 24 [D 20:41:57.094796] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 49/70. [D 20:41:57.094906] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1499 [D 20:41:57.094957] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 50/70. [D 20:41:57.111547] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1499 [D 20:41:57.111594] element 0: offset: 0x646f40, size: 24 [D 20:41:57.111608] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 51/70. [D 20:41:57.111754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.111767] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.111776] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:57.116855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.116869] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.116877] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:57.117741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1502 [D 20:41:57.117755] element 0: offset: 0x66e670, size: 24 [D 20:41:57.117766] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 52/70. [D 20:41:57.117862] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1502 [D 20:41:57.117914] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 53/70. [D 20:41:57.135577] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1502 [D 20:41:57.135622] element 0: offset: 0x66e670, size: 24 [D 20:41:57.135635] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 54/70. [D 20:41:57.135781] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.135794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.135803] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:57.142567] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1488 [D 20:41:57.142582] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.142592] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 55/70. [D 20:41:57.142665] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.142679] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.142687] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.149287] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.149300] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.149308] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.151609] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1506 [D 20:41:57.151623] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.151633] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 56/70. [D 20:41:57.151744] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1506 [D 20:41:57.151807] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 57/70. [D 20:41:57.161089] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1491 [D 20:41:57.161140] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.161155] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 58/70. [D 20:41:57.161309] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.161323] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.161331] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.167549] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.167564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.167573] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.169673] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1509 [D 20:41:57.169728] element 0: offset: 0x6358f0, size: 24 [D 20:41:57.169741] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 59/70. [D 20:41:57.172104] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1509 [D 20:41:57.172130] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 60/70. [D 20:41:57.172153] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1506 [D 20:41:57.174361] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.174374] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 0/70. [D 20:41:57.174472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.174487] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.174501] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.187299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.187314] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.187322] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.188366] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1512 [D 20:41:57.188377] element 0: offset: 0x655e70, size: 24 [D 20:41:57.188387] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 1/70. [D 20:41:57.188419] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1509 [D 20:41:57.188429] element 0: offset: 0x6358f0, size: 24 [D 20:41:57.188439] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 2/70. [D 20:41:57.190752] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1512 [D 20:41:57.190768] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 3/70. [D 20:41:57.190785] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.190798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.190810] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.204808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.204823] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.204834] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.204900] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1515 [D 20:41:57.204914] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.204924] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 4/70. [D 20:41:57.207884] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1515 [D 20:41:57.207909] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 5/70. [D 20:41:57.212296] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1512 [D 20:41:57.212348] element 0: offset: 0x655e70, size: 24 [D 20:41:57.212362] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 6/70. [D 20:41:57.212466] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.212508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.212519] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.223682] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.223697] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.223707] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.223744] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1515 [D 20:41:57.223753] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.223763] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 7/70. [D 20:41:57.223813] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.223823] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.223832] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.223877] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1518 [D 20:41:57.223896] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.223906] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 8/70. [D 20:41:57.226217] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1518 [D 20:41:57.226236] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 9/70. [D 20:41:57.240710] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.240724] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.240736] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.240789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1521 [D 20:41:57.240802] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.240811] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 10/70. [D 20:41:57.240919] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1521 [D 20:41:57.240980] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 11/70. [D 20:41:57.301810] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.301826] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.301836] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:57.302497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1524 [D 20:41:57.302511] element 0: offset: 0x655e70, size: 24 [D 20:41:57.302523] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 12/70. [D 20:41:57.302617] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1524 [D 20:41:57.302681] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 13/70. [D 20:41:57.619655] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1518 [D 20:41:57.619699] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.619713] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 14/70. [D 20:41:57.622297] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.622313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.622324] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:57.772750] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1521 [D 20:41:57.772811] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.772828] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 15/70. [D 20:41:57.775174] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.775189] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.775200] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.782027] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.782042] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.782053] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.782185] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1527 [D 20:41:57.782199] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.782210] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 16/70. [D 20:41:57.784908] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1527 [D 20:41:57.784974] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 17/70. [D 20:41:57.792218] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1524 [D 20:41:57.792278] element 0: offset: 0x655e70, size: 24 [D 20:41:57.792293] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 18/70. [D 20:41:57.792450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.792466] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.792475] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.800761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.800775] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.800784] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.800821] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1527 [D 20:41:57.800831] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.800840] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 19/70. [D 20:41:57.800886] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.800896] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.800904] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.800948] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1530 [D 20:41:57.800967] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.803085] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 20/70. [D 20:41:57.803157] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1530 [D 20:41:57.806562] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 21/70. [D 20:41:57.822441] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1530 [D 20:41:57.822456] element 0: offset: 0x6151c0, size: 24 [D 20:41:57.822467] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 22/70. [D 20:41:57.824749] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.824762] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.824771] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:57.833780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.833794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.833805] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:57.833890] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1533 [D 20:41:57.833908] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.833918] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 23/70. [D 20:41:57.836259] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1533 [D 20:41:57.836275] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 24/70. [D 20:41:57.850547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.850562] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.850570] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.850672] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1535 [D 20:41:57.850683] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.850692] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 25/70. [D 20:41:57.850746] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1535 [D 20:41:57.850801] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 26/70. [D 20:41:57.851786] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1533 [D 20:41:57.851801] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.851811] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 27/70. [D 20:41:57.851892] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.851905] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.851929] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.867829] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.867845] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.867856] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.867924] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1539 [D 20:41:57.867936] element 0: offset: 0x655e70, size: 24 [D 20:41:57.867945] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 28/70. [D 20:41:57.873368] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1535 [D 20:41:57.873421] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.873435] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 29/70. [D 20:41:57.873485] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1539 [D 20:41:57.873501] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 30/70. [D 20:41:57.873758] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.873772] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.873783] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.892579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.892601] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.892610] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.893998] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1539 [D 20:41:57.894011] element 0: offset: 0x655e70, size: 24 [D 20:41:57.894021] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 31/70. [D 20:41:57.894084] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1541 [D 20:41:57.894101] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.894161] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 32/70. [D 20:41:57.896726] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.896741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.896750] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.896778] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1541 [D 20:41:57.896790] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 33/70. [D 20:41:57.909118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.909133] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.909145] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.909236] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1545 [D 20:41:57.909247] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.909256] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 34/70. [D 20:41:57.911630] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1545 [D 20:41:57.911646] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 35/70. [D 20:41:57.911679] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1541 [D 20:41:57.911690] element 0: offset: 0x61ee50, size: 24 [D 20:41:57.911699] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 36/70. [D 20:41:57.911781] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.911806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.911816] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.925316] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.925331] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.925339] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.925433] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1547 [D 20:41:57.925444] element 0: offset: 0x61fad0, size: 24 [D 20:41:57.925453] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 37/70. [D 20:41:57.925547] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1547 [D 20:41:57.925608] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 38/70. [D 20:41:57.927929] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1545 [D 20:41:57.927942] element 0: offset: 0x5b0030, size: 24 [D 20:41:57.927953] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 39/70. [D 20:41:57.928035] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:57.928063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.928072] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:57.940591] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:57.940606] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:57.940617] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:57.940701] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1551 [D 20:41:57.940715] element 0: offset: 0x691fe0, size: 24 [D 20:41:57.940725] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 40/70. [D 20:41:57.947116] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1551 [D 20:41:57.947170] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 41/70. [D 20:41:58.088935] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1547 [D 20:41:58.089001] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.089016] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 42/70. [D 20:41:58.091462] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.091478] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.091487] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:58.097537] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.097553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.097564] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:58.097746] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1553 [D 20:41:58.097760] element 0: offset: 0x620d50, size: 24 [D 20:41:58.097772] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 43/70. [D 20:41:58.100276] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1553 [D 20:41:58.100294] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 44/70. [D 20:41:58.116982] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1553 [D 20:41:58.116997] element 0: offset: 0x620d50, size: 24 [D 20:41:58.117007] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 45/70. [D 20:41:58.119187] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.119200] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.119211] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:58.124627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.124641] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.124652] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:58.124733] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1556 [D 20:41:58.124748] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.124758] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 46/70. [D 20:41:58.124811] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1556 [D 20:41:58.124867] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 47/70. [D 20:41:58.140847] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1556 [D 20:41:58.140862] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.140873] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 48/70. [D 20:41:58.143047] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.143060] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.143071] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:58.153148] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.153161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.153172] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:58.153257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1559 [D 20:41:58.153272] element 0: offset: 0x5b0030, size: 24 [D 20:41:58.153282] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 49/70. [D 20:41:58.155640] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1559 [D 20:41:58.155655] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 50/70. [D 20:41:58.172335] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1559 [D 20:41:58.172395] element 0: offset: 0x5b0030, size: 24 [D 20:41:58.172410] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 51/70. [D 20:41:58.173773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.173788] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.173799] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:58.179752] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.179766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.179777] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:58.179854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1562 [D 20:41:58.179868] element 0: offset: 0x6358f0, size: 24 [D 20:41:58.179878] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 52/70. [D 20:41:58.182219] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1562 [D 20:41:58.182237] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 53/70. [D 20:41:58.197267] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1562 [D 20:41:58.197282] element 0: offset: 0x6358f0, size: 24 [D 20:41:58.197292] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 54/70. [D 20:41:58.197777] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.197790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.197800] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:58.204610] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.204623] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.204634] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:58.204717] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1565 [D 20:41:58.204741] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.204752] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 55/70. [D 20:41:58.207218] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1565 [D 20:41:58.207234] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 56/70. [D 20:41:58.404937] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.404971] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.404981] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:58.405155] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1569 [D 20:41:58.405166] element 0: offset: 0x5b0030, size: 24 [D 20:41:58.405177] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 57/70. [D 20:41:58.407541] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1569 [D 20:41:58.407558] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 58/70. [D 20:41:58.661791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.661830] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.661840] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.662205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1572 [D 20:41:58.662220] element 0: offset: 0x61f310, size: 24 [D 20:41:58.662232] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 59/70. [D 20:41:58.662361] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1572 [D 20:41:58.662396] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 60/70. [D 20:41:58.678428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1572 [D 20:41:58.678443] element 0: offset: 0x61f310, size: 24 [D 20:41:58.678453] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 0/70. [D 20:41:58.680794] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.680808] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.680817] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.686503] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.686516] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.686527] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.686612] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1575 [D 20:41:58.686636] element 0: offset: 0x61ee50, size: 24 [D 20:41:58.686648] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 1/70. [D 20:41:58.686699] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1575 [D 20:41:58.686754] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 2/70. [D 20:41:58.703723] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1575 [D 20:41:58.703739] element 0: offset: 0x61ee50, size: 24 [D 20:41:58.703749] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 3/70. [D 20:41:58.706141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.706156] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.706166] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.712184] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.712200] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.712208] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.714248] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1578 [D 20:41:58.714261] element 0: offset: 0x66e730, size: 24 [D 20:41:58.714271] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 4/70. [D 20:41:58.714367] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1578 [D 20:41:58.714420] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 5/70. [D 20:41:58.731994] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1578 [D 20:41:58.732054] element 0: offset: 0x66e730, size: 24 [D 20:41:58.732069] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 6/70. [D 20:41:58.734393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.734408] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.734419] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.739866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.739879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.739890] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.740004] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1581 [D 20:41:58.740022] element 0: offset: 0x620d50, size: 24 [D 20:41:58.740033] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 7/70. [D 20:41:58.742540] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1581 [D 20:41:58.742558] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 8/70. [D 20:41:58.757531] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1581 [D 20:41:58.757546] element 0: offset: 0x620d50, size: 24 [D 20:41:58.757556] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 9/70. [D 20:41:58.757787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.757801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.757821] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.765259] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.765272] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.765282] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.765370] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1584 [D 20:41:58.765396] element 0: offset: 0x61f800, size: 24 [D 20:41:58.765408] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 10/70. [D 20:41:58.767865] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1584 [D 20:41:58.767880] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 11/70. [D 20:41:58.782620] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1584 [D 20:41:58.782635] element 0: offset: 0x61f800, size: 24 [D 20:41:58.782646] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 12/70. [D 20:41:58.784966] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.784980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.784989] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.790304] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.790318] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.790329] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.790413] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1587 [D 20:41:58.790428] element 0: offset: 0x655e70, size: 24 [D 20:41:58.790437] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 13/70. [D 20:41:58.790532] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1587 [D 20:41:58.790595] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 14/70. [D 20:41:58.806581] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1587 [D 20:41:58.806595] element 0: offset: 0x655e70, size: 24 [D 20:41:58.806606] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 15/70. [D 20:41:58.808930] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.808944] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.808953] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.813788] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.813802] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.813811] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:41:58.814235] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1590 [D 20:41:58.814248] element 0: offset: 0x61ee50, size: 24 [D 20:41:58.814259] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 16/70. [D 20:41:58.814354] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1590 [D 20:41:58.814418] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 17/70. [D 20:41:58.892736] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1565 [D 20:41:58.892769] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.892781] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 18/70. [D 20:41:58.895159] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.895174] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.895184] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:41:58.901917] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1551 [D 20:41:58.901935] element 0: offset: 0x691fe0, size: 24 [D 20:41:58.901947] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 19/70. [D 20:41:58.904126] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.904139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.904149] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:58.910614] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.910628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.910639] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:58.910761] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1593 [D 20:41:58.910779] element 0: offset: 0x655e70, size: 24 [D 20:41:58.910789] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 20/70. [D 20:41:58.913306] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1593 [D 20:41:58.913326] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 21/70. [D 20:41:58.930209] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1593 [D 20:41:58.930269] element 0: offset: 0x655e70, size: 24 [D 20:41:58.930284] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 22/70. [D 20:41:58.932579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.932594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.932604] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:58.938718] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:58.938731] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.938742] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:58.938822] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1596 [D 20:41:58.938834] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.938845] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 23/70. [D 20:41:58.938952] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1596 [D 20:41:58.939004] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 24/70. [D 20:41:58.954211] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1596 [D 20:41:58.954226] element 0: offset: 0x61fad0, size: 24 [D 20:41:58.954236] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 25/70. [D 20:41:58.956585] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:58.956599] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:58.956608] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:59.214109] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1569 [D 20:41:59.214177] element 0: offset: 0x5b0030, size: 24 [D 20:41:59.214262] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 26/70. [D 20:41:59.216646] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.216661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.216671] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.223095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.223110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.223119] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.223287] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1599 [D 20:41:59.223299] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.223309] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 27/70. [D 20:41:59.225916] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1599 [D 20:41:59.225951] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 28/70. [D 20:41:59.317642] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1590 [D 20:41:59.317672] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.317686] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 29/70. [D 20:41:59.320296] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.320311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.320379] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.326558] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.326644] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.326655] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.326797] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1602 [D 20:41:59.326812] element 0: offset: 0x61fad0, size: 24 [D 20:41:59.326823] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 30/70. [D 20:41:59.329554] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1602 [D 20:41:59.329572] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 31/70. [D 20:41:59.344467] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1602 [D 20:41:59.344528] element 0: offset: 0x61fad0, size: 24 [D 20:41:59.344543] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 32/70. [D 20:41:59.347014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.347029] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.347040] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.445393] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1599 [D 20:41:59.445463] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.445480] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 33/70. [D 20:41:59.445843] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.445859] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.445869] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.454486] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.454501] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.454512] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.454629] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1605 [D 20:41:59.454648] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.454659] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 34/70. [D 20:41:59.457044] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1605 [D 20:41:59.457062] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 35/70. [D 20:41:59.473589] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1605 [D 20:41:59.473648] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.473663] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 36/70. [D 20:41:59.475850] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.475865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.475875] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.481831] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.481845] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.481856] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.482487] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1608 [D 20:41:59.482501] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.482512] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 37/70. [D 20:41:59.482618] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1608 [D 20:41:59.482675] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 38/70. [D 20:41:59.499376] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1608 [D 20:41:59.499391] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.499401] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 39/70. [D 20:41:59.501575] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.501588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.501598] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.508022] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.508036] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.508047] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.508129] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1611 [D 20:41:59.508144] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.508153] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 40/70. [D 20:41:59.510528] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1611 [D 20:41:59.510544] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 41/70. [D 20:41:59.526117] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1611 [D 20:41:59.526133] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.526143] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 42/70. [D 20:41:59.528487] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.528501] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.528511] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.534801] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.534815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.534826] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.534909] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1614 [D 20:41:59.534924] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.534934] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 43/70. [D 20:41:59.535031] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1614 [D 20:41:59.535089] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 44/70. [D 20:41:59.622323] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1614 [D 20:41:59.622391] element 0: offset: 0x691fe0, size: 24 [D 20:41:59.622456] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 45/70. [D 20:41:59.624756] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.624771] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.624781] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.631582] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.631599] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.631610] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.631693] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1617 [D 20:41:59.631706] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.631717] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 46/70. [D 20:41:59.631825] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1617 [D 20:41:59.631875] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 47/70. [D 20:41:59.647436] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.647452] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.647463] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.649896] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1619 [D 20:41:59.649956] element 0: offset: 0x61fad0, size: 24 [D 20:41:59.649973] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 48/70. [D 20:41:59.652367] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1619 [D 20:41:59.652434] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 49/70. [D 20:41:59.653841] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1617 [D 20:41:59.653860] element 0: offset: 0x61ee50, size: 24 [D 20:41:59.655466] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 50/70. [D 20:41:59.655564] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.655578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.655600] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.667514] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.667531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.667541] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.668319] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1623 [D 20:41:59.668330] element 0: offset: 0x66e730, size: 24 [D 20:41:59.668341] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 51/70. [D 20:41:59.668360] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1619 [D 20:41:59.668370] element 0: offset: 0x2aaaab203f80, size: 24 [D 20:41:59.668392] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 52/70. [D 20:41:59.670953] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1623 [D 20:41:59.670971] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 53/70. [D 20:41:59.670989] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.670999] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.671056] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.685310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.685326] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.685334] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.685355] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.685364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.685373] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:41:59.686425] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1623 [D 20:41:59.686437] element 0: offset: 0x2aaaab2009f0, size: 24 [D 20:41:59.686447] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 54/70. [D 20:41:59.686479] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1626 [D 20:41:59.686489] element 0: offset: 0x2aaaab200ac0, size: 24 [D 20:41:59.686499] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 55/70. [D 20:41:59.686512] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1628 [D 20:41:59.686525] element 0: offset: 0x2aaaab207c30, size: 24 [D 20:41:59.686550] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 56/70. [D 20:41:59.689187] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.689201] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.689210] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:41:59.689231] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1626 [D 20:41:59.689243] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 57/70. [D 20:41:59.689266] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1628 [D 20:41:59.689278] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 58/70. [D 20:41:59.719256] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1626 [D 20:41:59.719319] element 0: offset: 0x2aaaab2069c0, size: 24 [D 20:41:59.719335] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 59/70. [D 20:41:59.721638] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.721653] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.721664] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.721698] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1628 [D 20:41:59.721709] element 0: offset: 0x2aaaab207c30, size: 24 [D 20:41:59.721721] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 60/70. [D 20:41:59.721781] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.721806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.721816] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:41:59.727690] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.727704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.727715] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:41:59.727831] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1632 [D 20:41:59.727849] element 0: offset: 0x2aaaab207c70, size: 24 [D 20:41:59.727860] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 0/70. [D 20:41:59.727924] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1632 [D 20:41:59.727974] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 1/70. [D 20:41:59.741780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.741794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.741803] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.743242] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1632 [D 20:41:59.743254] element 0: offset: 0x2aaaab207c70, size: 24 [D 20:41:59.743263] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 2/70. [D 20:41:59.743302] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1634 [D 20:41:59.743313] element 0: offset: 0x2aaaab209460, size: 24 [D 20:41:59.743323] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 3/70. [D 20:41:59.745786] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.745799] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.745809] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.745832] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1634 [D 20:41:59.745844] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 4/70. [D 20:41:59.760661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.760675] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.760686] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.760738] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1638 [D 20:41:59.760750] element 0: offset: 0x2aaaab202ed0, size: 24 [D 20:41:59.760759] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 5/70. [D 20:41:59.765718] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1634 [D 20:41:59.765772] element 0: offset: 0x2aaaab209460, size: 24 [D 20:41:59.765787] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 6/70. [D 20:41:59.765843] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1638 [D 20:41:59.765866] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 7/70. [D 20:41:59.768092] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:41:59.768106] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.768116] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:41:59.781066] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:41:59.781081] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:41:59.781092] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:41:59.781183] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1640 [D 20:41:59.781210] element 0: offset: 0x2aaaab2092d0, size: 24 [D 20:41:59.781221] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 8/70. [D 20:41:59.781844] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1640 [D 20:41:59.783593] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 9/70. [D 20:42:00.060854] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.060914] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.060924] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:00.061083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1644 [D 20:42:00.061096] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.061108] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 10/70. [D 20:42:00.064329] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1644 [D 20:42:00.064350] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 11/70. [D 20:42:00.082337] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1644 [D 20:42:00.082403] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.082417] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 12/70. [D 20:42:00.084601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.084616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.084626] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:00.086782] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1638 [D 20:42:00.086836] element 0: offset: 0x2aaaab202ed0, size: 24 [D 20:42:00.086853] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 13/70. [D 20:42:00.089023] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.089038] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.089048] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:00.093855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.093869] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.093881] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:00.096177] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.096191] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.096200] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:00.096222] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1648 [D 20:42:00.096232] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.096243] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 14/70. [D 20:42:00.096261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1650 [D 20:42:00.096273] element 0: offset: 0x2aaaab206930, size: 24 [D 20:42:00.096283] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 15/70. [D 20:42:00.098840] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1648 [D 20:42:00.098859] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 16/70. [D 20:42:00.098886] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1650 [D 20:42:00.098898] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 17/70. [D 20:42:00.285083] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.285148] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.285158] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.285243] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1653 [D 20:42:00.285257] element 0: offset: 0x2aaaab203200, size: 24 [D 20:42:00.285271] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 18/70. [D 20:42:00.287791] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1653 [D 20:42:00.287810] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 19/70. [D 20:42:00.303488] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1653 [D 20:42:00.303506] element 0: offset: 0x2aaaab203200, size: 24 [D 20:42:00.303517] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 20/70. [D 20:42:00.305686] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.305700] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.305710] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.311780] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.311795] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.311807] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.311894] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1656 [D 20:42:00.311912] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.311922] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 21/70. [D 20:42:00.314403] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1656 [D 20:42:00.314418] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 22/70. [D 20:42:00.329261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1656 [D 20:42:00.329277] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.329287] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 23/70. [D 20:42:00.329857] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.329871] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.329881] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.337014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.337027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.337038] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.337125] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1659 [D 20:42:00.337140] element 0: offset: 0x2aaaab203200, size: 24 [D 20:42:00.337151] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 24/70. [D 20:42:00.339499] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1659 [D 20:42:00.339515] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 25/70. [D 20:42:00.355147] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1659 [D 20:42:00.355162] element 0: offset: 0x2aaaab203200, size: 24 [D 20:42:00.355173] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 26/70. [D 20:42:00.357457] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.357470] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.357480] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.362975] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.362989] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.363000] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.363083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1662 [D 20:42:00.363100] element 0: offset: 0x2aaaab207c10, size: 24 [D 20:42:00.363110] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 27/70. [D 20:42:00.363205] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1662 [D 20:42:00.363262] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 28/70. [D 20:42:00.378911] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1662 [D 20:42:00.378926] element 0: offset: 0x2aaaab207c10, size: 24 [D 20:42:00.378937] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 29/70. [D 20:42:00.381231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.381244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.381253] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.386562] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.386575] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.386587] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.386671] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1665 [D 20:42:00.386689] element 0: offset: 0x2aaaab20beb0, size: 24 [D 20:42:00.386699] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 30/70. [D 20:42:00.386794] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1665 [D 20:42:00.386847] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 31/70. [D 20:42:00.570037] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1648 [D 20:42:00.570157] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.570172] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 32/70. [D 20:42:00.572325] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.572340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.572351] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.577868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.577882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.577894] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.578273] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1668 [D 20:42:00.578286] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.578297] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 33/70. [D 20:42:00.578410] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1668 [D 20:42:00.578450] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 34/70. [D 20:42:00.596535] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1668 [D 20:42:00.596598] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.596614] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 35/70. [D 20:42:00.598799] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.598814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.598825] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.604472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.604486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.604496] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.604575] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1671 [D 20:42:00.604588] element 0: offset: 0x2aaaab206770, size: 24 [D 20:42:00.604598] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 36/70. [D 20:42:00.604709] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1671 [D 20:42:00.604745] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 37/70. [D 20:42:00.621956] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1671 [D 20:42:00.622017] element 0: offset: 0x2aaaab206770, size: 24 [D 20:42:00.622031] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 38/70. [D 20:42:00.624198] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.624212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.624222] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.629842] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.629860] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.629871] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.629949] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1674 [D 20:42:00.629962] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.629973] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 39/70. [D 20:42:00.630084] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1674 [D 20:42:00.630130] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 40/70. [D 20:42:00.647292] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1674 [D 20:42:00.647357] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.647373] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 41/70. [D 20:42:00.649608] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.649628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.649638] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.653868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.653883] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.653893] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.655205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1677 [D 20:42:00.655218] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.655229] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 42/70. [D 20:42:00.655336] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1677 [D 20:42:00.655456] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 43/70. [D 20:42:00.673036] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1677 [D 20:42:00.673100] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.673116] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 44/70. [D 20:42:00.675523] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.675539] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.675549] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.680895] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.680954] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.680964] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.686518] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1680 [D 20:42:00.686585] element 0: offset: 0x2aaaab207c10, size: 24 [D 20:42:00.686601] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 45/70. [D 20:42:00.686625] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1665 [D 20:42:00.686635] element 0: offset: 0x2aaaab20beb0, size: 24 [D 20:42:00.686646] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 46/70. [D 20:42:00.686659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1650 [D 20:42:00.686669] element 0: offset: 0x2aaaab206930, size: 24 [D 20:42:00.686687] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 47/70. [D 20:42:00.686754] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1640 [D 20:42:00.686779] element 0: offset: 0x2aaaab2092d0, size: 24 [D 20:42:00.686791] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 48/70. [D 20:42:00.688973] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1680 [D 20:42:00.688991] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 49/70. [D 20:42:00.689023] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.689034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.689043] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.689060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.689069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.689081] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:00.689095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.689120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.689129] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:00.701868] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.701882] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.701893] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:00.701924] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.701934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.701943] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:00.701960] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.701970] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.701979] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.702002] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1682 [D 20:42:00.702013] element 0: offset: 0x2aaaab203920, size: 24 [D 20:42:00.702038] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 50/70. [D 20:42:00.702052] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1686 [D 20:42:00.702061] element 0: offset: 0x2aaaab20beb0, size: 24 [D 20:42:00.702092] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 51/70. [D 20:42:00.702168] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1689 [D 20:42:00.702181] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:00.702195] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 52/70. [D 20:42:00.702237] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1682 [D 20:42:00.702256] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 53/70. [D 20:42:00.702312] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1686 [D 20:42:00.702328] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 54/70. [D 20:42:00.702367] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1689 [D 20:42:00.702383] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 55/70. [D 20:42:00.707660] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1680 [D 20:42:00.707677] element 0: offset: 0x63a130, size: 24 [D 20:42:00.707690] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 56/70. [D 20:42:00.707812] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:00.707828] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.707839] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:00.743871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:00.743887] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:00.743898] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:00.743961] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1692 [D 20:42:00.743974] element 0: offset: 0x61fad0, size: 24 [D 20:42:00.743986] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 57/70. [D 20:42:00.744084] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1692 [D 20:42:00.744153] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 58/70. [D 20:42:01.140638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1682 [D 20:42:01.140694] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.140711] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 59/70. [D 20:42:01.140896] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.140912] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.140923] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:01.146804] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.146821] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.146831] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:01.146931] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1694 [D 20:42:01.146944] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.146957] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 60/70. [D 20:42:01.147029] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1694 [D 20:42:01.147083] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 0/70. [D 20:42:01.164801] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1694 [D 20:42:01.164819] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.164832] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 1/70. [D 20:42:01.164877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.164890] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.164900] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:01.173125] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1689 [D 20:42:01.173141] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.173154] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 2/70. [D 20:42:01.173233] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.173248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.173259] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:01.175626] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.175643] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.175653] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:01.175705] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1697 [D 20:42:01.175718] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.175730] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 3/70. [D 20:42:01.175789] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1697 [D 20:42:01.175849] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 4/70. [D 20:42:01.188830] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.188880] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.188892] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:01.189005] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1701 [D 20:42:01.189019] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.189034] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 5/70. [D 20:42:01.189143] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1701 [D 20:42:01.189194] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 6/70. [D 20:42:01.189414] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1686 [D 20:42:01.189432] element 0: offset: 0x61f310, size: 24 [D 20:42:01.189444] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 7/70. [D 20:42:01.189547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.189563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.189573] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:01.193569] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1697 [D 20:42:01.193619] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.193634] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 8/70. [D 20:42:01.193798] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.193814] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.193824] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:01.201128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.201144] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.201155] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:01.201258] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1704 [D 20:42:01.201270] element 0: offset: 0x61f0e0, size: 24 [D 20:42:01.201282] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 9/70. [D 20:42:01.201382] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1704 [D 20:42:01.201436] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 10/70. [D 20:42:01.207781] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1701 [D 20:42:01.207830] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.207846] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 11/70. [D 20:42:01.207979] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.207992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.208004] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:01.210421] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1692 [D 20:42:01.210457] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.210474] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 12/70. [D 20:42:01.210618] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.210680] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.210691] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:01.213893] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.213908] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.213917] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:01.215759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1706 [D 20:42:01.215771] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.215784] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 13/70. [D 20:42:01.215856] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1706 [D 20:42:01.215884] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 14/70. [D 20:42:01.217237] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1704 [D 20:42:01.217252] element 0: offset: 0x61f0e0, size: 24 [D 20:42:01.218225] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 15/70. [D 20:42:01.218323] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.218335] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.218349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:01.232201] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.232217] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.232225] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:01.232332] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1710 [D 20:42:01.232343] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.232352] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 16/70. [D 20:42:01.232445] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1710 [D 20:42:01.232502] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 17/70. [D 20:42:01.233225] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1706 [D 20:42:01.233240] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.234926] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 18/70. [D 20:42:01.235021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.235034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.235043] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:01.249684] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1710 [D 20:42:01.249756] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.249772] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 19/70. [D 20:42:01.252104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.252118] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.252128] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:01.257587] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.257601] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.257610] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:01.257697] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1713 [D 20:42:01.257728] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.257740] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 20/70. [D 20:42:01.260192] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1713 [D 20:42:01.260210] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 21/70. [D 20:42:01.278525] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.278540] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.278548] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:01.278649] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1716 [D 20:42:01.278659] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.278668] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 22/70. [D 20:42:01.281025] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1716 [D 20:42:01.281041] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 23/70. [D 20:42:01.281056] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1713 [D 20:42:01.281065] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.281083] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 24/70. [D 20:42:01.281156] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.281168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.281178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:01.293812] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1716 [D 20:42:01.293826] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.293837] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 25/70. [D 20:42:01.296093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.296107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.296116] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:01.835778] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.835815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.835825] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:01.835977] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1719 [D 20:42:01.835989] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.836001] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 26/70. [D 20:42:01.838483] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1719 [D 20:42:01.838501] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 27/70. [D 20:42:01.854650] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1719 [D 20:42:01.854665] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.854675] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 28/70. [D 20:42:01.856967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.856980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.856990] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:01.865924] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.865938] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.865950] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:01.867807] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1722 [D 20:42:01.867821] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.867832] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 29/70. [D 20:42:01.867930] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1722 [D 20:42:01.867991] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 30/70. [D 20:42:01.886353] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1722 [D 20:42:01.886418] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.886432] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 31/70. [D 20:42:01.888671] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.888686] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.888696] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:01.895668] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.895686] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.895698] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:01.895803] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1725 [D 20:42:01.895817] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.895828] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 32/70. [D 20:42:01.895939] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1725 [D 20:42:01.895997] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 33/70. [D 20:42:01.912710] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1725 [D 20:42:01.912725] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.912736] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 34/70. [D 20:42:01.913922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.913936] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.913946] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:01.921465] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.921480] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.921490] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:01.921573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1728 [D 20:42:01.921592] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.921601] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 35/70. [D 20:42:01.921697] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1728 [D 20:42:01.921759] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 36/70. [D 20:42:01.939016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.939032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.939041] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:01.939067] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1728 [D 20:42:01.939079] element 0: offset: 0x61fad0, size: 24 [D 20:42:01.939089] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 37/70. [D 20:42:01.939207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1731 [D 20:42:01.939220] element 0: offset: 0x636d10, size: 24 [D 20:42:01.939238] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 38/70. [D 20:42:01.939273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.939284] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.939293] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:01.941631] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1731 [D 20:42:01.944728] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 39/70. [D 20:42:01.957689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.957704] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.957713] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:01.957736] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.957746] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.957754] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:01.959169] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1731 [D 20:42:01.959181] element 0: offset: 0x636d10, size: 24 [D 20:42:01.959192] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 40/70. [D 20:42:01.959225] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1734 [D 20:42:01.959234] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.959244] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 41/70. [D 20:42:01.959257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1736 [D 20:42:01.959270] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.959299] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 42/70. [D 20:42:01.961648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.961661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.961672] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:01.961696] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1734 [D 20:42:01.961722] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1736 [D 20:42:01.962616] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 43/70. [D 20:42:01.962697] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 44/70. [D 20:42:01.993381] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.993445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.993456] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:01.993506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:01.993516] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.993525] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:01.993555] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1734 [D 20:42:01.993566] element 0: offset: 0x61ee50, size: 24 [D 20:42:01.993579] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 45/70. [D 20:42:01.993599] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1736 [D 20:42:01.993609] element 0: offset: 0x5b0030, size: 24 [D 20:42:01.993666] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 46/70. [D 20:42:01.993687] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1740 [D 20:42:01.993697] element 0: offset: 0x63dc60, size: 24 [D 20:42:01.993706] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 47/70. [D 20:42:01.993721] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1743 [D 20:42:01.993730] element 0: offset: 0x61f310, size: 24 [D 20:42:01.993740] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 48/70. [D 20:42:01.996084] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.996098] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.996108] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:01.996125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:01.996137] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:01.996146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:01.996183] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1740 [D 20:42:01.996212] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1743 [D 20:42:01.996605] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 49/70. [D 20:42:01.996678] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 50/70. [D 20:42:02.023879] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.023911] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.023920] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.023946] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.023955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.023964] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.028226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1746 [D 20:42:02.028239] element 0: offset: 0x5b0030, size: 24 [D 20:42:02.028250] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 51/70. [D 20:42:02.028266] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1748 [D 20:42:02.028276] element 0: offset: 0x61f800, size: 24 [D 20:42:02.028286] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 52/70. [D 20:42:02.028301] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1743 [D 20:42:02.028330] element 0: offset: 0x61f310, size: 24 [D 20:42:02.028340] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 53/70. [D 20:42:02.028359] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1740 [D 20:42:02.028368] element 0: offset: 0x63dc60, size: 24 [D 20:42:02.028377] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 54/70. [D 20:42:02.030993] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1746 [D 20:42:02.031009] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 55/70. [D 20:42:02.031033] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1748 [D 20:42:02.031045] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 56/70. [D 20:42:02.031066] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.031076] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.031088] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.031104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.031113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.031121] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.058982] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.058996] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.059005] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.059025] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.059034] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.059043] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.061981] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1752 [D 20:42:02.062042] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.062057] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 57/70. [D 20:42:02.062081] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1755 [D 20:42:02.062091] element 0: offset: 0x657310, size: 24 [D 20:42:02.062100] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 58/70. [D 20:42:02.062118] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1746 [D 20:42:02.062135] element 0: offset: 0x5b0030, size: 24 [D 20:42:02.062145] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 59/70. [D 20:42:02.064665] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1748 [D 20:42:02.064680] element 0: offset: 0x61f800, size: 24 [D 20:42:02.064690] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 60/70. [D 20:42:02.064731] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1752 [D 20:42:02.064745] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 0/70. [D 20:42:02.064773] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1755 [D 20:42:02.064785] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 1/70. [D 20:42:02.064844] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.064889] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.064901] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.064926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.064937] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.064947] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.091536] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.091553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.091567] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.091599] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.091611] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.091622] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.091703] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1758 [D 20:42:02.091719] element 0: offset: 0x63df90, size: 24 [D 20:42:02.091733] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 2/70. [D 20:42:02.091755] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1760 [D 20:42:02.091766] element 0: offset: 0x61ee50, size: 24 [D 20:42:02.091777] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 3/70. [D 20:42:02.091852] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1758 [D 20:42:02.091885] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 4/70. [D 20:42:02.091893] BMI_post_recv: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 1760 [D 20:42:02.091961] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 5/70. [D 20:42:02.095433] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1755 [D 20:42:02.095475] element 0: offset: 0x657310, size: 24 [D 20:42:02.095490] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 6/70. [D 20:42:02.095617] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.095634] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.095682] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.100220] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1752 [D 20:42:02.100235] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.100247] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 7/70. [D 20:42:02.100361] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.100377] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.100386] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.117793] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.117812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.117821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.117852] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.117863] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.117875] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.117986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1764 [D 20:42:02.117999] element 0: offset: 0x61f310, size: 24 [D 20:42:02.118011] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 8/70. [D 20:42:02.118031] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1767 [D 20:42:02.118042] element 0: offset: 0x620d50, size: 24 [D 20:42:02.118053] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 9/70. [D 20:42:02.118130] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1764 [D 20:42:02.118171] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1767 [D 20:42:02.118173] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 10/70. [D 20:42:02.118258] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 11/70. [D 20:42:02.123717] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1760 [D 20:42:02.123754] element 0: offset: 0x61ee50, size: 24 [D 20:42:02.123771] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 12/70. [D 20:42:02.123812] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1758 [D 20:42:02.123823] element 0: offset: 0x63df90, size: 24 [D 20:42:02.123834] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 13/70. [D 20:42:02.126243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.126295] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.126305] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.126324] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.126334] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.126342] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.148846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.148861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.148870] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.148901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.148910] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.148919] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.149013] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1769 [D 20:42:02.149025] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.149037] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 14/70. [D 20:42:02.149056] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1773 [D 20:42:02.149069] element 0: offset: 0x63dc60, size: 24 [D 20:42:02.149079] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 15/70. [D 20:42:02.154545] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1769 [D 20:42:02.154606] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 16/70. [D 20:42:02.154638] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1773 [D 20:42:02.154650] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 17/70. [D 20:42:02.154668] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1764 [D 20:42:02.156916] element 0: offset: 0x61f310, size: 24 [D 20:42:02.156929] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 18/70. [D 20:42:02.156944] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1767 [D 20:42:02.156954] element 0: offset: 0x620d50, size: 24 [D 20:42:02.156964] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 19/70. [D 20:42:02.159232] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.159246] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.159257] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.159273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.159286] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.159295] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.184926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.184941] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.184949] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.184981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.184991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.185000] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:02.185083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1776 [D 20:42:02.185103] element 0: offset: 0x641100, size: 24 [D 20:42:02.185113] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 20/70. [D 20:42:02.185125] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1779 [D 20:42:02.185135] element 0: offset: 0x657310, size: 24 [D 20:42:02.185149] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 21/70. [D 20:42:02.185990] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1769 [D 20:42:02.186017] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.186030] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 22/70. [D 20:42:02.190452] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1773 [D 20:42:02.190511] element 0: offset: 0x63dc60, size: 24 [D 20:42:02.190525] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 23/70. [D 20:42:02.190575] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1776 [D 20:42:02.190591] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 24/70. [D 20:42:02.190623] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1779 [D 20:42:02.190636] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 25/70. [D 20:42:02.190665] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.190675] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.190684] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:02.192970] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.192985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.192994] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.219548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.219565] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.219574] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.219708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1781 [D 20:42:02.219720] element 0: offset: 0x61ee50, size: 24 [D 20:42:02.219731] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 26/70. [D 20:42:02.221242] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1776 [D 20:42:02.221296] element 0: offset: 0x641100, size: 24 [D 20:42:02.221311] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 27/70. [D 20:42:02.225033] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1779 [D 20:42:02.225081] element 0: offset: 0x657310, size: 24 [D 20:42:02.225095] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 28/70. [D 20:42:02.225142] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1781 [D 20:42:02.225158] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 29/70. [D 20:42:02.225195] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.225206] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.225249] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.227541] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.227555] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.227565] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:02.242590] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.242605] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.242613] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:02.242645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.242655] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.242663] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.242753] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1785 [D 20:42:02.242764] element 0: offset: 0x61f310, size: 24 [D 20:42:02.242773] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 30/70. [D 20:42:02.242786] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1788 [D 20:42:02.242795] element 0: offset: 0x691fe0, size: 24 [D 20:42:02.242805] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 31/70. [D 20:42:02.245449] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1785 [D 20:42:02.245462] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 32/70. [D 20:42:02.245485] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1788 [D 20:42:02.245496] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 33/70. [D 20:42:02.276144] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1785 [D 20:42:02.276207] element 0: offset: 0x61f310, size: 24 [D 20:42:02.276222] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 34/70. [D 20:42:02.278422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.278437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.278448] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.281356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1788 [D 20:42:02.281409] element 0: offset: 0x691fe0, size: 24 [D 20:42:02.281424] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 35/70. [D 20:42:02.284584] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.284599] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.284609] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:02.284630] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.284640] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.284649] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:02.284758] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1791 [D 20:42:02.284775] element 0: offset: 0x62b0a0, size: 24 [D 20:42:02.284785] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 36/70. [D 20:42:02.284852] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1791 [D 20:42:02.284905] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 37/70. [D 20:42:02.300859] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.300873] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.300884] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.300946] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1794 [D 20:42:02.300958] element 0: offset: 0x657310, size: 24 [D 20:42:02.300967] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 38/70. [D 20:42:02.301027] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1794 [D 20:42:02.301079] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 39/70. [D 20:42:02.306205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1791 [D 20:42:02.306260] element 0: offset: 0x62b0a0, size: 24 [D 20:42:02.306275] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 40/70. [D 20:42:02.308580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.308594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.308604] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.316299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.316314] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.316324] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.316412] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1797 [D 20:42:02.316426] element 0: offset: 0x6151c0, size: 24 [D 20:42:02.316437] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 41/70. [D 20:42:02.316555] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1797 [D 20:42:02.316599] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 42/70. [D 20:42:02.321453] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1794 [D 20:42:02.321508] element 0: offset: 0x657310, size: 24 [D 20:42:02.321523] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 43/70. [D 20:42:02.321976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.321991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.322001] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.334203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.334218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.334229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.334310] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1800 [D 20:42:02.334323] element 0: offset: 0x691fe0, size: 24 [D 20:42:02.334333] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 44/70. [D 20:42:02.336772] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1800 [D 20:42:02.336789] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 45/70. [D 20:42:02.742857] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1781 [D 20:42:02.742924] element 0: offset: 0x61ee50, size: 24 [D 20:42:02.742939] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 46/70. [D 20:42:02.745211] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.745225] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.745235] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.751097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.751111] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.751122] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.751203] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1802 [D 20:42:02.751216] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.751226] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 47/70. [D 20:42:02.751296] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1802 [D 20:42:02.751335] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 48/70. [D 20:42:02.768154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1802 [D 20:42:02.768215] element 0: offset: 0x61fad0, size: 24 [D 20:42:02.768230] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 49/70. [D 20:42:02.770021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.770035] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.770045] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.780333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.780348] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.780359] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.780438] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1805 [D 20:42:02.780451] element 0: offset: 0x61f800, size: 24 [D 20:42:02.780461] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 50/70. [D 20:42:02.780540] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1805 [D 20:42:02.780574] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 51/70. [D 20:42:02.799362] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1805 [D 20:42:02.799421] element 0: offset: 0x61f800, size: 24 [D 20:42:02.799435] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 52/70. [D 20:42:02.801555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.801569] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.801578] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.808161] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.808175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.808186] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:02.808267] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1808 [D 20:42:02.808280] element 0: offset: 0x641100, size: 24 [D 20:42:02.808291] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 53/70. [D 20:42:02.808365] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 1808 [D 20:42:02.808403] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 54/70. [D 20:42:02.826049] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1808 [D 20:42:02.826109] element 0: offset: 0x641100, size: 24 [D 20:42:02.826123] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 55/70. [D 20:42:02.828390] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.828404] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.828414] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:02.864527] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1797 [D 20:42:02.864592] element 0: offset: 0x6151c0, size: 24 [D 20:42:02.864607] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 56/70. [D 20:42:02.866999] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.867014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.867025] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:02.880653] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.880668] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.880679] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:02.880759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1812 [D 20:42:02.880772] element 0: offset: 0x63df90, size: 24 [D 20:42:02.880783] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 57/70. [D 20:42:02.880849] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1812 [D 20:42:02.880902] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 58/70. [D 20:42:02.897508] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1812 [D 20:42:02.897568] element 0: offset: 0x63df90, size: 24 [D 20:42:02.897582] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 59/70. [D 20:42:02.898038] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.898053] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.898062] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:02.909773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.909787] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.909798] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:02.909880] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1815 [D 20:42:02.909893] element 0: offset: 0x61f310, size: 24 [D 20:42:02.909904] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 60/70. [D 20:42:02.909970] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1815 [D 20:42:02.910025] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 0/70. [D 20:42:02.927651] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1815 [D 20:42:02.927709] element 0: offset: 0x61f310, size: 24 [D 20:42:02.927724] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 1/70. [D 20:42:02.929990] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:02.930004] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.930019] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:02.937855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:02.937869] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:02.937880] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:02.937960] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1818 [D 20:42:02.937974] element 0: offset: 0x620d50, size: 24 [D 20:42:02.937984] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 2/70. [D 20:42:02.938052] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1818 [D 20:42:02.938121] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 3/70. [D 20:42:03.122152] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1818 [D 20:42:03.122222] element 0: offset: 0x620d50, size: 24 [D 20:42:03.122238] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 4/70. [D 20:42:03.122262] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1800 [D 20:42:03.122278] element 0: offset: 0x691fe0, size: 24 [D 20:42:03.122288] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 5/70. [D 20:42:03.124616] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.124629] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.124638] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:03.124654] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.124663] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.124671] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.133318] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.133337] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.133346] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.133381] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.133391] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.133399] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:03.133490] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1822 [D 20:42:03.133501] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.133512] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 6/70. [D 20:42:03.133526] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1824 [D 20:42:03.133535] element 0: offset: 0x6151c0, size: 24 [D 20:42:03.133544] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 7/70. [D 20:42:03.136112] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1822 [D 20:42:03.136130] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 8/70. [D 20:42:03.136155] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1824 [D 20:42:03.136166] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 9/70. [D 20:42:03.167382] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1822 [D 20:42:03.167446] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.167460] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 10/70. [D 20:42:03.167648] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.167662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.167671] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:03.172640] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1824 [D 20:42:03.172654] element 0: offset: 0x6151c0, size: 24 [D 20:42:03.172665] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 11/70. [D 20:42:03.172740] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.172753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.172761] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.179625] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.179639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.179647] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.181944] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1827 [D 20:42:03.181958] element 0: offset: 0x66e860, size: 24 [D 20:42:03.181967] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 12/70. [D 20:42:03.182052] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1827 [D 20:42:03.182093] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 13/70. [D 20:42:03.201128] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1827 [D 20:42:03.201143] element 0: offset: 0x66e860, size: 24 [D 20:42:03.201153] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 14/70. [D 20:42:03.201231] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.201244] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.201252] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.207752] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.207766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.207774] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.210021] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1830 [D 20:42:03.210037] element 0: offset: 0x61f310, size: 24 [D 20:42:03.210047] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 15/70. [D 20:42:03.210120] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1830 [D 20:42:03.210166] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 16/70. [D 20:42:03.228152] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1830 [D 20:42:03.228167] element 0: offset: 0x61f310, size: 24 [D 20:42:03.228177] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 17/70. [D 20:42:03.228247] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.228260] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.228268] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.235039] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.235052] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.235060] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.237307] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1833 [D 20:42:03.237321] element 0: offset: 0x625600, size: 24 [D 20:42:03.237331] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 18/70. [D 20:42:03.237404] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1833 [D 20:42:03.237458] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 19/70. [D 20:42:03.257590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1833 [D 20:42:03.257605] element 0: offset: 0x625600, size: 24 [D 20:42:03.257615] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 20/70. [D 20:42:03.257693] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.257706] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.257714] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.264088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.264102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.264110] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.267128] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1836 [D 20:42:03.267141] element 0: offset: 0x620d50, size: 24 [D 20:42:03.267152] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 21/70. [D 20:42:03.267223] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1836 [D 20:42:03.267274] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 22/70. [D 20:42:03.285675] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1836 [D 20:42:03.285690] element 0: offset: 0x620d50, size: 24 [D 20:42:03.285700] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 23/70. [D 20:42:03.285776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.285790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.285798] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.521742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.521756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.521764] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.524011] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1838 [D 20:42:03.524025] element 0: offset: 0x624450, size: 24 [D 20:42:03.524034] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 24/70. [D 20:42:03.524104] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1838 [D 20:42:03.524149] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 25/70. [D 20:42:03.540151] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1838 [D 20:42:03.540166] element 0: offset: 0x624450, size: 24 [D 20:42:03.540176] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 26/70. [D 20:42:03.542452] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.542464] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.542472] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.550583] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.550597] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.550605] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.552654] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1841 [D 20:42:03.552668] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.552677] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 27/70. [D 20:42:03.552749] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1841 [D 20:42:03.552796] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 28/70. [D 20:42:03.572561] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1841 [D 20:42:03.572576] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.572586] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 29/70. [D 20:42:03.572658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.572670] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.572678] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.579033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.579046] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.579055] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.581294] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1844 [D 20:42:03.581307] element 0: offset: 0x655ed0, size: 24 [D 20:42:03.581317] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 30/70. [D 20:42:03.581415] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1844 [D 20:42:03.581481] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 31/70. [D 20:42:03.600705] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1844 [D 20:42:03.600720] element 0: offset: 0x655ed0, size: 24 [D 20:42:03.600730] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 32/70. [D 20:42:03.600806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.600820] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.600828] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.607148] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.607161] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.607170] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.609384] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1847 [D 20:42:03.609397] element 0: offset: 0x61fad0, size: 24 [D 20:42:03.609407] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 33/70. [D 20:42:03.609506] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1847 [D 20:42:03.609574] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 34/70. [D 20:42:03.627647] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1847 [D 20:42:03.627662] element 0: offset: 0x61fad0, size: 24 [D 20:42:03.627671] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 35/70. [D 20:42:03.627743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.627755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.627764] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.633952] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.633966] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.633974] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.634126] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1850 [D 20:42:03.634140] element 0: offset: 0x62b0a0, size: 24 [D 20:42:03.634150] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 36/70. [D 20:42:03.634227] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1850 [D 20:42:03.634264] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 37/70. [D 20:42:03.650952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1850 [D 20:42:03.650967] element 0: offset: 0x62b0a0, size: 24 [D 20:42:03.650977] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 38/70. [D 20:42:03.651097] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.651111] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.651119] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.661963] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.661976] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.661984] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.664256] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1853 [D 20:42:03.664269] element 0: offset: 0x61ee50, size: 24 [D 20:42:03.664279] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 39/70. [D 20:42:03.664349] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1853 [D 20:42:03.664396] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 40/70. [D 20:42:03.684422] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1853 [D 20:42:03.684437] element 0: offset: 0x61ee50, size: 24 [D 20:42:03.684447] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 41/70. [D 20:42:03.684519] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.684531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.684539] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.690506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.690520] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.690528] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.692768] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1856 [D 20:42:03.692782] element 0: offset: 0x691fe0, size: 24 [D 20:42:03.692791] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 42/70. [D 20:42:03.692890] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1856 [D 20:42:03.692959] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 43/70. [D 20:42:03.712205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1856 [D 20:42:03.712220] element 0: offset: 0x691fe0, size: 24 [D 20:42:03.712230] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 44/70. [D 20:42:03.712302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.712314] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.712322] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.719001] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.719014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.719023] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.719058] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.719069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.719077] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:03.721343] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1861 [D 20:42:03.721357] element 0: offset: 0x61f800, size: 24 [D 20:42:03.721366] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 45/70. [D 20:42:03.721380] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1862 [D 20:42:03.721389] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.721398] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 46/70. [D 20:42:03.721474] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1861 [D 20:42:03.721511] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1862 [D 20:42:03.721544] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 47/70. [D 20:42:03.721606] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 48/70. [D 20:42:03.754927] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1862 [D 20:42:03.754979] element 0: offset: 0x63dc60, size: 24 [D 20:42:03.754993] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 49/70. [D 20:42:03.755142] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.755155] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.755163] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:03.757629] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1861 [D 20:42:03.757643] element 0: offset: 0x61f800, size: 24 [D 20:42:03.757654] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 50/70. [D 20:42:03.757720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.757732] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.757740] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.772764] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.772778] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.772786] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.775062] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1866 [D 20:42:03.775075] element 0: offset: 0x655ed0, size: 24 [D 20:42:03.775085] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 51/70. [D 20:42:03.775201] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1866 [D 20:42:03.775259] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 52/70. [D 20:42:03.791449] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1866 [D 20:42:03.791496] element 0: offset: 0x655ed0, size: 24 [D 20:42:03.791510] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 53/70. [D 20:42:03.791657] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.791669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.791677] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.799249] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.799263] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.799272] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.801501] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1869 [D 20:42:03.801514] element 0: offset: 0x61fad0, size: 24 [D 20:42:03.801524] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 54/70. [D 20:42:03.801640] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1869 [D 20:42:03.801682] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 55/70. [D 20:42:03.822930] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1869 [D 20:42:03.822945] element 0: offset: 0x61fad0, size: 24 [D 20:42:03.822955] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 56/70. [D 20:42:03.823033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.823047] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.823055] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.829196] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.829209] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.829218] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.830137] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1872 [D 20:42:03.830150] element 0: offset: 0x62b0a0, size: 24 [D 20:42:03.830160] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 57/70. [D 20:42:03.830208] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1872 [D 20:42:03.830276] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 58/70. [D 20:42:03.844184] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1872 [D 20:42:03.844230] element 0: offset: 0x62b0a0, size: 24 [D 20:42:03.844244] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 59/70. [D 20:42:03.844388] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.844400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.844408] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.857214] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.857227] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.857236] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.859347] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1875 [D 20:42:03.859360] element 0: offset: 0x61ee50, size: 24 [D 20:42:03.859370] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 60/70. [D 20:42:03.859480] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1875 [D 20:42:03.859528] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 0/70. [D 20:42:03.879461] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1875 [D 20:42:03.879476] element 0: offset: 0x61ee50, size: 24 [D 20:42:03.879486] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 1/70. [D 20:42:03.879557] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.879570] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.879579] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.885315] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.885329] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.885337] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.886142] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1878 [D 20:42:03.886155] element 0: offset: 0x691fe0, size: 24 [D 20:42:03.886166] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 2/70. [D 20:42:03.886250] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1878 [D 20:42:03.886332] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 3/70. [D 20:42:03.903237] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1878 [D 20:42:03.903282] element 0: offset: 0x691fe0, size: 24 [D 20:42:03.903296] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 4/70. [D 20:42:03.903441] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.903454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.903462] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.910461] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.910475] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.910483] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.912573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1881 [D 20:42:03.912586] element 0: offset: 0x61f800, size: 24 [D 20:42:03.912596] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 5/70. [D 20:42:03.912677] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1881 [D 20:42:03.912704] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 6/70. [D 20:42:03.932265] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1881 [D 20:42:03.932279] element 0: offset: 0x61f800, size: 24 [D 20:42:03.932289] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 7/70. [D 20:42:03.932367] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.932380] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.932388] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:03.938597] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:03.938611] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.938619] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:03.940740] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1884 [D 20:42:03.940753] element 0: offset: 0x6151c0, size: 24 [D 20:42:03.940763] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 8/70. [D 20:42:03.940831] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1884 [D 20:42:03.940881] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 9/70. [D 20:42:03.956460] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1884 [D 20:42:03.956505] element 0: offset: 0x6151c0, size: 24 [D 20:42:03.956519] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 10/70. [D 20:42:03.956661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:03.956674] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:03.956682] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.187065] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.187079] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.187087] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.189256] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1887 [D 20:42:04.189269] element 0: offset: 0x655ed0, size: 24 [D 20:42:04.189279] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 11/70. [D 20:42:04.189390] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1887 [D 20:42:04.189446] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 12/70. [D 20:42:04.205563] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1887 [D 20:42:04.205578] element 0: offset: 0x655ed0, size: 24 [D 20:42:04.205588] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 13/70. [D 20:42:04.205630] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.205640] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.205649] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.217260] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.217273] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.217281] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.219392] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1890 [D 20:42:04.219405] element 0: offset: 0x61fad0, size: 24 [D 20:42:04.219415] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 14/70. [D 20:42:04.219514] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1890 [D 20:42:04.219584] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 15/70. [D 20:42:04.235503] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1890 [D 20:42:04.235549] element 0: offset: 0x61fad0, size: 24 [D 20:42:04.235563] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 16/70. [D 20:42:04.235627] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.235638] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.235646] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.241689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.241703] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.241711] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.242140] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1893 [D 20:42:04.242153] element 0: offset: 0x62b0a0, size: 24 [D 20:42:04.242163] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 17/70. [D 20:42:04.242262] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1893 [D 20:42:04.242319] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 18/70. [D 20:42:04.260685] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1893 [D 20:42:04.260700] element 0: offset: 0x62b0a0, size: 24 [D 20:42:04.260710] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 19/70. [D 20:42:04.260782] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.260794] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.260802] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.266842] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.266855] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.266864] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.269110] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1896 [D 20:42:04.269124] element 0: offset: 0x625600, size: 24 [D 20:42:04.269133] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 20/70. [D 20:42:04.269230] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1896 [D 20:42:04.269298] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 21/70. [D 20:42:04.285954] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1896 [D 20:42:04.286000] element 0: offset: 0x625600, size: 24 [D 20:42:04.286013] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 22/70. [D 20:42:04.286165] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.286178] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.286186] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.291019] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.291032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.291040] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.291871] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.291884] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.291892] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.294118] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1899 [D 20:42:04.294131] element 0: offset: 0x6151c0, size: 24 [D 20:42:04.294141] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 23/70. [D 20:42:04.294155] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1902 [D 20:42:04.294164] element 0: offset: 0x655ed0, size: 24 [D 20:42:04.294173] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 24/70. [D 20:42:04.294260] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1899 [D 20:42:04.294301] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1902 [D 20:42:04.294314] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 25/70. [D 20:42:04.294398] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 26/70. [D 20:42:04.322789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1899 [D 20:42:04.322841] element 0: offset: 0x6151c0, size: 24 [D 20:42:04.322855] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 27/70. [D 20:42:04.322921] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.322931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.322940] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.327523] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1902 [D 20:42:04.327537] element 0: offset: 0x655ed0, size: 24 [D 20:42:04.327546] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 28/70. [D 20:42:04.327620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.327632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.327640] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.329606] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.329620] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.329628] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.330169] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1905 [D 20:42:04.330183] element 0: offset: 0x61fad0, size: 24 [D 20:42:04.330193] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 29/70. [D 20:42:04.330292] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1905 [D 20:42:04.330367] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 30/70. [D 20:42:04.344492] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.344508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.344517] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.346826] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1908 [D 20:42:04.346865] element 0: offset: 0x2aaaab203c10, size: 24 [D 20:42:04.346878] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 31/70. [D 20:42:04.347607] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1908 [D 20:42:04.347625] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 32/70. [D 20:42:04.347823] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1905 [D 20:42:04.347838] element 0: offset: 0x2aaaab203ad0, size: 24 [D 20:42:04.347848] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 33/70. [D 20:42:04.347944] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.347957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.347965] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.357838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.357852] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.357860] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.360154] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1911 [D 20:42:04.360168] element 0: offset: 0x61fad0, size: 24 [D 20:42:04.360178] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 34/70. [D 20:42:04.363790] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1908 [D 20:42:04.363804] element 0: offset: 0x620d50, size: 24 [D 20:42:04.363816] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 35/70. [D 20:42:04.363847] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1911 [D 20:42:04.363859] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 36/70. [D 20:42:04.363903] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.363914] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.363922] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.376288] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.376319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.376328] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.378709] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1911 [D 20:42:04.378750] element 0: offset: 0x2aaaab203c30, size: 24 [D 20:42:04.378763] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 37/70. [D 20:42:04.378831] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1914 [D 20:42:04.378841] element 0: offset: 0x2aaaab209410, size: 24 [D 20:42:04.378851] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 38/70. [D 20:42:04.378936] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.378948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.378956] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.378990] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1914 [D 20:42:04.379012] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 39/70. [D 20:42:04.393787] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.393801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.393810] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.396030] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1917 [D 20:42:04.396043] element 0: offset: 0x2aaaab203d50, size: 24 [D 20:42:04.396053] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 40/70. [D 20:42:04.399471] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1917 [D 20:42:04.399489] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 41/70. [D 20:42:04.399526] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1914 [D 20:42:04.399536] element 0: offset: 0x2aaaab209410, size: 24 [D 20:42:04.399545] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 42/70. [D 20:42:04.399620] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.399632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.399640] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.415119] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1917 [D 20:42:04.415163] element 0: offset: 0x2aaaab203d50, size: 24 [D 20:42:04.415177] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 43/70. [D 20:42:04.415341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.415354] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.415363] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.417399] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.417412] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.417421] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.418162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1920 [D 20:42:04.418176] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.418186] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 44/70. [D 20:42:04.418273] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1920 [D 20:42:04.418307] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 45/70. [D 20:42:04.432367] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.432382] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.432390] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.434606] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1923 [D 20:42:04.434619] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.434630] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 46/70. [D 20:42:04.437648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1920 [D 20:42:04.437663] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.437674] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 47/70. [D 20:42:04.437703] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1923 [D 20:42:04.437718] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 48/70. [D 20:42:04.437741] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.437750] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.437758] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.453210] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1923 [D 20:42:04.453256] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.453270] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 49/70. [D 20:42:04.453329] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.453340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.453349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.463248] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.463262] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.463271] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.465560] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1926 [D 20:42:04.465573] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.465584] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 50/70. [D 20:42:04.465664] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1926 [D 20:42:04.465701] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 51/70. [D 20:42:04.483257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1926 [D 20:42:04.483273] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.483282] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 52/70. [D 20:42:04.483352] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.483365] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.483373] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.491593] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.491607] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.491615] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.493849] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1929 [D 20:42:04.493863] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.493873] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 53/70. [D 20:42:04.493967] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1929 [D 20:42:04.494031] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 54/70. [D 20:42:04.510461] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1929 [D 20:42:04.510505] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.510519] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 55/70. [D 20:42:04.510663] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.510675] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.510684] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.516453] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.516466] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.516474] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.518144] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1932 [D 20:42:04.518157] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.518167] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 56/70. [D 20:42:04.518265] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1932 [D 20:42:04.518327] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 57/70. [D 20:42:04.536042] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1932 [D 20:42:04.536057] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.536067] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 58/70. [D 20:42:04.536155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.536167] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.536175] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.747842] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.747856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.747864] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.750218] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1934 [D 20:42:04.750232] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.750241] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 59/70. [D 20:42:04.750343] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1934 [D 20:42:04.750422] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 60/70. [D 20:42:04.766276] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1934 [D 20:42:04.766322] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.766336] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 0/70. [D 20:42:04.768631] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.768654] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.768664] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.776173] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.776188] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.776198] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.776277] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1937 [D 20:42:04.776292] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.776323] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 1/70. [D 20:42:04.778154] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1937 [D 20:42:04.778771] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 2/70. [D 20:42:04.796082] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1937 [D 20:42:04.796144] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.796159] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 3/70. [D 20:42:04.798343] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.798358] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.798369] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.810341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.810356] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.810366] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.810506] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1940 [D 20:42:04.810520] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.810532] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 4/70. [D 20:42:04.812873] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1940 [D 20:42:04.812891] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 5/70. [D 20:42:04.827958] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1940 [D 20:42:04.827973] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.827984] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 6/70. [D 20:42:04.830117] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.830134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.830144] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.834134] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.834149] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.834158] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.836269] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1943 [D 20:42:04.836283] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.836295] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 7/70. [D 20:42:04.836392] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1943 [D 20:42:04.836452] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 8/70. [D 20:42:04.855497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1943 [D 20:42:04.855564] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.855579] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 9/70. [D 20:42:04.857722] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.857736] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.857747] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.863831] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.863846] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.863856] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.864012] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1946 [D 20:42:04.864027] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:04.864039] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 10/70. [D 20:42:04.864178] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1946 [D 20:42:04.864204] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 11/70. [D 20:42:04.880972] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1946 [D 20:42:04.881003] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:04.881015] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 12/70. [D 20:42:04.883154] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.883168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.883178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.888987] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.889001] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.889012] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.889087] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1949 [D 20:42:04.889101] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.889112] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 13/70. [D 20:42:04.891583] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1949 [D 20:42:04.891600] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 14/70. [D 20:42:04.908985] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1949 [D 20:42:04.909049] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:04.909064] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 15/70. [D 20:42:04.911253] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.911268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.911278] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:04.917086] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.917101] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.917111] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:04.917207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1952 [D 20:42:04.917220] element 0: offset: 0x2aaaab208c20, size: 24 [D 20:42:04.917236] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 16/70. [D 20:42:04.918161] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1952 [D 20:42:04.918179] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 17/70. [D 20:42:04.933691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.933712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.933721] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.933793] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1956 [D 20:42:04.933805] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.933816] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 18/70. [D 20:42:04.933917] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1956 [D 20:42:04.933966] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 19/70. [D 20:42:04.934190] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1952 [D 20:42:04.934205] element 0: offset: 0x2aaaab208c20, size: 24 [D 20:42:04.934217] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 20/70. [D 20:42:04.934306] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.934319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.934328] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.949880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.949906] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.949916] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.949990] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1958 [D 20:42:04.950004] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.950016] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 21/70. [D 20:42:04.952441] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1958 [D 20:42:04.952460] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 22/70. [D 20:42:04.957850] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1956 [D 20:42:04.957906] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:04.957921] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 23/70. [D 20:42:04.958018] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.958032] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.958052] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.969617] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:04.969632] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.969641] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:04.969747] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1962 [D 20:42:04.969759] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.969768] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 24/70. [D 20:42:04.969835] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1962 [D 20:42:04.969880] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 25/70. [D 20:42:04.972114] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1958 [D 20:42:04.972128] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:04.972140] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 26/70. [D 20:42:04.972234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.972247] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.972256] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:04.985546] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1962 [D 20:42:04.985608] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:04.985624] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 27/70. [D 20:42:04.987811] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:04.987825] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:04.987836] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.002662] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.002678] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.002689] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.002785] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1965 [D 20:42:05.002799] element 0: offset: 0x2aaaab208c20, size: 24 [D 20:42:05.002814] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 28/70. [D 20:42:05.005156] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1965 [D 20:42:05.005173] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 29/70. [D 20:42:05.019912] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1965 [D 20:42:05.019931] element 0: offset: 0x2aaaab208c20, size: 24 [D 20:42:05.019942] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 30/70. [D 20:42:05.022172] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.022186] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.022196] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.029636] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.029657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.029667] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.029749] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1968 [D 20:42:05.029763] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:05.029775] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 31/70. [D 20:42:05.032215] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1968 [D 20:42:05.032233] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 32/70. [D 20:42:05.051461] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1968 [D 20:42:05.051526] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:05.051541] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 33/70. [D 20:42:05.053679] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.053694] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.053704] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.257393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.257456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.257466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.257572] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1971 [D 20:42:05.257596] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:05.257611] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 34/70. [D 20:42:05.260098] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1971 [D 20:42:05.260117] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 35/70. [D 20:42:05.277262] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1971 [D 20:42:05.277280] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:05.277291] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 36/70. [D 20:42:05.278158] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.278172] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.278181] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.287581] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.287596] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.287606] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.287667] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1974 [D 20:42:05.287681] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:05.287691] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 37/70. [D 20:42:05.287745] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1974 [D 20:42:05.287796] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 38/70. [D 20:42:05.305996] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1974 [D 20:42:05.306062] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:05.306077] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 39/70. [D 20:42:05.308450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.308465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.308475] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.320295] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.320310] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.320320] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.320418] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1977 [D 20:42:05.320432] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:05.320448] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 40/70. [D 20:42:05.320516] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1977 [D 20:42:05.320558] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 41/70. [D 20:42:05.335424] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1977 [D 20:42:05.335460] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:05.335473] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 42/70. [D 20:42:05.337727] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.337741] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.337751] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.353205] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.353220] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.353231] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.353314] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1980 [D 20:42:05.353327] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:05.353338] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 43/70. [D 20:42:05.353398] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1980 [D 20:42:05.353443] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 44/70. [D 20:42:05.372078] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1980 [D 20:42:05.372143] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:05.372158] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 45/70. [D 20:42:05.374448] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.374462] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.374473] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.534004] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.534043] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.534053] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.534156] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1983 [D 20:42:05.534171] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:05.534192] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 46/70. [D 20:42:05.536634] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1983 [D 20:42:05.536652] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 47/70. [D 20:42:05.552847] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1983 [D 20:42:05.552863] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:05.552873] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 48/70. [D 20:42:05.555055] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.555069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.555080] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.567725] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.567739] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.567750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.567813] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1986 [D 20:42:05.567827] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.567837] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 49/70. [D 20:42:05.567906] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1986 [D 20:42:05.567954] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 50/70. [D 20:42:05.582155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.582170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.582181] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:05.585286] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1986 [D 20:42:05.585330] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.585343] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 51/70. [D 20:42:05.585449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.585462] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.585471] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:05.585487] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1989 [D 20:42:05.585496] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.585506] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 52/70. [D 20:42:05.585562] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1989 [D 20:42:05.585622] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 53/70. [D 20:42:05.595686] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.595701] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.595713] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:05.598194] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1992 [D 20:42:05.598236] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:05.598249] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 54/70. [D 20:42:05.598379] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1992 [D 20:42:05.598419] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 55/70. [D 20:42:05.600697] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1989 [D 20:42:05.600712] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.600725] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 56/70. [D 20:42:05.600819] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.600847] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.600856] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:05.615153] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1992 [D 20:42:05.615215] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:05.615230] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 57/70. [D 20:42:05.617551] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.617565] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.617575] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.622168] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.622181] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.622192] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.623009] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1995 [D 20:42:05.623024] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:05.623036] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 58/70. [D 20:42:05.623146] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 1995 [D 20:42:05.623193] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 59/70. [D 20:42:05.638051] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.638066] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.638074] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:05.638137] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1998 [D 20:42:05.638154] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:05.638163] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 60/70. [D 20:42:05.638265] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 1998 [D 20:42:05.638325] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 0/70. [D 20:42:05.640602] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1995 [D 20:42:05.640616] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:05.640628] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 1/70. [D 20:42:05.640711] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.640724] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.640748] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:05.656128] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 1998 [D 20:42:05.656193] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:05.656208] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 2/70. [D 20:42:05.658555] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.658570] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.658581] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.880527] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.880592] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.880602] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.880707] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2001 [D 20:42:05.880722] element 0: offset: 0x2aaaab211170, size: 24 [D 20:42:05.880742] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 3/70. [D 20:42:05.883199] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2001 [D 20:42:05.883217] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 4/70. [D 20:42:05.899095] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2001 [D 20:42:05.899113] element 0: offset: 0x2aaaab211170, size: 24 [D 20:42:05.899123] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 5/70. [D 20:42:05.901266] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.901280] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.901290] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.912386] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.912400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.912411] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.912472] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2004 [D 20:42:05.912485] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:05.912495] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 6/70. [D 20:42:05.912548] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2004 [D 20:42:05.912604] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 7/70. [D 20:42:05.930784] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2004 [D 20:42:05.930845] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:05.930860] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 8/70. [D 20:42:05.933139] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.933153] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.933163] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:05.941993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:05.942007] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.942018] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:05.942113] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2007 [D 20:42:05.942126] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.942137] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 9/70. [D 20:42:05.944469] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2007 [D 20:42:05.944486] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 10/70. [D 20:42:05.959787] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2007 [D 20:42:05.959803] element 0: offset: 0x2aaaab2066a0, size: 24 [D 20:42:05.959814] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 11/70. [D 20:42:05.961995] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:05.962008] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:05.962018] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.015095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.015123] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.015134] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.015207] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2009 [D 20:42:06.015221] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.015233] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 12/70. [D 20:42:06.015333] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2009 [D 20:42:06.015388] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 13/70. [D 20:42:06.033854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2009 [D 20:42:06.033918] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.033933] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 14/70. [D 20:42:06.036033] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.036048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.036058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.041990] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.042004] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.042014] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.042109] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2012 [D 20:42:06.042123] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:06.042139] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 15/70. [D 20:42:06.044577] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2012 [D 20:42:06.044596] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 16/70. [D 20:42:06.059750] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2012 [D 20:42:06.059767] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:06.059778] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 17/70. [D 20:42:06.061926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.061939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.061948] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.067700] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.067714] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.067725] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.067788] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2015 [D 20:42:06.067801] element 0: offset: 0x2aaaab2168e0, size: 24 [D 20:42:06.067812] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 18/70. [D 20:42:06.067906] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2015 [D 20:42:06.067963] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 19/70. [D 20:42:06.086464] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2015 [D 20:42:06.086527] element 0: offset: 0x2aaaab2168e0, size: 24 [D 20:42:06.086542] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 20/70. [D 20:42:06.088720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.088734] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.088745] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.425768] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.425830] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.425840] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.425945] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2019 [D 20:42:06.425970] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:06.425984] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 21/70. [D 20:42:06.426202] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2019 [D 20:42:06.428404] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 22/70. [D 20:42:06.443604] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2019 [D 20:42:06.443620] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:06.443630] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 23/70. [D 20:42:06.445794] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.445808] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.445818] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.452503] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.452517] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.452528] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.452590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2022 [D 20:42:06.452604] element 0: offset: 0x2aaaab210af0, size: 24 [D 20:42:06.452615] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 24/70. [D 20:42:06.452710] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2022 [D 20:42:06.452762] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 25/70. [D 20:42:06.470438] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2022 [D 20:42:06.470501] element 0: offset: 0x2aaaab210af0, size: 24 [D 20:42:06.470516] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 26/70. [D 20:42:06.470596] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.470610] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.470620] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.478542] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.478556] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.478567] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.478714] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2025 [D 20:42:06.478729] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:06.478741] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 27/70. [D 20:42:06.481066] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2025 [D 20:42:06.481083] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 28/70. [D 20:42:06.495806] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2025 [D 20:42:06.495822] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:06.495833] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 29/70. [D 20:42:06.497993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.498006] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.498016] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.503901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.503915] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.503925] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.503986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2028 [D 20:42:06.504000] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:06.504010] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 30/70. [D 20:42:06.504106] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2028 [D 20:42:06.504155] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 31/70. [D 20:42:06.521759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2028 [D 20:42:06.521821] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:06.521836] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 32/70. [D 20:42:06.522204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.522218] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.522228] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.529746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.529760] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.529771] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.529866] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2031 [D 20:42:06.529880] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.529892] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 33/70. [D 20:42:06.532366] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2031 [D 20:42:06.532384] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 34/70. [D 20:42:06.546991] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2031 [D 20:42:06.547007] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.547018] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 35/70. [D 20:42:06.549374] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.549388] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.549397] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.554705] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.554719] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.554730] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.554792] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2034 [D 20:42:06.554805] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:06.554816] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 36/70. [D 20:42:06.554912] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2034 [D 20:42:06.554961] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 37/70. [D 20:42:06.572535] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2034 [D 20:42:06.572602] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:06.572617] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 38/70. [D 20:42:06.574813] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.574828] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.574839] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.578183] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.578197] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.578207] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.580096] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2037 [D 20:42:06.580110] element 0: offset: 0x2aaaab2168e0, size: 24 [D 20:42:06.580122] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 39/70. [D 20:42:06.580237] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2037 [D 20:42:06.580271] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 40/70. [D 20:42:06.596907] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2037 [D 20:42:06.596923] element 0: offset: 0x2aaaab2168e0, size: 24 [D 20:42:06.596934] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 41/70. [D 20:42:06.599106] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.599120] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.599131] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.605905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.605918] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.605929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.605946] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.605958] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.605967] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:06.606022] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2040 [D 20:42:06.606035] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:06.606046] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 42/70. [D 20:42:06.606059] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2043 [D 20:42:06.606069] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:06.606079] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 43/70. [D 20:42:06.606155] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2040 [D 20:42:06.606225] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 44/70. [D 20:42:06.606278] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2043 [D 20:42:06.606295] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 45/70. [D 20:42:06.634379] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2040 [D 20:42:06.634420] element 0: offset: 0x2aaaab2079b0, size: 24 [D 20:42:06.634433] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 46/70. [D 20:42:06.636643] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.636657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.636666] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:06.639070] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2043 [D 20:42:06.639122] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:06.639137] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 47/70. [D 20:42:06.641297] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.641311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.641321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.872991] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.873048] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.873058] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.873162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2045 [D 20:42:06.873177] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:06.873200] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 48/70. [D 20:42:06.874207] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2045 [D 20:42:06.874225] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 49/70. [D 20:42:06.890437] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2045 [D 20:42:06.890453] element 0: offset: 0x2aaaab2053e0, size: 24 [D 20:42:06.890464] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 50/70. [D 20:42:06.892740] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.892753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.892764] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.899519] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.899533] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.899544] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.899606] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2048 [D 20:42:06.899620] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:06.899631] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 51/70. [D 20:42:06.899725] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2048 [D 20:42:06.899776] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 52/70. [D 20:42:06.917954] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2048 [D 20:42:06.918019] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:06.918035] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 53/70. [D 20:42:06.920289] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.920305] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.920316] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.925472] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.925486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.925496] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.926285] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2051 [D 20:42:06.926329] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.926343] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 54/70. [D 20:42:06.926920] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2051 [D 20:42:06.926941] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 55/70. [D 20:42:06.942112] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2051 [D 20:42:06.942157] element 0: offset: 0x2aaaab2065c0, size: 24 [D 20:42:06.942171] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 56/70. [D 20:42:06.944481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.944527] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.944537] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.949602] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.949616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.949626] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.949708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2054 [D 20:42:06.949723] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:06.949736] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 57/70. [D 20:42:06.950206] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2054 [D 20:42:06.950224] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 58/70. [D 20:42:06.967725] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2054 [D 20:42:06.967789] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:06.967804] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 59/70. [D 20:42:06.969934] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.969948] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.969958] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:06.975108] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:06.975122] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.975132] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:06.975261] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2057 [D 20:42:06.975276] element 0: offset: 0x2aaaab211170, size: 24 [D 20:42:06.975288] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 60/70. [D 20:42:06.977738] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2057 [D 20:42:06.977756] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 0/70. [D 20:42:06.993065] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2057 [D 20:42:06.993081] element 0: offset: 0x2aaaab211170, size: 24 [D 20:42:06.993091] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 1/70. [D 20:42:06.994185] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:06.994199] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:06.994209] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.103085] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.103100] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.103111] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.103173] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2061 [D 20:42:07.103187] element 0: offset: 0x2aaaab210af0, size: 24 [D 20:42:07.103198] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 2/70. [D 20:42:07.103295] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2061 [D 20:42:07.103350] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 3/70. [D 20:42:07.121656] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2061 [D 20:42:07.121718] element 0: offset: 0x2aaaab210af0, size: 24 [D 20:42:07.121732] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 4/70. [D 20:42:07.123873] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.123887] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.123898] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.129939] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.129953] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.129964] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.130059] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2064 [D 20:42:07.130073] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:07.130099] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 5/70. [D 20:42:07.130213] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2064 [D 20:42:07.130258] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 6/70. [D 20:42:07.146429] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2064 [D 20:42:07.146444] element 0: offset: 0x2aaaab203820, size: 24 [D 20:42:07.146455] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 7/70. [D 20:42:07.148721] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.148734] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.148744] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.154569] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.154582] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.154593] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.154655] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2067 [D 20:42:07.154669] element 0: offset: 0x2aaaab229f10, size: 24 [D 20:42:07.154679] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 8/70. [D 20:42:07.154775] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2067 [D 20:42:07.154826] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 9/70. [D 20:42:07.172804] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2067 [D 20:42:07.172866] element 0: offset: 0x2aaaab229f10, size: 24 [D 20:42:07.172881] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 10/70. [D 20:42:07.175021] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.175035] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.175046] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.360423] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.360474] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.360484] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.360587] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2070 [D 20:42:07.360602] element 0: offset: 0x2aaaab202b10, size: 24 [D 20:42:07.360624] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 11/70. [D 20:42:07.362220] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2070 [D 20:42:07.363082] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 12/70. [D 20:42:07.377583] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2070 [D 20:42:07.377598] element 0: offset: 0x2aaaab202b10, size: 24 [D 20:42:07.377609] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 13/70. [D 20:42:07.379886] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.379900] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.379910] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.385326] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.385340] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.385350] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.385411] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2073 [D 20:42:07.385425] element 0: offset: 0x2aaaab208d20, size: 24 [D 20:42:07.385435] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 14/70. [D 20:42:07.385534] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2073 [D 20:42:07.385593] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 15/70. [D 20:42:07.402950] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2073 [D 20:42:07.402994] element 0: offset: 0x2aaaab208d20, size: 24 [D 20:42:07.403007] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 16/70. [D 20:42:07.403111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.403123] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.403132] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:07.914674] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:07.914688] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.914696] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:07.916961] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2076 [D 20:42:07.916975] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:07.916985] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 17/70. [D 20:42:07.917096] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2076 [D 20:42:07.917147] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 18/70. [D 20:42:07.945630] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2076 [D 20:42:07.945677] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:07.945691] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 19/70. [D 20:42:07.945841] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:07.945854] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:07.945862] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.039305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.039319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.039327] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.041580] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2078 [D 20:42:08.041594] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:08.041603] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 20/70. [D 20:42:08.041712] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2078 [D 20:42:08.041755] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 21/70. [D 20:42:08.061379] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2078 [D 20:42:08.061395] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:08.061405] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 22/70. [D 20:42:08.061495] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.061507] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.061515] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.067311] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.067325] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.067333] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.069758] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2081 [D 20:42:08.069771] element 0: offset: 0x2aaaab226270, size: 24 [D 20:42:08.069781] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 23/70. [D 20:42:08.069882] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2081 [D 20:42:08.069939] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 24/70. [D 20:42:08.086103] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2081 [D 20:42:08.086150] element 0: offset: 0x2aaaab226270, size: 24 [D 20:42:08.086164] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 25/70. [D 20:42:08.086334] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.086347] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.086355] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.093030] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.093044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.093052] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.095264] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2084 [D 20:42:08.095277] element 0: offset: 0x2aaaab21ab70, size: 24 [D 20:42:08.095287] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 26/70. [D 20:42:08.095370] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2084 [D 20:42:08.095394] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 27/70. [D 20:42:08.112504] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2084 [D 20:42:08.112519] element 0: offset: 0x2aaaab21ab70, size: 24 [D 20:42:08.112529] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 28/70. [D 20:42:08.112616] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.112628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.112636] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.121753] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.121766] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.121775] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.122286] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2087 [D 20:42:08.122299] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:08.122309] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 29/70. [D 20:42:08.122357] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2087 [D 20:42:08.122421] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 30/70. [D 20:42:08.138793] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2087 [D 20:42:08.138839] element 0: offset: 0x2aaaab208ed0, size: 24 [D 20:42:08.138852] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 31/70. [D 20:42:08.139000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.139013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.139022] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.148599] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.148612] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.148621] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.150813] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2090 [D 20:42:08.150826] element 0: offset: 0x2aaaab208d20, size: 24 [D 20:42:08.150836] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 32/70. [D 20:42:08.150917] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2090 [D 20:42:08.150944] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 33/70. [D 20:42:08.168890] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2090 [D 20:42:08.168905] element 0: offset: 0x2aaaab208d20, size: 24 [D 20:42:08.168915] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 34/70. [D 20:42:08.169002] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.169014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.169022] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.174799] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.174812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.174820] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.177035] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2093 [D 20:42:08.177049] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:08.177059] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 35/70. [D 20:42:08.177128] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2093 [D 20:42:08.177170] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 36/70. [D 20:42:08.193326] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2093 [D 20:42:08.193373] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:08.193386] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 37/70. [D 20:42:08.193449] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.193460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.193469] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.201153] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.201166] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.201175] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.203375] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2096 [D 20:42:08.203388] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:08.203398] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 38/70. [D 20:42:08.203511] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2096 [D 20:42:08.203565] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 39/70. [D 20:42:08.222081] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2096 [D 20:42:08.222095] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:08.222105] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 40/70. [D 20:42:08.222178] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.222190] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.222199] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.227346] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.227360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.227369] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.229589] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2099 [D 20:42:08.229602] element 0: offset: 0x2aaaab226270, size: 24 [D 20:42:08.229612] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 41/70. [D 20:42:08.229710] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2099 [D 20:42:08.229785] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 42/70. [D 20:42:08.245431] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2099 [D 20:42:08.245478] element 0: offset: 0x2aaaab226270, size: 24 [D 20:42:08.245491] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 43/70. [D 20:42:08.245554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.245565] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.245574] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.919994] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.920008] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.920017] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.922301] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2103 [D 20:42:08.922314] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:08.922324] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 44/70. [D 20:42:08.922405] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2103 [D 20:42:08.922441] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 45/70. [D 20:42:08.940624] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2103 [D 20:42:08.940639] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:08.940649] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 46/70. [D 20:42:08.940723] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.940735] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.940743] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.953360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.953374] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.953382] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.955608] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2106 [D 20:42:08.955621] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:42:08.955631] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 47/70. [D 20:42:08.955701] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2106 [D 20:42:08.955754] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 48/70. [D 20:42:08.971364] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2106 [D 20:42:08.971410] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:42:08.971423] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 49/70. [D 20:42:08.971590] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:08.971604] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.971612] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:08.983580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:08.983593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:08.983602] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:08.985796] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2109 [D 20:42:08.985810] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:08.985820] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 50/70. [D 20:42:08.985901] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2109 [D 20:42:08.985928] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 51/70. [D 20:42:09.005191] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2109 [D 20:42:09.005206] element 0: offset: 0x2aaaab218630, size: 24 [D 20:42:09.005216] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 52/70. [D 20:42:09.005290] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.005303] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.005311] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.012304] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.012317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.012326] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.014567] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2112 [D 20:42:09.014580] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:09.014590] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 53/70. [D 20:42:09.014659] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2112 [D 20:42:09.014709] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 54/70. [D 20:42:09.032281] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2112 [D 20:42:09.032330] element 0: offset: 0x2aaaab210e00, size: 24 [D 20:42:09.032344] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 55/70. [D 20:42:09.032411] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.032422] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.032431] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.042413] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.042427] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.042435] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.044705] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2115 [D 20:42:09.044719] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:09.044729] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 56/70. [D 20:42:09.044844] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2115 [D 20:42:09.044904] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 57/70. [D 20:42:09.057287] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.057303] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.057312] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.059529] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2118 [D 20:42:09.059543] element 0: offset: 0x61fad0, size: 24 [D 20:42:09.059554] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 58/70. [D 20:42:09.062371] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2118 [D 20:42:09.062388] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 59/70. [D 20:42:09.065116] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2115 [D 20:42:09.065130] element 0: offset: 0x61f0a0, size: 24 [D 20:42:09.065139] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 60/70. [D 20:42:09.065242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.065255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.065263] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.076716] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.076729] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.076737] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.079428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2121 [D 20:42:09.079472] element 0: offset: 0x615190, size: 24 [D 20:42:09.079486] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 0/70. [D 20:42:09.080090] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2121 [D 20:42:09.080108] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 1/70. [D 20:42:09.080280] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2118 [D 20:42:09.080295] element 0: offset: 0x61fad0, size: 24 [D 20:42:09.080305] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 2/70. [D 20:42:09.080401] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.080413] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.080422] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.092162] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.092175] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.092184] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.094377] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2124 [D 20:42:09.094390] element 0: offset: 0x61f310, size: 24 [D 20:42:09.094400] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 3/70. [D 20:42:09.097402] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2121 [D 20:42:09.097416] element 0: offset: 0x615190, size: 24 [D 20:42:09.097427] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 4/70. [D 20:42:09.097461] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2124 [D 20:42:09.097474] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 5/70. [D 20:42:09.097496] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.097505] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.097513] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.110473] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.110486] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.110495] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.113083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2127 [D 20:42:09.113121] element 0: offset: 0x63df90, size: 24 [D 20:42:09.113134] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 6/70. [D 20:42:09.113854] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2127 [D 20:42:09.113873] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 7/70. [D 20:42:09.114075] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2124 [D 20:42:09.114089] element 0: offset: 0x61f310, size: 24 [D 20:42:09.114100] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 8/70. [D 20:42:09.114195] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.114207] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.114216] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.128072] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.128086] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.128094] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.128265] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.128279] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.128287] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:09.130495] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2131 [D 20:42:09.130508] element 0: offset: 0x615190, size: 24 [D 20:42:09.130518] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 9/70. [D 20:42:09.130532] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2133 [D 20:42:09.130540] element 0: offset: 0x61f0e0, size: 24 [D 20:42:09.130549] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 10/70. [D 20:42:09.133669] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2127 [D 20:42:09.133684] element 0: offset: 0x63df90, size: 24 [D 20:42:09.133697] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 11/70. [D 20:42:09.133732] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2131 [D 20:42:09.133747] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 12/70. [D 20:42:09.133773] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2133 [D 20:42:09.133785] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 13/70. [D 20:42:09.133807] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.133816] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.133824] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:09.156775] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.156789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.156797] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:09.159370] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2136 [D 20:42:09.159411] element 0: offset: 0x61fa80, size: 24 [D 20:42:09.159425] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 14/70. [D 20:42:09.160147] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2131 [D 20:42:09.160162] element 0: offset: 0x615190, size: 24 [D 20:42:09.160171] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 15/70. [D 20:42:09.162407] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2133 [D 20:42:09.162422] element 0: offset: 0x61f0e0, size: 24 [D 20:42:09.162433] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 16/70. [D 20:42:09.162475] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2136 [D 20:42:09.162490] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 17/70. [D 20:42:09.162518] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.162528] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.162536] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:09.162554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.162563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.162571] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.176374] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2136 [D 20:42:09.176420] element 0: offset: 0x61fa80, size: 24 [D 20:42:09.176435] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 18/70. [D 20:42:09.176602] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.176615] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.176624] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.182614] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.182627] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.182636] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.184861] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2139 [D 20:42:09.184874] element 0: offset: 0x61ee50, size: 24 [D 20:42:09.184884] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 19/70. [D 20:42:09.184965] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2139 [D 20:42:09.185040] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.185052] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.185060] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.185074] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 20/70. [D 20:42:09.185140] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2142 [D 20:42:09.185160] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.185171] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 21/70. [D 20:42:09.185218] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2142 [D 20:42:09.194442] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 22/70. [D 20:42:09.201597] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2139 [D 20:42:09.201612] element 0: offset: 0x61ee50, size: 24 [D 20:42:09.201622] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 23/70. [D 20:42:09.201737] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.201750] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.201758] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.213795] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2142 [D 20:42:09.213841] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.213856] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 24/70. [D 20:42:09.214003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.214016] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.214024] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.231254] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.231268] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.231276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.233484] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2145 [D 20:42:09.233497] element 0: offset: 0x615190, size: 24 [D 20:42:09.233507] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 25/70. [D 20:42:09.233589] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2145 [D 20:42:09.233631] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 26/70. [D 20:42:09.246366] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.246382] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.246390] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.248637] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2148 [D 20:42:09.248651] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.248661] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 27/70. [D 20:42:09.251841] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2145 [D 20:42:09.251856] element 0: offset: 0x615190, size: 24 [D 20:42:09.251866] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 28/70. [D 20:42:09.251897] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2148 [D 20:42:09.251909] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 29/70. [D 20:42:09.251958] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.251968] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.251976] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.265469] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.265483] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.265492] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.268098] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2151 [D 20:42:09.268139] element 0: offset: 0x63df90, size: 24 [D 20:42:09.268153] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 30/70. [D 20:42:09.268685] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2151 [D 20:42:09.268701] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 31/70. [D 20:42:09.268893] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2148 [D 20:42:09.268908] element 0: offset: 0x5b0030, size: 24 [D 20:42:09.268918] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 32/70. [D 20:42:09.269014] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.269026] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.269035] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.282089] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.282102] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.282111] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.284368] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2154 [D 20:42:09.284382] element 0: offset: 0x61ee50, size: 24 [D 20:42:09.284392] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 33/70. [D 20:42:09.286427] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2154 [D 20:42:09.286444] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 34/70. [D 20:42:09.289785] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2151 [D 20:42:09.289798] element 0: offset: 0x63df90, size: 24 [D 20:42:09.289808] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 35/70. [D 20:42:09.289915] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.289928] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.289936] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.298972] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.298985] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.298994] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:09.301648] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2157 [D 20:42:09.301689] element 0: offset: 0x61fad0, size: 24 [D 20:42:09.301702] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 36/70. [D 20:42:09.302174] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2157 [D 20:42:09.302191] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 37/70. [D 20:42:09.302408] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2154 [D 20:42:09.302422] element 0: offset: 0x61ee50, size: 24 [D 20:42:09.302433] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 38/70. [D 20:42:09.304806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.304867] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.304877] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:09.317369] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2157 [D 20:42:09.317430] element 0: offset: 0x61fad0, size: 24 [D 20:42:09.317445] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 39/70. [D 20:42:09.318335] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.318350] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.318361] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.318383] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.318396] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.318404] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.320014] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2160 [D 20:42:09.320031] element 0: offset: 0x61f800, size: 24 [D 20:42:09.320042] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 40/70. [D 20:42:09.320148] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2160 [D 20:42:09.320204] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 41/70. [D 20:42:09.335741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2160 [D 20:42:09.335789] element 0: offset: 0x61f800, size: 24 [D 20:42:09.335802] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 42/70. [D 20:42:09.335970] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.335983] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.335992] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:09.370612] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:09.370626] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.370634] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:09.372728] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2162 [D 20:42:09.372741] element 0: offset: 0x615190, size: 24 [D 20:42:09.372751] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 43/70. [D 20:42:09.372832] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2162 [D 20:42:09.372857] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 44/70. [D 20:42:09.390166] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2162 [D 20:42:09.390181] element 0: offset: 0x615190, size: 24 [D 20:42:09.390191] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 45/70. [D 20:42:09.390269] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:09.390282] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:09.390290] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.009282] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.009296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.009304] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.011588] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2166 [D 20:42:10.011601] element 0: offset: 0x620d50, size: 24 [D 20:42:10.011611] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 46/70. [D 20:42:10.011717] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2166 [D 20:42:10.011780] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 47/70. [D 20:42:10.032459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.032508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.032518] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:10.032553] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.032563] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.032571] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:10.032665] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2169 [D 20:42:10.032677] element 0: offset: 0x61f800, size: 24 [D 20:42:10.032689] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 48/70. [D 20:42:10.032709] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2172 [D 20:42:10.032719] element 0: offset: 0x61f0e0, size: 24 [D 20:42:10.032729] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 49/70. [D 20:42:10.032774] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2169 [D 20:42:10.032796] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 50/70. [D 20:42:10.032812] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2172 [D 20:42:10.032870] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2166 [D 20:42:10.032876] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 51/70. [D 20:42:10.032880] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:10.032918] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 52/70. [D 20:42:10.033111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.033123] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.033132] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:10.060522] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.060536] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.060547] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:10.064239] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2169 [D 20:42:10.064288] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.064301] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 53/70. [D 20:42:10.066688] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2172 [D 20:42:10.066702] element 0: offset: 0x2aaaab203c10, size: 24 [D 20:42:10.066713] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 54/70. [D 20:42:10.066750] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2175 [D 20:42:10.066760] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.066770] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 55/70. [D 20:42:10.066808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.066818] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.066826] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:10.066846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.066854] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.066863] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:10.066896] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2175 [D 20:42:10.066930] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 56/70. [D 20:42:10.079235] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.079266] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.079276] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:10.081841] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2177 [D 20:42:10.081884] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:42:10.081898] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 57/70. [D 20:42:10.082221] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2177 [D 20:42:10.082238] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 58/70. [D 20:42:10.082497] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2175 [D 20:42:10.082512] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.082522] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 59/70. [D 20:42:10.082629] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.082649] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.082659] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:10.098993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.099009] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.099020] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:10.099102] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2181 [D 20:42:10.099117] element 0: offset: 0x2aaaab203c10, size: 24 [D 20:42:10.099144] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 60/70. [D 20:42:10.101590] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2181 [D 20:42:10.101608] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 0/70. [D 20:42:10.107034] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2177 [D 20:42:10.107094] element 0: offset: 0x2aaaab2343f0, size: 24 [D 20:42:10.107111] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 1/70. [D 20:42:10.109331] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.109345] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.109371] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:10.115645] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.115660] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.115668] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:10.115779] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2183 [D 20:42:10.115790] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:10.115800] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 2/70. [D 20:42:10.115911] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2183 [D 20:42:10.115961] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 3/70. [D 20:42:10.116082] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2181 [D 20:42:10.116094] element 0: offset: 0x2aaaab203c10, size: 24 [D 20:42:10.116118] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 4/70. [D 20:42:10.116187] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.116213] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.116224] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:10.133426] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2183 [D 20:42:10.133487] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:10.133502] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 5/70. [D 20:42:10.135782] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.135796] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.135806] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.142481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.142496] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.142507] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.142603] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2186 [D 20:42:10.142617] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.142632] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 6/70. [D 20:42:10.142699] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2186 [D 20:42:10.142738] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 7/70. [D 20:42:10.158406] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2186 [D 20:42:10.158421] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.158432] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 8/70. [D 20:42:10.160821] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.160834] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.160844] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.348019] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.348818] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.348829] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.348912] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2189 [D 20:42:10.348926] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.348938] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 9/70. [D 20:42:10.350403] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2189 [D 20:42:10.351317] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 10/70. [D 20:42:10.369815] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2189 [D 20:42:10.370598] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.370615] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 11/70. [D 20:42:10.372781] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.372796] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.372807] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.381993] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.382023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.382033] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.382138] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2192 [D 20:42:10.382152] element 0: offset: 0x2aaaab23b2f0, size: 24 [D 20:42:10.382171] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 12/70. [D 20:42:10.384640] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2192 [D 20:42:10.384658] openib_post_sr: 10.1.4.240:38258 bh 0 len 48 wr 13/70. [D 20:42:10.399355] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2192 [D 20:42:10.399372] element 0: offset: 0x2aaaab23b2f0, size: 24 [D 20:42:10.399383] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 14/70. [D 20:42:10.401529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.401543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.401551] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.410282] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.410296] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.410307] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.410370] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2195 [D 20:42:10.410384] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:10.410397] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 15/70. [D 20:42:10.410505] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2195 [D 20:42:10.410583] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 16/70. [D 20:42:10.425805] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.425819] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.425830] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:10.425910] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2199 [D 20:42:10.425924] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.425935] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 17/70. [D 20:42:10.430425] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2195 [D 20:42:10.430479] element 0: offset: 0x2aaaab235960, size: 24 [D 20:42:10.430493] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 18/70. [D 20:42:10.430543] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2199 [D 20:42:10.430559] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 19/70. [D 20:42:10.432770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.432784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.432793] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:10.447109] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2199 [D 20:42:10.447125] element 0: offset: 0x2aaaab202bd0, size: 24 [D 20:42:10.447135] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 20/70. [D 20:42:10.449259] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.449272] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.449283] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.456292] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.456306] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.456318] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.456411] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2202 [D 20:42:10.456424] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.456435] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 21/70. [D 20:42:10.458767] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2202 [D 20:42:10.458782] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 22/70. [D 20:42:10.476226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2202 [D 20:42:10.476291] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.476306] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 23/70. [D 20:42:10.478434] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.478448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.478458] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.484823] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.484838] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.484849] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.484946] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2205 [D 20:42:10.484960] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:10.484986] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 24/70. [D 20:42:10.486422] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2205 [D 20:42:10.487419] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 25/70. [D 20:42:10.502457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2205 [D 20:42:10.502472] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:10.502483] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 26/70. [D 20:42:10.504748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.504761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.504771] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.568864] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.568879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.568890] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.568953] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2208 [D 20:42:10.568966] element 0: offset: 0x2aaaab203850, size: 24 [D 20:42:10.568976] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 27/70. [D 20:42:10.569078] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2208 [D 20:42:10.569144] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 28/70. [D 20:42:10.586878] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2208 [D 20:42:10.586923] element 0: offset: 0x2aaaab203850, size: 24 [D 20:42:10.586936] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 29/70. [D 20:42:10.587041] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.587054] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.587063] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.593217] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.593230] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.593239] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.595474] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2211 [D 20:42:10.595488] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:10.595498] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 30/70. [D 20:42:10.595610] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2211 [D 20:42:10.595666] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 31/70. [D 20:42:10.611858] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2211 [D 20:42:10.611903] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:10.611917] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 32/70. [D 20:42:10.611980] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.611991] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.611999] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.620481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.620495] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.620504] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.622708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2214 [D 20:42:10.622722] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.622732] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 33/70. [D 20:42:10.622837] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2214 [D 20:42:10.622886] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 34/70. [D 20:42:10.641483] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2214 [D 20:42:10.641498] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:10.641508] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 35/70. [D 20:42:10.641582] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.641594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.641602] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.816990] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.817003] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.817012] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.819266] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2217 [D 20:42:10.819279] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:10.819290] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 36/70. [D 20:42:10.819387] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2217 [D 20:42:10.819455] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 37/70. [D 20:42:10.834784] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2217 [D 20:42:10.834831] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:10.834844] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 38/70. [D 20:42:10.834997] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.835010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.835019] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:10.841005] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:10.841019] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.841027] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:10.842457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2220 [D 20:42:10.842471] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:10.842481] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 39/70. [D 20:42:10.842578] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2220 [D 20:42:10.842633] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 40/70. [D 20:42:10.861594] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2220 [D 20:42:10.861609] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:10.861620] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 41/70. [D 20:42:10.861706] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:10.861718] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:10.861727] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.201887] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.201901] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.201910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.204167] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2223 [D 20:42:11.204180] element 0: offset: 0x2aaaab21ab50, size: 24 [D 20:42:11.204190] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 42/70. [D 20:42:11.204261] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2223 [D 20:42:11.204305] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 43/70. [D 20:42:11.220659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2223 [D 20:42:11.220706] element 0: offset: 0x2aaaab21ab50, size: 24 [D 20:42:11.220720] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 44/70. [D 20:42:11.220784] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.220795] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.220804] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.221055] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.221069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.221078] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.223274] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2226 [D 20:42:11.223287] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.223298] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 45/70. [D 20:42:11.223380] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2226 [D 20:42:11.223406] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 46/70. [D 20:42:11.238740] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.238755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.238764] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.241035] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2229 [D 20:42:11.241049] element 0: offset: 0x2aaaab205200, size: 24 [D 20:42:11.241059] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 47/70. [D 20:42:11.242547] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2226 [D 20:42:11.242561] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.242571] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 48/70. [D 20:42:11.242593] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2229 [D 20:42:11.242606] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 49/70. [D 20:42:11.242649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.242661] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.242669] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.255761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.255806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.255816] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.257694] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2229 [D 20:42:11.257732] element 0: offset: 0x2aaaab205200, size: 24 [D 20:42:11.257745] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 50/70. [D 20:42:11.257858] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2232 [D 20:42:11.257871] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.257882] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 51/70. [D 20:42:11.257910] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.257919] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.257928] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.257990] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2232 [D 20:42:11.258040] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 52/70. [D 20:42:11.273963] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2232 [D 20:42:11.273977] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.273988] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 53/70. [D 20:42:11.274104] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.274118] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.274127] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.278037] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.278051] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.278059] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.280252] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2235 [D 20:42:11.280265] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:11.280275] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 54/70. [D 20:42:11.280373] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2235 [D 20:42:11.280445] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 55/70. [D 20:42:11.294024] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2235 [D 20:42:11.294072] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:11.294085] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 56/70. [D 20:42:11.294236] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.294248] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.294257] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.294743] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.294756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.294765] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.297016] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2238 [D 20:42:11.297030] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:11.297040] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 57/70. [D 20:42:11.297149] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2238 [D 20:42:11.297198] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 58/70. [D 20:42:11.309789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.309805] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.309815] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.312136] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2241 [D 20:42:11.312150] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.312160] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 59/70. [D 20:42:11.314557] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2241 [D 20:42:11.314575] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 60/70. [D 20:42:11.319904] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2238 [D 20:42:11.319918] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:11.319927] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 0/70. [D 20:42:11.320055] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.320068] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.320077] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.329012] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2241 [D 20:42:11.329058] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.329073] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 1/70. [D 20:42:11.329242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.329255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.329263] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.331742] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.331755] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.331764] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.334036] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2244 [D 20:42:11.334050] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.334060] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 2/70. [D 20:42:11.334141] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2244 [D 20:42:11.334176] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 3/70. [D 20:42:11.346988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.347003] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.347012] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.349139] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2247 [D 20:42:11.349152] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:11.349163] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 4/70. [D 20:42:11.352457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2244 [D 20:42:11.352471] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.352484] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 5/70. [D 20:42:11.352514] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2247 [D 20:42:11.352527] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 6/70. [D 20:42:11.352550] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.352559] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.352567] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.366520] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.366533] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.366542] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.368798] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2250 [D 20:42:11.368811] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:11.368821] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 7/70. [D 20:42:11.368928] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2250 [D 20:42:11.368944] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 8/70. [D 20:42:11.385606] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2250 [D 20:42:11.385620] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:11.385630] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 9/70. [D 20:42:11.385748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.385762] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.385770] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.399643] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.399657] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.399665] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.401897] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2253 [D 20:42:11.401911] element 0: offset: 0x2aaaab21ab50, size: 24 [D 20:42:11.401921] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 10/70. [D 20:42:11.402019] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2253 [D 20:42:11.402078] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 11/70. [D 20:42:11.421024] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2253 [D 20:42:11.421039] element 0: offset: 0x2aaaab21ab50, size: 24 [D 20:42:11.421049] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 12/70. [D 20:42:11.421122] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.421134] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.421143] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.427115] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.427128] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.427137] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.429420] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2256 [D 20:42:11.429433] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.429443] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 13/70. [D 20:42:11.429512] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2256 [D 20:42:11.429554] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 14/70. [D 20:42:11.447772] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2256 [D 20:42:11.447787] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.447798] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 15/70. [D 20:42:11.447866] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.447879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.447888] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.456010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.456023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.456032] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.458287] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2259 [D 20:42:11.458301] element 0: offset: 0x2aaaab2359f0, size: 24 [D 20:42:11.458311] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 16/70. [D 20:42:11.458408] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2259 [D 20:42:11.458467] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 17/70. [D 20:42:11.477538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2259 [D 20:42:11.477553] element 0: offset: 0x2aaaab2359f0, size: 24 [D 20:42:11.477563] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 18/70. [D 20:42:11.477637] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.477649] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.477657] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:11.549209] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2247 [D 20:42:11.549259] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:11.549274] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 19/70. [D 20:42:11.549345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.549356] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.549365] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.560242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.560256] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.560265] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.562407] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2262 [D 20:42:11.562421] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.562431] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 20/70. [D 20:42:11.562516] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2262 [D 20:42:11.562552] openib_post_sr: 10.1.4.240:38258 bh 9 len 48 wr 21/70. [D 20:42:11.581768] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2262 [D 20:42:11.581784] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.581794] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 22/70. [D 20:42:11.581869] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.581881] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.581889] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.588386] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.588400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.588408] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.590539] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2265 [D 20:42:11.590552] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:11.590563] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 23/70. [D 20:42:11.590632] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2265 [D 20:42:11.590678] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 24/70. [D 20:42:11.607952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2265 [D 20:42:11.607999] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:11.608014] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 25/70. [D 20:42:11.608078] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.608089] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.608098] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:11.616728] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.616742] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.616750] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:11.618524] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2268 [D 20:42:11.618538] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.618548] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 26/70. [D 20:42:11.618607] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2268 [D 20:42:11.618658] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 27/70. [D 20:42:11.710649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:11.710664] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.710672] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:11.712803] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2270 [D 20:42:11.712817] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:11.712827] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 28/70. [D 20:42:11.712900] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2270 [D 20:42:11.712942] openib_post_sr: 10.1.4.240:38258 bh 17 len 48 wr 29/70. [D 20:42:11.955636] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2268 [D 20:42:11.955653] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:11.955663] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 30/70. [D 20:42:11.955744] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:11.955756] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:11.955764] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.090036] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2270 [D 20:42:12.090086] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:12.090100] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 31/70. [D 20:42:12.090264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.090277] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.090285] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:12.097129] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.097143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.097152] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:12.099490] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2273 [D 20:42:12.099504] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:12.099514] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 32/70. [D 20:42:12.099689] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2273 [D 20:42:12.099707] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 33/70. [D 20:42:12.117836] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2273 [D 20:42:12.117850] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:12.117860] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 34/70. [D 20:42:12.117952] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.117964] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.117972] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:12.123952] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.123966] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.123974] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:12.126067] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2276 [D 20:42:12.126080] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:12.126090] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 35/70. [D 20:42:12.126185] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2276 [D 20:42:12.126271] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 36/70. [D 20:42:12.142022] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2276 [D 20:42:12.142068] element 0: offset: 0x2aaaab2259a0, size: 24 [D 20:42:12.142081] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 37/70. [D 20:42:12.142229] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.142242] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.142251] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:12.148298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.148311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.148319] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:12.150538] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2279 [D 20:42:12.150552] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:12.150562] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 38/70. [D 20:42:12.150693] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2279 [D 20:42:12.150744] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 39/70. [D 20:42:12.169096] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.169113] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.169124] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.169205] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2283 [D 20:42:12.169220] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:12.169233] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 40/70. [D 20:42:12.174566] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2279 [D 20:42:12.174617] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:12.174632] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 41/70. [D 20:42:12.174681] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2283 [D 20:42:12.174698] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 42/70. [D 20:42:12.176898] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.176912] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.176922] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.193858] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.193873] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.193882] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.193994] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2285 [D 20:42:12.194006] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:12.194259] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 43/70. [D 20:42:12.196537] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2285 [D 20:42:12.196552] openib_post_sr: 10.1.4.240:38258 bh 12 len 48 wr 44/70. [D 20:42:12.196567] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2283 [D 20:42:12.196577] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:12.196590] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 45/70. [D 20:42:12.196669] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.196682] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.196692] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.208402] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.208416] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.208427] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.208495] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2289 [D 20:42:12.208509] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:12.208520] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 46/70. [D 20:42:12.213953] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2285 [D 20:42:12.214005] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:12.214018] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 47/70. [D 20:42:12.214069] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2289 [D 20:42:12.214085] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 48/70. [D 20:42:12.214559] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.214574] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.214585] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.232800] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.232815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.232823] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.233248] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2291 [D 20:42:12.233259] element 0: offset: 0x2aaaab208c00, size: 24 [D 20:42:12.233269] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 49/70. [D 20:42:12.235595] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2291 [D 20:42:12.235610] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 50/70. [D 20:42:12.235625] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2289 [D 20:42:12.235637] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:12.235647] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 51/70. [D 20:42:12.235745] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.235758] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.235768] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.248580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.248594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.248605] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.248671] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2295 [D 20:42:12.248686] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:12.248696] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 52/70. [D 20:42:12.252755] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2295 [D 20:42:12.252812] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 53/70. [D 20:42:12.695746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.695811] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.695821] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:12.695940] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2298 [D 20:42:12.695955] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:12.695968] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 54/70. [D 20:42:12.698281] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2298 [D 20:42:12.698299] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 55/70. [D 20:42:12.714068] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2298 [D 20:42:12.714084] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:12.714094] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 56/70. [D 20:42:12.716393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.716406] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.716416] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:12.725379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.725392] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.725403] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:12.725465] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2301 [D 20:42:12.725478] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:12.725489] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 57/70. [D 20:42:12.725543] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2301 [D 20:42:12.725580] openib_post_sr: 10.1.4.240:38258 bh 6 len 48 wr 58/70. [D 20:42:12.742991] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2301 [D 20:42:12.743035] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:12.743049] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 59/70. [D 20:42:12.745465] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.745480] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.745491] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:12.748419] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2291 [D 20:42:12.748467] element 0: offset: 0x2aaaab208c00, size: 24 [D 20:42:12.748484] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 60/70. [D 20:42:12.750707] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.750722] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.750733] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:12.754203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.754220] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.754229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:12.754337] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2304 [D 20:42:12.754356] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:12.754367] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 0/70. [D 20:42:12.760899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2295 [D 20:42:12.760958] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:12.760972] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 1/70. [D 20:42:12.761023] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2304 [D 20:42:12.761039] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 2/70. [D 20:42:12.761069] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.761080] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.761089] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:12.763341] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2306 [D 20:42:12.763356] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:12.763367] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 3/70. [D 20:42:12.763394] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.763403] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.763412] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:12.763469] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2306 [D 20:42:12.779052] openib_post_sr: 10.1.4.240:38258 bh 13 len 48 wr 4/70. [D 20:42:12.781589] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.781603] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.781611] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:12.781673] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2310 [D 20:42:12.781684] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:12.781693] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 5/70. [D 20:42:12.781786] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2310 [D 20:42:12.782528] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2304 [D 20:42:12.782543] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:12.782553] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 6/70. [D 20:42:12.782631] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:12.782645] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.782669] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:12.789830] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 7/70. [D 20:42:12.804880] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:12.804932] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:12.804942] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:12.805042] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2313 [D 20:42:12.805100] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:12.805114] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 8/70. [D 20:42:12.806633] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2313 [D 20:42:12.807563] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 9/70. [D 20:42:13.380982] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2306 [D 20:42:13.381050] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:13.381067] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 10/70. [D 20:42:13.383432] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.383448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.383458] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:13.389012] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.389027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.389037] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:13.389136] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2315 [D 20:42:13.389149] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:13.389161] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 11/70. [D 20:42:13.389229] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2315 [D 20:42:13.389272] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 12/70. [D 20:42:13.396850] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2310 [D 20:42:13.396916] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:13.396932] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 13/70. [D 20:42:13.399184] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.399199] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.399209] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:13.405298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.405313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.405322] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:13.405417] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2319 [D 20:42:13.405430] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:13.405441] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 14/70. [D 20:42:13.410637] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2315 [D 20:42:13.410681] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:13.410695] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 15/70. [D 20:42:13.410743] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2319 [D 20:42:13.410758] openib_post_sr: 10.1.4.240:38258 bh 5 len 48 wr 16/70. [D 20:42:13.410789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.410800] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.410808] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:13.427812] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2319 [D 20:42:13.427826] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:13.427836] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 17/70. [D 20:42:13.427910] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.427922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.427930] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:13.438992] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.439006] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.439014] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:13.441240] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2322 [D 20:42:13.441253] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:13.441264] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 18/70. [D 20:42:13.441362] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2322 [D 20:42:13.441414] openib_post_sr: 10.1.4.240:38258 bh 8 len 48 wr 19/70. [D 20:42:13.460281] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2322 [D 20:42:13.460296] element 0: offset: 0x2aaaab235510, size: 24 [D 20:42:13.460306] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 20/70. [D 20:42:13.460379] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.460391] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.460399] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:13.465529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.465543] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.465552] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:13.467778] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2325 [D 20:42:13.467791] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.467801] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 21/70. [D 20:42:13.467917] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2325 [D 20:42:13.467954] openib_post_sr: 10.1.4.240:38258 bh 11 len 48 wr 22/70. [D 20:42:13.486649] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2325 [D 20:42:13.486664] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.486674] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 23/70. [D 20:42:13.488932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.488988] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.488998] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:13.494101] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.494116] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.494125] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:13.494226] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2328 [D 20:42:13.494241] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:13.494255] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 24/70. [D 20:42:13.496619] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2328 [D 20:42:13.496637] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 25/70. [D 20:42:13.514307] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2328 [D 20:42:13.514368] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:13.514383] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 26/70. [D 20:42:13.514642] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.514656] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.514666] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:13.546014] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2313 [D 20:42:13.546051] element 0: offset: 0x2aaaab229920, size: 24 [D 20:42:13.546066] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 27/70. [D 20:42:13.548562] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.548577] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.548588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.554644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.554659] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.554670] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.554799] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2331 [D 20:42:13.554813] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:13.554825] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 28/70. [D 20:42:13.554896] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2331 [D 20:42:13.554930] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 29/70. [D 20:42:13.573930] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2331 [D 20:42:13.573994] element 0: offset: 0x2aaaab229bc0, size: 24 [D 20:42:13.574009] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 30/70. [D 20:42:13.576204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.576219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.576230] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.582629] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.582642] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.582653] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.583278] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2334 [D 20:42:13.583292] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:13.583303] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 31/70. [D 20:42:13.583416] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2334 [D 20:42:13.583461] openib_post_sr: 10.1.4.240:38258 bh 1 len 48 wr 32/70. [D 20:42:13.602018] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2334 [D 20:42:13.602080] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:13.602095] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 33/70. [D 20:42:13.604328] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.604343] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.604353] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.610012] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.610028] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.610038] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.610132] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2337 [D 20:42:13.610146] element 0: offset: 0x2aaaab217e10, size: 24 [D 20:42:13.610158] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 34/70. [D 20:42:13.612821] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2337 [D 20:42:13.612840] openib_post_sr: 10.1.4.240:38258 bh 4 len 48 wr 35/70. [D 20:42:13.627450] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2337 [D 20:42:13.627497] element 0: offset: 0x2aaaab217e10, size: 24 [D 20:42:13.627510] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 36/70. [D 20:42:13.630054] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.630069] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.630080] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.635208] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.635222] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.635234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.635326] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2340 [D 20:42:13.635340] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:13.635351] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 37/70. [D 20:42:13.635469] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2340 [D 20:42:13.635508] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 38/70. [D 20:42:13.652929] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2340 [D 20:42:13.652995] element 0: offset: 0x2aaaab202c30, size: 24 [D 20:42:13.653009] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 39/70. [D 20:42:13.655194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.655208] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.655219] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.682799] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.682813] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.682824] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.682919] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2345 [D 20:42:13.682933] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:13.682944] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 40/70. [D 20:42:13.839177] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 1310720, tag: 2345 [D 20:42:13.839228] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 41/70. [D 20:42:13.839335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fe44b0 rkey 4a40042 nic_wr_credit 145. [D 20:42:13.839407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40044b0 rkey 4a40044 nic_wr_credit 146. [D 20:42:13.839419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40244b0 rkey 4a40044 nic_wr_credit 147. [D 20:42:13.839430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40444b0 rkey 4a40044 nic_wr_credit 148. [D 20:42:13.839444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40644b0 rkey 4a40044 nic_wr_credit 149. [D 20:42:13.839454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40844b0 rkey 4a40044 nic_wr_credit 150. [D 20:42:13.839464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40a44b0 rkey 4a40044 nic_wr_credit 151. [D 20:42:13.839479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40c44b0 rkey 4a40044 nic_wr_credit 152. [D 20:42:13.839489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40e44b0 rkey 4a40044 nic_wr_credit 153. [D 20:42:13.839499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41044b0 rkey 4a40044 nic_wr_credit 154. [D 20:42:13.839515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41244b0 rkey 4a40044 nic_wr_credit 155. [D 20:42:13.839525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41444b0 rkey 4a40044 nic_wr_credit 156. [D 20:42:13.839534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41644b0 rkey 4a40044 nic_wr_credit 157. [D 20:42:13.839544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41844b0 rkey 4a40044 nic_wr_credit 158. [D 20:42:13.839554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41a44b0 rkey 4a40044 nic_wr_credit 159. [D 20:42:13.839565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41c44b0 rkey 4a40044 nic_wr_credit 160. [D 20:42:13.839574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41e44b0 rkey 4a40044 nic_wr_credit 161. [D 20:42:13.839584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42044b0 rkey 4a40044 nic_wr_credit 162. [D 20:42:13.839741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42244b0 rkey 4a40044 nic_wr_credit 163. [D 20:42:13.839753] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f42444b0 rkey 4a40044 nic_wr_credit 164. [D 20:42:13.848369] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 164. [D 20:42:13.848394] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 42/70. [D 20:42:13.850661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.850677] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.850687] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 0 [D 20:42:13.871629] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.871647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.871658] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 1 [D 20:42:13.871693] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.871703] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.871714] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:13.871830] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2349 [D 20:42:13.871845] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.871858] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 43/70. [D 20:42:13.871890] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2351 [D 20:42:13.871900] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:13.871911] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 44/70. [D 20:42:13.874622] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2349 [D 20:42:13.874642] openib_post_sr: 10.1.4.240:38258 bh 14 len 48 wr 45/70. [D 20:42:13.874667] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2351 [D 20:42:13.874682] openib_post_sr: 10.1.4.240:38258 bh 15 len 48 wr 46/70. [D 20:42:13.881846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.881874] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.881884] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:13.881915] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2349 [D 20:42:13.881925] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.881936] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 47/70. [D 20:42:13.881951] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2351 [D 20:42:13.881960] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:13.881969] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 48/70. [D 20:42:13.882054] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.882067] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.882076] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:13.882131] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2355 [D 20:42:13.882142] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.882152] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 49/70. [D 20:42:13.884546] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.884560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.884571] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:13.884599] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2355 [D 20:42:13.884611] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 50/70. [D 20:42:13.897550] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.897566] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.897577] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:13.897596] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.897609] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.897618] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:13.897705] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2361 [D 20:42:13.897720] element 0: offset: 0x2aaaab208c00, size: 24 [D 20:42:13.897730] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 51/70. [D 20:42:13.897759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2362 [D 20:42:13.897774] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:13.897784] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 52/70. [D 20:42:13.903802] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2355 [D 20:42:13.903865] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:13.903880] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 53/70. [D 20:42:13.906091] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:13.906107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.906116] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:13.912926] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.912940] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.912950] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:13.912983] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:13.912993] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:13.913002] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.110105] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2361 [D 20:42:14.110160] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 54/70. [D 20:42:14.110273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 164. [D 20:42:14.110347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 165. [D 20:42:14.110368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 166. [D 20:42:14.110379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 167. [D 20:42:14.110390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 168. [D 20:42:14.110400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 169. [D 20:42:14.110415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 170. [D 20:42:14.110425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 171. [D 20:42:14.110435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 172. [D 20:42:14.110451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 173. [D 20:42:14.110461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 174. [D 20:42:14.110471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 175. [D 20:42:14.110480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 176. [D 20:42:14.110491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 177. [D 20:42:14.110500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 178. [D 20:42:14.110562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 179. [D 20:42:14.110573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 180. [D 20:42:14.110587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 181. [D 20:42:14.110597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 182. [D 20:42:14.110606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 183. [D 20:42:14.110621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 184. [D 20:42:14.110630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 185. [D 20:42:14.110644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 186. [D 20:42:14.110676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 187. [D 20:42:14.110686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 188. [D 20:42:14.110696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 189. [D 20:42:14.110712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 190. [D 20:42:14.110722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 191. [D 20:42:14.110732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 192. [D 20:42:14.110758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 193. [D 20:42:14.110768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 194. [D 20:42:14.110777] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 195. [D 20:42:14.118067] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 195. [D 20:42:14.118083] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 55/70. [D 20:42:14.120354] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.120370] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.120381] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.126170] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.126185] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.126195] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.126229] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2376 [D 20:42:14.126240] element 0: offset: 0x2aaaab202c60, size: 24 [D 20:42:14.126255] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 56/70. [D 20:42:14.148993] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2362 [D 20:42:14.149012] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 57/70. [D 20:42:14.149077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 195. [D 20:42:14.149157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 196. [D 20:42:14.149169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 197. [D 20:42:14.149180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 198. [D 20:42:14.149195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 199. [D 20:42:14.149205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 200. [D 20:42:14.149215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 201. [D 20:42:14.149229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 202. [D 20:42:14.149239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 203. [D 20:42:14.149249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 204. [D 20:42:14.149259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 205. [D 20:42:14.149313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 206. [D 20:42:14.149325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 207. [D 20:42:14.149347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 208. [D 20:42:14.149358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 209. [D 20:42:14.149368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 210. [D 20:42:14.149378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 211. [D 20:42:14.149395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 212. [D 20:42:14.149406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 213. [D 20:42:14.149427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 214. [D 20:42:14.149444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 215. [D 20:42:14.149453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 216. [D 20:42:14.149463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 217. [D 20:42:14.149494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 218. [D 20:42:14.149510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 219. [D 20:42:14.149520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 220. [D 20:42:14.149530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 221. [D 20:42:14.149560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 222. [D 20:42:14.149576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 223. [D 20:42:14.149586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 224. [D 20:42:14.149596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 225. [D 20:42:14.149612] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 226. [D 20:42:14.155194] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 226. [D 20:42:14.155212] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 58/70. [D 20:42:14.157421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.157437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.157447] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.162802] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.162817] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.162828] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.162862] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2378 [D 20:42:14.162873] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:14.162887] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 59/70. [D 20:42:14.191131] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2376 [D 20:42:14.191150] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 60/70. [D 20:42:14.191211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 226. [D 20:42:14.191281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 227. [D 20:42:14.191301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 228. [D 20:42:14.191314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 229. [D 20:42:14.191325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 230. [D 20:42:14.191336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 231. [D 20:42:14.191346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 232. [D 20:42:14.191356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 233. [D 20:42:14.191366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 234. [D 20:42:14.191377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 235. [D 20:42:14.191430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 236. [D 20:42:14.191443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 237. [D 20:42:14.191462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 238. [D 20:42:14.191477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 239. [D 20:42:14.191487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 240. [D 20:42:14.191497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 241. [D 20:42:14.191511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 242. [D 20:42:14.191520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 243. [D 20:42:14.191530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 244. [D 20:42:14.191556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 245. [D 20:42:14.191566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 246. [D 20:42:14.191581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 247. [D 20:42:14.191591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 248. [D 20:42:14.191619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 249. [D 20:42:14.191629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 250. [D 20:42:14.191639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 251. [D 20:42:14.191649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 252. [D 20:42:14.191659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 253. [D 20:42:14.191669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 254. [D 20:42:14.191679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 255. [D 20:42:14.191698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 256. [D 20:42:14.191708] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 257. [D 20:42:14.197136] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 257. [D 20:42:14.197154] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 0/70. [D 20:42:14.199450] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.199465] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.199476] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.205135] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.205150] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.205160] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.205192] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2382 [D 20:42:14.205203] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:14.205216] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 1/70. [D 20:42:14.284873] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2378 [D 20:42:14.284892] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 2/70. [D 20:42:14.285025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 257. [D 20:42:14.285101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 258. [D 20:42:14.285112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 259. [D 20:42:14.285123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 260. [D 20:42:14.285137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 261. [D 20:42:14.285147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 262. [D 20:42:14.285157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 263. [D 20:42:14.285170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 264. [D 20:42:14.285180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 265. [D 20:42:14.285190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 266. [D 20:42:14.285206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 267. [D 20:42:14.285266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 268. [D 20:42:14.285278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 269. [D 20:42:14.285301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 270. [D 20:42:14.285312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 271. [D 20:42:14.285323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 272. [D 20:42:14.285338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 273. [D 20:42:14.285349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 274. [D 20:42:14.285376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 275. [D 20:42:14.285391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 276. [D 20:42:14.285401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 277. [D 20:42:14.285411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 278. [D 20:42:14.285440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 279. [D 20:42:14.285450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 280. [D 20:42:14.285462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 281. [D 20:42:14.285472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 282. [D 20:42:14.285484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 283. [D 20:42:14.285499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 284. [D 20:42:14.285528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 285. [D 20:42:14.285539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 286. [D 20:42:14.285549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 287. [D 20:42:14.285565] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 288. [D 20:42:14.290955] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 288. [D 20:42:14.290973] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 3/70. [D 20:42:14.293197] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.293212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.293222] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.299000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.299015] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.299026] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.299060] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2384 [D 20:42:14.299071] element 0: offset: 0x2aaaab208c00, size: 24 [D 20:42:14.299085] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 4/70. [D 20:42:14.334841] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2384 [D 20:42:14.334861] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 5/70. [D 20:42:14.334925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 288. [D 20:42:14.334994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 289. [D 20:42:14.335014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 290. [D 20:42:14.335025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 291. [D 20:42:14.335035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 292. [D 20:42:14.335045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 293. [D 20:42:14.335060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 294. [D 20:42:14.335070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 295. [D 20:42:14.335079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 296. [D 20:42:14.335089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 297. [D 20:42:14.335106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 298. [D 20:42:14.335117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 299. [D 20:42:14.335126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 300. [D 20:42:14.335136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 301. [D 20:42:14.335146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 302. [D 20:42:14.335164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 303. [D 20:42:14.335216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 304. [D 20:42:14.335226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 305. [D 20:42:14.335236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 306. [D 20:42:14.335246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 307. [D 20:42:14.335261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 308. [D 20:42:14.335271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 309. [D 20:42:14.335281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 310. [D 20:42:14.335305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 311. [D 20:42:14.335315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 312. [D 20:42:14.335325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 313. [D 20:42:14.335340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 314. [D 20:42:14.335350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 315. [D 20:42:14.335376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 316. [D 20:42:14.335386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 317. [D 20:42:14.335396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 318. [D 20:42:14.335424] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 319. [D 20:42:14.340903] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 319. [D 20:42:14.340920] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 6/70. [D 20:42:14.343130] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.343145] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.343156] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.346679] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.346693] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.346703] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.346737] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2387 [D 20:42:14.346749] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:14.349036] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 7/70. [D 20:42:14.429799] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2387 [D 20:42:14.429817] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 8/70. [D 20:42:14.429903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 319. [D 20:42:14.429980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 320. [D 20:42:14.430028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 321. [D 20:42:14.430038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 322. [D 20:42:14.430049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 323. [D 20:42:14.430059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 324. [D 20:42:14.430070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 325. [D 20:42:14.430093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 326. [D 20:42:14.430105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 327. [D 20:42:14.430115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 328. [D 20:42:14.430125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 329. [D 20:42:14.430139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 330. [D 20:42:14.430153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 331. [D 20:42:14.430163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 332. [D 20:42:14.430175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 333. [D 20:42:14.430185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 334. [D 20:42:14.430195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 335. [D 20:42:14.430205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 336. [D 20:42:14.430223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 337. [D 20:42:14.430254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 338. [D 20:42:14.430267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 339. [D 20:42:14.430277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 340. [D 20:42:14.430300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 341. [D 20:42:14.430311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 342. [D 20:42:14.430321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 343. [D 20:42:14.430334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 344. [D 20:42:14.430344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 345. [D 20:42:14.430369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 346. [D 20:42:14.430379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 347. [D 20:42:14.430389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 348. [D 20:42:14.430400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 349. [D 20:42:14.430424] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 350. [D 20:42:14.435885] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 350. [D 20:42:14.435904] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 9/70. [D 20:42:14.438204] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.438219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.438229] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.443751] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.443765] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.443776] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.443809] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2390 [D 20:42:14.443821] element 0: offset: 0x2aaaab202c60, size: 24 [D 20:42:14.443835] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 10/70. [D 20:42:14.449159] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2382 [D 20:42:14.449185] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 11/70. [D 20:42:14.449247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 350. [D 20:42:14.449309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 351. [D 20:42:14.449325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 352. [D 20:42:14.449336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 353. [D 20:42:14.449349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 354. [D 20:42:14.449359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 355. [D 20:42:14.449369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 356. [D 20:42:14.449382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 357. [D 20:42:14.449392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 358. [D 20:42:14.449402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 359. [D 20:42:14.449418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 360. [D 20:42:14.449427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 361. [D 20:42:14.449437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 362. [D 20:42:14.449452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 363. [D 20:42:14.449462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 364. [D 20:42:14.449472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 365. [D 20:42:14.449515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 366. [D 20:42:14.449526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 367. [D 20:42:14.449537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 368. [D 20:42:14.449547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 369. [D 20:42:14.449570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 370. [D 20:42:14.449580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 371. [D 20:42:14.449591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 372. [D 20:42:14.449601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 373. [D 20:42:14.449610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 374. [D 20:42:14.449627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 375. [D 20:42:14.449637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 376. [D 20:42:14.449647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 377. [D 20:42:14.449657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 378. [D 20:42:14.449691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 379. [D 20:42:14.449702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 380. [D 20:42:14.449713] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 381. [D 20:42:14.458606] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 381. [D 20:42:14.458681] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 12/70. [D 20:42:14.460863] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.460878] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.460889] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.466928] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.466949] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.466960] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.466993] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2394 [D 20:42:14.467004] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:14.467017] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 13/70. [D 20:42:14.477772] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2390 [D 20:42:14.477791] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 14/70. [D 20:42:14.477850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 381. [D 20:42:14.477915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 382. [D 20:42:14.477934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 383. [D 20:42:14.477945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 384. [D 20:42:14.477955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 385. [D 20:42:14.477965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 386. [D 20:42:14.477981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 387. [D 20:42:14.477991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 388. [D 20:42:14.478001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 389. [D 20:42:14.478017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 390. [D 20:42:14.478026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 391. [D 20:42:14.478036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 392. [D 20:42:14.478047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 393. [D 20:42:14.478056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 394. [D 20:42:14.478066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 395. [D 20:42:14.478076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 396. [D 20:42:14.478130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 397. [D 20:42:14.478141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 398. [D 20:42:14.478151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 399. [D 20:42:14.478177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 400. [D 20:42:14.478187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 401. [D 20:42:14.478197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 402. [D 20:42:14.478207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 403. [D 20:42:14.478217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 404. [D 20:42:14.478228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 405. [D 20:42:14.478239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 406. [D 20:42:14.478248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 407. [D 20:42:14.478282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 408. [D 20:42:14.478294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 409. [D 20:42:14.478308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 410. [D 20:42:14.478318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 411. [D 20:42:14.478328] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 412. [D 20:42:14.483774] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 412. [D 20:42:14.483793] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 15/70. [D 20:42:14.485999] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.486013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.486024] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.491748] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.491763] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.491773] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.491812] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2396 [D 20:42:14.491823] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:14.491837] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 16/70. [D 20:42:14.553546] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2394 [D 20:42:14.553598] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 17/70. [D 20:42:14.553670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 412. [D 20:42:14.553744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 413. [D 20:42:14.553755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 414. [D 20:42:14.553766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 415. [D 20:42:14.553780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 416. [D 20:42:14.553790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 417. [D 20:42:14.553801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 418. [D 20:42:14.553815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 419. [D 20:42:14.553825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 420. [D 20:42:14.553835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 421. [D 20:42:14.553851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 422. [D 20:42:14.553860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 423. [D 20:42:14.553870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 424. [D 20:42:14.553880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 425. [D 20:42:14.553889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 426. [D 20:42:14.553899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 427. [D 20:42:14.553910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 428. [D 20:42:14.553922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 429. [D 20:42:14.553980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 430. [D 20:42:14.553991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 431. [D 20:42:14.554000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 432. [D 20:42:14.554010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 433. [D 20:42:14.554026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 434. [D 20:42:14.554036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 435. [D 20:42:14.554045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 436. [D 20:42:14.554055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 437. [D 20:42:14.554072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 438. [D 20:42:14.554082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 439. [D 20:42:14.554092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 440. [D 20:42:14.554102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 441. [D 20:42:14.554129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 442. [D 20:42:14.554140] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 443. [D 20:42:14.559599] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 443. [D 20:42:14.559617] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 18/70. [D 20:42:14.561828] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.561844] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.561854] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.567877] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.567899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.567910] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.567944] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2400 [D 20:42:14.567955] element 0: offset: 0x2aaaab205330, size: 24 [D 20:42:14.567968] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 19/70. [D 20:42:14.582793] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2396 [D 20:42:14.582812] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 20/70. [D 20:42:14.582869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 443. [D 20:42:14.582935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 444. [D 20:42:14.582955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 445. [D 20:42:14.582966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 446. [D 20:42:14.582977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 447. [D 20:42:14.582987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 448. [D 20:42:14.583002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 449. [D 20:42:14.583012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 450. [D 20:42:14.583022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 451. [D 20:42:14.583038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 452. [D 20:42:14.583089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 453. [D 20:42:14.583101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 454. [D 20:42:14.583111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 455. [D 20:42:14.583136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 456. [D 20:42:14.583146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 457. [D 20:42:14.583157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 458. [D 20:42:14.583167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 459. [D 20:42:14.583177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 460. [D 20:42:14.583187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 461. [D 20:42:14.583197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 462. [D 20:42:14.583224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 463. [D 20:42:14.583240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 464. [D 20:42:14.583250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 465. [D 20:42:14.583259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 466. [D 20:42:14.583275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 467. [D 20:42:14.583285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 468. [D 20:42:14.583295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 469. [D 20:42:14.583304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 470. [D 20:42:14.583315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 471. [D 20:42:14.583325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 472. [D 20:42:14.583334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 473. [D 20:42:14.583359] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 474. [D 20:42:14.588792] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 474. [D 20:42:14.588810] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 21/70. [D 20:42:14.591125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.591140] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.591151] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.596829] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.596843] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.596853] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.596887] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2402 [D 20:42:14.596898] element 0: offset: 0x2aaaab202c60, size: 24 [D 20:42:14.596912] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 22/70. [D 20:42:14.656173] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2402 [D 20:42:14.656231] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 23/70. [D 20:42:14.656298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 474. [D 20:42:14.656372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 475. [D 20:42:14.656384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 476. [D 20:42:14.656395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 477. [D 20:42:14.656405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 478. [D 20:42:14.656414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 479. [D 20:42:14.656425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 480. [D 20:42:14.656435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 481. [D 20:42:14.656445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 482. [D 20:42:14.656455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 483. [D 20:42:14.656473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 484. [D 20:42:14.656482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 485. [D 20:42:14.656492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 486. [D 20:42:14.656502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 487. [D 20:42:14.656566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 488. [D 20:42:14.656577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 489. [D 20:42:14.656587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 490. [D 20:42:14.656597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 491. [D 20:42:14.656607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 492. [D 20:42:14.656617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 493. [D 20:42:14.656627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 494. [D 20:42:14.656642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 495. [D 20:42:14.656651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 496. [D 20:42:14.656661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 497. [D 20:42:14.656671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 498. [D 20:42:14.656683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 499. [D 20:42:14.656693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 500. [D 20:42:14.656716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 501. [D 20:42:14.656726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 502. [D 20:42:14.656736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 503. [D 20:42:14.656746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 504. [D 20:42:14.656764] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 505. [D 20:42:14.662298] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 505. [D 20:42:14.662315] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 24/70. [D 20:42:14.664503] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.664518] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.664529] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.670048] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.670064] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.670074] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.670107] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2405 [D 20:42:14.670119] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:14.670131] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 25/70. [D 20:42:14.722289] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2400 [D 20:42:14.722308] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 26/70. [D 20:42:14.722367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 505. [D 20:42:14.722437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 506. [D 20:42:14.722455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 507. [D 20:42:14.722465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 508. [D 20:42:14.722477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 509. [D 20:42:14.722486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 510. [D 20:42:14.722502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 511. [D 20:42:14.722512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 512. [D 20:42:14.722522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 513. [D 20:42:14.722538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 514. [D 20:42:14.722589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 515. [D 20:42:14.722601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 516. [D 20:42:14.722610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 517. [D 20:42:14.722638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 518. [D 20:42:14.722648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 519. [D 20:42:14.722663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 520. [D 20:42:14.722673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 521. [D 20:42:14.722683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 522. [D 20:42:14.722708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 523. [D 20:42:14.722719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 524. [D 20:42:14.722729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 525. [D 20:42:14.722740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 526. [D 20:42:14.722750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 527. [D 20:42:14.722760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 528. [D 20:42:14.722770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 529. [D 20:42:14.722795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 530. [D 20:42:14.722811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 531. [D 20:42:14.722821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 532. [D 20:42:14.722830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 533. [D 20:42:14.722855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 534. [D 20:42:14.722865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 535. [D 20:42:14.722876] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 536. [D 20:42:14.728291] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 536. [D 20:42:14.728308] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 27/70. [D 20:42:14.730491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:14.730506] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.730515] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:14.736670] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:14.736685] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:14.736697] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:14.736731] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2409 [D 20:42:14.736742] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:14.736754] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 28/70. [D 20:42:15.055861] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2405 [D 20:42:15.055915] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 29/70. [D 20:42:15.056053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 536. [D 20:42:15.056134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 537. [D 20:42:15.056146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 538. [D 20:42:15.056157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 539. [D 20:42:15.056171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 540. [D 20:42:15.056181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 541. [D 20:42:15.056191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 542. [D 20:42:15.056207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 543. [D 20:42:15.056217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 544. [D 20:42:15.056227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 545. [D 20:42:15.056240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 546. [D 20:42:15.056250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 547. [D 20:42:15.056288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 548. [D 20:42:15.056299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 549. [D 20:42:15.056313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 550. [D 20:42:15.056323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 551. [D 20:42:15.056333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 552. [D 20:42:15.056348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 553. [D 20:42:15.056357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 554. [D 20:42:15.056367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 555. [D 20:42:15.056382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 556. [D 20:42:15.056392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 557. [D 20:42:15.056402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 558. [D 20:42:15.056412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 559. [D 20:42:15.056428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 560. [D 20:42:15.056450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 561. [D 20:42:15.056461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 562. [D 20:42:15.056470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 563. [D 20:42:15.056480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 564. [D 20:42:15.056496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 565. [D 20:42:15.056507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 566. [D 20:42:15.056516] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 567. [D 20:42:15.058774] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.058790] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.058801] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 5 [D 20:42:15.058863] BMI_post_send_list: addr: 6416064, count: 1, total_size: 104, tag: 2412 [D 20:42:15.058877] element 0: offset: 0x2aaaab229a50, size: 104 [D 20:42:15.058890] openib_post_sr: 10.1.4.240:38258 bh 0 len 120 wr 30/70. [D 20:42:15.061994] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 567. [D 20:42:15.062009] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 31/70. [D 20:42:15.062689] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.062702] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.062713] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 4 [D 20:42:15.062731] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.062743] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.062751] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.168642] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2409 [D 20:42:15.168662] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 32/70. [D 20:42:15.168764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 567. [D 20:42:15.168875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 568. [D 20:42:15.168886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 569. [D 20:42:15.168897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 570. [D 20:42:15.168911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 571. [D 20:42:15.168921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 572. [D 20:42:15.168931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 573. [D 20:42:15.168945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 574. [D 20:42:15.168955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 575. [D 20:42:15.168965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 576. [D 20:42:15.168975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 577. [D 20:42:15.168985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 578. [D 20:42:15.168995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 579. [D 20:42:15.169005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 580. [D 20:42:15.169035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 581. [D 20:42:15.169057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 582. [D 20:42:15.169071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 583. [D 20:42:15.169081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 584. [D 20:42:15.169091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 585. [D 20:42:15.169116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 586. [D 20:42:15.169126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 587. [D 20:42:15.169139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 588. [D 20:42:15.169179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 589. [D 20:42:15.169190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 590. [D 20:42:15.169203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 591. [D 20:42:15.169227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 592. [D 20:42:15.169237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 593. [D 20:42:15.169247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 594. [D 20:42:15.169270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 595. [D 20:42:15.169281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 596. [D 20:42:15.169291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 597. [D 20:42:15.169302] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 598. [D 20:42:15.174735] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 598. [D 20:42:15.174753] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 33/70. [D 20:42:15.177046] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.177061] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.177071] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:15.183755] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.183770] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.183781] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:15.183815] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2415 [D 20:42:15.183826] element 0: offset: 0x2aaaab2030a0, size: 24 [D 20:42:15.183838] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 34/70. [D 20:42:15.198327] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.198364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.198373] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.198402] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2417 [D 20:42:15.198412] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.198424] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 35/70. [D 20:42:15.239047] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2415 [D 20:42:15.239088] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 36/70. [D 20:42:15.239149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 598. [D 20:42:15.239221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 599. [D 20:42:15.239232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 600. [D 20:42:15.239243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 601. [D 20:42:15.239253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 602. [D 20:42:15.239262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 603. [D 20:42:15.239273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 604. [D 20:42:15.239283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 605. [D 20:42:15.239292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 606. [D 20:42:15.239302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 607. [D 20:42:15.239312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 608. [D 20:42:15.239322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 609. [D 20:42:15.239332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 610. [D 20:42:15.239389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 611. [D 20:42:15.239413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 612. [D 20:42:15.239424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 613. [D 20:42:15.239434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 614. [D 20:42:15.239443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 615. [D 20:42:15.239460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 616. [D 20:42:15.239470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 617. [D 20:42:15.239480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 618. [D 20:42:15.239489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 619. [D 20:42:15.239516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 620. [D 20:42:15.239526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 621. [D 20:42:15.239537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 622. [D 20:42:15.239547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 623. [D 20:42:15.239568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 624. [D 20:42:15.239585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 625. [D 20:42:15.239595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 626. [D 20:42:15.239605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 627. [D 20:42:15.239615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 628. [D 20:42:15.239625] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 629. [D 20:42:15.245077] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 629. [D 20:42:15.245096] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 37/70. [D 20:42:15.246715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.246730] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.246742] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.253491] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.253505] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.253515] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.253549] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2421 [D 20:42:15.253560] element 0: offset: 0x2aaaab202f80, size: 24 [D 20:42:15.253574] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 38/70. [D 20:42:15.317098] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2417 [D 20:42:15.317153] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 39/70. [D 20:42:15.317219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 629. [D 20:42:15.317291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 630. [D 20:42:15.317302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 631. [D 20:42:15.317314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 632. [D 20:42:15.317324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 633. [D 20:42:15.317335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 634. [D 20:42:15.317346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 635. [D 20:42:15.317355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 636. [D 20:42:15.317365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 637. [D 20:42:15.317383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 638. [D 20:42:15.317392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 639. [D 20:42:15.317402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 640. [D 20:42:15.317458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 641. [D 20:42:15.317470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 642. [D 20:42:15.317482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 643. [D 20:42:15.317492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 644. [D 20:42:15.317502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 645. [D 20:42:15.317512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 646. [D 20:42:15.317536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 647. [D 20:42:15.317547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 648. [D 20:42:15.317569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 649. [D 20:42:15.317580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 650. [D 20:42:15.317590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 651. [D 20:42:15.317600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 652. [D 20:42:15.317610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 653. [D 20:42:15.317620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 654. [D 20:42:15.317644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 655. [D 20:42:15.317654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 656. [D 20:42:15.317664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 657. [D 20:42:15.317678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 658. [D 20:42:15.317687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 659. [D 20:42:15.317697] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 660. [D 20:42:15.323150] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 660. [D 20:42:15.323167] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 40/70. [D 20:42:15.325493] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.325508] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.325518] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.330744] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.330758] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.330770] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.330804] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2423 [D 20:42:15.330815] element 0: offset: 0x2aaaab235a20, size: 24 [D 20:42:15.330827] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 41/70. [D 20:42:15.369309] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2421 [D 20:42:15.369327] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 42/70. [D 20:42:15.369392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 660. [D 20:42:15.369504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 661. [D 20:42:15.369518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 662. [D 20:42:15.369529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 663. [D 20:42:15.369540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 664. [D 20:42:15.369551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 665. [D 20:42:15.369561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 666. [D 20:42:15.369584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 667. [D 20:42:15.369594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 668. [D 20:42:15.369604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 669. [D 20:42:15.369614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 670. [D 20:42:15.369624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 671. [D 20:42:15.369648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 672. [D 20:42:15.369658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 673. [D 20:42:15.369679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 674. [D 20:42:15.369689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 675. [D 20:42:15.369699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 676. [D 20:42:15.369713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 677. [D 20:42:15.369736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 678. [D 20:42:15.369748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 679. [D 20:42:15.369758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 680. [D 20:42:15.369780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 681. [D 20:42:15.369790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 682. [D 20:42:15.369800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 683. [D 20:42:15.369821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 684. [D 20:42:15.369831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 685. [D 20:42:15.369841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 686. [D 20:42:15.369851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 687. [D 20:42:15.369862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 688. [D 20:42:15.369872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 689. [D 20:42:15.369882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 690. [D 20:42:15.369895] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 691. [D 20:42:15.375362] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 691. [D 20:42:15.375380] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 43/70. [D 20:42:15.377554] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.377569] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.377580] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.471103] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2370 [D 20:42:15.471119] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:15.471137] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 44/70. [D 20:42:15.473264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.473278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.473288] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:15.473352] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2373 [D 20:42:15.473365] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:15.473376] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 45/70. [D 20:42:15.476795] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2373 [D 20:42:15.476814] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 46/70. [D 20:42:15.476834] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.476848] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.476857] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:15.476944] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2429 [D 20:42:15.476963] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:15.476975] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 47/70. [D 20:42:15.477320] BMI_post_recv: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2429 [D 20:42:15.485957] openib_post_sr: 10.1.4.240:38258 bh 18 len 48 wr 48/70. [D 20:42:15.492437] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2373 [D 20:42:15.492457] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:15.492468] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 49/70. [D 20:42:15.493059] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2429 [D 20:42:15.493074] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:15.493084] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 50/70. [D 20:42:15.493157] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.493169] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.493178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:15.493194] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.493203] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.493211] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:15.497255] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.497269] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.497278] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:15.498252] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.498266] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.498275] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:15.498768] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2432 [D 20:42:15.498782] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:15.498792] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 51/70. [D 20:42:15.498834] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2435 [D 20:42:15.498844] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.498854] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 52/70. [D 20:42:15.499095] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2435 [D 20:42:15.499113] openib_post_sr: 10.1.4.240:38258 bh 3 len 48 wr 53/70. [D 20:42:15.511371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.511385] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.511394] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.511412] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2438 [D 20:42:15.511422] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:15.511432] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 54/70. [D 20:42:15.517481] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2435 [D 20:42:15.517531] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.517546] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 55/70. [D 20:42:15.517702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.517715] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.517724] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.525967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.525983] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.525992] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.526095] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2441 [D 20:42:15.526106] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:15.526117] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 56/70. [D 20:42:15.526225] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2441 [D 20:42:15.526339] openib_post_sr: 10.1.4.240:38258 bh 7 len 48 wr 57/70. [D 20:42:15.546958] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2441 [D 20:42:15.546973] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:15.546983] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 58/70. [D 20:42:15.547065] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.547079] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.547087] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.554316] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.554329] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.554338] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.554386] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2444 [D 20:42:15.554396] element 0: offset: 0x2aaaab202f80, size: 24 [D 20:42:15.554406] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 59/70. [D 20:42:15.554459] BMI_post_recv: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2444 [D 20:42:15.554510] openib_post_sr: 10.1.4.240:38258 bh 10 len 48 wr 60/70. [D 20:42:15.563983] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2423 [D 20:42:15.564003] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 0/70. [D 20:42:15.567369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 691. [D 20:42:15.567395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 692. [D 20:42:15.567406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 693. [D 20:42:15.567417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 694. [D 20:42:15.567428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 695. [D 20:42:15.567439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 696. [D 20:42:15.567449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 697. [D 20:42:15.567459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 698. [D 20:42:15.567469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 699. [D 20:42:15.567479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 700. [D 20:42:15.567489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 701. [D 20:42:15.567506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 702. [D 20:42:15.567516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 703. [D 20:42:15.567526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 704. [D 20:42:15.567535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 705. [D 20:42:15.567545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 706. [D 20:42:15.567556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 707. [D 20:42:15.567588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 708. [D 20:42:15.567598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 709. [D 20:42:15.567609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 710. [D 20:42:15.567619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 711. [D 20:42:15.567629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 712. [D 20:42:15.567639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 713. [D 20:42:15.567657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 714. [D 20:42:15.567667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 715. [D 20:42:15.567677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 716. [D 20:42:15.567702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 717. [D 20:42:15.567713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 718. [D 20:42:15.567723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 719. [D 20:42:15.567733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 720. [D 20:42:15.567743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 721. [D 20:42:15.567753] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 722. [D 20:42:15.573328] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 722. [D 20:42:15.573394] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 1/70. [D 20:42:15.573458] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.573472] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.573480] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.576217] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2444 [D 20:42:15.576230] element 0: offset: 0x2aaaab202f80, size: 24 [D 20:42:15.576241] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 2/70. [D 20:42:15.576305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.576316] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.576325] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:15.579120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.579135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.579144] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:15.579162] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2446 [D 20:42:15.579172] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:15.579182] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 3/70. [D 20:42:15.584088] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.584103] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.584111] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.584171] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2450 [D 20:42:15.584182] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.584192] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 4/70. [D 20:42:15.584289] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2450 [D 20:42:15.584376] openib_post_sr: 10.1.4.240:38258 bh 16 len 48 wr 5/70. [D 20:42:15.605376] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2450 [D 20:42:15.605390] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.605401] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 6/70. [D 20:42:15.605482] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.605496] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.605504] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.612874] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.612888] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.612896] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.612945] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2453 [D 20:42:15.612956] element 0: offset: 0x2aaaab235880, size: 24 [D 20:42:15.612966] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 7/70. [D 20:42:15.613020] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2453 [D 20:42:15.613072] openib_post_sr: 10.1.4.240:38258 bh 19 len 48 wr 8/70. [D 20:42:15.631608] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2453 [D 20:42:15.631622] element 0: offset: 0x2aaaab235880, size: 24 [D 20:42:15.631632] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 9/70. [D 20:42:15.631709] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.631723] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.631731] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.635118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.635132] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.635140] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.635188] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2456 [D 20:42:15.635199] element 0: offset: 0x2aaaab208e30, size: 24 [D 20:42:15.635209] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 10/70. [D 20:42:15.635258] BMI_post_recv: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2456 [D 20:42:15.635292] openib_post_sr: 10.1.4.240:38258 bh 2 len 48 wr 11/70. [D 20:42:15.642891] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2456 [D 20:42:15.642907] element 0: offset: 0x2aaaab208e30, size: 24 [D 20:42:15.642917] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 12/70. [D 20:42:15.642981] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.642993] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.643001] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.643907] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.643921] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.643929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.643976] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2459 [D 20:42:15.643987] element 0: offset: 0x2aaaab20e7d0, size: 24 [D 20:42:15.643997] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 13/70. [D 20:42:15.644141] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2446 [D 20:42:15.644158] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 14/70. [D 20:42:15.644209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 722. [D 20:42:15.644269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 723. [D 20:42:15.644281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 724. [D 20:42:15.644291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 725. [D 20:42:15.644302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 726. [D 20:42:15.644312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 727. [D 20:42:15.644321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 728. [D 20:42:15.644331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 729. [D 20:42:15.644347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 730. [D 20:42:15.644356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 731. [D 20:42:15.644387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 732. [D 20:42:15.644402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 733. [D 20:42:15.644411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 734. [D 20:42:15.644422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 735. [D 20:42:15.644437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 736. [D 20:42:15.644447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 737. [D 20:42:15.644473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 738. [D 20:42:15.644483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 739. [D 20:42:15.644493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 740. [D 20:42:15.644506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 741. [D 20:42:15.644516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 742. [D 20:42:15.644526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 743. [D 20:42:15.644555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 744. [D 20:42:15.644566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 745. [D 20:42:15.644577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 746. [D 20:42:15.644586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 747. [D 20:42:15.644597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 748. [D 20:42:15.644621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 749. [D 20:42:15.644632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 750. [D 20:42:15.644643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 751. [D 20:42:15.644653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 752. [D 20:42:15.644663] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 753. [D 20:42:15.653310] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 753. [D 20:42:15.653329] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 15/70. [D 20:42:15.653537] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.653553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.653561] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.659417] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.659430] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.659439] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.659454] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2461 [D 20:42:15.659463] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:15.659475] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 16/70. [D 20:42:15.738224] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2432 [D 20:42:15.738241] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 17/70. [D 20:42:15.738343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 753. [D 20:42:15.738453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 754. [D 20:42:15.738464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 755. [D 20:42:15.738474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 756. [D 20:42:15.738484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 757. [D 20:42:15.738495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 758. [D 20:42:15.738505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 759. [D 20:42:15.738515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 760. [D 20:42:15.738525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 761. [D 20:42:15.738534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 762. [D 20:42:15.738544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 763. [D 20:42:15.738576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 764. [D 20:42:15.738586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 765. [D 20:42:15.738610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 766. [D 20:42:15.738620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 767. [D 20:42:15.738633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 768. [D 20:42:15.738651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 769. [D 20:42:15.738662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 770. [D 20:42:15.738672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 771. [D 20:42:15.738682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 772. [D 20:42:15.738707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 773. [D 20:42:15.738717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 774. [D 20:42:15.738734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 775. [D 20:42:15.738758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 776. [D 20:42:15.738768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 777. [D 20:42:15.738777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 778. [D 20:42:15.738798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 779. [D 20:42:15.738808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 780. [D 20:42:15.738818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 781. [D 20:42:15.738840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 782. [D 20:42:15.738850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 783. [D 20:42:15.738860] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 784. [D 20:42:15.744653] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 784. [D 20:42:15.744671] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 18/70. [D 20:42:15.744736] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.744751] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.744759] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.751263] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.751276] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.751284] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.751300] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2465 [D 20:42:15.751310] element 0: offset: 0x2aaaab235a20, size: 24 [D 20:42:15.751320] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 19/70. [D 20:42:15.806448] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2461 [D 20:42:15.806464] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 20/70. [D 20:42:15.806523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 784. [D 20:42:15.806593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 785. [D 20:42:15.806652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 786. [D 20:42:15.806663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 787. [D 20:42:15.806673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 788. [D 20:42:15.806684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 789. [D 20:42:15.806694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 790. [D 20:42:15.806722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 791. [D 20:42:15.806787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 792. [D 20:42:15.806798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 793. [D 20:42:15.806808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 794. [D 20:42:15.806818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 795. [D 20:42:15.806828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 796. [D 20:42:15.806838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 797. [D 20:42:15.806848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 798. [D 20:42:15.806858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 799. [D 20:42:15.806868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 800. [D 20:42:15.806890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 801. [D 20:42:15.806901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 802. [D 20:42:15.806911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 803. [D 20:42:15.806934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 804. [D 20:42:15.806944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 805. [D 20:42:15.806953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 806. [D 20:42:15.806975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 807. [D 20:42:15.806985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 808. [D 20:42:15.806995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 809. [D 20:42:15.807006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 810. [D 20:42:15.807016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 811. [D 20:42:15.807026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 812. [D 20:42:15.807052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 813. [D 20:42:15.807062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 814. [D 20:42:15.807073] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 815. [D 20:42:15.812478] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 815. [D 20:42:15.812495] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 21/70. [D 20:42:15.812561] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.812576] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.812584] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.818049] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.818063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.818071] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.818086] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2467 [D 20:42:15.818096] element 0: offset: 0x2aaaab235880, size: 24 [D 20:42:15.818106] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 22/70. [D 20:42:15.888353] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2467 [D 20:42:15.888369] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 23/70. [D 20:42:15.888471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 815. [D 20:42:15.888548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 816. [D 20:42:15.888559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 817. [D 20:42:15.888569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 818. [D 20:42:15.888583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 819. [D 20:42:15.888593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 820. [D 20:42:15.888602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 821. [D 20:42:15.888612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 822. [D 20:42:15.888622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 823. [D 20:42:15.888632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 824. [D 20:42:15.888641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 825. [D 20:42:15.888659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 826. [D 20:42:15.888669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 827. [D 20:42:15.888678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 828. [D 20:42:15.888688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 829. [D 20:42:15.888700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 830. [D 20:42:15.888709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 831. [D 20:42:15.888719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 832. [D 20:42:15.888777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 833. [D 20:42:15.888788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 834. [D 20:42:15.888807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 835. [D 20:42:15.888817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 836. [D 20:42:15.888827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 837. [D 20:42:15.888837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 838. [D 20:42:15.888847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 839. [D 20:42:15.888857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 840. [D 20:42:15.888866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 841. [D 20:42:15.888876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 842. [D 20:42:15.888901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 843. [D 20:42:15.888911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 844. [D 20:42:15.888921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 845. [D 20:42:15.888932] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 846. [D 20:42:15.894447] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 846. [D 20:42:15.894465] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 24/70. [D 20:42:15.894770] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:15.894785] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.894795] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:15.902209] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:15.902223] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:15.902234] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:15.902268] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2470 [D 20:42:15.902279] element 0: offset: 0x2aaaab225a60, size: 24 [D 20:42:15.902293] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 25/70. [D 20:42:16.046660] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2470 [D 20:42:16.046696] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 26/70. [D 20:42:16.046829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 846. [D 20:42:16.046942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 847. [D 20:42:16.046954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 848. [D 20:42:16.046965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 849. [D 20:42:16.046979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 850. [D 20:42:16.046989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 851. [D 20:42:16.046999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 852. [D 20:42:16.047014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 853. [D 20:42:16.047023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 854. [D 20:42:16.047033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 855. [D 20:42:16.047063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 856. [D 20:42:16.047100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 857. [D 20:42:16.047123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 858. [D 20:42:16.047153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 859. [D 20:42:16.047163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 860. [D 20:42:16.047172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 861. [D 20:42:16.047182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 862. [D 20:42:16.047199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 863. [D 20:42:16.047224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 864. [D 20:42:16.047237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 865. [D 20:42:16.047247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 866. [D 20:42:16.047256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 867. [D 20:42:16.047270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 868. [D 20:42:16.047280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 869. [D 20:42:16.047290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 870. [D 20:42:16.047305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 871. [D 20:42:16.047315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 872. [D 20:42:16.047325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 873. [D 20:42:16.047335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 874. [D 20:42:16.047344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 875. [D 20:42:16.047363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 876. [D 20:42:16.047388] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 877. [D 20:42:16.052843] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 877. [D 20:42:16.052859] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 27/70. [D 20:42:16.055153] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.055168] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.055178] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.058761] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.058775] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.058785] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.058818] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2473 [D 20:42:16.058829] element 0: offset: 0x2aaaab202f80, size: 24 [D 20:42:16.058841] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 28/70. [D 20:42:16.142568] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2465 [D 20:42:16.142586] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 29/70. [D 20:42:16.142672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 877. [D 20:42:16.142762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 878. [D 20:42:16.142774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 879. [D 20:42:16.142784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 880. [D 20:42:16.142795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 881. [D 20:42:16.142805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 882. [D 20:42:16.142815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 883. [D 20:42:16.142826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 884. [D 20:42:16.142835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 885. [D 20:42:16.142848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 886. [D 20:42:16.142864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 887. [D 20:42:16.142879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 888. [D 20:42:16.142889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 889. [D 20:42:16.142898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 890. [D 20:42:16.142915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 891. [D 20:42:16.142925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 892. [D 20:42:16.142975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 893. [D 20:42:16.142988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 894. [D 20:42:16.142998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 895. [D 20:42:16.143055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 896. [D 20:42:16.143068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 897. [D 20:42:16.143077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 898. [D 20:42:16.143104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 899. [D 20:42:16.143116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 900. [D 20:42:16.143129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 901. [D 20:42:16.143139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 902. [D 20:42:16.143148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 903. [D 20:42:16.143163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 904. [D 20:42:16.143186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 905. [D 20:42:16.143200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 906. [D 20:42:16.143210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 907. [D 20:42:16.143220] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 908. [D 20:42:16.148647] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 908. [D 20:42:16.148664] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 30/70. [D 20:42:16.151015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.151031] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.151041] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.157644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.157658] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.157668] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.157700] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2477 [D 20:42:16.157711] element 0: offset: 0x2aaaab223670, size: 24 [D 20:42:16.157723] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 31/70. [D 20:42:16.170106] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2438 [D 20:42:16.170125] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 32/70. [D 20:42:16.170190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 908. [D 20:42:16.170269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 909. [D 20:42:16.170280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 910. [D 20:42:16.170291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 911. [D 20:42:16.170302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 912. [D 20:42:16.170311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 913. [D 20:42:16.170321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 914. [D 20:42:16.170331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 915. [D 20:42:16.170347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 916. [D 20:42:16.170357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 917. [D 20:42:16.170367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 918. [D 20:42:16.170377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 919. [D 20:42:16.170388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 920. [D 20:42:16.170397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 921. [D 20:42:16.170408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 922. [D 20:42:16.170422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 923. [D 20:42:16.170432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 924. [D 20:42:16.170441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 925. [D 20:42:16.170452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 926. [D 20:42:16.170462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 927. [D 20:42:16.170524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 928. [D 20:42:16.170538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 929. [D 20:42:16.170549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 930. [D 20:42:16.170569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 931. [D 20:42:16.170583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 932. [D 20:42:16.170593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 933. [D 20:42:16.170602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 934. [D 20:42:16.170616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 935. [D 20:42:16.170626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 936. [D 20:42:16.170636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 937. [D 20:42:16.170664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 938. [D 20:42:16.170677] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 939. [D 20:42:16.174948] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2473 [D 20:42:16.174967] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 33/70. [D 20:42:16.176143] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 939. [D 20:42:16.176189] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 34/70. [D 20:42:16.176204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 939. [D 20:42:16.176220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 940. [D 20:42:16.176231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 941. [D 20:42:16.176240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 942. [D 20:42:16.176255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 943. [D 20:42:16.176265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 944. [D 20:42:16.176274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 945. [D 20:42:16.176289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 946. [D 20:42:16.176299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 947. [D 20:42:16.176309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 948. [D 20:42:16.176345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 949. [D 20:42:16.176355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 950. [D 20:42:16.176365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 951. [D 20:42:16.176375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 952. [D 20:42:16.176390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 953. [D 20:42:16.176400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 954. [D 20:42:16.176410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 955. [D 20:42:16.176434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 956. [D 20:42:16.176443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 957. [D 20:42:16.176465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 958. [D 20:42:16.176475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 959. [D 20:42:16.176484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 960. [D 20:42:16.176495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 961. [D 20:42:16.176505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 962. [D 20:42:16.176514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 963. [D 20:42:16.176524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 964. [D 20:42:16.176534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 965. [D 20:42:16.176553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 966. [D 20:42:16.176563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 967. [D 20:42:16.176572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 968. [D 20:42:16.176583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 969. [D 20:42:16.176592] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 970. [D 20:42:16.176667] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.176681] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.176707] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.182124] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 970. [D 20:42:16.182139] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 35/70. [D 20:42:16.184207] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.184220] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.184230] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.184262] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2480 [D 20:42:16.184273] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:16.184284] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 36/70. [D 20:42:16.184305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.184321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.184330] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.190179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.190195] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.190205] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.190221] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2482 [D 20:42:16.190232] element 0: offset: 0x2aaaab235880, size: 24 [D 20:42:16.190241] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 37/70. [D 20:42:16.259618] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2477 [D 20:42:16.259637] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 38/70. [D 20:42:16.259697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 970. [D 20:42:16.259776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 971. [D 20:42:16.259788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 972. [D 20:42:16.259798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 973. [D 20:42:16.259809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 974. [D 20:42:16.259818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 975. [D 20:42:16.259834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 976. [D 20:42:16.259844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 977. [D 20:42:16.259854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 978. [D 20:42:16.259869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 979. [D 20:42:16.259879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 980. [D 20:42:16.259888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 981. [D 20:42:16.259898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 982. [D 20:42:16.259908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 983. [D 20:42:16.259918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 984. [D 20:42:16.259927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 985. [D 20:42:16.259937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 986. [D 20:42:16.259990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 987. [D 20:42:16.260002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 988. [D 20:42:16.260012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 989. [D 20:42:16.260021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 990. [D 20:42:16.260046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 991. [D 20:42:16.260055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 992. [D 20:42:16.260065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 993. [D 20:42:16.260076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 994. [D 20:42:16.260085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 995. [D 20:42:16.260095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 996. [D 20:42:16.260105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 997. [D 20:42:16.260121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 998. [D 20:42:16.260130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 999. [D 20:42:16.260140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1000. [D 20:42:16.260166] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1001. [D 20:42:16.265680] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1001. [D 20:42:16.265698] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 39/70. [D 20:42:16.266794] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.266809] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.266820] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.274497] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.274512] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.274522] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.274555] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2486 [D 20:42:16.274566] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:16.274578] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 40/70. [D 20:42:16.333165] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2482 [D 20:42:16.333196] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 41/70. [D 20:42:16.333257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 1001. [D 20:42:16.333328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 1002. [D 20:42:16.333339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 1003. [D 20:42:16.333349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 1004. [D 20:42:16.333369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 1005. [D 20:42:16.333379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 1006. [D 20:42:16.333389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 1007. [D 20:42:16.333400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 1008. [D 20:42:16.333409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 1009. [D 20:42:16.333419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 1010. [D 20:42:16.333429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 1011. [D 20:42:16.333486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 1012. [D 20:42:16.333509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 1013. [D 20:42:16.333523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 1014. [D 20:42:16.333533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 1015. [D 20:42:16.333543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 1016. [D 20:42:16.333557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 1017. [D 20:42:16.333567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 1018. [D 20:42:16.333576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 1019. [D 20:42:16.333602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 1020. [D 20:42:16.333612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 1021. [D 20:42:16.333622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 1022. [D 20:42:16.333633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 1023. [D 20:42:16.333642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 1024. [D 20:42:16.333652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 1025. [D 20:42:16.333677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 1026. [D 20:42:16.333688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 1027. [D 20:42:16.333697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 1028. [D 20:42:16.333707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 1029. [D 20:42:16.333717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 1030. [D 20:42:16.333743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 1031. [D 20:42:16.333753] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 1032. [D 20:42:16.339257] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1032. [D 20:42:16.339276] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 42/70. [D 20:42:16.341539] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.341554] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.341564] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.395327] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2486 [D 20:42:16.395347] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 43/70. [D 20:42:16.395407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1032. [D 20:42:16.395486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1033. [D 20:42:16.395498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1034. [D 20:42:16.395509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1035. [D 20:42:16.395519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1036. [D 20:42:16.395528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1037. [D 20:42:16.395539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1038. [D 20:42:16.395549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1039. [D 20:42:16.395558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1040. [D 20:42:16.395568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1041. [D 20:42:16.395578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1042. [D 20:42:16.395588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1043. [D 20:42:16.395635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1044. [D 20:42:16.395650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1045. [D 20:42:16.395661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1046. [D 20:42:16.395671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1047. [D 20:42:16.395681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1048. [D 20:42:16.395691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1049. [D 20:42:16.395711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1050. [D 20:42:16.395728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1051. [D 20:42:16.395747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1052. [D 20:42:16.395776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1053. [D 20:42:16.395792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1054. [D 20:42:16.395802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1055. [D 20:42:16.395811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1056. [D 20:42:16.395842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1057. [D 20:42:16.395859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1058. [D 20:42:16.395870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1059. [D 20:42:16.395879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1060. [D 20:42:16.395895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1061. [D 20:42:16.395905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1062. [D 20:42:16.395915] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1063. [D 20:42:16.401413] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1063. [D 20:42:16.401431] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 44/70. [D 20:42:16.403678] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.403694] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.403704] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:16.410533] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.410547] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.410556] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:16.410590] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2489 [D 20:42:16.410601] element 0: offset: 0x2aaaab235a20, size: 24 [D 20:42:16.410615] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 45/70. [D 20:42:16.437692] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2459 [D 20:42:16.437710] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 46/70. [D 20:42:16.437777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 1063. [D 20:42:16.437856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 1064. [D 20:42:16.437867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 1065. [D 20:42:16.437878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 1066. [D 20:42:16.437888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 1067. [D 20:42:16.437897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 1068. [D 20:42:16.437907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 1069. [D 20:42:16.437918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 1070. [D 20:42:16.437927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 1071. [D 20:42:16.437937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 1072. [D 20:42:16.437946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 1073. [D 20:42:16.438009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 1074. [D 20:42:16.438020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 1075. [D 20:42:16.438041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 1076. [D 20:42:16.438055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 1077. [D 20:42:16.438065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 1078. [D 20:42:16.438075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 1079. [D 20:42:16.438088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 1080. [D 20:42:16.438098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 1081. [D 20:42:16.438122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 1082. [D 20:42:16.438134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 1083. [D 20:42:16.438143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 1084. [D 20:42:16.438154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 1085. [D 20:42:16.438164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 1086. [D 20:42:16.438173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 1087. [D 20:42:16.438183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 1088. [D 20:42:16.438209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 1089. [D 20:42:16.438218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 1090. [D 20:42:16.438228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 1091. [D 20:42:16.438238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 1092. [D 20:42:16.438248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 1093. [D 20:42:16.438268] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 1094. [D 20:42:16.445531] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1094. [D 20:42:16.445556] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 47/70. [D 20:42:16.447724] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.447739] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.447749] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:16.453459] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.453477] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.453488] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:16.453523] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2492 [D 20:42:16.453534] element 0: offset: 0x2aaaab218000, size: 24 [D 20:42:16.453548] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 48/70. [D 20:42:16.471060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.471104] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.471114] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.471145] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2494 [D 20:42:16.471156] element 0: offset: 0x2aaaab2030a0, size: 24 [D 20:42:16.471167] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 49/70. [D 20:42:16.474987] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2489 [D 20:42:16.475005] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 50/70. [D 20:42:16.475155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1094. [D 20:42:16.475219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1095. [D 20:42:16.475230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1096. [D 20:42:16.475240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1097. [D 20:42:16.475255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1098. [D 20:42:16.475264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1099. [D 20:42:16.475274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1100. [D 20:42:16.475288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1101. [D 20:42:16.475298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1102. [D 20:42:16.475307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1103. [D 20:42:16.475318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1104. [D 20:42:16.475328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1105. [D 20:42:16.475338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1106. [D 20:42:16.475388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1107. [D 20:42:16.475402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1108. [D 20:42:16.475412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1109. [D 20:42:16.475422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1110. [D 20:42:16.475447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1111. [D 20:42:16.475457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1112. [D 20:42:16.475467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1113. [D 20:42:16.475478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1114. [D 20:42:16.475488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1115. [D 20:42:16.475498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1116. [D 20:42:16.475526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1117. [D 20:42:16.475536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1118. [D 20:42:16.475546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1119. [D 20:42:16.475556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1120. [D 20:42:16.475566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1121. [D 20:42:16.475586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1122. [D 20:42:16.475596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1123. [D 20:42:16.475606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1124. [D 20:42:16.475624] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1125. [D 20:42:16.484773] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1125. [D 20:42:16.484792] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 51/70. [D 20:42:16.487128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.487143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.487153] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.493754] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.493804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.493814] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.493851] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2498 [D 20:42:16.493862] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:16.493877] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 52/70. [D 20:42:16.510982] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2480 [D 20:42:16.511001] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 53/70. [D 20:42:16.511061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1125. [D 20:42:16.511163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1126. [D 20:42:16.511177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1127. [D 20:42:16.511188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1128. [D 20:42:16.511199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1129. [D 20:42:16.511209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1130. [D 20:42:16.511219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1131. [D 20:42:16.511229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1132. [D 20:42:16.511240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1133. [D 20:42:16.511250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1134. [D 20:42:16.511260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1135. [D 20:42:16.511270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1136. [D 20:42:16.511287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1137. [D 20:42:16.511297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1138. [D 20:42:16.511338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1139. [D 20:42:16.511349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1140. [D 20:42:16.511373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1141. [D 20:42:16.511387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1142. [D 20:42:16.511397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1143. [D 20:42:16.511407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1144. [D 20:42:16.511435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1145. [D 20:42:16.511446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1146. [D 20:42:16.511457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1147. [D 20:42:16.511466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1148. [D 20:42:16.511477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1149. [D 20:42:16.511487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1150. [D 20:42:16.511497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1151. [D 20:42:16.511513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1152. [D 20:42:16.511523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1153. [D 20:42:16.511533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1154. [D 20:42:16.511566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1155. [D 20:42:16.511576] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1156. [D 20:42:16.517019] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1156. [D 20:42:16.517036] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 54/70. [D 20:42:16.519202] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:16.519217] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.519227] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:16.524760] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:16.524783] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:16.524793] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:16.524828] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2501 [D 20:42:16.524839] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:16.524853] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 55/70. [D 20:42:17.171510] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2498 [D 20:42:17.171567] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 56/70. [D 20:42:17.171680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1156. [D 20:42:17.171755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1157. [D 20:42:17.171766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1158. [D 20:42:17.171776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1159. [D 20:42:17.171791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1160. [D 20:42:17.171801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1161. [D 20:42:17.171810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1162. [D 20:42:17.171826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1163. [D 20:42:17.171836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1164. [D 20:42:17.171845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1165. [D 20:42:17.171861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1166. [D 20:42:17.171870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1167. [D 20:42:17.171957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1168. [D 20:42:17.171968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1169. [D 20:42:17.171978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1170. [D 20:42:17.171988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1171. [D 20:42:17.172002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1172. [D 20:42:17.172011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1173. [D 20:42:17.172021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1174. [D 20:42:17.172030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1175. [D 20:42:17.172041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1176. [D 20:42:17.172050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1177. [D 20:42:17.172075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1178. [D 20:42:17.172086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1179. [D 20:42:17.172096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1180. [D 20:42:17.172105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1181. [D 20:42:17.172129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1182. [D 20:42:17.172139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1183. [D 20:42:17.172149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1184. [D 20:42:17.172159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1185. [D 20:42:17.172169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1186. [D 20:42:17.172179] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1187. [D 20:42:17.177650] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1187. [D 20:42:17.177666] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 57/70. [D 20:42:17.178870] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.178885] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.178896] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.186668] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.186684] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.186693] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.186727] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2504 [D 20:42:17.186738] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:17.186752] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 58/70. [D 20:42:17.254571] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2501 [D 20:42:17.254590] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 59/70. [D 20:42:17.254648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1187. [D 20:42:17.254727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1188. [D 20:42:17.254738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1189. [D 20:42:17.254749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1190. [D 20:42:17.254759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1191. [D 20:42:17.254769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1192. [D 20:42:17.254785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1193. [D 20:42:17.254794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1194. [D 20:42:17.254804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1195. [D 20:42:17.254814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1196. [D 20:42:17.254868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1197. [D 20:42:17.254878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1198. [D 20:42:17.254891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1199. [D 20:42:17.254901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1200. [D 20:42:17.254910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1201. [D 20:42:17.254938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1202. [D 20:42:17.254949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1203. [D 20:42:17.254959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1204. [D 20:42:17.254969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1205. [D 20:42:17.254979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1206. [D 20:42:17.254989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1207. [D 20:42:17.254999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1208. [D 20:42:17.255008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1209. [D 20:42:17.255018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1210. [D 20:42:17.255028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1211. [D 20:42:17.255053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1212. [D 20:42:17.255063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1213. [D 20:42:17.255077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1214. [D 20:42:17.255086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1215. [D 20:42:17.255096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1216. [D 20:42:17.255111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1217. [D 20:42:17.255121] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1218. [D 20:42:17.260687] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1218. [D 20:42:17.260704] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 60/70. [D 20:42:17.263001] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.263016] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.263026] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.266892] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.266907] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.266917] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.266950] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2507 [D 20:42:17.266961] element 0: offset: 0x2aaaab217d60, size: 24 [D 20:42:17.266973] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 0/70. [D 20:42:17.576137] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2507 [D 20:42:17.576157] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 1/70. [D 20:42:17.576252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1218. [D 20:42:17.576332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1219. [D 20:42:17.576343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1220. [D 20:42:17.576354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1221. [D 20:42:17.576364] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1222. [D 20:42:17.576374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1223. [D 20:42:17.576384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1224. [D 20:42:17.576394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1225. [D 20:42:17.576404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1226. [D 20:42:17.576414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1227. [D 20:42:17.576423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1228. [D 20:42:17.576439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1229. [D 20:42:17.576448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1230. [D 20:42:17.576458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1231. [D 20:42:17.576539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1232. [D 20:42:17.576550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1233. [D 20:42:17.576563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1234. [D 20:42:17.576574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1235. [D 20:42:17.576583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1236. [D 20:42:17.576593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1237. [D 20:42:17.576619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1238. [D 20:42:17.576629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1239. [D 20:42:17.576639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1240. [D 20:42:17.576649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1241. [D 20:42:17.576676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1242. [D 20:42:17.576686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1243. [D 20:42:17.576696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1244. [D 20:42:17.576707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1245. [D 20:42:17.576716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1246. [D 20:42:17.576731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1247. [D 20:42:17.576741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1248. [D 20:42:17.576751] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1249. [D 20:42:17.582271] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1249. [D 20:42:17.582288] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 2/70. [D 20:42:17.584611] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.584626] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.584636] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.590124] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.590139] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.590148] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.590182] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2510 [D 20:42:17.590193] element 0: offset: 0x2aaaab235a20, size: 24 [D 20:42:17.590207] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 3/70. [D 20:42:17.666618] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2492 [D 20:42:17.666637] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 4/70. [D 20:42:17.666772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1249. [D 20:42:17.666840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 1250. [D 20:42:17.666861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 1251. [D 20:42:17.666872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 1252. [D 20:42:17.666883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 1253. [D 20:42:17.666892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 1254. [D 20:42:17.666903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1255. [D 20:42:17.666913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1256. [D 20:42:17.666923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1257. [D 20:42:17.667002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 1258. [D 20:42:17.667015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 1259. [D 20:42:17.667025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 1260. [D 20:42:17.667035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 1261. [D 20:42:17.667046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 1262. [D 20:42:17.667073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1263. [D 20:42:17.667083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1264. [D 20:42:17.667093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1265. [D 20:42:17.667108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 1266. [D 20:42:17.667132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 1267. [D 20:42:17.667143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 1268. [D 20:42:17.667153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 1269. [D 20:42:17.667163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 1270. [D 20:42:17.667173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1271. [D 20:42:17.667183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1272. [D 20:42:17.667203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1273. [D 20:42:17.667213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 1274. [D 20:42:17.667223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 1275. [D 20:42:17.667233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 1276. [D 20:42:17.667243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 1277. [D 20:42:17.667260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 1278. [D 20:42:17.667287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1279. [D 20:42:17.667301] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1280. [D 20:42:17.672700] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1280. [D 20:42:17.672716] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 5/70. [D 20:42:17.675077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.675092] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.675104] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.680881] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.680894] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.680904] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.680937] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2513 [D 20:42:17.680947] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:17.680962] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 6/70. [D 20:42:17.704106] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2504 [D 20:42:17.704125] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 7/70. [D 20:42:17.704182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1280. [D 20:42:17.704250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1281. [D 20:42:17.704261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1282. [D 20:42:17.704272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1283. [D 20:42:17.704282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1284. [D 20:42:17.704292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1285. [D 20:42:17.704302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1286. [D 20:42:17.704312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1287. [D 20:42:17.704322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1288. [D 20:42:17.704332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1289. [D 20:42:17.704341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1290. [D 20:42:17.704351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1291. [D 20:42:17.704391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1292. [D 20:42:17.704404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1293. [D 20:42:17.704414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1294. [D 20:42:17.704424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1295. [D 20:42:17.704461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1296. [D 20:42:17.704471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1297. [D 20:42:17.704481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1298. [D 20:42:17.704494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1299. [D 20:42:17.704504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1300. [D 20:42:17.704513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1301. [D 20:42:17.704539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1302. [D 20:42:17.704548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1303. [D 20:42:17.704558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1304. [D 20:42:17.704569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1305. [D 20:42:17.704578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1306. [D 20:42:17.704598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1307. [D 20:42:17.704608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1308. [D 20:42:17.704617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1309. [D 20:42:17.704627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1310. [D 20:42:17.704637] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1311. [D 20:42:17.710107] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1311. [D 20:42:17.710124] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 8/70. [D 20:42:17.710884] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.710899] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.710909] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.719010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.719026] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.719036] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.719069] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2516 [D 20:42:17.719080] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:17.719092] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 9/70. [D 20:42:17.763690] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2516 [D 20:42:17.763710] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 10/70. [D 20:42:17.763772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1311. [D 20:42:17.763842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1312. [D 20:42:17.763863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1313. [D 20:42:17.763875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1314. [D 20:42:17.763886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1315. [D 20:42:17.763896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1316. [D 20:42:17.763906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1317. [D 20:42:17.763916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1318. [D 20:42:17.763927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1319. [D 20:42:17.763938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1320. [D 20:42:17.763948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1321. [D 20:42:17.763958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1322. [D 20:42:17.763975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1323. [D 20:42:17.763985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1324. [D 20:42:17.763995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1325. [D 20:42:17.764005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1326. [D 20:42:17.764015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1327. [D 20:42:17.764027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1328. [D 20:42:17.764036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1329. [D 20:42:17.764046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1330. [D 20:42:17.764057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1331. [D 20:42:17.764108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1332. [D 20:42:17.764120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1333. [D 20:42:17.764131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1334. [D 20:42:17.764141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1335. [D 20:42:17.764151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1336. [D 20:42:17.764161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1337. [D 20:42:17.764177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1338. [D 20:42:17.764186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1339. [D 20:42:17.764212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1340. [D 20:42:17.764222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1341. [D 20:42:17.764232] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1342. [D 20:42:17.769777] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1342. [D 20:42:17.769794] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 11/70. [D 20:42:17.772114] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.772129] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.772140] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.839813] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2513 [D 20:42:17.839832] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 12/70. [D 20:42:17.839922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1342. [D 20:42:17.840022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 1343. [D 20:42:17.840033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 1344. [D 20:42:17.840044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 1345. [D 20:42:17.840055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 1346. [D 20:42:17.840065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 1347. [D 20:42:17.840075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1348. [D 20:42:17.840085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1349. [D 20:42:17.840095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1350. [D 20:42:17.840105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 1351. [D 20:42:17.840115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 1352. [D 20:42:17.840148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 1353. [D 20:42:17.840165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 1354. [D 20:42:17.840187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 1355. [D 20:42:17.840202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1356. [D 20:42:17.840223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1357. [D 20:42:17.840236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1358. [D 20:42:17.840246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 1359. [D 20:42:17.840256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 1360. [D 20:42:17.840279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 1361. [D 20:42:17.840289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 1362. [D 20:42:17.840299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 1363. [D 20:42:17.840309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1364. [D 20:42:17.840332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1365. [D 20:42:17.840344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1366. [D 20:42:17.840353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 1367. [D 20:42:17.840374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 1368. [D 20:42:17.840385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 1369. [D 20:42:17.840404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 1370. [D 20:42:17.840420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 1371. [D 20:42:17.840429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1372. [D 20:42:17.840456] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1373. [D 20:42:17.845883] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1373. [D 20:42:17.845900] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 13/70. [D 20:42:17.848191] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.848206] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.848216] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:17.854190] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.854204] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.854215] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:17.854248] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2519 [D 20:42:17.854260] element 0: offset: 0x2aaaab203080, size: 24 [D 20:42:17.854274] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 14/70. [D 20:42:17.869320] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2510 [D 20:42:17.869338] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 15/70. [D 20:42:17.869404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1373. [D 20:42:17.869510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1374. [D 20:42:17.869523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1375. [D 20:42:17.869533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1376. [D 20:42:17.869548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1377. [D 20:42:17.869558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1378. [D 20:42:17.869568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1379. [D 20:42:17.869581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1380. [D 20:42:17.869591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1381. [D 20:42:17.869601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1382. [D 20:42:17.869631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1383. [D 20:42:17.869641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1384. [D 20:42:17.869667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1385. [D 20:42:17.869683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1386. [D 20:42:17.869702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1387. [D 20:42:17.869713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1388. [D 20:42:17.869723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1389. [D 20:42:17.869733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1390. [D 20:42:17.869758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1391. [D 20:42:17.869768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1392. [D 20:42:17.869778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1393. [D 20:42:17.869811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1394. [D 20:42:17.869822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1395. [D 20:42:17.869832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1396. [D 20:42:17.869852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1397. [D 20:42:17.869862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1398. [D 20:42:17.869872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1399. [D 20:42:17.869897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1400. [D 20:42:17.869906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1401. [D 20:42:17.869916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1402. [D 20:42:17.869926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1403. [D 20:42:17.869944] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1404. [D 20:42:17.875406] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1404. [D 20:42:17.875424] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 16/70. [D 20:42:17.877573] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.877588] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.877599] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:17.883783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.883807] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.883818] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:17.883854] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2522 [D 20:42:17.883865] element 0: offset: 0x2aaaab217d60, size: 24 [D 20:42:17.883880] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 17/70. [D 20:42:17.894732] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2494 [D 20:42:17.894750] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 18/70. [D 20:42:17.894817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1404. [D 20:42:17.894901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1405. [D 20:42:17.894913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1406. [D 20:42:17.894923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1407. [D 20:42:17.894934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1408. [D 20:42:17.894944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1409. [D 20:42:17.894954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1410. [D 20:42:17.894964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1411. [D 20:42:17.894974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1412. [D 20:42:17.894984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1413. [D 20:42:17.894993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1414. [D 20:42:17.895010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1415. [D 20:42:17.895020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1416. [D 20:42:17.895030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1417. [D 20:42:17.895052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1418. [D 20:42:17.895062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1419. [D 20:42:17.895072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1420. [D 20:42:17.895082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1421. [D 20:42:17.895099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1422. [D 20:42:17.895109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1423. [D 20:42:17.895159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1424. [D 20:42:17.895172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1425. [D 20:42:17.895183] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1426. [D 20:42:17.895194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1427. [D 20:42:17.895216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1428. [D 20:42:17.895227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1429. [D 20:42:17.895237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1430. [D 20:42:17.895247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1431. [D 20:42:17.895257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1432. [D 20:42:17.895272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1433. [D 20:42:17.895291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1434. [D 20:42:17.895301] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1435. [D 20:42:17.900761] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1435. [D 20:42:17.900797] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 19/70. [D 20:42:17.902950] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.902966] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.902976] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:17.906894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.906939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.906948] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:17.906986] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2526 [D 20:42:17.906999] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:17.909206] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 20/70. [D 20:42:17.909236] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.909250] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.909260] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.909277] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2527 [D 20:42:17.909288] element 0: offset: 0x2aaaab218000, size: 24 [D 20:42:17.909298] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 21/70. [D 20:42:17.913635] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2519 [D 20:42:17.913668] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 22/70. [D 20:42:17.913731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1435. [D 20:42:17.913801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1436. [D 20:42:17.913822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1437. [D 20:42:17.913833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1438. [D 20:42:17.913843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1439. [D 20:42:17.913853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1440. [D 20:42:17.913868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1441. [D 20:42:17.913878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1442. [D 20:42:17.913888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1443. [D 20:42:17.913903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1444. [D 20:42:17.913913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1445. [D 20:42:17.913923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1446. [D 20:42:17.913939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1447. [D 20:42:17.913949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1448. [D 20:42:17.913959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1449. [D 20:42:17.913969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1450. [D 20:42:17.913979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1451. [D 20:42:17.913997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1452. [D 20:42:17.914047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1453. [D 20:42:17.914058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1454. [D 20:42:17.914068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1455. [D 20:42:17.914084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1456. [D 20:42:17.914093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1457. [D 20:42:17.914103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1458. [D 20:42:17.914132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1459. [D 20:42:17.914142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1460. [D 20:42:17.914154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1461. [D 20:42:17.914164] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1462. [D 20:42:17.914174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1463. [D 20:42:17.914188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1464. [D 20:42:17.914198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1465. [D 20:42:17.914207] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1466. [D 20:42:17.922376] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1466. [D 20:42:17.922393] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 23/70. [D 20:42:17.924713] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.924729] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.924739] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.928431] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.928446] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.928455] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.928489] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2531 [D 20:42:17.928500] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:17.928513] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 24/70. [D 20:42:17.969302] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2531 [D 20:42:17.969320] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 25/70. [D 20:42:17.969390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 1466. [D 20:42:17.969405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1467. [D 20:42:17.969415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1468. [D 20:42:17.969424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1469. [D 20:42:17.969434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1470. [D 20:42:17.969443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1471. [D 20:42:17.969453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1472. [D 20:42:17.969462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1473. [D 20:42:17.969472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1474. [D 20:42:17.969481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1475. [D 20:42:17.969490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1476. [D 20:42:17.969500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1477. [D 20:42:17.969509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1478. [D 20:42:17.969518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1479. [D 20:42:17.969528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1480. [D 20:42:17.969537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1481. [D 20:42:17.969546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1482. [D 20:42:17.969555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1483. [D 20:42:17.969565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1484. [D 20:42:17.969574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1485. [D 20:42:17.969583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1486. [D 20:42:17.969593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1487. [D 20:42:17.969602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1488. [D 20:42:17.969611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1489. [D 20:42:17.969621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1490. [D 20:42:17.969630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1491. [D 20:42:17.969639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1492. [D 20:42:17.969649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1493. [D 20:42:17.969658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1494. [D 20:42:17.969668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1495. [D 20:42:17.969678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1496. [D 20:42:17.969687] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1497. [D 20:42:17.975368] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1497. [D 20:42:17.975438] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 26/70. [D 20:42:17.977526] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:17.977541] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.977551] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:17.983505] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:17.983520] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:17.983531] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:17.983564] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2534 [D 20:42:17.983575] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:17.983587] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 27/70. [D 20:42:18.059663] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2527 [D 20:42:18.059682] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 28/70. [D 20:42:18.059820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1497. [D 20:42:18.059891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1498. [D 20:42:18.059903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1499. [D 20:42:18.059913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1500. [D 20:42:18.059924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1501. [D 20:42:18.059933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1502. [D 20:42:18.059943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1503. [D 20:42:18.059954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1504. [D 20:42:18.059964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1505. [D 20:42:18.059974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1506. [D 20:42:18.059984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1507. [D 20:42:18.060000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1508. [D 20:42:18.060010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1509. [D 20:42:18.060020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1510. [D 20:42:18.060030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1511. [D 20:42:18.060040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1512. [D 20:42:18.060051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1513. [D 20:42:18.060061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1514. [D 20:42:18.060071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1515. [D 20:42:18.060081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1516. [D 20:42:18.060091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1517. [D 20:42:18.060101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1518. [D 20:42:18.060111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1519. [D 20:42:18.060121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1520. [D 20:42:18.060131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1521. [D 20:42:18.060144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1522. [D 20:42:18.060154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1523. [D 20:42:18.060211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1524. [D 20:42:18.060221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1525. [D 20:42:18.060231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1526. [D 20:42:18.060242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1527. [D 20:42:18.060264] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1528. [D 20:42:18.065786] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1528. [D 20:42:18.065803] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 29/70. [D 20:42:18.068099] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.068114] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.068124] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.073538] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.073553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.073564] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.073597] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2536 [D 20:42:18.073608] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:18.073622] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 30/70. [D 20:42:18.119894] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2534 [D 20:42:18.119913] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 31/70. [D 20:42:18.119970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1528. [D 20:42:18.120036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1529. [D 20:42:18.120057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1530. [D 20:42:18.120067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1531. [D 20:42:18.120078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1532. [D 20:42:18.120088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1533. [D 20:42:18.120103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1534. [D 20:42:18.120112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1535. [D 20:42:18.120122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1536. [D 20:42:18.120138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1537. [D 20:42:18.120189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1538. [D 20:42:18.120199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1539. [D 20:42:18.120215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1540. [D 20:42:18.120225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1541. [D 20:42:18.120236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1542. [D 20:42:18.120246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1543. [D 20:42:18.120257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1544. [D 20:42:18.120269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1545. [D 20:42:18.120279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1546. [D 20:42:18.120289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1547. [D 20:42:18.120318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1548. [D 20:42:18.120328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1549. [D 20:42:18.120340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1550. [D 20:42:18.120355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1551. [D 20:42:18.120365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1552. [D 20:42:18.120390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1553. [D 20:42:18.120400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1554. [D 20:42:18.120410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1555. [D 20:42:18.120424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1556. [D 20:42:18.120434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1557. [D 20:42:18.120444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1558. [D 20:42:18.120473] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1559. [D 20:42:18.125944] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1559. [D 20:42:18.125961] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 32/70. [D 20:42:18.126908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.126923] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.126933] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.134284] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.134299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.134310] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.134342] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2540 [D 20:42:18.134353] element 0: offset: 0x2aaaab235940, size: 24 [D 20:42:18.134365] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 33/70. [D 20:42:18.166601] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2522 [D 20:42:18.166620] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 34/70. [D 20:42:18.166678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1559. [D 20:42:18.166758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 1560. [D 20:42:18.166770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 1561. [D 20:42:18.166780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 1562. [D 20:42:18.166791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 1563. [D 20:42:18.166801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 1564. [D 20:42:18.166817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1565. [D 20:42:18.166827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1566. [D 20:42:18.166836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1567. [D 20:42:18.166847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 1568. [D 20:42:18.166909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 1569. [D 20:42:18.166934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 1570. [D 20:42:18.166944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 1571. [D 20:42:18.166959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 1572. [D 20:42:18.166969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1573. [D 20:42:18.166979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1574. [D 20:42:18.167008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1575. [D 20:42:18.167018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 1576. [D 20:42:18.167030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 1577. [D 20:42:18.167040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 1578. [D 20:42:18.167050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 1579. [D 20:42:18.167064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 1580. [D 20:42:18.167083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1581. [D 20:42:18.167094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1582. [D 20:42:18.167105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1583. [D 20:42:18.167115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 1584. [D 20:42:18.167137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 1585. [D 20:42:18.167148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 1586. [D 20:42:18.167158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 1587. [D 20:42:18.167172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 1588. [D 20:42:18.167182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1589. [D 20:42:18.167192] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1590. [D 20:42:18.172615] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1590. [D 20:42:18.172632] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 35/70. [D 20:42:18.174843] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.174858] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.174868] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.180549] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.180564] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.180575] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.180608] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2543 [D 20:42:18.180619] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:18.180634] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 36/70. [D 20:42:18.229078] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2540 [D 20:42:18.229097] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 37/70. [D 20:42:18.229161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1590. [D 20:42:18.229230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1591. [D 20:42:18.229250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1592. [D 20:42:18.229261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1593. [D 20:42:18.229272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1594. [D 20:42:18.229282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1595. [D 20:42:18.229296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1596. [D 20:42:18.229306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1597. [D 20:42:18.229316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1598. [D 20:42:18.229331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1599. [D 20:42:18.229383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1600. [D 20:42:18.229407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1601. [D 20:42:18.229419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1602. [D 20:42:18.229429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1603. [D 20:42:18.229440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1604. [D 20:42:18.229450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1605. [D 20:42:18.229460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1606. [D 20:42:18.229471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1607. [D 20:42:18.229497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1608. [D 20:42:18.229507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1609. [D 20:42:18.229517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1610. [D 20:42:18.229527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1611. [D 20:42:18.229543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1612. [D 20:42:18.229554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1613. [D 20:42:18.229564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1614. [D 20:42:18.229574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1615. [D 20:42:18.229583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1616. [D 20:42:18.229603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1617. [D 20:42:18.229627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1618. [D 20:42:18.229638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1619. [D 20:42:18.229649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1620. [D 20:42:18.229659] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1621. [D 20:42:18.235141] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1621. [D 20:42:18.235159] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 38/70. [D 20:42:18.237302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.237317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.237327] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.243516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.243530] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.243541] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.243573] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2546 [D 20:42:18.243584] element 0: offset: 0x2aaaab236a80, size: 24 [D 20:42:18.243597] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 39/70. [D 20:42:18.314739] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2536 [D 20:42:18.314757] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 40/70. [D 20:42:18.314880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1621. [D 20:42:18.314967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1622. [D 20:42:18.314979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1623. [D 20:42:18.314989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1624. [D 20:42:18.315000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1625. [D 20:42:18.315010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1626. [D 20:42:18.315020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1627. [D 20:42:18.315030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1628. [D 20:42:18.315040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1629. [D 20:42:18.315050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1630. [D 20:42:18.315060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1631. [D 20:42:18.315105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1632. [D 20:42:18.315117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1633. [D 20:42:18.315127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1634. [D 20:42:18.315138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1635. [D 20:42:18.315175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1636. [D 20:42:18.315185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1637. [D 20:42:18.315195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1638. [D 20:42:18.315224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1639. [D 20:42:18.315235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1640. [D 20:42:18.315249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1641. [D 20:42:18.315259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1642. [D 20:42:18.315269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1643. [D 20:42:18.315297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1644. [D 20:42:18.315310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1645. [D 20:42:18.315322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1646. [D 20:42:18.315333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1647. [D 20:42:18.315343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1648. [D 20:42:18.315353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1649. [D 20:42:18.315366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1650. [D 20:42:18.315376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1651. [D 20:42:18.315386] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1652. [D 20:42:18.320825] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1652. [D 20:42:18.320843] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 41/70. [D 20:42:18.323203] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.323219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.323229] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.326907] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.326920] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.326930] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.326962] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2548 [D 20:42:18.326973] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:18.326985] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 42/70. [D 20:42:18.382431] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2546 [D 20:42:18.382450] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 43/70. [D 20:42:18.382510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1652. [D 20:42:18.382577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1653. [D 20:42:18.382598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1654. [D 20:42:18.382612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1655. [D 20:42:18.382622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1656. [D 20:42:18.382633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1657. [D 20:42:18.382643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1658. [D 20:42:18.382653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1659. [D 20:42:18.382663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1660. [D 20:42:18.382678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1661. [D 20:42:18.382726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1662. [D 20:42:18.382741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1663. [D 20:42:18.382765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1664. [D 20:42:18.382780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1665. [D 20:42:18.382790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1666. [D 20:42:18.382800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1667. [D 20:42:18.382825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1668. [D 20:42:18.382835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1669. [D 20:42:18.382845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1670. [D 20:42:18.382861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1671. [D 20:42:18.382871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1672. [D 20:42:18.382881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1673. [D 20:42:18.382897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1674. [D 20:42:18.382938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1675. [D 20:42:18.382948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1676. [D 20:42:18.382958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1677. [D 20:42:18.382985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1678. [D 20:42:18.382995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1679. [D 20:42:18.383007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1680. [D 20:42:18.383017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1681. [D 20:42:18.383032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1682. [D 20:42:18.383043] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1683. [D 20:42:18.388492] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1683. [D 20:42:18.388510] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 44/70. [D 20:42:18.390826] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.390841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.390851] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.472783] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2543 [D 20:42:18.472802] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 45/70. [D 20:42:18.472936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1683. [D 20:42:18.473006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 1684. [D 20:42:18.473017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 1685. [D 20:42:18.473028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 1686. [D 20:42:18.473039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 1687. [D 20:42:18.473049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 1688. [D 20:42:18.473059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1689. [D 20:42:18.473069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1690. [D 20:42:18.473079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1691. [D 20:42:18.473089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 1692. [D 20:42:18.473099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 1693. [D 20:42:18.473142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 1694. [D 20:42:18.473155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 1695. [D 20:42:18.473165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 1696. [D 20:42:18.473175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1697. [D 20:42:18.473210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1698. [D 20:42:18.473223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1699. [D 20:42:18.473233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 1700. [D 20:42:18.473259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 1701. [D 20:42:18.473274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 1702. [D 20:42:18.473284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 1703. [D 20:42:18.473294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 1704. [D 20:42:18.473310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1705. [D 20:42:18.473320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1706. [D 20:42:18.473329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1707. [D 20:42:18.473357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 1708. [D 20:42:18.473367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 1709. [D 20:42:18.473381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 1710. [D 20:42:18.473391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 1711. [D 20:42:18.473401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 1712. [D 20:42:18.473428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1713. [D 20:42:18.473438] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1714. [D 20:42:18.478866] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1714. [D 20:42:18.478883] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 46/70. [D 20:42:18.481192] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.481208] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.481218] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:18.486923] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.486939] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.486949] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:18.486983] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2552 [D 20:42:18.486993] element 0: offset: 0x2aaaab218000, size: 24 [D 20:42:18.487006] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 47/70. [D 20:42:18.519040] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2526 [D 20:42:18.519058] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 48/70. [D 20:42:18.519122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1714. [D 20:42:18.519200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1715. [D 20:42:18.519211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1716. [D 20:42:18.519222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1717. [D 20:42:18.519233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1718. [D 20:42:18.519243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1719. [D 20:42:18.519259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1720. [D 20:42:18.519269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1721. [D 20:42:18.519278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1722. [D 20:42:18.519295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1723. [D 20:42:18.519344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1724. [D 20:42:18.519357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1725. [D 20:42:18.519367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1726. [D 20:42:18.519393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1727. [D 20:42:18.519403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1728. [D 20:42:18.519414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1729. [D 20:42:18.519424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1730. [D 20:42:18.519434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1731. [D 20:42:18.519445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1732. [D 20:42:18.519472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1733. [D 20:42:18.519483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1734. [D 20:42:18.519493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1735. [D 20:42:18.519503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1736. [D 20:42:18.519514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1737. [D 20:42:18.519525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1738. [D 20:42:18.519546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1739. [D 20:42:18.519556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1740. [D 20:42:18.519571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1741. [D 20:42:18.519582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1742. [D 20:42:18.519602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1743. [D 20:42:18.519612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1744. [D 20:42:18.519622] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1745. [D 20:42:18.522900] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.522920] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.522929] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.522967] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2555 [D 20:42:18.522979] element 0: offset: 0x2aaaab235940, size: 24 [D 20:42:18.522992] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 49/70. [D 20:42:18.525247] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1745. [D 20:42:18.525263] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 50/70. [D 20:42:18.527681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.527696] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.527706] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.533687] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.533711] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.533722] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.533748] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2558 [D 20:42:18.533759] element 0: offset: 0x2aaaab225ec0, size: 24 [D 20:42:18.533770] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 51/70. [D 20:42:18.595985] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2548 [D 20:42:18.596004] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 52/70. [D 20:42:18.596063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1745. [D 20:42:18.596143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1746. [D 20:42:18.596155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1747. [D 20:42:18.596166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1748. [D 20:42:18.596180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1749. [D 20:42:18.596190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1750. [D 20:42:18.596200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1751. [D 20:42:18.596215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1752. [D 20:42:18.596225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1753. [D 20:42:18.596235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1754. [D 20:42:18.596245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1755. [D 20:42:18.596283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1756. [D 20:42:18.596294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1757. [D 20:42:18.596304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1758. [D 20:42:18.596338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1759. [D 20:42:18.596350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1760. [D 20:42:18.596360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1761. [D 20:42:18.596370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1762. [D 20:42:18.596386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1763. [D 20:42:18.596396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1764. [D 20:42:18.596420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1765. [D 20:42:18.596431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1766. [D 20:42:18.596441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1767. [D 20:42:18.596455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1768. [D 20:42:18.596482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1769. [D 20:42:18.596495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1770. [D 20:42:18.596505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1771. [D 20:42:18.596527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1772. [D 20:42:18.596539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1773. [D 20:42:18.596549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1774. [D 20:42:18.596563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1775. [D 20:42:18.596573] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1776. [D 20:42:18.601999] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1776. [D 20:42:18.602016] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 53/70. [D 20:42:18.604333] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.604348] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.604359] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.609846] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.609861] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.609871] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.609904] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2560 [D 20:42:18.609914] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:18.609927] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 54/70. [D 20:42:18.665483] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2558 [D 20:42:18.665501] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 55/70. [D 20:42:18.665562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1776. [D 20:42:18.665639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1777. [D 20:42:18.665650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1778. [D 20:42:18.665661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1779. [D 20:42:18.665672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1780. [D 20:42:18.665682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1781. [D 20:42:18.665699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1782. [D 20:42:18.665708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1783. [D 20:42:18.665718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1784. [D 20:42:18.665734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1785. [D 20:42:18.665782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1786. [D 20:42:18.665795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1787. [D 20:42:18.665805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1788. [D 20:42:18.665832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1789. [D 20:42:18.665842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1790. [D 20:42:18.665857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1791. [D 20:42:18.665866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1792. [D 20:42:18.665876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1793. [D 20:42:18.665905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1794. [D 20:42:18.665921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1795. [D 20:42:18.665932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1796. [D 20:42:18.665942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1797. [D 20:42:18.665958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1798. [D 20:42:18.665978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1799. [D 20:42:18.665989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1800. [D 20:42:18.666000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1801. [D 20:42:18.666010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1802. [D 20:42:18.666024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1803. [D 20:42:18.666035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1804. [D 20:42:18.666055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1805. [D 20:42:18.666066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1806. [D 20:42:18.666076] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1807. [D 20:42:18.671551] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1807. [D 20:42:18.671567] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 56/70. [D 20:42:18.673796] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.673812] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.673822] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.679664] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.679679] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.679690] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.679722] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2564 [D 20:42:18.679733] element 0: offset: 0x2aaaab2302e0, size: 24 [D 20:42:18.679745] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 57/70. [D 20:42:18.777804] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2560 [D 20:42:18.777823] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 58/70. [D 20:42:18.777922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1807. [D 20:42:18.778003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1808. [D 20:42:18.778015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1809. [D 20:42:18.778026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1810. [D 20:42:18.778040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1811. [D 20:42:18.778050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1812. [D 20:42:18.778060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1813. [D 20:42:18.778074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1814. [D 20:42:18.778084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1815. [D 20:42:18.778094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1816. [D 20:42:18.778157] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1817. [D 20:42:18.778168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1818. [D 20:42:18.778187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1819. [D 20:42:18.778198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1820. [D 20:42:18.778208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1821. [D 20:42:18.778217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1822. [D 20:42:18.778228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1823. [D 20:42:18.778239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1824. [D 20:42:18.778249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1825. [D 20:42:18.778259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1826. [D 20:42:18.778286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1827. [D 20:42:18.778296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1828. [D 20:42:18.778307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1829. [D 20:42:18.778318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1830. [D 20:42:18.778327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1831. [D 20:42:18.778338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1832. [D 20:42:18.778357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1833. [D 20:42:18.778367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1834. [D 20:42:18.778377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1835. [D 20:42:18.778387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1836. [D 20:42:18.778397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1837. [D 20:42:18.778407] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1838. [D 20:42:18.783926] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1838. [D 20:42:18.783943] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 59/70. [D 20:42:18.786262] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.786277] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.786287] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.791634] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.791648] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.791659] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.791692] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2566 [D 20:42:18.791703] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:18.791715] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 60/70. [D 20:42:18.814665] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2555 [D 20:42:18.814683] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 0/70. [D 20:42:18.814746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 1838. [D 20:42:18.814823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 1839. [D 20:42:18.814835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 1840. [D 20:42:18.814845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 1841. [D 20:42:18.814856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 1842. [D 20:42:18.814866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 1843. [D 20:42:18.814882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 1844. [D 20:42:18.814892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 1845. [D 20:42:18.814902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 1846. [D 20:42:18.814913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 1847. [D 20:42:18.814969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 1848. [D 20:42:18.814980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 1849. [D 20:42:18.814991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 1850. [D 20:42:18.815001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 1851. [D 20:42:18.815011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 1852. [D 20:42:18.815021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 1853. [D 20:42:18.815031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 1854. [D 20:42:18.815041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 1855. [D 20:42:18.815051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 1856. [D 20:42:18.815061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 1857. [D 20:42:18.815088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 1858. [D 20:42:18.815099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 1859. [D 20:42:18.815109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 1860. [D 20:42:18.815119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 1861. [D 20:42:18.815130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 1862. [D 20:42:18.815154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 1863. [D 20:42:18.815163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 1864. [D 20:42:18.815178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 1865. [D 20:42:18.815188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 1866. [D 20:42:18.815198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 1867. [D 20:42:18.815221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 1868. [D 20:42:18.815232] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 1869. [D 20:42:18.820678] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1869. [D 20:42:18.820696] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 1/70. [D 20:42:18.822838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.822853] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.822863] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.828445] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.828460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.828471] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.828503] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2570 [D 20:42:18.828514] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:18.828527] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 2/70. [D 20:42:18.869872] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2566 [D 20:42:18.869891] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 3/70. [D 20:42:18.869950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1869. [D 20:42:18.870033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1870. [D 20:42:18.870045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1871. [D 20:42:18.870058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1872. [D 20:42:18.870069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1873. [D 20:42:18.870079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1874. [D 20:42:18.870090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1875. [D 20:42:18.870100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1876. [D 20:42:18.870110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1877. [D 20:42:18.870120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1878. [D 20:42:18.870145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1879. [D 20:42:18.870160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1880. [D 20:42:18.870170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1881. [D 20:42:18.870180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1882. [D 20:42:18.870190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1883. [D 20:42:18.870212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1884. [D 20:42:18.870222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1885. [D 20:42:18.870232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1886. [D 20:42:18.870255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1887. [D 20:42:18.870265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1888. [D 20:42:18.870275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1889. [D 20:42:18.870297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1890. [D 20:42:18.870308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1891. [D 20:42:18.870319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1892. [D 20:42:18.870328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1893. [D 20:42:18.870339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1894. [D 20:42:18.870363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1895. [D 20:42:18.870375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1896. [D 20:42:18.870385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1897. [D 20:42:18.870394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1898. [D 20:42:18.870404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1899. [D 20:42:18.870431] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1900. [D 20:42:18.875950] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1900. [D 20:42:18.875966] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 4/70. [D 20:42:18.878304] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.878319] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.878329] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.884684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.884698] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.884708] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.884741] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2572 [D 20:42:18.884752] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:18.884764] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 5/70. [D 20:42:18.906539] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2564 [D 20:42:18.906557] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 6/70. [D 20:42:18.906619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1900. [D 20:42:18.906723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1901. [D 20:42:18.906737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1902. [D 20:42:18.906749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1903. [D 20:42:18.906760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1904. [D 20:42:18.906770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1905. [D 20:42:18.906781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1906. [D 20:42:18.906806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 1907. [D 20:42:18.906816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 1908. [D 20:42:18.906826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 1909. [D 20:42:18.906837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 1910. [D 20:42:18.906859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 1911. [D 20:42:18.906870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 1912. [D 20:42:18.906883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 1913. [D 20:42:18.906893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 1914. [D 20:42:18.906903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 1915. [D 20:42:18.906913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 1916. [D 20:42:18.906953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 1917. [D 20:42:18.906973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 1918. [D 20:42:18.906984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 1919. [D 20:42:18.907000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 1920. [D 20:42:18.907021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 1921. [D 20:42:18.907032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 1922. [D 20:42:18.907042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 1923. [D 20:42:18.907051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 1924. [D 20:42:18.907062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 1925. [D 20:42:18.907073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 1926. [D 20:42:18.907083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 1927. [D 20:42:18.907099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 1928. [D 20:42:18.907124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 1929. [D 20:42:18.907135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 1930. [D 20:42:18.907146] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 1931. [D 20:42:18.912584] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1931. [D 20:42:18.912602] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 7/70. [D 20:42:18.914817] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.914832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.914842] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:18.920661] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:18.920682] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.920692] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:18.920725] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2576 [D 20:42:18.920736] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:18.920750] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 8/70. [D 20:42:18.976358] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2552 [D 20:42:18.976376] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 9/70. [D 20:42:18.976436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 1931. [D 20:42:18.976507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 1932. [D 20:42:18.976563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 1933. [D 20:42:18.976575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 1934. [D 20:42:18.976586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 1935. [D 20:42:18.976596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 1936. [D 20:42:18.976606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 1937. [D 20:42:18.976628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 1938. [D 20:42:18.976643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 1939. [D 20:42:18.976653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 1940. [D 20:42:18.976663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 1941. [D 20:42:18.976673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 1942. [D 20:42:18.976700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 1943. [D 20:42:18.976711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 1944. [D 20:42:18.976733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 1945. [D 20:42:18.976743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 1946. [D 20:42:18.976753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 1947. [D 20:42:18.976773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 1948. [D 20:42:18.976787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 1949. [D 20:42:18.976809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 1950. [D 20:42:18.976825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 1951. [D 20:42:18.976835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 1952. [D 20:42:18.976859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 1953. [D 20:42:18.976869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 1954. [D 20:42:18.976891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 1955. [D 20:42:18.976901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 1956. [D 20:42:18.976921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 1957. [D 20:42:18.976932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 1958. [D 20:42:18.976942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 1959. [D 20:42:18.976965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 1960. [D 20:42:18.976976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 1961. [D 20:42:18.976987] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 1962. [D 20:42:18.982363] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1962. [D 20:42:18.982379] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 10/70. [D 20:42:18.984628] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:18.984642] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:18.984652] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.026072] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2572 [D 20:42:19.026090] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 11/70. [D 20:42:19.026152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 1962. [D 20:42:19.026263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 1963. [D 20:42:19.026277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 1964. [D 20:42:19.026288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 1965. [D 20:42:19.026299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 1966. [D 20:42:19.026310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 1967. [D 20:42:19.026321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 1968. [D 20:42:19.026349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 1969. [D 20:42:19.026360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 1970. [D 20:42:19.026370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 1971. [D 20:42:19.026380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 1972. [D 20:42:19.026390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 1973. [D 20:42:19.026400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 1974. [D 20:42:19.026410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 1975. [D 20:42:19.026420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 1976. [D 20:42:19.026444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 1977. [D 20:42:19.026454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 1978. [D 20:42:19.026476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 1979. [D 20:42:19.026486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 1980. [D 20:42:19.026496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 1981. [D 20:42:19.026524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 1982. [D 20:42:19.026535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 1983. [D 20:42:19.026549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 1984. [D 20:42:19.026559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 1985. [D 20:42:19.026569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 1986. [D 20:42:19.026592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 1987. [D 20:42:19.026602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 1988. [D 20:42:19.026612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 1989. [D 20:42:19.026622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 1990. [D 20:42:19.026632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 1991. [D 20:42:19.026642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 1992. [D 20:42:19.026666] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 1993. [D 20:42:19.032123] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 1993. [D 20:42:19.032140] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 12/70. [D 20:42:19.034284] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.034299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.034309] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:19.040284] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.040300] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.040311] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:19.040343] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2578 [D 20:42:19.040354] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:19.040366] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 13/70. [D 20:42:19.095793] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2576 [D 20:42:19.095811] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 14/70. [D 20:42:19.095870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 1993. [D 20:42:19.095946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 1994. [D 20:42:19.095958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 1995. [D 20:42:19.095969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 1996. [D 20:42:19.095980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 1997. [D 20:42:19.095990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 1998. [D 20:42:19.096005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 1999. [D 20:42:19.096015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2000. [D 20:42:19.096025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2001. [D 20:42:19.096041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2002. [D 20:42:19.096051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2003. [D 20:42:19.096061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2004. [D 20:42:19.096070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2005. [D 20:42:19.096088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2006. [D 20:42:19.096098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2007. [D 20:42:19.096107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2008. [D 20:42:19.096161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2009. [D 20:42:19.096172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2010. [D 20:42:19.096182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2011. [D 20:42:19.096206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2012. [D 20:42:19.096217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2013. [D 20:42:19.096232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2014. [D 20:42:19.096242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2015. [D 20:42:19.096252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2016. [D 20:42:19.096268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2017. [D 20:42:19.096278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2018. [D 20:42:19.096302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2019. [D 20:42:19.096312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2020. [D 20:42:19.096323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2021. [D 20:42:19.096338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2022. [D 20:42:19.096348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2023. [D 20:42:19.096373] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2024. [D 20:42:19.101858] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2024. [D 20:42:19.101876] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 15/70. [D 20:42:19.102979] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.102994] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.103004] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:19.110298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.110313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.110323] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:19.110356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2582 [D 20:42:19.110367] element 0: offset: 0x2aaaab235940, size: 24 [D 20:42:19.110379] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 16/70. [D 20:42:19.114476] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.114490] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.114500] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.114515] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2585 [D 20:42:19.114525] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:19.114535] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 17/70. [D 20:42:19.166874] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2570 [D 20:42:19.166892] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 18/70. [D 20:42:19.166951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2024. [D 20:42:19.167032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2025. [D 20:42:19.167044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2026. [D 20:42:19.167054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2027. [D 20:42:19.167065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2028. [D 20:42:19.167075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2029. [D 20:42:19.167091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2030. [D 20:42:19.167101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2031. [D 20:42:19.167111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2032. [D 20:42:19.167126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2033. [D 20:42:19.167176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2034. [D 20:42:19.167187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2035. [D 20:42:19.167197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2036. [D 20:42:19.167224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2037. [D 20:42:19.167234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2038. [D 20:42:19.167244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2039. [D 20:42:19.167257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2040. [D 20:42:19.167267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2041. [D 20:42:19.167277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2042. [D 20:42:19.167329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2043. [D 20:42:19.167340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2044. [D 20:42:19.167350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2045. [D 20:42:19.167374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2046. [D 20:42:19.167384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2047. [D 20:42:19.167395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2048. [D 20:42:19.167405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2049. [D 20:42:19.167415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2050. [D 20:42:19.167426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2051. [D 20:42:19.167436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2052. [D 20:42:19.167457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2053. [D 20:42:19.167467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2054. [D 20:42:19.167477] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2055. [D 20:42:19.172886] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2055. [D 20:42:19.172902] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 19/70. [D 20:42:19.175015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.175030] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.175040] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.180845] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.180865] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.180876] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.180910] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2588 [D 20:42:19.180920] element 0: offset: 0x2aaaab218100, size: 24 [D 20:42:19.180933] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 20/70. [D 20:42:19.246107] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2588 [D 20:42:19.246126] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 21/70. [D 20:42:19.246185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2055. [D 20:42:19.246256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2056. [D 20:42:19.246268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2057. [D 20:42:19.246279] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2058. [D 20:42:19.246291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2059. [D 20:42:19.246301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2060. [D 20:42:19.246311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2061. [D 20:42:19.246324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2062. [D 20:42:19.246334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2063. [D 20:42:19.246344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2064. [D 20:42:19.246384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2065. [D 20:42:19.246395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2066. [D 20:42:19.246405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2067. [D 20:42:19.246415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2068. [D 20:42:19.246454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2069. [D 20:42:19.246465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2070. [D 20:42:19.246475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2071. [D 20:42:19.246485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2072. [D 20:42:19.246496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2073. [D 20:42:19.246506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2074. [D 20:42:19.246531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2075. [D 20:42:19.246541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2076. [D 20:42:19.246557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2077. [D 20:42:19.246581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2078. [D 20:42:19.246592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2079. [D 20:42:19.246602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2080. [D 20:42:19.246612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2081. [D 20:42:19.246622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2082. [D 20:42:19.246645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2083. [D 20:42:19.246655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2084. [D 20:42:19.246671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2085. [D 20:42:19.246681] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2086. [D 20:42:19.252164] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2086. [D 20:42:19.252181] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 22/70. [D 20:42:19.254448] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.254463] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.254473] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.260264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.260278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.260289] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.260320] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2591 [D 20:42:19.260331] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:19.260343] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 23/70. [D 20:42:19.311288] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2578 [D 20:42:19.311306] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 24/70. [D 20:42:19.311365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2086. [D 20:42:19.311434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2087. [D 20:42:19.311455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2088. [D 20:42:19.311466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2089. [D 20:42:19.311477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2090. [D 20:42:19.311486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2091. [D 20:42:19.311500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2092. [D 20:42:19.311510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2093. [D 20:42:19.311520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2094. [D 20:42:19.311536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2095. [D 20:42:19.311589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2096. [D 20:42:19.311599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2097. [D 20:42:19.311610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2098. [D 20:42:19.311634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2099. [D 20:42:19.311644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2100. [D 20:42:19.311655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2101. [D 20:42:19.311665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2102. [D 20:42:19.311675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2103. [D 20:42:19.311685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2104. [D 20:42:19.311711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2105. [D 20:42:19.311727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2106. [D 20:42:19.311738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2107. [D 20:42:19.311748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2108. [D 20:42:19.311758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2109. [D 20:42:19.311768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2110. [D 20:42:19.311792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2111. [D 20:42:19.311805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2112. [D 20:42:19.311815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2113. [D 20:42:19.311825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2114. [D 20:42:19.311848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2115. [D 20:42:19.311857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2116. [D 20:42:19.311868] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2117. [D 20:42:19.317287] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2117. [D 20:42:19.317304] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 25/70. [D 20:42:19.318995] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.319011] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.319021] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.460715] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.460730] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.460741] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.460773] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2593 [D 20:42:19.460784] element 0: offset: 0x2aaaab2302e0, size: 24 [D 20:42:19.460797] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 26/70. [D 20:42:19.630418] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2593 [D 20:42:19.630436] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 27/70. [D 20:42:19.630534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 2117. [D 20:42:19.630645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 2118. [D 20:42:19.630657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2119. [D 20:42:19.630668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2120. [D 20:42:19.630682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2121. [D 20:42:19.630692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2122. [D 20:42:19.630702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2123. [D 20:42:19.630716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2124. [D 20:42:19.630725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2125. [D 20:42:19.630735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2126. [D 20:42:19.630746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2127. [D 20:42:19.630773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2128. [D 20:42:19.630784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2129. [D 20:42:19.630805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2130. [D 20:42:19.630814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2131. [D 20:42:19.630825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2132. [D 20:42:19.630848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2133. [D 20:42:19.630861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2134. [D 20:42:19.630887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2135. [D 20:42:19.630897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2136. [D 20:42:19.630922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2137. [D 20:42:19.630932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2138. [D 20:42:19.630945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2139. [D 20:42:19.630967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2140. [D 20:42:19.630980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2141. [D 20:42:19.631014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2142. [D 20:42:19.631024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2143. [D 20:42:19.631046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2144. [D 20:42:19.631057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2145. [D 20:42:19.631067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2146. [D 20:42:19.631090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2147. [D 20:42:19.631100] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2148. [D 20:42:19.636504] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2148. [D 20:42:19.636522] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 28/70. [D 20:42:19.638832] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.638847] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.638858] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.643025] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.643039] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.643050] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.643083] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2596 [D 20:42:19.643094] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:19.644210] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 29/70. [D 20:42:19.689744] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2585 [D 20:42:19.689762] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 30/70. [D 20:42:19.689823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2148. [D 20:42:19.689917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2149. [D 20:42:19.689930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2150. [D 20:42:19.689942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2151. [D 20:42:19.689953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2152. [D 20:42:19.689963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2153. [D 20:42:19.689974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2154. [D 20:42:19.689984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2155. [D 20:42:19.689995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2156. [D 20:42:19.690035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2157. [D 20:42:19.690057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2158. [D 20:42:19.690071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2159. [D 20:42:19.690090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2160. [D 20:42:19.690105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2161. [D 20:42:19.690115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2162. [D 20:42:19.690138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2163. [D 20:42:19.690148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2164. [D 20:42:19.690168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2165. [D 20:42:19.690180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2166. [D 20:42:19.690190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2167. [D 20:42:19.690215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2168. [D 20:42:19.690225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2169. [D 20:42:19.690252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2170. [D 20:42:19.690262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2171. [D 20:42:19.690283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2172. [D 20:42:19.690294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2173. [D 20:42:19.690317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2174. [D 20:42:19.690328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2175. [D 20:42:19.690338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2176. [D 20:42:19.690348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2177. [D 20:42:19.690359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2178. [D 20:42:19.690369] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2179. [D 20:42:19.695771] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2179. [D 20:42:19.695788] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 31/70. [D 20:42:19.698077] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.698092] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.698102] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.703362] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.703382] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.703393] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.703426] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2600 [D 20:42:19.703437] element 0: offset: 0x2aaaab236c70, size: 24 [D 20:42:19.703451] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 32/70. [D 20:42:19.741489] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2591 [D 20:42:19.741509] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 33/70. [D 20:42:19.741572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2179. [D 20:42:19.741648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2180. [D 20:42:19.741660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2181. [D 20:42:19.741671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2182. [D 20:42:19.741682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2183. [D 20:42:19.741692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2184. [D 20:42:19.741708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2185. [D 20:42:19.741718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2186. [D 20:42:19.741728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2187. [D 20:42:19.741743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2188. [D 20:42:19.741753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2189. [D 20:42:19.741803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2190. [D 20:42:19.741818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2191. [D 20:42:19.741839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2192. [D 20:42:19.741854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2193. [D 20:42:19.741864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2194. [D 20:42:19.741874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2195. [D 20:42:19.741888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2196. [D 20:42:19.741898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2197. [D 20:42:19.741908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2198. [D 20:42:19.741918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2199. [D 20:42:19.741943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2200. [D 20:42:19.741954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2201. [D 20:42:19.741964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2202. [D 20:42:19.741973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2203. [D 20:42:19.742004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2204. [D 20:42:19.742015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2205. [D 20:42:19.742025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2206. [D 20:42:19.742035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2207. [D 20:42:19.742045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2208. [D 20:42:19.742067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2209. [D 20:42:19.742077] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2210. [D 20:42:19.747528] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2210. [D 20:42:19.747546] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 34/70. [D 20:42:19.749634] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.749648] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.749659] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.755010] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.755024] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.755035] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.755068] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2603 [D 20:42:19.755079] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:19.755744] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 35/70. [D 20:42:19.842014] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2582 [D 20:42:19.842032] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 36/70. [D 20:42:19.842153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 2210. [D 20:42:19.842230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 2211. [D 20:42:19.842241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 2212. [D 20:42:19.842252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 2213. [D 20:42:19.842262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 2214. [D 20:42:19.842272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 2215. [D 20:42:19.842281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2216. [D 20:42:19.842291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2217. [D 20:42:19.842301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2218. [D 20:42:19.842311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 2219. [D 20:42:19.842320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 2220. [D 20:42:19.842330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 2221. [D 20:42:19.842379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 2222. [D 20:42:19.842389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 2223. [D 20:42:19.842410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2224. [D 20:42:19.842421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2225. [D 20:42:19.842431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2226. [D 20:42:19.842441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2227. [D 20:42:19.842454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2228. [D 20:42:19.842464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2229. [D 20:42:19.842473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2230. [D 20:42:19.842489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2231. [D 20:42:19.842499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2232. [D 20:42:19.842509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2233. [D 20:42:19.842541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2234. [D 20:42:19.842550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2235. [D 20:42:19.842560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2236. [D 20:42:19.842575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2237. [D 20:42:19.842585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2238. [D 20:42:19.842611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2239. [D 20:42:19.842621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2240. [D 20:42:19.842631] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2241. [D 20:42:19.848088] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2241. [D 20:42:19.848107] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 37/70. [D 20:42:19.850424] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.850439] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.850450] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.856664] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.856678] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.856689] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.856721] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2606 [D 20:42:19.856732] element 0: offset: 0x2aaaab20f830, size: 24 [D 20:42:19.856744] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 38/70. [D 20:42:19.904147] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2596 [D 20:42:19.904166] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 39/70. [D 20:42:19.904229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 2241. [D 20:42:19.904300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 2242. [D 20:42:19.904318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2243. [D 20:42:19.904329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2244. [D 20:42:19.904361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2245. [D 20:42:19.904373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2246. [D 20:42:19.904383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2247. [D 20:42:19.904392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2248. [D 20:42:19.904406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2249. [D 20:42:19.904416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2250. [D 20:42:19.904426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2251. [D 20:42:19.904456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2252. [D 20:42:19.904473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2253. [D 20:42:19.904495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2254. [D 20:42:19.904506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2255. [D 20:42:19.904516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2256. [D 20:42:19.904526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2257. [D 20:42:19.904536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2258. [D 20:42:19.904546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2259. [D 20:42:19.904569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2260. [D 20:42:19.904579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2261. [D 20:42:19.904599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2262. [D 20:42:19.904609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2263. [D 20:42:19.904619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2264. [D 20:42:19.904635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2265. [D 20:42:19.904644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2266. [D 20:42:19.904668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2267. [D 20:42:19.904678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2268. [D 20:42:19.904689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2269. [D 20:42:19.904716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2270. [D 20:42:19.904727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2271. [D 20:42:19.904740] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2272. [D 20:42:19.910154] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2272. [D 20:42:19.910172] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 40/70. [D 20:42:19.912425] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.912440] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.912450] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.917889] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.917904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.917915] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.917948] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2608 [D 20:42:19.917959] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:19.917972] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 41/70. [D 20:42:19.966565] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2608 [D 20:42:19.966583] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 42/70. [D 20:42:19.966644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 2272. [D 20:42:19.966714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 2273. [D 20:42:19.966774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2274. [D 20:42:19.966785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2275. [D 20:42:19.966796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2276. [D 20:42:19.966807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2277. [D 20:42:19.966817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2278. [D 20:42:19.966840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2279. [D 20:42:19.966850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2280. [D 20:42:19.966860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2281. [D 20:42:19.966876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2282. [D 20:42:19.966901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2283. [D 20:42:19.966912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2284. [D 20:42:19.966934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2285. [D 20:42:19.966944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2286. [D 20:42:19.966955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2287. [D 20:42:19.966976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2288. [D 20:42:19.966990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2289. [D 20:42:19.967012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2290. [D 20:42:19.967028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2291. [D 20:42:19.967038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2292. [D 20:42:19.967060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2293. [D 20:42:19.967072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2294. [D 20:42:19.967095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2295. [D 20:42:19.967110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2296. [D 20:42:19.967131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2297. [D 20:42:19.967145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2298. [D 20:42:19.967167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2299. [D 20:42:19.967180] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2300. [D 20:42:19.967201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2301. [D 20:42:19.967214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2302. [D 20:42:19.967224] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2303. [D 20:42:19.972614] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2303. [D 20:42:19.972631] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 43/70. [D 20:42:19.974783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:19.974798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.974808] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:19.979029] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:19.979044] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:19.979054] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:19.979087] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2611 [D 20:42:19.979098] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:19.979110] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 44/70. [D 20:42:20.025111] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2600 [D 20:42:20.025129] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 45/70. [D 20:42:20.025194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2303. [D 20:42:20.025305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2304. [D 20:42:20.025317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2305. [D 20:42:20.025328] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2306. [D 20:42:20.025342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2307. [D 20:42:20.025352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2308. [D 20:42:20.025362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2309. [D 20:42:20.025376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2310. [D 20:42:20.025386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2311. [D 20:42:20.025396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2312. [D 20:42:20.025406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2313. [D 20:42:20.025432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2314. [D 20:42:20.025442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2315. [D 20:42:20.025464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2316. [D 20:42:20.025474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2317. [D 20:42:20.025485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2318. [D 20:42:20.025504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2319. [D 20:42:20.025519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2320. [D 20:42:20.025529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2321. [D 20:42:20.025555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2322. [D 20:42:20.025565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2323. [D 20:42:20.025575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2324. [D 20:42:20.025598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2325. [D 20:42:20.025607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2326. [D 20:42:20.025629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2327. [D 20:42:20.025639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2328. [D 20:42:20.025649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2329. [D 20:42:20.025671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2330. [D 20:42:20.025682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2331. [D 20:42:20.025702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2332. [D 20:42:20.025713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2333. [D 20:42:20.025735] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2334. [D 20:42:20.031158] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2334. [D 20:42:20.031174] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 46/70. [D 20:42:20.033341] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.033356] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.033366] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.039096] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.039112] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.039122] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.039156] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2615 [D 20:42:20.039167] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:20.039179] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 47/70. [D 20:42:20.045053] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2603 [D 20:42:20.045071] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 48/70. [D 20:42:20.045237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2334. [D 20:42:20.045304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2335. [D 20:42:20.045316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2336. [D 20:42:20.045327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2337. [D 20:42:20.045338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2338. [D 20:42:20.045347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2339. [D 20:42:20.045357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2340. [D 20:42:20.045368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2341. [D 20:42:20.045377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2342. [D 20:42:20.045387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2343. [D 20:42:20.045397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2344. [D 20:42:20.045431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2345. [D 20:42:20.045442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2346. [D 20:42:20.045464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2347. [D 20:42:20.045479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2348. [D 20:42:20.045489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2349. [D 20:42:20.045511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2350. [D 20:42:20.045521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2351. [D 20:42:20.045531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2352. [D 20:42:20.045558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2353. [D 20:42:20.045568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2354. [D 20:42:20.045580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2355. [D 20:42:20.045590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2356. [D 20:42:20.045600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2357. [D 20:42:20.045626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2358. [D 20:42:20.045636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2359. [D 20:42:20.045649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2360. [D 20:42:20.045659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2361. [D 20:42:20.045680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2362. [D 20:42:20.045691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2363. [D 20:42:20.045700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2364. [D 20:42:20.045724] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2365. [D 20:42:20.052724] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2365. [D 20:42:20.052740] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 49/70. [D 20:42:20.055075] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.055091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.055101] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.060538] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.060553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.060563] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.060596] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2618 [D 20:42:20.060607] element 0: offset: 0x2aaaab218130, size: 24 [D 20:42:20.060620] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 50/70. [D 20:42:20.102034] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2606 [D 20:42:20.102052] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 51/70. [D 20:42:20.102112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 2365. [D 20:42:20.102189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 2366. [D 20:42:20.102200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 2367. [D 20:42:20.102211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 2368. [D 20:42:20.102221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 2369. [D 20:42:20.102231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 2370. [D 20:42:20.102247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2371. [D 20:42:20.102257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2372. [D 20:42:20.102267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2373. [D 20:42:20.102283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 2374. [D 20:42:20.102333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 2375. [D 20:42:20.102345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 2376. [D 20:42:20.102372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 2377. [D 20:42:20.102382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 2378. [D 20:42:20.102392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2379. [D 20:42:20.102421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2380. [D 20:42:20.102431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2381. [D 20:42:20.102445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2382. [D 20:42:20.102455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2383. [D 20:42:20.102465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2384. [D 20:42:20.102481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2385. [D 20:42:20.102504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2386. [D 20:42:20.102517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2387. [D 20:42:20.102526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2388. [D 20:42:20.102537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2389. [D 20:42:20.102559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2390. [D 20:42:20.102569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2391. [D 20:42:20.102580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2392. [D 20:42:20.102589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2393. [D 20:42:20.102599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2394. [D 20:42:20.102623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2395. [D 20:42:20.102633] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2396. [D 20:42:20.108044] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2396. [D 20:42:20.108062] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 52/70. [D 20:42:20.110340] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.110355] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.110365] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.116371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.116385] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.116395] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.116428] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2621 [D 20:42:20.116439] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:20.116454] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 53/70. [D 20:42:20.157996] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2621 [D 20:42:20.158015] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 54/70. [D 20:42:20.158071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 2396. [D 20:42:20.158140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 2397. [D 20:42:20.158166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 2398. [D 20:42:20.158178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 2399. [D 20:42:20.158189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 2400. [D 20:42:20.158199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 2401. [D 20:42:20.158210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2402. [D 20:42:20.158220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2403. [D 20:42:20.158230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2404. [D 20:42:20.158240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 2405. [D 20:42:20.158263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 2406. [D 20:42:20.158274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 2407. [D 20:42:20.158298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 2408. [D 20:42:20.158308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 2409. [D 20:42:20.158336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2410. [D 20:42:20.158346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2411. [D 20:42:20.158358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2412. [D 20:42:20.158382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2413. [D 20:42:20.158395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2414. [D 20:42:20.158413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2415. [D 20:42:20.158424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2416. [D 20:42:20.158434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2417. [D 20:42:20.158456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2418. [D 20:42:20.158467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2419. [D 20:42:20.158477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2420. [D 20:42:20.158499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2421. [D 20:42:20.158509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2422. [D 20:42:20.158529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2423. [D 20:42:20.158541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2424. [D 20:42:20.158551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2425. [D 20:42:20.158572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2426. [D 20:42:20.158582] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2427. [D 20:42:20.164080] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2427. [D 20:42:20.164097] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 55/70. [D 20:42:20.166255] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.166270] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.166281] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.171056] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.171071] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.171082] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.171116] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2624 [D 20:42:20.171127] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:20.171139] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 56/70. [D 20:42:20.218617] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2611 [D 20:42:20.218636] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 57/70. [D 20:42:20.218696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2427. [D 20:42:20.218767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2428. [D 20:42:20.218822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2429. [D 20:42:20.218833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2430. [D 20:42:20.218844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2431. [D 20:42:20.218854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2432. [D 20:42:20.218864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2433. [D 20:42:20.218888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2434. [D 20:42:20.218899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2435. [D 20:42:20.218909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2436. [D 20:42:20.218920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2437. [D 20:42:20.218929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2438. [D 20:42:20.218952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2439. [D 20:42:20.218967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2440. [D 20:42:20.218988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2441. [D 20:42:20.219002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2442. [D 20:42:20.219023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2443. [D 20:42:20.219038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2444. [D 20:42:20.219064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2445. [D 20:42:20.219074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2446. [D 20:42:20.219095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2447. [D 20:42:20.219107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2448. [D 20:42:20.219116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2449. [D 20:42:20.219135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2450. [D 20:42:20.219146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2451. [D 20:42:20.219156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2452. [D 20:42:20.219166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2453. [D 20:42:20.219176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2454. [D 20:42:20.219194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2455. [D 20:42:20.219203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2456. [D 20:42:20.219213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2457. [D 20:42:20.219224] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2458. [D 20:42:20.224620] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2458. [D 20:42:20.224637] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 58/70. [D 20:42:20.226937] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.226952] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.226962] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.232679] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.232694] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.232704] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.232736] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2626 [D 20:42:20.232747] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:20.232760] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 59/70. [D 20:42:20.323523] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2618 [D 20:42:20.323541] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 60/70. [D 20:42:20.323640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2458. [D 20:42:20.323743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2459. [D 20:42:20.323756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2460. [D 20:42:20.323766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2461. [D 20:42:20.323781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2462. [D 20:42:20.323790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2463. [D 20:42:20.323800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2464. [D 20:42:20.323815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2465. [D 20:42:20.323825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2466. [D 20:42:20.323834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2467. [D 20:42:20.323864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2468. [D 20:42:20.323874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2469. [D 20:42:20.323886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2470. [D 20:42:20.323912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2471. [D 20:42:20.323922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2472. [D 20:42:20.323944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2473. [D 20:42:20.323954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2474. [D 20:42:20.323964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2475. [D 20:42:20.323985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2476. [D 20:42:20.323995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2477. [D 20:42:20.324005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2478. [D 20:42:20.324033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2479. [D 20:42:20.324043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2480. [D 20:42:20.324054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2481. [D 20:42:20.324075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2482. [D 20:42:20.324086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2483. [D 20:42:20.324096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2484. [D 20:42:20.324118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2485. [D 20:42:20.324128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2486. [D 20:42:20.324138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2487. [D 20:42:20.324161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2488. [D 20:42:20.324171] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2489. [D 20:42:20.329606] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2489. [D 20:42:20.329624] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 0/70. [D 20:42:20.331076] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.331091] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.331102] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.337485] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.337499] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.337509] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.337542] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2630 [D 20:42:20.337552] element 0: offset: 0x2aaaab20f830, size: 24 [D 20:42:20.337567] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 1/70. [D 20:42:20.403361] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2615 [D 20:42:20.403379] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 2/70. [D 20:42:20.403440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2489. [D 20:42:20.403549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2490. [D 20:42:20.403562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2491. [D 20:42:20.403574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2492. [D 20:42:20.403584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2493. [D 20:42:20.403594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2494. [D 20:42:20.403604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2495. [D 20:42:20.403626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2496. [D 20:42:20.403641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2497. [D 20:42:20.403651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2498. [D 20:42:20.403661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2499. [D 20:42:20.403672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2500. [D 20:42:20.403695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2501. [D 20:42:20.403706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2502. [D 20:42:20.403730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2503. [D 20:42:20.403740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2504. [D 20:42:20.403765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2505. [D 20:42:20.403775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2506. [D 20:42:20.403787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2507. [D 20:42:20.403797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2508. [D 20:42:20.403807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2509. [D 20:42:20.403820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2510. [D 20:42:20.403847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2511. [D 20:42:20.403860] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2512. [D 20:42:20.403869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2513. [D 20:42:20.403879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2514. [D 20:42:20.403902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2515. [D 20:42:20.403911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2516. [D 20:42:20.403922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2517. [D 20:42:20.403932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2518. [D 20:42:20.403958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2519. [D 20:42:20.403969] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2520. [D 20:42:20.409404] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2520. [D 20:42:20.409422] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 3/70. [D 20:42:20.411756] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.411771] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.411782] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.417474] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.417488] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.417499] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.417531] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2633 [D 20:42:20.417542] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:20.417554] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 4/70. [D 20:42:20.498446] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2626 [D 20:42:20.498465] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 5/70. [D 20:42:20.498582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2520. [D 20:42:20.498692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2521. [D 20:42:20.498703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2522. [D 20:42:20.498714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2523. [D 20:42:20.498729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2524. [D 20:42:20.498738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2525. [D 20:42:20.498748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2526. [D 20:42:20.498763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2527. [D 20:42:20.498773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2528. [D 20:42:20.498782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2529. [D 20:42:20.498812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2530. [D 20:42:20.498823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2531. [D 20:42:20.498845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2532. [D 20:42:20.498856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2533. [D 20:42:20.498866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2534. [D 20:42:20.498890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2535. [D 20:42:20.498901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2536. [D 20:42:20.498911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2537. [D 20:42:20.498935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2538. [D 20:42:20.498946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2539. [D 20:42:20.498955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2540. [D 20:42:20.498965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2541. [D 20:42:20.498983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2542. [D 20:42:20.499003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2543. [D 20:42:20.499018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2544. [D 20:42:20.499029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2545. [D 20:42:20.499038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2546. [D 20:42:20.499049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2547. [D 20:42:20.499063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2548. [D 20:42:20.499072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2549. [D 20:42:20.499082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2550. [D 20:42:20.499108] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2551. [D 20:42:20.504550] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2551. [D 20:42:20.504568] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 6/70. [D 20:42:20.506857] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.506873] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.506883] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.512383] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.512400] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.512411] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.512445] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2635 [D 20:42:20.512456] element 0: offset: 0x2aaaab225ec0, size: 24 [D 20:42:20.512469] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 7/70. [D 20:42:20.573663] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2624 [D 20:42:20.573681] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 8/70. [D 20:42:20.573744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 2551. [D 20:42:20.573820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 2552. [D 20:42:20.573832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 2553. [D 20:42:20.573842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 2554. [D 20:42:20.573853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 2555. [D 20:42:20.573862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 2556. [D 20:42:20.573878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2557. [D 20:42:20.573888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2558. [D 20:42:20.573898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2559. [D 20:42:20.573914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 2560. [D 20:42:20.573963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 2561. [D 20:42:20.573976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 2562. [D 20:42:20.574003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 2563. [D 20:42:20.574015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 2564. [D 20:42:20.574025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2565. [D 20:42:20.574035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2566. [D 20:42:20.574058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2567. [D 20:42:20.574068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2568. [D 20:42:20.574078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2569. [D 20:42:20.574088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2570. [D 20:42:20.574098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2571. [D 20:42:20.574113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2572. [D 20:42:20.574138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2573. [D 20:42:20.574149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2574. [D 20:42:20.574159] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2575. [D 20:42:20.574169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2576. [D 20:42:20.574191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2577. [D 20:42:20.574201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2578. [D 20:42:20.574211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2579. [D 20:42:20.574227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2580. [D 20:42:20.574236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2581. [D 20:42:20.574246] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2582. [D 20:42:20.579674] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2582. [D 20:42:20.579691] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 9/70. [D 20:42:20.581902] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.581917] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.581927] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.653550] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2630 [D 20:42:20.653568] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 10/70. [D 20:42:20.653673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2582. [D 20:42:20.653750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2583. [D 20:42:20.653762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2584. [D 20:42:20.653773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2585. [D 20:42:20.653787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2586. [D 20:42:20.653797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2587. [D 20:42:20.653807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2588. [D 20:42:20.653822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2589. [D 20:42:20.653832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2590. [D 20:42:20.653842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2591. [D 20:42:20.653857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2592. [D 20:42:20.653872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2593. [D 20:42:20.653882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2594. [D 20:42:20.653894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2595. [D 20:42:20.653911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2596. [D 20:42:20.653921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2597. [D 20:42:20.653972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2598. [D 20:42:20.653982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2599. [D 20:42:20.653992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2600. [D 20:42:20.654003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2601. [D 20:42:20.654013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2602. [D 20:42:20.654037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2603. [D 20:42:20.654051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2604. [D 20:42:20.654061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2605. [D 20:42:20.654070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2606. [D 20:42:20.654099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2607. [D 20:42:20.654109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2608. [D 20:42:20.654123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2609. [D 20:42:20.654132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2610. [D 20:42:20.654145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2611. [D 20:42:20.654169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2612. [D 20:42:20.654179] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2613. [D 20:42:20.659608] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2613. [D 20:42:20.659625] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 11/70. [D 20:42:20.661918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.661934] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.661944] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:20.667079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.667095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.667105] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:20.667138] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2639 [D 20:42:20.667149] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:20.667161] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 12/70. [D 20:42:20.712691] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.712760] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.712770] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.712808] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2642 [D 20:42:20.712820] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:20.712834] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 13/70. [D 20:42:20.741768] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2633 [D 20:42:20.741786] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 14/70. [D 20:42:20.741848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2613. [D 20:42:20.741925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2614. [D 20:42:20.741936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2615. [D 20:42:20.741947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2616. [D 20:42:20.741957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2617. [D 20:42:20.741967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2618. [D 20:42:20.741983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2619. [D 20:42:20.741993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2620. [D 20:42:20.742003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2621. [D 20:42:20.742019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2622. [D 20:42:20.742028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2623. [D 20:42:20.742038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2624. [D 20:42:20.742048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2625. [D 20:42:20.742058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2626. [D 20:42:20.742068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2627. [D 20:42:20.742078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2628. [D 20:42:20.742126] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2629. [D 20:42:20.742139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2630. [D 20:42:20.742149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2631. [D 20:42:20.742165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2632. [D 20:42:20.742175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2633. [D 20:42:20.742185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2634. [D 20:42:20.742196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2635. [D 20:42:20.742222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2636. [D 20:42:20.742232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2637. [D 20:42:20.742242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2638. [D 20:42:20.742253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2639. [D 20:42:20.742263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2640. [D 20:42:20.742273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2641. [D 20:42:20.742284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2642. [D 20:42:20.742294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2643. [D 20:42:20.742321] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2644. [D 20:42:20.747783] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2644. [D 20:42:20.747801] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 15/70. [D 20:42:20.750115] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.750130] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.750140] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.755739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.755753] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.755764] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.755796] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2645 [D 20:42:20.755807] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:20.755819] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 16/70. [D 20:42:20.817288] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2635 [D 20:42:20.817306] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 17/70. [D 20:42:20.817369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2644. [D 20:42:20.817450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2645. [D 20:42:20.817462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2646. [D 20:42:20.817472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2647. [D 20:42:20.817483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2648. [D 20:42:20.817492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2649. [D 20:42:20.817508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2650. [D 20:42:20.817518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2651. [D 20:42:20.817527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2652. [D 20:42:20.817543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2653. [D 20:42:20.817593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2654. [D 20:42:20.817606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2655. [D 20:42:20.817632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2656. [D 20:42:20.817642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2657. [D 20:42:20.817652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2658. [D 20:42:20.817681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2659. [D 20:42:20.817691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2660. [D 20:42:20.817705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2661. [D 20:42:20.817715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2662. [D 20:42:20.817727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2663. [D 20:42:20.817742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2664. [D 20:42:20.817766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2665. [D 20:42:20.817780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2666. [D 20:42:20.817790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2667. [D 20:42:20.817812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2668. [D 20:42:20.817822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2669. [D 20:42:20.817832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2670. [D 20:42:20.817846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2671. [D 20:42:20.817856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2672. [D 20:42:20.817865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2673. [D 20:42:20.817893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2674. [D 20:42:20.817903] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2675. [D 20:42:20.823313] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2675. [D 20:42:20.823332] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 18/70. [D 20:42:20.825481] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.825496] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.825506] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.831351] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.831365] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.831376] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.831409] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2647 [D 20:42:20.831420] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:20.831433] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 19/70. [D 20:42:20.897193] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2645 [D 20:42:20.897212] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 20/70. [D 20:42:20.897269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2675. [D 20:42:20.897367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2676. [D 20:42:20.897381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2677. [D 20:42:20.897391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2678. [D 20:42:20.897402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2679. [D 20:42:20.897413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2680. [D 20:42:20.897423] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2681. [D 20:42:20.897433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2682. [D 20:42:20.897443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2683. [D 20:42:20.897469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2684. [D 20:42:20.897478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2685. [D 20:42:20.897507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2686. [D 20:42:20.897517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2687. [D 20:42:20.897541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2688. [D 20:42:20.897554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2689. [D 20:42:20.897567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2690. [D 20:42:20.897577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2691. [D 20:42:20.897586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2692. [D 20:42:20.897596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2693. [D 20:42:20.897624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2694. [D 20:42:20.897635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2695. [D 20:42:20.897649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2696. [D 20:42:20.897670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2697. [D 20:42:20.897683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2698. [D 20:42:20.897702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2699. [D 20:42:20.897713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2700. [D 20:42:20.897723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2701. [D 20:42:20.897733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2702. [D 20:42:20.897757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2703. [D 20:42:20.897768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2704. [D 20:42:20.897779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2705. [D 20:42:20.897789] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2706. [D 20:42:20.903224] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2706. [D 20:42:20.903242] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 21/70. [D 20:42:20.905563] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.905578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.905588] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.911037] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.911051] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.911062] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.911122] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2651 [D 20:42:20.911136] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:20.911148] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 22/70. [D 20:42:20.955116] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2647 [D 20:42:20.955134] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 23/70. [D 20:42:20.955194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2706. [D 20:42:20.955265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2707. [D 20:42:20.955318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2708. [D 20:42:20.955329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2709. [D 20:42:20.955340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2710. [D 20:42:20.955351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2711. [D 20:42:20.955360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2712. [D 20:42:20.955381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2713. [D 20:42:20.955397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2714. [D 20:42:20.955406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2715. [D 20:42:20.955416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2716. [D 20:42:20.955445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2717. [D 20:42:20.955455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2718. [D 20:42:20.955485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2719. [D 20:42:20.955495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2720. [D 20:42:20.955505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2721. [D 20:42:20.955515] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2722. [D 20:42:20.955525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2723. [D 20:42:20.955535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2724. [D 20:42:20.955544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2725. [D 20:42:20.955569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2726. [D 20:42:20.955579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2727. [D 20:42:20.955588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2728. [D 20:42:20.955611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2729. [D 20:42:20.955621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2730. [D 20:42:20.955631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2731. [D 20:42:20.955653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2732. [D 20:42:20.955663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2733. [D 20:42:20.955674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2734. [D 20:42:20.955683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2735. [D 20:42:20.955693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2736. [D 20:42:20.955703] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2737. [D 20:42:20.961118] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2737. [D 20:42:20.961135] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 24/70. [D 20:42:20.963342] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:20.963357] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.963368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:20.967156] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:20.967171] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:20.967181] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:20.967214] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2653 [D 20:42:20.967225] element 0: offset: 0x2aaaab20f830, size: 24 [D 20:42:20.969080] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 25/70. [D 20:42:21.012721] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2651 [D 20:42:21.012741] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 26/70. [D 20:42:21.012799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2737. [D 20:42:21.012881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2738. [D 20:42:21.012892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2739. [D 20:42:21.012903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2740. [D 20:42:21.012914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2741. [D 20:42:21.012924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2742. [D 20:42:21.012940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2743. [D 20:42:21.012950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2744. [D 20:42:21.012960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2745. [D 20:42:21.012976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2746. [D 20:42:21.013026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2747. [D 20:42:21.013039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2748. [D 20:42:21.013049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2749. [D 20:42:21.013059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2750. [D 20:42:21.013071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2751. [D 20:42:21.013088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2752. [D 20:42:21.013098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2753. [D 20:42:21.013107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2754. [D 20:42:21.013118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2755. [D 20:42:21.013128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2756. [D 20:42:21.013155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2757. [D 20:42:21.013169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2758. [D 20:42:21.013179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2759. [D 20:42:21.013189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2760. [D 20:42:21.013205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2761. [D 20:42:21.013215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2762. [D 20:42:21.013225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2763. [D 20:42:21.013252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2764. [D 20:42:21.013261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2765. [D 20:42:21.013276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2766. [D 20:42:21.013285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2767. [D 20:42:21.013295] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2768. [D 20:42:21.018738] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2768. [D 20:42:21.018754] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 27/70. [D 20:42:21.020895] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.020910] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.020921] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.026415] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.026430] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.026440] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.026472] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2657 [D 20:42:21.026483] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:21.026496] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 28/70. [D 20:42:21.092543] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2653 [D 20:42:21.092561] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 29/70. [D 20:42:21.092619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 2768. [D 20:42:21.092691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 2769. [D 20:42:21.092712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 2770. [D 20:42:21.092723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 2771. [D 20:42:21.092734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 2772. [D 20:42:21.092743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 2773. [D 20:42:21.092757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 2774. [D 20:42:21.092767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 2775. [D 20:42:21.092777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 2776. [D 20:42:21.092792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 2777. [D 20:42:21.092845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 2778. [D 20:42:21.092856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 2779. [D 20:42:21.092879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 2780. [D 20:42:21.092890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 2781. [D 20:42:21.092901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 2782. [D 20:42:21.092910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 2783. [D 20:42:21.092921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 2784. [D 20:42:21.092931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 2785. [D 20:42:21.092941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 2786. [D 20:42:21.092967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 2787. [D 20:42:21.092977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 2788. [D 20:42:21.092987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 2789. [D 20:42:21.093003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 2790. [D 20:42:21.093027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 2791. [D 20:42:21.093038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 2792. [D 20:42:21.093048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 2793. [D 20:42:21.093058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 2794. [D 20:42:21.093085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 2795. [D 20:42:21.093095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 2796. [D 20:42:21.093107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 2797. [D 20:42:21.093117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 2798. [D 20:42:21.093129] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 2799. [D 20:42:21.098548] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2799. [D 20:42:21.098565] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 30/70. [D 20:42:21.100702] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.100717] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.100728] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.132601] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2639 [D 20:42:21.132619] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 31/70. [D 20:42:21.132681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 2799. [D 20:42:21.132758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 2800. [D 20:42:21.132769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 2801. [D 20:42:21.132785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 2802. [D 20:42:21.132796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 2803. [D 20:42:21.132806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 2804. [D 20:42:21.132823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 2805. [D 20:42:21.132833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 2806. [D 20:42:21.132842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 2807. [D 20:42:21.132896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 2808. [D 20:42:21.132906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 2809. [D 20:42:21.132916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 2810. [D 20:42:21.132930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 2811. [D 20:42:21.132953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 2812. [D 20:42:21.132965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 2813. [D 20:42:21.132975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 2814. [D 20:42:21.132985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 2815. [D 20:42:21.132998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 2816. [D 20:42:21.133008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 2817. [D 20:42:21.133018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 2818. [D 20:42:21.133034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 2819. [D 20:42:21.133044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 2820. [D 20:42:21.133053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 2821. [D 20:42:21.133063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 2822. [D 20:42:21.133074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 2823. [D 20:42:21.133084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 2824. [D 20:42:21.133093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 2825. [D 20:42:21.133114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 2826. [D 20:42:21.133124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 2827. [D 20:42:21.133134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 2828. [D 20:42:21.133144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 2829. [D 20:42:21.133161] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 2830. [D 20:42:21.138619] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2830. [D 20:42:21.138637] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 32/70. [D 20:42:21.140771] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.140786] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.140797] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:21.199349] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2657 [D 20:42:21.199367] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 33/70. [D 20:42:21.199439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 2830. [D 20:42:21.199547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 2831. [D 20:42:21.199559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 2832. [D 20:42:21.199570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 2833. [D 20:42:21.199581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 2834. [D 20:42:21.199591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 2835. [D 20:42:21.199601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 2836. [D 20:42:21.199611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 2837. [D 20:42:21.199621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 2838. [D 20:42:21.199631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 2839. [D 20:42:21.199641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 2840. [D 20:42:21.199672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 2841. [D 20:42:21.199683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 2842. [D 20:42:21.199706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 2843. [D 20:42:21.199722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 2844. [D 20:42:21.199733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 2845. [D 20:42:21.199752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 2846. [D 20:42:21.199766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 2847. [D 20:42:21.199786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 2848. [D 20:42:21.199796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 2849. [D 20:42:21.199807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 2850. [D 20:42:21.199817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 2851. [D 20:42:21.199841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 2852. [D 20:42:21.199852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 2853. [D 20:42:21.199863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 2854. [D 20:42:21.199872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 2855. [D 20:42:21.199892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 2856. [D 20:42:21.199908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 2857. [D 20:42:21.199929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 2858. [D 20:42:21.199940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 2859. [D 20:42:21.199950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 2860. [D 20:42:21.199972] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 2861. [D 20:42:21.205419] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2861. [D 20:42:21.205435] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 34/70. [D 20:42:21.207155] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.207170] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.207180] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:21.213984] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.214020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.214030] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:21.214065] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2660 [D 20:42:21.214077] element 0: offset: 0x2aaaab218230, size: 24 [D 20:42:21.214090] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 35/70. [D 20:42:21.234591] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.234653] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.234663] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:21.234699] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2662 [D 20:42:21.234713] element 0: offset: 0x2aaaab2258c0, size: 24 [D 20:42:21.234727] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 36/70. [D 20:42:21.246233] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2642 [D 20:42:21.246252] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 37/70. [D 20:42:21.246306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 2861. [D 20:42:21.246338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 2862. [D 20:42:21.246349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 2863. [D 20:42:21.246360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 2864. [D 20:42:21.246370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 2865. [D 20:42:21.246380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 2866. [D 20:42:21.246390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 2867. [D 20:42:21.246399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 2868. [D 20:42:21.246410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 2869. [D 20:42:21.246427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 2870. [D 20:42:21.246436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 2871. [D 20:42:21.246446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 2872. [D 20:42:21.246456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 2873. [D 20:42:21.246466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 2874. [D 20:42:21.246476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 2875. [D 20:42:21.246486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 2876. [D 20:42:21.246518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 2877. [D 20:42:21.246528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 2878. [D 20:42:21.246538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 2879. [D 20:42:21.246554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 2880. [D 20:42:21.246564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 2881. [D 20:42:21.246574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 2882. [D 20:42:21.246602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 2883. [D 20:42:21.246612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 2884. [D 20:42:21.246626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 2885. [D 20:42:21.246636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 2886. [D 20:42:21.246660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 2887. [D 20:42:21.246670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 2888. [D 20:42:21.246682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 2889. [D 20:42:21.246704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 2890. [D 20:42:21.246714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 2891. [D 20:42:21.246735] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 2892. [D 20:42:21.252200] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2892. [D 20:42:21.252218] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 38/70. [D 20:42:21.254504] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.254518] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.254527] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:21.259151] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.259165] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.259176] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:21.259202] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2666 [D 20:42:21.259212] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:21.261097] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 39/70. [D 20:42:21.270729] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.270789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.270799] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.270837] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2669 [D 20:42:21.270850] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:21.270864] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 40/70. [D 20:42:21.326104] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2662 [D 20:42:21.326140] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 41/70. [D 20:42:21.326203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2892. [D 20:42:21.326276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2893. [D 20:42:21.326287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 2894. [D 20:42:21.326297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 2895. [D 20:42:21.326312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 2896. [D 20:42:21.326366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 2897. [D 20:42:21.326377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 2898. [D 20:42:21.326387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2899. [D 20:42:21.326410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2900. [D 20:42:21.326420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2901. [D 20:42:21.326431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 2902. [D 20:42:21.326441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 2903. [D 20:42:21.326451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 2904. [D 20:42:21.326461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 2905. [D 20:42:21.326484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 2906. [D 20:42:21.326506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 2907. [D 20:42:21.326516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 2908. [D 20:42:21.326535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 2909. [D 20:42:21.326546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 2910. [D 20:42:21.326556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 2911. [D 20:42:21.326566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 2912. [D 20:42:21.326577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 2913. [D 20:42:21.326587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 2914. [D 20:42:21.326597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 2915. [D 20:42:21.326607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 2916. [D 20:42:21.326618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 2917. [D 20:42:21.326645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 2918. [D 20:42:21.326661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 2919. [D 20:42:21.326682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 2920. [D 20:42:21.326696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 2921. [D 20:42:21.326714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 2922. [D 20:42:21.326725] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 2923. [D 20:42:21.332133] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2923. [D 20:42:21.332150] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 42/70. [D 20:42:21.334468] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.334483] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.334493] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.339118] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.339133] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.339144] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.339177] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2671 [D 20:42:21.339188] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:21.339200] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 43/70. [D 20:42:21.405323] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2671 [D 20:42:21.405342] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 44/70. [D 20:42:21.405402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2923. [D 20:42:21.405471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2924. [D 20:42:21.405491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 2925. [D 20:42:21.405501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 2926. [D 20:42:21.405511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 2927. [D 20:42:21.405522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 2928. [D 20:42:21.405537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 2929. [D 20:42:21.405547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2930. [D 20:42:21.405557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2931. [D 20:42:21.405572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2932. [D 20:42:21.405622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 2933. [D 20:42:21.405632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 2934. [D 20:42:21.405642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 2935. [D 20:42:21.405652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 2936. [D 20:42:21.405662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 2937. [D 20:42:21.405679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 2938. [D 20:42:21.405689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 2939. [D 20:42:21.405699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 2940. [D 20:42:21.405710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 2941. [D 20:42:21.405720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 2942. [D 20:42:21.405747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 2943. [D 20:42:21.405760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 2944. [D 20:42:21.405770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 2945. [D 20:42:21.405780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 2946. [D 20:42:21.405790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 2947. [D 20:42:21.405800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 2948. [D 20:42:21.405810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 2949. [D 20:42:21.405820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 2950. [D 20:42:21.405845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 2951. [D 20:42:21.405855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 2952. [D 20:42:21.405865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 2953. [D 20:42:21.405876] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 2954. [D 20:42:21.411398] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2954. [D 20:42:21.411416] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 45/70. [D 20:42:21.413750] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.413765] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.413775] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.419140] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.419154] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.419165] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.419198] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2674 [D 20:42:21.419209] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:21.419221] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 46/70. [D 20:42:21.467054] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2660 [D 20:42:21.467072] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 47/70. [D 20:42:21.467132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 2954. [D 20:42:21.467203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 2955. [D 20:42:21.467215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 2956. [D 20:42:21.467225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 2957. [D 20:42:21.467236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 2958. [D 20:42:21.467247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 2959. [D 20:42:21.467256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 2960. [D 20:42:21.467266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 2961. [D 20:42:21.467276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 2962. [D 20:42:21.467286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 2963. [D 20:42:21.467296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 2964. [D 20:42:21.467361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 2965. [D 20:42:21.467373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 2966. [D 20:42:21.467395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 2967. [D 20:42:21.467406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 2968. [D 20:42:21.467416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 2969. [D 20:42:21.467432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 2970. [D 20:42:21.467442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 2971. [D 20:42:21.467451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 2972. [D 20:42:21.467482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 2973. [D 20:42:21.467494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 2974. [D 20:42:21.467507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 2975. [D 20:42:21.467517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 2976. [D 20:42:21.467527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 2977. [D 20:42:21.467540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 2978. [D 20:42:21.467566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 2979. [D 20:42:21.467579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 2980. [D 20:42:21.467589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 2981. [D 20:42:21.467598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 2982. [D 20:42:21.467621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 2983. [D 20:42:21.467631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 2984. [D 20:42:21.467641] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 2985. [D 20:42:21.473055] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 2985. [D 20:42:21.473071] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 48/70. [D 20:42:21.475151] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.475166] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.475177] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.529088] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2674 [D 20:42:21.529106] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 49/70. [D 20:42:21.529163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 2985. [D 20:42:21.529230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 2986. [D 20:42:21.529268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 2987. [D 20:42:21.529280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 2988. [D 20:42:21.529290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 2989. [D 20:42:21.529304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 2990. [D 20:42:21.529314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 2991. [D 20:42:21.529327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 2992. [D 20:42:21.529354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 2993. [D 20:42:21.529365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 2994. [D 20:42:21.529388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 2995. [D 20:42:21.529405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 2996. [D 20:42:21.529427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 2997. [D 20:42:21.529441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 2998. [D 20:42:21.529460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 2999. [D 20:42:21.529471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3000. [D 20:42:21.529481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3001. [D 20:42:21.529502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3002. [D 20:42:21.529514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 3003. [D 20:42:21.529524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 3004. [D 20:42:21.529548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 3005. [D 20:42:21.529558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 3006. [D 20:42:21.529582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 3007. [D 20:42:21.529592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3008. [D 20:42:21.529613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3009. [D 20:42:21.529623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3010. [D 20:42:21.529633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 3011. [D 20:42:21.529655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 3012. [D 20:42:21.529665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 3013. [D 20:42:21.529676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 3014. [D 20:42:21.529702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 3015. [D 20:42:21.529716] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3016. [D 20:42:21.535090] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3016. [D 20:42:21.535108] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 50/70. [D 20:42:21.537324] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.537339] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.537349] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:21.543322] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.543338] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.543349] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:21.543382] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2677 [D 20:42:21.543393] element 0: offset: 0x2aaaab234fe0, size: 24 [D 20:42:21.543405] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 51/70. [D 20:42:21.591022] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2666 [D 20:42:21.591040] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 52/70. [D 20:42:21.591098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3016. [D 20:42:21.591196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3017. [D 20:42:21.591210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3018. [D 20:42:21.591221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3019. [D 20:42:21.591231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3020. [D 20:42:21.591242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3021. [D 20:42:21.591253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3022. [D 20:42:21.591263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3023. [D 20:42:21.591299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3024. [D 20:42:21.591310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3025. [D 20:42:21.591332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3026. [D 20:42:21.591343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3027. [D 20:42:21.591353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3028. [D 20:42:21.591374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3029. [D 20:42:21.591387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3030. [D 20:42:21.591405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3031. [D 20:42:21.591416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3032. [D 20:42:21.591427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3033. [D 20:42:21.591450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3034. [D 20:42:21.591460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3035. [D 20:42:21.591470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3036. [D 20:42:21.591493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3037. [D 20:42:21.591503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3038. [D 20:42:21.591529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3039. [D 20:42:21.591539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3040. [D 20:42:21.591549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3041. [D 20:42:21.591954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3042. [D 20:42:21.591966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3043. [D 20:42:21.591976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3044. [D 20:42:21.591998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3045. [D 20:42:21.592009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3046. [D 20:42:21.592019] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3047. [D 20:42:21.597050] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3047. [D 20:42:21.597067] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 53/70. [D 20:42:21.599429] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.599444] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.599455] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:21.606141] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.606188] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.606198] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:21.606235] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2681 [D 20:42:21.606248] element 0: offset: 0x2aaaab218230, size: 24 [D 20:42:21.606262] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 54/70. [D 20:42:21.606285] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.606299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.606308] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.606322] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2684 [D 20:42:21.606332] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:21.606342] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 55/70. [D 20:42:21.644549] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2669 [D 20:42:21.644567] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 56/70. [D 20:42:21.644625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3047. [D 20:42:21.644704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3048. [D 20:42:21.644716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3049. [D 20:42:21.644726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3050. [D 20:42:21.644737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3051. [D 20:42:21.644793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3052. [D 20:42:21.644804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3053. [D 20:42:21.644814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3054. [D 20:42:21.644837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3055. [D 20:42:21.644847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3056. [D 20:42:21.644868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3057. [D 20:42:21.644878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3058. [D 20:42:21.644889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3059. [D 20:42:21.644913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3060. [D 20:42:21.644923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3061. [D 20:42:21.644943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3062. [D 20:42:21.644953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3063. [D 20:42:21.644975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3064. [D 20:42:21.644986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3065. [D 20:42:21.645006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3066. [D 20:42:21.645017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3067. [D 20:42:21.645027] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3068. [D 20:42:21.645037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3069. [D 20:42:21.645046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3070. [D 20:42:21.645056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3071. [D 20:42:21.645066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3072. [D 20:42:21.645084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3073. [D 20:42:21.645107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3074. [D 20:42:21.645118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3075. [D 20:42:21.645129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3076. [D 20:42:21.645138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3077. [D 20:42:21.645148] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3078. [D 20:42:21.650558] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3078. [D 20:42:21.650575] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 57/70. [D 20:42:21.652890] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.652905] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.652916] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.657940] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.657955] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.657965] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.657998] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2687 [D 20:42:21.658009] element 0: offset: 0x2aaaab225980, size: 24 [D 20:42:21.658023] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 58/70. [D 20:42:21.777226] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2677 [D 20:42:21.777246] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 59/70. [D 20:42:21.777384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 3078. [D 20:42:21.777490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 3079. [D 20:42:21.777501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 3080. [D 20:42:21.777512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 3081. [D 20:42:21.777526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 3082. [D 20:42:21.777536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 3083. [D 20:42:21.777546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 3084. [D 20:42:21.777561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3085. [D 20:42:21.777570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3086. [D 20:42:21.777580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3087. [D 20:42:21.777609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 3088. [D 20:42:21.777621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 3089. [D 20:42:21.777632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 3090. [D 20:42:21.777660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 3091. [D 20:42:21.777670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 3092. [D 20:42:21.777689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3093. [D 20:42:21.777699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3094. [D 20:42:21.777709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3095. [D 20:42:21.777732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 3096. [D 20:42:21.777742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 3097. [D 20:42:21.777752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 3098. [D 20:42:21.777779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 3099. [D 20:42:21.777789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 3100. [D 20:42:21.777804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3101. [D 20:42:21.777825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3102. [D 20:42:21.777839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3103. [D 20:42:21.777858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 3104. [D 20:42:21.777869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 3105. [D 20:42:21.777879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 3106. [D 20:42:21.777903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 3107. [D 20:42:21.777913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 3108. [D 20:42:21.777923] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3109. [D 20:42:21.783349] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3109. [D 20:42:21.783367] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 60/70. [D 20:42:21.785684] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.785699] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.785709] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.791560] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.791575] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.791585] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.791619] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2689 [D 20:42:21.791630] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:21.791642] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 0/70. [D 20:42:21.844117] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2681 [D 20:42:21.844135] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 1/70. [D 20:42:21.844194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3109. [D 20:42:21.844260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3110. [D 20:42:21.844280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3111. [D 20:42:21.844290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3112. [D 20:42:21.844300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3113. [D 20:42:21.844310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3114. [D 20:42:21.844325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3115. [D 20:42:21.844335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3116. [D 20:42:21.844344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3117. [D 20:42:21.844360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3118. [D 20:42:21.844408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3119. [D 20:42:21.844418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3120. [D 20:42:21.844428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3121. [D 20:42:21.844452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3122. [D 20:42:21.844462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3123. [D 20:42:21.844472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3124. [D 20:42:21.844486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3125. [D 20:42:21.844496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3126. [D 20:42:21.844506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3127. [D 20:42:21.844534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3128. [D 20:42:21.844544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3129. [D 20:42:21.844554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3130. [D 20:42:21.844564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3131. [D 20:42:21.844574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3132. [D 20:42:21.844584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3133. [D 20:42:21.844609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3134. [D 20:42:21.844624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3135. [D 20:42:21.844635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3136. [D 20:42:21.844645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3137. [D 20:42:21.844667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3138. [D 20:42:21.844678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3139. [D 20:42:21.844688] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3140. [D 20:42:21.850120] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3140. [D 20:42:21.850137] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 2/70. [D 20:42:21.852398] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:21.852412] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.852424] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:21.858613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:21.858627] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:21.858637] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:21.858669] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2693 [D 20:42:21.858680] element 0: offset: 0x2aaaab225ec0, size: 24 [D 20:42:21.858692] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 3/70. [D 20:42:22.135928] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2684 [D 20:42:22.135947] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 4/70. [D 20:42:22.136066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3140. [D 20:42:22.136144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3141. [D 20:42:22.136156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3142. [D 20:42:22.136166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3143. [D 20:42:22.136177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3144. [D 20:42:22.136187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3145. [D 20:42:22.136196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3146. [D 20:42:22.136206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3147. [D 20:42:22.136216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3148. [D 20:42:22.136226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3149. [D 20:42:22.136235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3150. [D 20:42:22.136314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3151. [D 20:42:22.136339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3152. [D 20:42:22.136349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3153. [D 20:42:22.136359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3154. [D 20:42:22.136369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3155. [D 20:42:22.136385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3156. [D 20:42:22.136394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3157. [D 20:42:22.136404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3158. [D 20:42:22.136420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3159. [D 20:42:22.136429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3160. [D 20:42:22.136439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3161. [D 20:42:22.136449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3162. [D 20:42:22.136459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3163. [D 20:42:22.136469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3164. [D 20:42:22.136479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3165. [D 20:42:22.136489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3166. [D 20:42:22.136499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3167. [D 20:42:22.136508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3168. [D 20:42:22.136518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3169. [D 20:42:22.136544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3170. [D 20:42:22.136554] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3171. [D 20:42:22.142002] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3171. [D 20:42:22.142019] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 5/70. [D 20:42:22.144296] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.144312] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.144321] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.149731] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.149746] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.149757] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.149789] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2696 [D 20:42:22.149800] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:22.149812] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 6/70. [D 20:42:22.159760] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2687 [D 20:42:22.159778] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 7/70. [D 20:42:22.159824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3171. [D 20:42:22.159855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3172. [D 20:42:22.159866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3173. [D 20:42:22.159876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3174. [D 20:42:22.159887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3175. [D 20:42:22.159897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3176. [D 20:42:22.159906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3177. [D 20:42:22.159923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3178. [D 20:42:22.159933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3179. [D 20:42:22.159942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3180. [D 20:42:22.159952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3181. [D 20:42:22.159968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3182. [D 20:42:22.159978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3183. [D 20:42:22.159988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3184. [D 20:42:22.160029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3185. [D 20:42:22.160040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3186. [D 20:42:22.160050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3187. [D 20:42:22.160065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3188. [D 20:42:22.160089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3189. [D 20:42:22.160100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3190. [D 20:42:22.160110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3191. [D 20:42:22.160119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3192. [D 20:42:22.160142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3193. [D 20:42:22.160152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3194. [D 20:42:22.160162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3195. [D 20:42:22.160177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3196. [D 20:42:22.160187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3197. [D 20:42:22.160196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3198. [D 20:42:22.160215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3199. [D 20:42:22.160225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3200. [D 20:42:22.160235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3201. [D 20:42:22.160244] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3202. [D 20:42:22.165712] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3202. [D 20:42:22.165729] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 8/70. [D 20:42:22.168000] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.168014] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.168024] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.171205] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.171219] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.171229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.171251] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2699 [D 20:42:22.171261] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:22.173345] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 9/70. [D 20:42:22.238554] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2689 [D 20:42:22.238572] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 10/70. [D 20:42:22.238632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 3202. [D 20:42:22.238701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 3203. [D 20:42:22.238750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 3204. [D 20:42:22.238761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 3205. [D 20:42:22.238771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 3206. [D 20:42:22.238782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 3207. [D 20:42:22.238791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 3208. [D 20:42:22.238801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3209. [D 20:42:22.238826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3210. [D 20:42:22.238836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3211. [D 20:42:22.238846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 3212. [D 20:42:22.238862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 3213. [D 20:42:22.238872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 3214. [D 20:42:22.238881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 3215. [D 20:42:22.238891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 3216. [D 20:42:22.238914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3217. [D 20:42:22.238924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3218. [D 20:42:22.238934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3219. [D 20:42:22.238956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 3220. [D 20:42:22.238966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 3221. [D 20:42:22.238976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 3222. [D 20:42:22.238998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 3223. [D 20:42:22.239008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 3224. [D 20:42:22.239023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3225. [D 20:42:22.239033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3226. [D 20:42:22.239042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3227. [D 20:42:22.239070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 3228. [D 20:42:22.239080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 3229. [D 20:42:22.239093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 3230. [D 20:42:22.239103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 3231. [D 20:42:22.239127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 3232. [D 20:42:22.239137] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3233. [D 20:42:22.244561] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3233. [D 20:42:22.244579] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 11/70. [D 20:42:22.246901] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.246916] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.246926] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.252344] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.252360] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.252370] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.252403] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2701 [D 20:42:22.252414] element 0: offset: 0x2aaaab218230, size: 24 [D 20:42:22.252427] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 12/70. [D 20:42:22.330676] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2696 [D 20:42:22.330694] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 13/70. [D 20:42:22.330787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3233. [D 20:42:22.330897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3234. [D 20:42:22.330909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3235. [D 20:42:22.330919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3236. [D 20:42:22.330930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3237. [D 20:42:22.330940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3238. [D 20:42:22.330949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3239. [D 20:42:22.330959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3240. [D 20:42:22.330969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3241. [D 20:42:22.330979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3242. [D 20:42:22.330989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3243. [D 20:42:22.331021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3244. [D 20:42:22.331031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3245. [D 20:42:22.331058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3246. [D 20:42:22.331067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3247. [D 20:42:22.331080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3248. [D 20:42:22.331104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3249. [D 20:42:22.331117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3250. [D 20:42:22.331127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3251. [D 20:42:22.331136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3252. [D 20:42:22.331161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3253. [D 20:42:22.331170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3254. [D 20:42:22.331185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3255. [D 20:42:22.331211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3256. [D 20:42:22.331222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3257. [D 20:42:22.331231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3258. [D 20:42:22.331258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3259. [D 20:42:22.331267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3260. [D 20:42:22.331291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3261. [D 20:42:22.331301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3262. [D 20:42:22.331322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3263. [D 20:42:22.331332] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3264. [D 20:42:22.336752] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3264. [D 20:42:22.336768] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 14/70. [D 20:42:22.339093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.339108] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.339118] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.340874] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2693 [D 20:42:22.340893] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 15/70. [D 20:42:22.341939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3264. [D 20:42:22.341959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3265. [D 20:42:22.341970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3266. [D 20:42:22.341980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3267. [D 20:42:22.341992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3268. [D 20:42:22.342007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3269. [D 20:42:22.342017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3270. [D 20:42:22.342026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3271. [D 20:42:22.342037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3272. [D 20:42:22.342046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3273. [D 20:42:22.342056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3274. [D 20:42:22.342066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3275. [D 20:42:22.342089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3276. [D 20:42:22.342098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3277. [D 20:42:22.342108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3278. [D 20:42:22.342122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3279. [D 20:42:22.342131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3280. [D 20:42:22.342141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3281. [D 20:42:22.342151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3282. [D 20:42:22.342175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3283. [D 20:42:22.342185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3284. [D 20:42:22.342194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3285. [D 20:42:22.342205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3286. [D 20:42:22.342214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3287. [D 20:42:22.342224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3288. [D 20:42:22.342248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3289. [D 20:42:22.342258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3290. [D 20:42:22.342268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3291. [D 20:42:22.342278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3292. [D 20:42:22.342288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3293. [D 20:42:22.342298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3294. [D 20:42:22.342307] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3295. [D 20:42:22.344698] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.344712] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.344722] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.344755] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2705 [D 20:42:22.344766] element 0: offset: 0x2aaaab203630, size: 24 [D 20:42:22.344778] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 16/70. [D 20:42:22.347828] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3295. [D 20:42:22.347843] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 17/70. [D 20:42:22.350220] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.350235] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.350244] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.356474] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.356504] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.356514] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.356543] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2708 [D 20:42:22.356554] element 0: offset: 0x2aaaab210aa0, size: 24 [D 20:42:22.356567] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 18/70. [D 20:42:22.407383] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2699 [D 20:42:22.407402] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 19/70. [D 20:42:22.407460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3295. [D 20:42:22.407540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3296. [D 20:42:22.407551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3297. [D 20:42:22.407561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3298. [D 20:42:22.407576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3299. [D 20:42:22.407586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3300. [D 20:42:22.407596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3301. [D 20:42:22.407610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3302. [D 20:42:22.407620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3303. [D 20:42:22.407630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3304. [D 20:42:22.407645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3305. [D 20:42:22.407660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3306. [D 20:42:22.407670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3307. [D 20:42:22.407679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3308. [D 20:42:22.407695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3309. [D 20:42:22.407704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3310. [D 20:42:22.407714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3311. [D 20:42:22.407724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3312. [D 20:42:22.407741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3313. [D 20:42:22.407751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3314. [D 20:42:22.407761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3315. [D 20:42:22.407771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3316. [D 20:42:22.407782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3317. [D 20:42:22.407791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3318. [D 20:42:22.407801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3319. [D 20:42:22.407855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3320. [D 20:42:22.407866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3321. [D 20:42:22.407876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3322. [D 20:42:22.407900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3323. [D 20:42:22.407910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3324. [D 20:42:22.407921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3325. [D 20:42:22.407930] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3326. [D 20:42:22.413396] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3326. [D 20:42:22.413414] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 20/70. [D 20:42:22.415228] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.415245] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.415254] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.418808] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.418822] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.418830] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.418857] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2711 [D 20:42:22.418867] element 0: offset: 0x2aaaab2347d0, size: 24 [D 20:42:22.418878] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 21/70. [D 20:42:22.491333] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2708 [D 20:42:22.491351] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 22/70. [D 20:42:22.491469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3326. [D 20:42:22.491579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3327. [D 20:42:22.491590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3328. [D 20:42:22.491601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3329. [D 20:42:22.491615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3330. [D 20:42:22.491625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3331. [D 20:42:22.491635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3332. [D 20:42:22.491649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3333. [D 20:42:22.491659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3334. [D 20:42:22.491668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3335. [D 20:42:22.491699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3336. [D 20:42:22.491710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3337. [D 20:42:22.491724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3338. [D 20:42:22.491738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3339. [D 20:42:22.491748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3340. [D 20:42:22.491758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3341. [D 20:42:22.491780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3342. [D 20:42:22.491790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3343. [D 20:42:22.491815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3344. [D 20:42:22.491826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3345. [D 20:42:22.491840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3346. [D 20:42:22.491862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3347. [D 20:42:22.491875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3348. [D 20:42:22.491885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3349. [D 20:42:22.491895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3350. [D 20:42:22.491907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3351. [D 20:42:22.491923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3352. [D 20:42:22.491933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3353. [D 20:42:22.491943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3354. [D 20:42:22.491952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3355. [D 20:42:22.491980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3356. [D 20:42:22.491990] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3357. [D 20:42:22.497432] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3357. [D 20:42:22.497448] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 23/70. [D 20:42:22.497517] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.497532] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.497540] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.503932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.503946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.503954] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.503972] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2714 [D 20:42:22.503982] element 0: offset: 0x2aaaab2302e0, size: 24 [D 20:42:22.503992] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 24/70. [D 20:42:22.576021] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2711 [D 20:42:22.576038] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 25/70. [D 20:42:22.576154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3357. [D 20:42:22.576263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3358. [D 20:42:22.576274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3359. [D 20:42:22.576285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3360. [D 20:42:22.576295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3361. [D 20:42:22.576306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3362. [D 20:42:22.576316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3363. [D 20:42:22.576326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3364. [D 20:42:22.576335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3365. [D 20:42:22.576345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3366. [D 20:42:22.576354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3367. [D 20:42:22.576386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3368. [D 20:42:22.576396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3369. [D 20:42:22.576410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3370. [D 20:42:22.576420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3371. [D 20:42:22.576430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3372. [D 20:42:22.576439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3373. [D 20:42:22.576469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3374. [D 20:42:22.576479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3375. [D 20:42:22.576493] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3376. [D 20:42:22.576503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3377. [D 20:42:22.576512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3378. [D 20:42:22.576534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3379. [D 20:42:22.576544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3380. [D 20:42:22.576554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3381. [D 20:42:22.576565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3382. [D 20:42:22.576575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3383. [D 20:42:22.576585] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3384. [D 20:42:22.576611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3385. [D 20:42:22.576626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3386. [D 20:42:22.576637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3387. [D 20:42:22.576647] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3388. [D 20:42:22.582119] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3388. [D 20:42:22.582137] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 26/70. [D 20:42:22.582201] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.582216] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.582224] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.587593] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.587606] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.587615] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.587631] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2717 [D 20:42:22.587640] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:22.587650] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 27/70. [D 20:42:22.665079] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2714 [D 20:42:22.665096] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 28/70. [D 20:42:22.665194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3388. [D 20:42:22.665304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3389. [D 20:42:22.665316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3390. [D 20:42:22.665326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3391. [D 20:42:22.665341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3392. [D 20:42:22.665351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3393. [D 20:42:22.665361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3394. [D 20:42:22.665375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3395. [D 20:42:22.665385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3396. [D 20:42:22.665394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3397. [D 20:42:22.665424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3398. [D 20:42:22.665437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3399. [D 20:42:22.665466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3400. [D 20:42:22.665477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3401. [D 20:42:22.665487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3402. [D 20:42:22.665497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3403. [D 20:42:22.665506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3404. [D 20:42:22.665517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3405. [D 20:42:22.665541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3406. [D 20:42:22.665551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3407. [D 20:42:22.665571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3408. [D 20:42:22.665581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3409. [D 20:42:22.665591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3410. [D 20:42:22.665606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3411. [D 20:42:22.665615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3412. [D 20:42:22.665625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3413. [D 20:42:22.665653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3414. [D 20:42:22.665664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3415. [D 20:42:22.665685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3416. [D 20:42:22.665695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3417. [D 20:42:22.665709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3418. [D 20:42:22.665719] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3419. [D 20:42:22.671162] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3419. [D 20:42:22.671178] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 29/70. [D 20:42:22.671234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.671249] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.671258] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.677745] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.677759] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.677767] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.677783] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2720 [D 20:42:22.677792] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:22.677803] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 30/70. [D 20:42:22.706874] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2717 [D 20:42:22.706891] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 31/70. [D 20:42:22.706951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3419. [D 20:42:22.707060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3420. [D 20:42:22.707074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3421. [D 20:42:22.707085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3422. [D 20:42:22.707095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3423. [D 20:42:22.707106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3424. [D 20:42:22.707115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3425. [D 20:42:22.707138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3426. [D 20:42:22.707153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3427. [D 20:42:22.707163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3428. [D 20:42:22.707173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3429. [D 20:42:22.707198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3430. [D 20:42:22.707208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3431. [D 20:42:22.707217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3432. [D 20:42:22.707248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3433. [D 20:42:22.707258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3434. [D 20:42:22.707278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3435. [D 20:42:22.707288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3436. [D 20:42:22.707297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3437. [D 20:42:22.707307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3438. [D 20:42:22.707330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3439. [D 20:42:22.707340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3440. [D 20:42:22.707350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3441. [D 20:42:22.707372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3442. [D 20:42:22.707413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3443. [D 20:42:22.707424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3444. [D 20:42:22.707437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3445. [D 20:42:22.707447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3446. [D 20:42:22.707456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3447. [D 20:42:22.707481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3448. [D 20:42:22.707490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3449. [D 20:42:22.707505] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3450. [D 20:42:22.712919] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3450. [D 20:42:22.712935] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 32/70. [D 20:42:22.712998] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.713013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.713021] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.718418] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.718432] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.718440] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.718456] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2723 [D 20:42:22.718465] element 0: offset: 0x2aaaab2185e0, size: 24 [D 20:42:22.718477] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 33/70. [D 20:42:22.736249] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2701 [D 20:42:22.736265] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 34/70. [D 20:42:22.736325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 3450. [D 20:42:22.736391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 3451. [D 20:42:22.736439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 3452. [D 20:42:22.736451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 3453. [D 20:42:22.736461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 3454. [D 20:42:22.736476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 3455. [D 20:42:22.736487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 3456. [D 20:42:22.736512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3457. [D 20:42:22.736522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3458. [D 20:42:22.736532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3459. [D 20:42:22.736542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 3460. [D 20:42:22.736553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 3461. [D 20:42:22.736563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 3462. [D 20:42:22.736573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 3463. [D 20:42:22.736582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 3464. [D 20:42:22.736607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3465. [D 20:42:22.736617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3466. [D 20:42:22.736637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3467. [D 20:42:22.736647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 3468. [D 20:42:22.736657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 3469. [D 20:42:22.736685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 3470. [D 20:42:22.736695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 3471. [D 20:42:22.736709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 3472. [D 20:42:22.736719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3473. [D 20:42:22.736729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3474. [D 20:42:22.736755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3475. [D 20:42:22.736764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 3476. [D 20:42:22.736779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 3477. [D 20:42:22.736800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 3478. [D 20:42:22.736811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 3479. [D 20:42:22.736821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 3480. [D 20:42:22.736831] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3481. [D 20:42:22.742250] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3481. [D 20:42:22.742267] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 35/70. [D 20:42:22.742332] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.742347] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.742355] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.748013] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.748027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.748035] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.748051] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2725 [D 20:42:22.748060] element 0: offset: 0x2aaaab225ec0, size: 24 [D 20:42:22.748070] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 36/70. [D 20:42:22.762239] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2705 [D 20:42:22.762255] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 37/70. [D 20:42:22.762317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3481. [D 20:42:22.762389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3482. [D 20:42:22.762400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3483. [D 20:42:22.762410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3484. [D 20:42:22.762422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3485. [D 20:42:22.762431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3486. [D 20:42:22.762442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3487. [D 20:42:22.762453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3488. [D 20:42:22.762462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3489. [D 20:42:22.762472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3490. [D 20:42:22.762488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3491. [D 20:42:22.762498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3492. [D 20:42:22.762542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3493. [D 20:42:22.762554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3494. [D 20:42:22.762564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3495. [D 20:42:22.762580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3496. [D 20:42:22.762605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3497. [D 20:42:22.762620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3498. [D 20:42:22.762643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3499. [D 20:42:22.762656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3500. [D 20:42:22.762666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3501. [D 20:42:22.762676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3502. [D 20:42:22.762689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3503. [D 20:42:22.762714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3504. [D 20:42:22.762728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3505. [D 20:42:22.762738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3506. [D 20:42:22.762747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3507. [D 20:42:22.762773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3508. [D 20:42:22.762784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3509. [D 20:42:22.762797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3510. [D 20:42:22.762806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3511. [D 20:42:22.762816] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3512. [D 20:42:22.768245] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3512. [D 20:42:22.768261] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 38/70. [D 20:42:22.768327] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.768342] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.768350] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.773922] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.773935] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.773943] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.773959] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2729 [D 20:42:22.773968] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:22.773979] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 39/70. [D 20:42:22.824197] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2729 [D 20:42:22.824214] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 40/70. [D 20:42:22.824269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3512. [D 20:42:22.824336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3513. [D 20:42:22.824355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3514. [D 20:42:22.824366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3515. [D 20:42:22.824377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3516. [D 20:42:22.824387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3517. [D 20:42:22.824403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3518. [D 20:42:22.824412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3519. [D 20:42:22.824422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3520. [D 20:42:22.824438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3521. [D 20:42:22.824488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3522. [D 20:42:22.824499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3523. [D 20:42:22.824509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3524. [D 20:42:22.824535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3525. [D 20:42:22.824545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3526. [D 20:42:22.824554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3527. [D 20:42:22.824569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3528. [D 20:42:22.824579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3529. [D 20:42:22.824589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3530. [D 20:42:22.824616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3531. [D 20:42:22.824625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3532. [D 20:42:22.824635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3533. [D 20:42:22.824651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3534. [D 20:42:22.824661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3535. [D 20:42:22.824686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3536. [D 20:42:22.824697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3537. [D 20:42:22.824707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3538. [D 20:42:22.824722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3539. [D 20:42:22.824731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3540. [D 20:42:22.824741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3541. [D 20:42:22.824771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3542. [D 20:42:22.824781] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3543. [D 20:42:22.830277] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3543. [D 20:42:22.830293] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 41/70. [D 20:42:22.830360] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.830375] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.830383] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.836095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.836109] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.836117] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.836133] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2732 [D 20:42:22.836142] element 0: offset: 0x2aaaab216880, size: 24 [D 20:42:22.836152] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 42/70. [D 20:42:22.897044] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2720 [D 20:42:22.897061] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 43/70. [D 20:42:22.897120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3543. [D 20:42:22.897189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3544. [D 20:42:22.897210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3545. [D 20:42:22.897223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3546. [D 20:42:22.897234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3547. [D 20:42:22.897244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3548. [D 20:42:22.897254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3549. [D 20:42:22.897263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3550. [D 20:42:22.897273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3551. [D 20:42:22.897288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3552. [D 20:42:22.897337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3553. [D 20:42:22.897348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3554. [D 20:42:22.897371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3555. [D 20:42:22.897385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3556. [D 20:42:22.897395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3557. [D 20:42:22.897405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3558. [D 20:42:22.897433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3559. [D 20:42:22.897442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3560. [D 20:42:22.897454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3561. [D 20:42:22.897464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3562. [D 20:42:22.897474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3563. [D 20:42:22.897491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3564. [D 20:42:22.897501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3565. [D 20:42:22.897511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3566. [D 20:42:22.897520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3567. [D 20:42:22.897537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3568. [D 20:42:22.897560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3569. [D 20:42:22.897571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3570. [D 20:42:22.897581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3571. [D 20:42:22.897591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3572. [D 20:42:22.897601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3573. [D 20:42:22.897611] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3574. [D 20:42:22.903047] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3574. [D 20:42:22.903064] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 44/70. [D 20:42:22.903128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.903143] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.903151] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.909651] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.909665] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.909673] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.909688] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2735 [D 20:42:22.909697] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:22.909707] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 45/70. [D 20:42:22.973041] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2723 [D 20:42:22.973057] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 46/70. [D 20:42:22.973114] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3574. [D 20:42:22.973220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3575. [D 20:42:22.973234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3576. [D 20:42:22.973245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3577. [D 20:42:22.973255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3578. [D 20:42:22.973266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3579. [D 20:42:22.973276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3580. [D 20:42:22.973285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3581. [D 20:42:22.973295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3582. [D 20:42:22.973305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3583. [D 20:42:22.973323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3584. [D 20:42:22.973333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3585. [D 20:42:22.973342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3586. [D 20:42:22.973366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3587. [D 20:42:22.973376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3588. [D 20:42:22.973386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3589. [D 20:42:22.973409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3590. [D 20:42:22.973418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3591. [D 20:42:22.973428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3592. [D 20:42:22.973438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3593. [D 20:42:22.973449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3594. [D 20:42:22.973459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3595. [D 20:42:22.973484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3596. [D 20:42:22.973494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3597. [D 20:42:22.973504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3598. [D 20:42:22.973514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3599. [D 20:42:22.973524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3600. [D 20:42:22.973547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3601. [D 20:42:22.973562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3602. [D 20:42:22.973572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3603. [D 20:42:22.973582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3604. [D 20:42:22.973591] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3605. [D 20:42:22.979039] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3605. [D 20:42:22.979056] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 47/70. [D 20:42:22.979120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:22.979135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.979143] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:22.984600] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:22.984614] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:22.984622] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:22.984638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2738 [D 20:42:22.984647] element 0: offset: 0x2aaaab235240, size: 24 [D 20:42:22.984657] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 48/70. [D 20:42:23.067599] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2725 [D 20:42:23.067616] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 49/70. [D 20:42:23.067733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 3605. [D 20:42:23.067834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 3606. [D 20:42:23.067846] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 3607. [D 20:42:23.067856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 3608. [D 20:42:23.067871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 3609. [D 20:42:23.067880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 3610. [D 20:42:23.067890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 3611. [D 20:42:23.067906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3612. [D 20:42:23.067915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3613. [D 20:42:23.067925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3614. [D 20:42:23.067955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 3615. [D 20:42:23.067965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 3616. [D 20:42:23.067992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 3617. [D 20:42:23.068008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 3618. [D 20:42:23.068030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 3619. [D 20:42:23.068045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3620. [D 20:42:23.068055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3621. [D 20:42:23.068077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3622. [D 20:42:23.068088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 3623. [D 20:42:23.068098] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 3624. [D 20:42:23.068124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 3625. [D 20:42:23.068134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 3626. [D 20:42:23.068158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 3627. [D 20:42:23.068169] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3628. [D 20:42:23.068194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3629. [D 20:42:23.068204] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3630. [D 20:42:23.068226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 3631. [D 20:42:23.068236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 3632. [D 20:42:23.068246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 3633. [D 20:42:23.068256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 3634. [D 20:42:23.068266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 3635. [D 20:42:23.068276] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3636. [D 20:42:23.073689] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3636. [D 20:42:23.073706] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 50/70. [D 20:42:23.073769] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.073784] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.073792] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.079681] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.079695] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.079703] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.079719] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2740 [D 20:42:23.079728] element 0: offset: 0x2aaaab225a40, size: 24 [D 20:42:23.079738] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 51/70. [D 20:42:23.139186] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2740 [D 20:42:23.139203] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 52/70. [D 20:42:23.139260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 3636. [D 20:42:23.139329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 3637. [D 20:42:23.139381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 3638. [D 20:42:23.139393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 3639. [D 20:42:23.139404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 3640. [D 20:42:23.139414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 3641. [D 20:42:23.139424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 3642. [D 20:42:23.139433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 3643. [D 20:42:23.139458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 3644. [D 20:42:23.139468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 3645. [D 20:42:23.139477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 3646. [D 20:42:23.139488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 3647. [D 20:42:23.139497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 3648. [D 20:42:23.139508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 3649. [D 20:42:23.139518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 3650. [D 20:42:23.139528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 3651. [D 20:42:23.139554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 3652. [D 20:42:23.139564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 3653. [D 20:42:23.139586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 3654. [D 20:42:23.139596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 3655. [D 20:42:23.139606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 3656. [D 20:42:23.139633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 3657. [D 20:42:23.139643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 3658. [D 20:42:23.139656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 3659. [D 20:42:23.139666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 3660. [D 20:42:23.139675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 3661. [D 20:42:23.139701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 3662. [D 20:42:23.139711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 3663. [D 20:42:23.139725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 3664. [D 20:42:23.139753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 3665. [D 20:42:23.139763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 3666. [D 20:42:23.139773] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 3667. [D 20:42:23.145230] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3667. [D 20:42:23.145247] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 53/70. [D 20:42:23.145310] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.145325] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.145333] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.205820] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2732 [D 20:42:23.205837] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 54/70. [D 20:42:23.205900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3667. [D 20:42:23.206007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3668. [D 20:42:23.206021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3669. [D 20:42:23.206031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3670. [D 20:42:23.206042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3671. [D 20:42:23.206053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3672. [D 20:42:23.206063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3673. [D 20:42:23.206072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3674. [D 20:42:23.206083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3675. [D 20:42:23.206107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3676. [D 20:42:23.206118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3677. [D 20:42:23.206144] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3678. [D 20:42:23.206154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3679. [D 20:42:23.206167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3680. [D 20:42:23.206177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3681. [D 20:42:23.206187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3682. [D 20:42:23.206197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3683. [D 20:42:23.206225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3684. [D 20:42:23.206236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3685. [D 20:42:23.206260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3686. [D 20:42:23.206270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3687. [D 20:42:23.206283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3688. [D 20:42:23.206302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3689. [D 20:42:23.206317] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3690. [D 20:42:23.206327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3691. [D 20:42:23.206349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3692. [D 20:42:23.206360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3693. [D 20:42:23.206370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3694. [D 20:42:23.206399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3695. [D 20:42:23.206410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3696. [D 20:42:23.206422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3697. [D 20:42:23.206432] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3698. [D 20:42:23.211872] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3698. [D 20:42:23.211890] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 55/70. [D 20:42:23.211957] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.211972] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.211980] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:23.218276] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.218290] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.218298] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:23.218314] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2744 [D 20:42:23.218323] element 0: offset: 0x2aaaab218230, size: 24 [D 20:42:23.218334] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 56/70. [D 20:42:23.257998] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2735 [D 20:42:23.258015] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 57/70. [D 20:42:23.258076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 3698. [D 20:42:23.258146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 3699. [D 20:42:23.258202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 3700. [D 20:42:23.258213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 3701. [D 20:42:23.258224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 3702. [D 20:42:23.258234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 3703. [D 20:42:23.258244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 3704. [D 20:42:23.258254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 3705. [D 20:42:23.258264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 3706. [D 20:42:23.258274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 3707. [D 20:42:23.258291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 3708. [D 20:42:23.258301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 3709. [D 20:42:23.258323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 3710. [D 20:42:23.258335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 3711. [D 20:42:23.258345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 3712. [D 20:42:23.258355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 3713. [D 20:42:23.258377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 3714. [D 20:42:23.258386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 3715. [D 20:42:23.258397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 3716. [D 20:42:23.258407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 3717. [D 20:42:23.258417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 3718. [D 20:42:23.258427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 3719. [D 20:42:23.258452] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 3720. [D 20:42:23.258461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 3721. [D 20:42:23.258472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 3722. [D 20:42:23.258482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 3723. [D 20:42:23.258491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 3724. [D 20:42:23.258514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 3725. [D 20:42:23.258524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 3726. [D 20:42:23.258534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 3727. [D 20:42:23.258554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 3728. [D 20:42:23.258564] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 3729. [D 20:42:23.264011] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3729. [D 20:42:23.264028] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 58/70. [D 20:42:23.264095] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.264110] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.264118] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:23.282932] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.282945] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.282954] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:23.282970] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2746 [D 20:42:23.282979] element 0: offset: 0x2aaaab203630, size: 24 [D 20:42:23.282989] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 59/70. [D 20:42:23.325408] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2738 [D 20:42:23.325425] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 60/70. [D 20:42:23.325485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3729. [D 20:42:23.325584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3730. [D 20:42:23.325598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3731. [D 20:42:23.325610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3732. [D 20:42:23.325620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3733. [D 20:42:23.325630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3734. [D 20:42:23.325641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3735. [D 20:42:23.325650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3736. [D 20:42:23.325683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3737. [D 20:42:23.325693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3738. [D 20:42:23.325703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3739. [D 20:42:23.325727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3740. [D 20:42:23.325738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3741. [D 20:42:23.325760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3742. [D 20:42:23.325770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3743. [D 20:42:23.325781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3744. [D 20:42:23.325803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3745. [D 20:42:23.325812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3746. [D 20:42:23.325834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3747. [D 20:42:23.325845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3748. [D 20:42:23.325855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3749. [D 20:42:23.325874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3750. [D 20:42:23.325885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3751. [D 20:42:23.325908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 3752. [D 20:42:23.325919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 3753. [D 20:42:23.325929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 3754. [D 20:42:23.325949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 3755. [D 20:42:23.325964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 3756. [D 20:42:23.325985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 3757. [D 20:42:23.325999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 3758. [D 20:42:23.326009] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 3759. [D 20:42:23.326031] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 3760. [D 20:42:23.331442] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3760. [D 20:42:23.331458] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 0/70. [D 20:42:23.331526] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.331541] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.331550] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:23.337198] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.337212] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.337220] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:23.337236] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2750 [D 20:42:23.337245] element 0: offset: 0x2aaaab21ce10, size: 24 [D 20:42:23.337255] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 1/70. [D 20:42:23.396406] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.396420] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.396429] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.396445] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2753 [D 20:42:23.396454] element 0: offset: 0x2aaaab235a00, size: 24 [D 20:42:23.396464] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 2/70. [D 20:42:23.399733] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2746 [D 20:42:23.399750] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 3/70. [D 20:42:23.399808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3760. [D 20:42:23.399889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3761. [D 20:42:23.399901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 3762. [D 20:42:23.399911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 3763. [D 20:42:23.399922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 3764. [D 20:42:23.399932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 3765. [D 20:42:23.399947] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 3766. [D 20:42:23.399957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3767. [D 20:42:23.399967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3768. [D 20:42:23.399999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3769. [D 20:42:23.400031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 3770. [D 20:42:23.400043] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 3771. [D 20:42:23.400053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 3772. [D 20:42:23.400063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 3773. [D 20:42:23.400073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 3774. [D 20:42:23.400084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3775. [D 20:42:23.400096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3776. [D 20:42:23.400124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3777. [D 20:42:23.400151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 3778. [D 20:42:23.400162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 3779. [D 20:42:23.400171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 3780. [D 20:42:23.400186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 3781. [D 20:42:23.400196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 3782. [D 20:42:23.400206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3783. [D 20:42:23.400230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3784. [D 20:42:23.400241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3785. [D 20:42:23.400251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 3786. [D 20:42:23.400273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 3787. [D 20:42:23.400283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 3788. [D 20:42:23.400293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 3789. [D 20:42:23.400303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 3790. [D 20:42:23.400327] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3791. [D 20:42:23.410737] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3791. [D 20:42:23.410760] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 4/70. [D 20:42:23.410863] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.410879] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.410888] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.416421] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.416435] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.416443] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.416459] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2755 [D 20:42:23.416468] element 0: offset: 0x2aaaab225a40, size: 24 [D 20:42:23.416478] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 5/70. [D 20:42:23.431276] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2744 [D 20:42:23.431296] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 6/70. [D 20:42:23.431363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 3791. [D 20:42:23.431430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 3792. [D 20:42:23.431478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 3793. [D 20:42:23.431488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 3794. [D 20:42:23.431499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 3795. [D 20:42:23.431516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 3796. [D 20:42:23.431526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3797. [D 20:42:23.431554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3798. [D 20:42:23.431564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3799. [D 20:42:23.431574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 3800. [D 20:42:23.431602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 3801. [D 20:42:23.431612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 3802. [D 20:42:23.431625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 3803. [D 20:42:23.431646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 3804. [D 20:42:23.431661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3805. [D 20:42:23.431681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3806. [D 20:42:23.431695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3807. [D 20:42:23.431704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 3808. [D 20:42:23.431728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 3809. [D 20:42:23.431738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 3810. [D 20:42:23.431748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 3811. [D 20:42:23.431760] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 3812. [D 20:42:23.431776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3813. [D 20:42:23.431799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3814. [D 20:42:23.431809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3815. [D 20:42:23.431819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 3816. [D 20:42:23.431829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 3817. [D 20:42:23.431839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 3818. [D 20:42:23.431856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 3819. [D 20:42:23.431878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 3820. [D 20:42:23.431889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3821. [D 20:42:23.431910] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3822. [D 20:42:23.437287] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3822. [D 20:42:23.437304] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 7/70. [D 20:42:23.437371] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.437385] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.437394] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.443739] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.443752] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.443761] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.443776] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2759 [D 20:42:23.443786] element 0: offset: 0x2aaaab209460, size: 24 [D 20:42:23.443796] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 8/70. [D 20:42:23.505058] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2759 [D 20:42:23.505075] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 9/70. [D 20:42:23.505136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 3822. [D 20:42:23.505202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 3823. [D 20:42:23.505256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 3824. [D 20:42:23.505267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 3825. [D 20:42:23.505278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 3826. [D 20:42:23.505288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 3827. [D 20:42:23.505298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3828. [D 20:42:23.505323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3829. [D 20:42:23.505337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3830. [D 20:42:23.505347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 3831. [D 20:42:23.505357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 3832. [D 20:42:23.505383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 3833. [D 20:42:23.505393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 3834. [D 20:42:23.505418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 3835. [D 20:42:23.505428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3836. [D 20:42:23.505441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3837. [D 20:42:23.505462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3838. [D 20:42:23.505475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 3839. [D 20:42:23.505485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 3840. [D 20:42:23.505508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 3841. [D 20:42:23.505518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 3842. [D 20:42:23.505527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 3843. [D 20:42:23.505551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3844. [D 20:42:23.505561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3845. [D 20:42:23.505587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3846. [D 20:42:23.505601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 3847. [D 20:42:23.505624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 3848. [D 20:42:23.505635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 3849. [D 20:42:23.505646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 3850. [D 20:42:23.505655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 3851. [D 20:42:23.505680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3852. [D 20:42:23.505690] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3853. [D 20:42:23.511113] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3853. [D 20:42:23.511134] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 10/70. [D 20:42:23.511198] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.511213] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.511221] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.517483] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.517497] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.517505] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.517521] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2762 [D 20:42:23.517530] element 0: offset: 0x2aaaab216880, size: 24 [D 20:42:23.517543] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 11/70. [D 20:42:23.559676] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2755 [D 20:42:23.559692] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 12/70. [D 20:42:23.559749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3853. [D 20:42:23.559828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3854. [D 20:42:23.559839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 3855. [D 20:42:23.559849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 3856. [D 20:42:23.559861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 3857. [D 20:42:23.559870] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 3858. [D 20:42:23.559886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 3859. [D 20:42:23.559896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3860. [D 20:42:23.559906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3861. [D 20:42:23.559921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3862. [D 20:42:23.559973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 3863. [D 20:42:23.559983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 3864. [D 20:42:23.560013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 3865. [D 20:42:23.560023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 3866. [D 20:42:23.560034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 3867. [D 20:42:23.560044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3868. [D 20:42:23.560053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3869. [D 20:42:23.560064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3870. [D 20:42:23.560074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 3871. [D 20:42:23.560084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 3872. [D 20:42:23.560094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 3873. [D 20:42:23.560104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 3874. [D 20:42:23.560123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 3875. [D 20:42:23.560133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3876. [D 20:42:23.560143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3877. [D 20:42:23.560167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3878. [D 20:42:23.560177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 3879. [D 20:42:23.560187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 3880. [D 20:42:23.560202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 3881. [D 20:42:23.560212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 3882. [D 20:42:23.560222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 3883. [D 20:42:23.560253] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3884. [D 20:42:23.565684] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3884. [D 20:42:23.565701] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 13/70. [D 20:42:23.565767] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.565782] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.565790] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.571128] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.571141] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.571150] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.571166] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2764 [D 20:42:23.571175] element 0: offset: 0x2aaaab225ec0, size: 24 [D 20:42:23.571185] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 14/70. [D 20:42:23.628144] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2750 [D 20:42:23.628161] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 15/70. [D 20:42:23.628226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 3884. [D 20:42:23.628304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 3885. [D 20:42:23.628316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 3886. [D 20:42:23.628326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 3887. [D 20:42:23.628337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 3888. [D 20:42:23.628347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 3889. [D 20:42:23.628361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 3890. [D 20:42:23.628371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 3891. [D 20:42:23.628381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 3892. [D 20:42:23.628396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 3893. [D 20:42:23.628447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 3894. [D 20:42:23.628459] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 3895. [D 20:42:23.628469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 3896. [D 20:42:23.628494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 3897. [D 20:42:23.628504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 3898. [D 20:42:23.628514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 3899. [D 20:42:23.628527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 3900. [D 20:42:23.628537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 3901. [D 20:42:23.628547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 3902. [D 20:42:23.628572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 3903. [D 20:42:23.628582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 3904. [D 20:42:23.628596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 3905. [D 20:42:23.628606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 3906. [D 20:42:23.628616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 3907. [D 20:42:23.628647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 3908. [D 20:42:23.628657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 3909. [D 20:42:23.628672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 3910. [D 20:42:23.628683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 3911. [D 20:42:23.628706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 3912. [D 20:42:23.628717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 3913. [D 20:42:23.628727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 3914. [D 20:42:23.628737] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 3915. [D 20:42:23.634161] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3915. [D 20:42:23.634178] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 16/70. [D 20:42:23.634241] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.634255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.634264] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.689424] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2762 [D 20:42:23.689440] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 17/70. [D 20:42:23.689500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 3915. [D 20:42:23.689568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 3916. [D 20:42:23.689589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 3917. [D 20:42:23.689599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 3918. [D 20:42:23.689610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 3919. [D 20:42:23.689620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 3920. [D 20:42:23.689635] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 3921. [D 20:42:23.689645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 3922. [D 20:42:23.689654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 3923. [D 20:42:23.689665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 3924. [D 20:42:23.689716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 3925. [D 20:42:23.689729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 3926. [D 20:42:23.689739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 3927. [D 20:42:23.689766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 3928. [D 20:42:23.689776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 3929. [D 20:42:23.689786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 3930. [D 20:42:23.689798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 3931. [D 20:42:23.689807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 3932. [D 20:42:23.689817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 3933. [D 20:42:23.689843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 3934. [D 20:42:23.689858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 3935. [D 20:42:23.689869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 3936. [D 20:42:23.689879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 3937. [D 20:42:23.689889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 3938. [D 20:42:23.689899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 3939. [D 20:42:23.689923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 3940. [D 20:42:23.689936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 3941. [D 20:42:23.689946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 3942. [D 20:42:23.689956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 3943. [D 20:42:23.689979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 3944. [D 20:42:23.689989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 3945. [D 20:42:23.689999] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 3946. [D 20:42:23.695434] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3946. [D 20:42:23.695451] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 18/70. [D 20:42:23.695521] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.695536] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.695544] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:23.721469] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2764 [D 20:42:23.721485] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 19/70. [D 20:42:23.721550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 3946. [D 20:42:23.721626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 3947. [D 20:42:23.721641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 3948. [D 20:42:23.721652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 3949. [D 20:42:23.721666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 3950. [D 20:42:23.721676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 3951. [D 20:42:23.721686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 3952. [D 20:42:23.721699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 3953. [D 20:42:23.721709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 3954. [D 20:42:23.721719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 3955. [D 20:42:23.721773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 3956. [D 20:42:23.721784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 3957. [D 20:42:23.721794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 3958. [D 20:42:23.721804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 3959. [D 20:42:23.721815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 3960. [D 20:42:23.721825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 3961. [D 20:42:23.721835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 3962. [D 20:42:23.721845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 3963. [D 20:42:23.721863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 3964. [D 20:42:23.721873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 3965. [D 20:42:23.721883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 3966. [D 20:42:23.721915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 3967. [D 20:42:23.721924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 3968. [D 20:42:23.721934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 3969. [D 20:42:23.721950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 3970. [D 20:42:23.721960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 3971. [D 20:42:23.721984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 3972. [D 20:42:23.721994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 3973. [D 20:42:23.722004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 3974. [D 20:42:23.722019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 3975. [D 20:42:23.722029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 3976. [D 20:42:23.722039] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 3977. [D 20:42:23.727493] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 3977. [D 20:42:23.727511] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 20/70. [D 20:42:23.727579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.727594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.727603] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 1 [D 20:42:23.733848] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.733862] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.733870] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 2 [D 20:42:23.733887] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2767 [D 20:42:23.733897] element 0: offset: 0x2aaaab205390, size: 24 [D 20:42:23.733907] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 21/70. [D 20:42:23.757664] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2753 [D 20:42:23.757681] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 22/70. [D 20:42:23.757746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 3977. [D 20:42:23.757822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 3978. [D 20:42:23.757833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 3979. [D 20:42:23.757844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 3980. [D 20:42:23.757855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 3981. [D 20:42:23.757865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 3982. [D 20:42:23.757881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 3983. [D 20:42:23.757891] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 3984. [D 20:42:23.757901] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 3985. [D 20:42:23.757917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 3986. [D 20:42:23.757966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 3987. [D 20:42:23.757979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 3988. [D 20:42:23.758004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 3989. [D 20:42:23.758016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 3990. [D 20:42:23.758025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 3991. [D 20:42:23.758036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 3992. [D 20:42:23.758047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 3993. [D 20:42:23.758057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 3994. [D 20:42:23.758067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 3995. [D 20:42:23.758095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 3996. [D 20:42:23.758107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 3997. [D 20:42:23.758122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 3998. [D 20:42:23.758132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 3999. [D 20:42:23.758142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4000. [D 20:42:23.758171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4001. [D 20:42:23.758181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4002. [D 20:42:23.758193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4003. [D 20:42:23.758203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4004. [D 20:42:23.758213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4005. [D 20:42:23.758226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4006. [D 20:42:23.758236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4007. [D 20:42:23.758246] openib_post_sr_rdmaw: ibv_post_send wr_id 61efb0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4008. [D 20:42:23.762281] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.762297] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.762306] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:23.762322] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2771 [D 20:42:23.762331] element 0: offset: 0x2aaaab218230, size: 24 [D 20:42:23.762342] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 23/70. [D 20:42:23.763678] openib_check_cq: completed rdma wr_id 61efb0, nic_wr_credit 4008. [D 20:42:23.763698] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 24/70. [D 20:42:23.763774] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.763789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.763797] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:23.770207] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.770220] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.770229] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:23.770245] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2774 [D 20:42:23.770254] element 0: offset: 0x61f310, size: 24 [D 20:42:23.770264] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 25/70. [D 20:42:23.827065] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.827080] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.827088] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.827104] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2777 [D 20:42:23.827114] element 0: offset: 0x5b0030, size: 24 [D 20:42:23.827123] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 26/70. [D 20:42:23.830565] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2767 [D 20:42:23.830582] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 27/70. [D 20:42:23.830639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 4008. [D 20:42:23.830708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 4009. [D 20:42:23.830739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 4010. [D 20:42:23.830750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 4011. [D 20:42:23.830761] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 4012. [D 20:42:23.830771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 4013. [D 20:42:23.830782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 4014. [D 20:42:23.830791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4015. [D 20:42:23.830802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4016. [D 20:42:23.830812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4017. [D 20:42:23.830834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 4018. [D 20:42:23.830850] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 4019. [D 20:42:23.830873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 4020. [D 20:42:23.830887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 4021. [D 20:42:23.830910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 4022. [D 20:42:23.830924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4023. [D 20:42:23.830944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4024. [D 20:42:23.830957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4025. [D 20:42:23.830976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 4026. [D 20:42:23.830991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 4027. [D 20:42:23.831010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 4028. [D 20:42:23.831021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 4029. [D 20:42:23.831031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 4030. [D 20:42:23.831041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4031. [D 20:42:23.831051] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4032. [D 20:42:23.831074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4033. [D 20:42:23.831083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 4034. [D 20:42:23.831104] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 4035. [D 20:42:23.831124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 4036. [D 20:42:23.831136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 4037. [D 20:42:23.831146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 4038. [D 20:42:23.831156] openib_post_sr_rdmaw: ibv_post_send wr_id 67ef00 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4039. [D 20:42:23.841528] openib_check_cq: completed rdma wr_id 67ef00, nic_wr_credit 4039. [D 20:42:23.841545] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 28/70. [D 20:42:23.841653] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:23.841669] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.841678] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:23.847658] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:23.847672] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:23.847680] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:23.847696] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2779 [D 20:42:23.847706] element 0: offset: 0x662650, size: 24 [D 20:42:23.847716] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 29/70. [D 20:42:24.134073] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2779 [D 20:42:24.134090] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 30/70. [D 20:42:24.134244] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 4039. [D 20:42:24.134315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 4040. [D 20:42:24.134326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 4041. [D 20:42:24.134336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 4042. [D 20:42:24.134351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 4043. [D 20:42:24.134360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 4044. [D 20:42:24.134370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 4045. [D 20:42:24.134385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4046. [D 20:42:24.134395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4047. [D 20:42:24.134405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4048. [D 20:42:24.134418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 4049. [D 20:42:24.134497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 4050. [D 20:42:24.134508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 4051. [D 20:42:24.134517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 4052. [D 20:42:24.134528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 4053. [D 20:42:24.134538] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4054. [D 20:42:24.134548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4055. [D 20:42:24.134558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4056. [D 20:42:24.134569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 4057. [D 20:42:24.134579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 4058. [D 20:42:24.134589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 4059. [D 20:42:24.134617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 4060. [D 20:42:24.134628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 4061. [D 20:42:24.134639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4062. [D 20:42:24.134649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4063. [D 20:42:24.134659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4064. [D 20:42:24.134669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 4065. [D 20:42:24.134679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 4066. [D 20:42:24.134689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 4067. [D 20:42:24.134699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 4068. [D 20:42:24.134724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 4069. [D 20:42:24.134734] openib_post_sr_rdmaw: ibv_post_send wr_id 63e820 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4070. [D 20:42:24.140208] openib_check_cq: completed rdma wr_id 63e820, nic_wr_credit 4070. [D 20:42:24.140225] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 31/70. [D 20:42:24.140292] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.140306] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.140315] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.146136] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.146150] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.146158] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.146174] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2782 [D 20:42:24.146183] element 0: offset: 0x61fab0, size: 24 [D 20:42:24.146193] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 32/70. [D 20:42:24.197521] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2774 [D 20:42:24.197538] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 33/70. [D 20:42:24.197598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4070. [D 20:42:24.197673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4071. [D 20:42:24.197685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4072. [D 20:42:24.197695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4073. [D 20:42:24.197707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4074. [D 20:42:24.197721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4075. [D 20:42:24.197734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4076. [D 20:42:24.197744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4077. [D 20:42:24.197754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4078. [D 20:42:24.197770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4079. [D 20:42:24.197779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4080. [D 20:42:24.197789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4081. [D 20:42:24.197799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4082. [D 20:42:24.197817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4083. [D 20:42:24.197827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4084. [D 20:42:24.197837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4085. [D 20:42:24.197885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4086. [D 20:42:24.197896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4087. [D 20:42:24.197906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4088. [D 20:42:24.197916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4089. [D 20:42:24.197940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4090. [D 20:42:24.197951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4091. [D 20:42:24.197962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4092. [D 20:42:24.197971] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4093. [D 20:42:24.197982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4094. [D 20:42:24.197992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4095. [D 20:42:24.198002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4096. [D 20:42:24.198011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4097. [D 20:42:24.198037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4098. [D 20:42:24.198046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4099. [D 20:42:24.198057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4100. [D 20:42:24.198068] openib_post_sr_rdmaw: ibv_post_send wr_id 61f5a0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4101. [D 20:42:24.203529] openib_check_cq: completed rdma wr_id 61f5a0, nic_wr_credit 4101. [D 20:42:24.203547] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 34/70. [D 20:42:24.203613] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.203628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.203636] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.209891] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.209904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.209912] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.209928] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2786 [D 20:42:24.209937] element 0: offset: 0x67efc0, size: 24 [D 20:42:24.209948] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 35/70. [D 20:42:24.251845] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2771 [D 20:42:24.251863] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 36/70. [D 20:42:24.251924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4101. [D 20:42:24.251991] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4102. [D 20:42:24.252002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4103. [D 20:42:24.252013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4104. [D 20:42:24.252023] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4105. [D 20:42:24.252033] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4106. [D 20:42:24.252044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4107. [D 20:42:24.252054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4108. [D 20:42:24.252063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4109. [D 20:42:24.252081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4110. [D 20:42:24.252091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4111. [D 20:42:24.252101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4112. [D 20:42:24.252111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4113. [D 20:42:24.252121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4114. [D 20:42:24.252130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4115. [D 20:42:24.252140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4116. [D 20:42:24.252190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4117. [D 20:42:24.252201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4118. [D 20:42:24.252211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4119. [D 20:42:24.252246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4120. [D 20:42:24.252257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4121. [D 20:42:24.252267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4122. [D 20:42:24.252277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4123. [D 20:42:24.252293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4124. [D 20:42:24.252303] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4125. [D 20:42:24.252313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4126. [D 20:42:24.252337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4127. [D 20:42:24.252346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4128. [D 20:42:24.252357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4129. [D 20:42:24.252367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4130. [D 20:42:24.252377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4131. [D 20:42:24.252404] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4132. [D 20:42:24.257847] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 4132. [D 20:42:24.257864] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 37/70. [D 20:42:24.257929] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.257943] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.257951] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.263419] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.263433] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.263441] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.263457] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2789 [D 20:42:24.263467] element 0: offset: 0x662650, size: 24 [D 20:42:24.263477] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 38/70. [D 20:42:24.337095] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2789 [D 20:42:24.337113] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 39/70. [D 20:42:24.337224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4132. [D 20:42:24.337326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4133. [D 20:42:24.337337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4134. [D 20:42:24.337347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4135. [D 20:42:24.337362] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4136. [D 20:42:24.337372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4137. [D 20:42:24.337382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4138. [D 20:42:24.337396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4139. [D 20:42:24.337406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4140. [D 20:42:24.337416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4141. [D 20:42:24.337432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4142. [D 20:42:24.337441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4143. [D 20:42:24.337451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4144. [D 20:42:24.337461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4145. [D 20:42:24.337488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4146. [D 20:42:24.337498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4147. [D 20:42:24.337519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4148. [D 20:42:24.337530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4149. [D 20:42:24.337546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4150. [D 20:42:24.337574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4151. [D 20:42:24.337589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4152. [D 20:42:24.337608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4153. [D 20:42:24.337623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4154. [D 20:42:24.337633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4155. [D 20:42:24.337655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4156. [D 20:42:24.337666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4157. [D 20:42:24.337676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4158. [D 20:42:24.337703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4159. [D 20:42:24.337713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4160. [D 20:42:24.337742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4161. [D 20:42:24.337753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4162. [D 20:42:24.337776] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4163. [D 20:42:24.343238] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 4163. [D 20:42:24.343255] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 40/70. [D 20:42:24.343321] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.343335] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.343343] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.348928] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.348941] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.348950] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.348965] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2792 [D 20:42:24.348974] element 0: offset: 0x61f310, size: 24 [D 20:42:24.348984] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 41/70. [D 20:42:24.421406] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2782 [D 20:42:24.421423] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 42/70. [D 20:42:24.421541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 4163. [D 20:42:24.421649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 4164. [D 20:42:24.421661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 4165. [D 20:42:24.421672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 4166. [D 20:42:24.421686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 4167. [D 20:42:24.421696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 4168. [D 20:42:24.421706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 4169. [D 20:42:24.421720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4170. [D 20:42:24.421730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4171. [D 20:42:24.421739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4172. [D 20:42:24.421774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 4173. [D 20:42:24.421786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 4174. [D 20:42:24.421808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 4175. [D 20:42:24.421823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 4176. [D 20:42:24.421842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 4177. [D 20:42:24.421853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4178. [D 20:42:24.421864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4179. [D 20:42:24.421882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4180. [D 20:42:24.421898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 4181. [D 20:42:24.421908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 4182. [D 20:42:24.421934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 4183. [D 20:42:24.421944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 4184. [D 20:42:24.421967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 4185. [D 20:42:24.421977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4186. [D 20:42:24.421998] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4187. [D 20:42:24.422008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4188. [D 20:42:24.422029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 4189. [D 20:42:24.422040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 4190. [D 20:42:24.422050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 4191. [D 20:42:24.422060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 4192. [D 20:42:24.422081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 4193. [D 20:42:24.422090] openib_post_sr_rdmaw: ibv_post_send wr_id 63fda0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4194. [D 20:42:24.427569] openib_check_cq: completed rdma wr_id 63fda0, nic_wr_credit 4194. [D 20:42:24.427587] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 43/70. [D 20:42:24.427653] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.427668] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.427676] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.433509] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.433522] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.433531] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.433546] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2794 [D 20:42:24.433555] element 0: offset: 0x662650, size: 24 [D 20:42:24.433565] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 44/70. [D 20:42:24.470374] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2792 [D 20:42:24.470391] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 45/70. [D 20:42:24.470454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4194. [D 20:42:24.470522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4195. [D 20:42:24.470577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4196. [D 20:42:24.470587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4197. [D 20:42:24.470599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4198. [D 20:42:24.470609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4199. [D 20:42:24.470619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4200. [D 20:42:24.470640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4201. [D 20:42:24.470656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4202. [D 20:42:24.470666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4203. [D 20:42:24.470676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4204. [D 20:42:24.470705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4205. [D 20:42:24.470715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4206. [D 20:42:24.470738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4207. [D 20:42:24.470749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4208. [D 20:42:24.470759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4209. [D 20:42:24.470781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4210. [D 20:42:24.470797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4211. [D 20:42:24.470819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4212. [D 20:42:24.470830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4213. [D 20:42:24.470840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4214. [D 20:42:24.470863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4215. [D 20:42:24.470874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4216. [D 20:42:24.470884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4217. [D 20:42:24.470903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4218. [D 20:42:24.470913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4219. [D 20:42:24.470934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4220. [D 20:42:24.470946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4221. [D 20:42:24.470956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4222. [D 20:42:24.470976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4223. [D 20:42:24.470987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4224. [D 20:42:24.471011] openib_post_sr_rdmaw: ibv_post_send wr_id 63fda0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4225. [D 20:42:24.476432] openib_check_cq: completed rdma wr_id 63fda0, nic_wr_credit 4225. [D 20:42:24.476450] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 46/70. [D 20:42:24.476516] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.476531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.476539] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.481954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.481967] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.481975] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.481991] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2798 [D 20:42:24.482001] element 0: offset: 0x61fab0, size: 24 [D 20:42:24.482013] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 47/70. [D 20:42:24.533998] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2786 [D 20:42:24.534015] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 48/70. [D 20:42:24.534072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4225. [D 20:42:24.534138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4226. [D 20:42:24.534158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4227. [D 20:42:24.534168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4228. [D 20:42:24.534179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4229. [D 20:42:24.534189] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4230. [D 20:42:24.534205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4231. [D 20:42:24.534214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4232. [D 20:42:24.534224] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4233. [D 20:42:24.534234] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4234. [D 20:42:24.534286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4235. [D 20:42:24.534297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4236. [D 20:42:24.534308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4237. [D 20:42:24.534332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4238. [D 20:42:24.534342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4239. [D 20:42:24.534352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4240. [D 20:42:24.534367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4241. [D 20:42:24.534377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4242. [D 20:42:24.534387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4243. [D 20:42:24.534419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4244. [D 20:42:24.534430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4245. [D 20:42:24.534440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4246. [D 20:42:24.534450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4247. [D 20:42:24.534460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4248. [D 20:42:24.534471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4249. [D 20:42:24.534494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4250. [D 20:42:24.534504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4251. [D 20:42:24.534514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4252. [D 20:42:24.534524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4253. [D 20:42:24.534534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4254. [D 20:42:24.534551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4255. [D 20:42:24.534575] openib_post_sr_rdmaw: ibv_post_send wr_id 63da60 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4256. [D 20:42:24.539997] openib_check_cq: completed rdma wr_id 63da60, nic_wr_credit 4256. [D 20:42:24.540015] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 49/70. [D 20:42:24.540081] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.540095] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.540103] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.546093] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.546107] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.546115] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.546131] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2801 [D 20:42:24.546141] element 0: offset: 0x61ee50, size: 24 [D 20:42:24.546150] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 50/70. [D 20:42:24.594131] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2777 [D 20:42:24.594148] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 51/70. [D 20:42:24.594209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 4256. [D 20:42:24.594287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 4257. [D 20:42:24.594298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 4258. [D 20:42:24.594309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 4259. [D 20:42:24.594320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 4260. [D 20:42:24.594330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 4261. [D 20:42:24.594346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 4262. [D 20:42:24.594356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 4263. [D 20:42:24.594366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 4264. [D 20:42:24.594382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 4265. [D 20:42:24.594431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 4266. [D 20:42:24.594444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 4267. [D 20:42:24.594454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 4268. [D 20:42:24.594464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 4269. [D 20:42:24.594474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 4270. [D 20:42:24.594492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 4271. [D 20:42:24.594501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 4272. [D 20:42:24.594511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 4273. [D 20:42:24.594527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 4274. [D 20:42:24.594537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 4275. [D 20:42:24.594565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 4276. [D 20:42:24.594578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 4277. [D 20:42:24.594588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 4278. [D 20:42:24.594597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4279. [D 20:42:24.594613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4280. [D 20:42:24.594623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4281. [D 20:42:24.594632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4282. [D 20:42:24.594663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4283. [D 20:42:24.594678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4284. [D 20:42:24.594689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4285. [D 20:42:24.594698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4286. [D 20:42:24.594714] openib_post_sr_rdmaw: ibv_post_send wr_id 63e4f0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4287. [D 20:42:24.600140] openib_check_cq: completed rdma wr_id 63e4f0, nic_wr_credit 4287. [D 20:42:24.600157] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 52/70. [D 20:42:24.600223] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.600238] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.600246] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.605833] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.605846] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.605855] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.605871] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2804 [D 20:42:24.605880] element 0: offset: 0x63e800, size: 24 [D 20:42:24.605890] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 53/70. [D 20:42:24.653422] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2798 [D 20:42:24.653439] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 54/70. [D 20:42:24.653505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4287. [D 20:42:24.653573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4288. [D 20:42:24.653593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4289. [D 20:42:24.653603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4290. [D 20:42:24.653615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4291. [D 20:42:24.653625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4292. [D 20:42:24.653641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4293. [D 20:42:24.653651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4294. [D 20:42:24.653661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4295. [D 20:42:24.653703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4296. [D 20:42:24.653717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4297. [D 20:42:24.653727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4298. [D 20:42:24.653737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4299. [D 20:42:24.653748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4300. [D 20:42:24.653769] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4301. [D 20:42:24.653784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4302. [D 20:42:24.653798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4303. [D 20:42:24.653813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4304. [D 20:42:24.653824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4305. [D 20:42:24.653845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4306. [D 20:42:24.653859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4307. [D 20:42:24.653869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4308. [D 20:42:24.653879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4309. [D 20:42:24.653894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4310. [D 20:42:24.653928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4311. [D 20:42:24.653940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4312. [D 20:42:24.653950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4313. [D 20:42:24.653965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4314. [D 20:42:24.653976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4315. [D 20:42:24.653996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4316. [D 20:42:24.654010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4317. [D 20:42:24.654020] openib_post_sr_rdmaw: ibv_post_send wr_id 62ac20 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4318. [D 20:42:24.659429] openib_check_cq: completed rdma wr_id 62ac20, nic_wr_credit 4318. [D 20:42:24.659446] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 55/70. [D 20:42:24.659511] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.659525] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.659534] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.664996] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.665010] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.665018] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.665034] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2807 [D 20:42:24.665043] element 0: offset: 0x691fe0, size: 24 [D 20:42:24.665053] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 56/70. [D 20:42:24.732967] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2794 [D 20:42:24.732985] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 57/70. [D 20:42:24.733047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 4318. [D 20:42:24.733115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 4319. [D 20:42:24.733166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 4320. [D 20:42:24.733177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 4321. [D 20:42:24.733188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 4322. [D 20:42:24.733203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 4323. [D 20:42:24.733214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 4324. [D 20:42:24.733243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4325. [D 20:42:24.733253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4326. [D 20:42:24.733263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4327. [D 20:42:24.733290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 4328. [D 20:42:24.733300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 4329. [D 20:42:24.733313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 4330. [D 20:42:24.733341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 4331. [D 20:42:24.733352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 4332. [D 20:42:24.733372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4333. [D 20:42:24.733382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4334. [D 20:42:24.733392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4335. [D 20:42:24.733417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 4336. [D 20:42:24.733427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 4337. [D 20:42:24.733437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 4338. [D 20:42:24.733460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 4339. [D 20:42:24.733470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 4340. [D 20:42:24.733481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4341. [D 20:42:24.733491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4342. [D 20:42:24.733511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4343. [D 20:42:24.733528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 4344. [D 20:42:24.733549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 4345. [D 20:42:24.733564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 4346. [D 20:42:24.733574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 4347. [D 20:42:24.733583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 4348. [D 20:42:24.733593] openib_post_sr_rdmaw: ibv_post_send wr_id 62acc0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4349. [D 20:42:24.738969] openib_check_cq: completed rdma wr_id 62acc0, nic_wr_credit 4349. [D 20:42:24.738985] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 58/70. [D 20:42:24.739049] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.739063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.739072] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.744929] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.744943] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.744951] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.744967] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2809 [D 20:42:24.744977] element 0: offset: 0x6151c0, size: 24 [D 20:42:24.744987] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 59/70. [D 20:42:24.810420] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2801 [D 20:42:24.810438] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 60/70. [D 20:42:24.810495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4349. [D 20:42:24.810591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4350. [D 20:42:24.810605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4351. [D 20:42:24.810616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4352. [D 20:42:24.810627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4353. [D 20:42:24.810638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4354. [D 20:42:24.810647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4355. [D 20:42:24.810657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4356. [D 20:42:24.810697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4357. [D 20:42:24.810708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4358. [D 20:42:24.810731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4359. [D 20:42:24.810741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4360. [D 20:42:24.810762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4361. [D 20:42:24.810773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4362. [D 20:42:24.810784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4363. [D 20:42:24.810794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4364. [D 20:42:24.810804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4365. [D 20:42:24.810819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4366. [D 20:42:24.810842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4367. [D 20:42:24.810853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4368. [D 20:42:24.810881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4369. [D 20:42:24.810892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4370. [D 20:42:24.810917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4371. [D 20:42:24.810927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4372. [D 20:42:24.810938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4373. [D 20:42:24.810959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4374. [D 20:42:24.810973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4375. [D 20:42:24.810983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4376. [D 20:42:24.810993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4377. [D 20:42:24.811003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4378. [D 20:42:24.811018] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4379. [D 20:42:24.811028] openib_post_sr_rdmaw: ibv_post_send wr_id 657210 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4380. [D 20:42:24.816445] openib_check_cq: completed rdma wr_id 657210, nic_wr_credit 4380. [D 20:42:24.816463] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 0/70. [D 20:42:24.816531] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.816546] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.816554] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.822696] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.822709] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.822718] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.822734] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2813 [D 20:42:24.822743] element 0: offset: 0x67eee0, size: 24 [D 20:42:24.822753] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 1/70. [D 20:42:24.882388] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2804 [D 20:42:24.882405] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 2/70. [D 20:42:24.882469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 4380. [D 20:42:24.882578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 4381. [D 20:42:24.882592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 4382. [D 20:42:24.882603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 4383. [D 20:42:24.882613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 4384. [D 20:42:24.882624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 4385. [D 20:42:24.882637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 4386. [D 20:42:24.882661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 4387. [D 20:42:24.882674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 4388. [D 20:42:24.882684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 4389. [D 20:42:24.882694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 4390. [D 20:42:24.882719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 4391. [D 20:42:24.882729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 4392. [D 20:42:24.882743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 4393. [D 20:42:24.882752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 4394. [D 20:42:24.882762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 4395. [D 20:42:24.882772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 4396. [D 20:42:24.882789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 4397. [D 20:42:24.882812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 4398. [D 20:42:24.882825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 4399. [D 20:42:24.882856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 4400. [D 20:42:24.882866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 4401. [D 20:42:24.882893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 4402. [D 20:42:24.882902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4403. [D 20:42:24.882924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4404. [D 20:42:24.882934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4405. [D 20:42:24.882944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4406. [D 20:42:24.882958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4407. [D 20:42:24.882968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4408. [D 20:42:24.882978] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4409. [D 20:42:24.882988] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4410. [D 20:42:24.883005] openib_post_sr_rdmaw: ibv_post_send wr_id 64dc90 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4411. [D 20:42:24.888436] openib_check_cq: completed rdma wr_id 64dc90, nic_wr_credit 4411. [D 20:42:24.888453] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 3/70. [D 20:42:24.888518] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.888533] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.888541] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.894139] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.894153] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.894161] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.894177] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2816 [D 20:42:24.894186] element 0: offset: 0x61f310, size: 24 [D 20:42:24.894196] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 4/70. [D 20:42:24.969390] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2807 [D 20:42:24.969407] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 5/70. [D 20:42:24.969522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4411. [D 20:42:24.969598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4412. [D 20:42:24.969609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4413. [D 20:42:24.969619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4414. [D 20:42:24.969634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4415. [D 20:42:24.969644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4416. [D 20:42:24.969653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4417. [D 20:42:24.969668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4418. [D 20:42:24.969678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4419. [D 20:42:24.969687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4420. [D 20:42:24.969742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4421. [D 20:42:24.969753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4422. [D 20:42:24.969764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4423. [D 20:42:24.969774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4424. [D 20:42:24.969793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4425. [D 20:42:24.969803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4426. [D 20:42:24.969813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4427. [D 20:42:24.969830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4428. [D 20:42:24.969840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4429. [D 20:42:24.969853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4430. [D 20:42:24.969876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4431. [D 20:42:24.969886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4432. [D 20:42:24.969896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4433. [D 20:42:24.969912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4434. [D 20:42:24.969922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4435. [D 20:42:24.969932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4436. [D 20:42:24.969942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4437. [D 20:42:24.969969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4438. [D 20:42:24.969979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4439. [D 20:42:24.969990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4440. [D 20:42:24.970000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4441. [D 20:42:24.970010] openib_post_sr_rdmaw: ibv_post_send wr_id 63e3b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4442. [D 20:42:24.975454] openib_check_cq: completed rdma wr_id 63e3b0, nic_wr_credit 4442. [D 20:42:24.975472] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 6/70. [D 20:42:24.975539] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:24.975553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.975561] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:24.981275] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:24.981288] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:24.981296] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:24.981313] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2819 [D 20:42:24.981322] element 0: offset: 0x63dc60, size: 24 [D 20:42:24.981332] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 7/70. [D 20:42:25.019153] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2819 [D 20:42:25.019170] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 8/70. [D 20:42:25.019235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4442. [D 20:42:25.019302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4443. [D 20:42:25.019321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4444. [D 20:42:25.019332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4445. [D 20:42:25.019343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4446. [D 20:42:25.019353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4447. [D 20:42:25.019368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4448. [D 20:42:25.019378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4449. [D 20:42:25.019388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4450. [D 20:42:25.019406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4451. [D 20:42:25.019454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4452. [D 20:42:25.019468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4453. [D 20:42:25.019487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4454. [D 20:42:25.019497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4455. [D 20:42:25.019507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4456. [D 20:42:25.019517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4457. [D 20:42:25.019558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4458. [D 20:42:25.019570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4459. [D 20:42:25.019592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4460. [D 20:42:25.019602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4461. [D 20:42:25.019613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4462. [D 20:42:25.019623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4463. [D 20:42:25.019633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4464. [D 20:42:25.019644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4465. [D 20:42:25.019654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4466. [D 20:42:25.019664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4467. [D 20:42:25.019674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4468. [D 20:42:25.019691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4469. [D 20:42:25.019701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4470. [D 20:42:25.019711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4471. [D 20:42:25.019734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4472. [D 20:42:25.019745] openib_post_sr_rdmaw: ibv_post_send wr_id 63d880 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4473. [D 20:42:25.025216] openib_check_cq: completed rdma wr_id 63d880, nic_wr_credit 4473. [D 20:42:25.025233] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 9/70. [D 20:42:25.025297] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.025311] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.025320] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.031050] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.031063] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.031072] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.031087] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2822 [D 20:42:25.031097] element 0: offset: 0x6572d0, size: 24 [D 20:42:25.031107] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 10/70. [D 20:42:25.093156] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2813 [D 20:42:25.093172] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 11/70. [D 20:42:25.093232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4473. [D 20:42:25.093308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4474. [D 20:42:25.093320] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4475. [D 20:42:25.093330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4476. [D 20:42:25.093341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4477. [D 20:42:25.093351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4478. [D 20:42:25.093361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4479. [D 20:42:25.093371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4480. [D 20:42:25.093381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4481. [D 20:42:25.093391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4482. [D 20:42:25.093433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4483. [D 20:42:25.093447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4484. [D 20:42:25.093457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4485. [D 20:42:25.093472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4486. [D 20:42:25.093508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4487. [D 20:42:25.093521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4488. [D 20:42:25.093531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4489. [D 20:42:25.093543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4490. [D 20:42:25.093558] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4491. [D 20:42:25.093568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4492. [D 20:42:25.093578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4493. [D 20:42:25.093588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4494. [D 20:42:25.093605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4495. [D 20:42:25.093615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4496. [D 20:42:25.093625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4497. [D 20:42:25.093650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4498. [D 20:42:25.093660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4499. [D 20:42:25.093671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4500. [D 20:42:25.093681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4501. [D 20:42:25.093691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4502. [D 20:42:25.093702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4503. [D 20:42:25.093728] openib_post_sr_rdmaw: ibv_post_send wr_id 62a860 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4504. [D 20:42:25.099162] openib_check_cq: completed rdma wr_id 62a860, nic_wr_credit 4504. [D 20:42:25.099179] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 12/70. [D 20:42:25.099243] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.099257] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.099265] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.105524] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.105537] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.105546] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.105562] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2825 [D 20:42:25.105571] element 0: offset: 0x5b0030, size: 24 [D 20:42:25.105581] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 13/70. [D 20:42:25.140357] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2809 [D 20:42:25.140373] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 14/70. [D 20:42:25.140434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40042 nic_wr_credit 4504. [D 20:42:25.140502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40042 nic_wr_credit 4505. [D 20:42:25.140522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 4506. [D 20:42:25.140533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 4507. [D 20:42:25.140543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 4508. [D 20:42:25.140553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 4509. [D 20:42:25.140569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 4510. [D 20:42:25.140579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 4511. [D 20:42:25.140589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 4512. [D 20:42:25.140604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 4513. [D 20:42:25.140652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 4514. [D 20:42:25.140663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 4515. [D 20:42:25.140673] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 4516. [D 20:42:25.140697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 4517. [D 20:42:25.140707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 4518. [D 20:42:25.140717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 4519. [D 20:42:25.140730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 4520. [D 20:42:25.140758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 4521. [D 20:42:25.140772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 4522. [D 20:42:25.140781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 4523. [D 20:42:25.140792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 4524. [D 20:42:25.140805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 4525. [D 20:42:25.140830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 4526. [D 20:42:25.140843] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 4527. [D 20:42:25.140852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 4528. [D 20:42:25.140862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 4529. [D 20:42:25.140878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 4530. [D 20:42:25.140902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 4531. [D 20:42:25.140916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 4532. [D 20:42:25.140926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 4533. [D 20:42:25.140936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 4534. [D 20:42:25.140949] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 4535. [D 20:42:25.146358] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 4535. [D 20:42:25.146375] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 15/70. [D 20:42:25.146440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.146454] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.146462] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.212118] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2816 [D 20:42:25.212135] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 16/70. [D 20:42:25.212233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 4535. [D 20:42:25.212325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 4536. [D 20:42:25.212337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 4537. [D 20:42:25.212347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 4538. [D 20:42:25.212358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 4539. [D 20:42:25.212368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 4540. [D 20:42:25.212378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 4541. [D 20:42:25.212388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 4542. [D 20:42:25.212398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 4543. [D 20:42:25.212407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 4544. [D 20:42:25.212417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 4545. [D 20:42:25.212454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 4546. [D 20:42:25.212465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 4547. [D 20:42:25.212494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 4548. [D 20:42:25.212505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 4549. [D 20:42:25.212524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 4550. [D 20:42:25.212536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 4551. [D 20:42:25.212545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 4552. [D 20:42:25.212556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 4553. [D 20:42:25.212566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 4554. [D 20:42:25.212591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 4555. [D 20:42:25.212607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 4556. [D 20:42:25.212617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 4557. [D 20:42:25.212627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4558. [D 20:42:25.212649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4559. [D 20:42:25.212672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4560. [D 20:42:25.212685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4561. [D 20:42:25.212707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4562. [D 20:42:25.212719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4563. [D 20:42:25.212728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4564. [D 20:42:25.212751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4565. [D 20:42:25.212761] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4566. [D 20:42:25.218194] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 4566. [D 20:42:25.218212] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 17/70. [D 20:42:25.218275] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.218289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.218298] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.224309] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.224322] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.224331] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.224347] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2828 [D 20:42:25.224357] element 0: offset: 0x61fab0, size: 24 [D 20:42:25.224369] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 18/70. [D 20:42:25.277325] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2822 [D 20:42:25.277342] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 19/70. [D 20:42:25.277397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4566. [D 20:42:25.277464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4567. [D 20:42:25.277518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4568. [D 20:42:25.277529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4569. [D 20:42:25.277540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4570. [D 20:42:25.277550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4571. [D 20:42:25.277560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4572. [D 20:42:25.277580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4573. [D 20:42:25.277596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4574. [D 20:42:25.277606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4575. [D 20:42:25.277615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4576. [D 20:42:25.277626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4577. [D 20:42:25.277649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4578. [D 20:42:25.277659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4579. [D 20:42:25.277683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4580. [D 20:42:25.277693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4581. [D 20:42:25.277713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4582. [D 20:42:25.277724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4583. [D 20:42:25.277735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4584. [D 20:42:25.277745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4585. [D 20:42:25.277767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4586. [D 20:42:25.277777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4587. [D 20:42:25.277787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4588. [D 20:42:25.277810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4589. [D 20:42:25.277820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4590. [D 20:42:25.277830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4591. [D 20:42:25.277851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4592. [D 20:42:25.277861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4593. [D 20:42:25.277872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4594. [D 20:42:25.277898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4595. [D 20:42:25.277915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4596. [D 20:42:25.277934] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4597. [D 20:42:25.283325] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 4597. [D 20:42:25.283343] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 20/70. [D 20:42:25.285384] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.285395] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.285403] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.285418] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2830 [D 20:42:25.285427] element 0: offset: 0x67efc0, size: 24 [D 20:42:25.285436] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 21/70. [D 20:42:25.285451] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.285460] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.285469] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.289397] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.289410] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.289419] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.289434] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2834 [D 20:42:25.289443] element 0: offset: 0x63dc60, size: 24 [D 20:42:25.289453] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 22/70. [D 20:42:25.343624] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2825 [D 20:42:25.343645] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 23/70. [D 20:42:25.343708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4597. [D 20:42:25.343778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4598. [D 20:42:25.343827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4599. [D 20:42:25.343838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4600. [D 20:42:25.343849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4601. [D 20:42:25.343859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4602. [D 20:42:25.343869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4603. [D 20:42:25.343879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4604. [D 20:42:25.343902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4605. [D 20:42:25.343912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4606. [D 20:42:25.343922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4607. [D 20:42:25.343939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4608. [D 20:42:25.343948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4609. [D 20:42:25.343960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4610. [D 20:42:25.343969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4611. [D 20:42:25.343979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4612. [D 20:42:25.343989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4613. [D 20:42:25.344001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4614. [D 20:42:25.344011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4615. [D 20:42:25.344036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4616. [D 20:42:25.344053] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4617. [D 20:42:25.344062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4618. [D 20:42:25.344088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4619. [D 20:42:25.344099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4620. [D 20:42:25.344109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4621. [D 20:42:25.344120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4622. [D 20:42:25.344142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4623. [D 20:42:25.344153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4624. [D 20:42:25.344163] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4625. [D 20:42:25.344186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4626. [D 20:42:25.344197] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4627. [D 20:42:25.344207] openib_post_sr_rdmaw: ibv_post_send wr_id 63e320 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4628. [D 20:42:25.349631] openib_check_cq: completed rdma wr_id 63e320, nic_wr_credit 4628. [D 20:42:25.349647] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 24/70. [D 20:42:25.349717] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.349732] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.349741] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.355903] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.355916] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.355925] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.355943] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2837 [D 20:42:25.355953] element 0: offset: 0x61ee50, size: 24 [D 20:42:25.355963] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 25/70. [D 20:42:25.444331] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2834 [D 20:42:25.444348] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 26/70. [D 20:42:25.444469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4628. [D 20:42:25.444577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4629. [D 20:42:25.444589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4630. [D 20:42:25.444600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4631. [D 20:42:25.444614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4632. [D 20:42:25.444624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4633. [D 20:42:25.444634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4634. [D 20:42:25.444650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4635. [D 20:42:25.444660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4636. [D 20:42:25.444670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4637. [D 20:42:25.444701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4638. [D 20:42:25.444716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4639. [D 20:42:25.444741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4640. [D 20:42:25.444753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4641. [D 20:42:25.444763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4642. [D 20:42:25.444773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4643. [D 20:42:25.444783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4644. [D 20:42:25.444793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4645. [D 20:42:25.444815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4646. [D 20:42:25.444826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4647. [D 20:42:25.444842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4648. [D 20:42:25.444864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4649. [D 20:42:25.444878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4650. [D 20:42:25.444909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4651. [D 20:42:25.444931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4652. [D 20:42:25.444942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4653. [D 20:42:25.444953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4654. [D 20:42:25.444963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4655. [D 20:42:25.444972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4656. [D 20:42:25.444983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4657. [D 20:42:25.444993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4658. [D 20:42:25.445003] openib_post_sr_rdmaw: ibv_post_send wr_id 625590 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4659. [D 20:42:25.450437] openib_check_cq: completed rdma wr_id 625590, nic_wr_credit 4659. [D 20:42:25.450454] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 27/70. [D 20:42:25.450518] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.450532] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.450541] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.474414] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2837 [D 20:42:25.474431] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 28/70. [D 20:42:25.474496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 4659. [D 20:42:25.474602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 4660. [D 20:42:25.474614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 4661. [D 20:42:25.474625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 4662. [D 20:42:25.474640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 4663. [D 20:42:25.474649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 4664. [D 20:42:25.474659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 4665. [D 20:42:25.474675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 4666. [D 20:42:25.474685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 4667. [D 20:42:25.474694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 4668. [D 20:42:25.474705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 4669. [D 20:42:25.474730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 4670. [D 20:42:25.474741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 4671. [D 20:42:25.474767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 4672. [D 20:42:25.474781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 4673. [D 20:42:25.474803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 4674. [D 20:42:25.474816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 4675. [D 20:42:25.474838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 4676. [D 20:42:25.474849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 4677. [D 20:42:25.474859] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 4678. [D 20:42:25.474880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 4679. [D 20:42:25.474890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 4680. [D 20:42:25.474900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 4681. [D 20:42:25.474922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 4682. [D 20:42:25.474931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 4683. [D 20:42:25.474952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 4684. [D 20:42:25.474962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 4685. [D 20:42:25.474974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 4686. [D 20:42:25.475001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 4687. [D 20:42:25.475011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 4688. [D 20:42:25.475026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 4689. [D 20:42:25.475046] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 4690. [D 20:42:25.480465] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 4690. [D 20:42:25.480481] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 29/70. [D 20:42:25.480545] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.480560] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.480568] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.486881] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.486895] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.486903] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.486920] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2840 [D 20:42:25.486929] element 0: offset: 0x63e800, size: 24 [D 20:42:25.486940] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 30/70. [D 20:42:25.520927] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2828 [D 20:42:25.520944] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 31/70. [D 20:42:25.521003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 4690. [D 20:42:25.521071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 4691. [D 20:42:25.521123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 4692. [D 20:42:25.521135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 4693. [D 20:42:25.521145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 4694. [D 20:42:25.521161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 4695. [D 20:42:25.521171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4696. [D 20:42:25.521193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4697. [D 20:42:25.521207] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4698. [D 20:42:25.521216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 4699. [D 20:42:25.521226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 4700. [D 20:42:25.521254] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 4701. [D 20:42:25.521264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 4702. [D 20:42:25.521288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 4703. [D 20:42:25.521299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4704. [D 20:42:25.521309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4705. [D 20:42:25.521332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4706. [D 20:42:25.521342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 4707. [D 20:42:25.521352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 4708. [D 20:42:25.521374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 4709. [D 20:42:25.521387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 4710. [D 20:42:25.521408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 4711. [D 20:42:25.521419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4712. [D 20:42:25.521428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4713. [D 20:42:25.521447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4714. [D 20:42:25.521462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 4715. [D 20:42:25.521483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 4716. [D 20:42:25.521498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 4717. [D 20:42:25.521518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 4718. [D 20:42:25.521529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 4719. [D 20:42:25.521539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4720. [D 20:42:25.521558] openib_post_sr_rdmaw: ibv_post_send wr_id 615140 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4721. [D 20:42:25.526932] openib_check_cq: completed rdma wr_id 615140, nic_wr_credit 4721. [D 20:42:25.526949] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 32/70. [D 20:42:25.527015] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.527030] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.527038] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.533179] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.533193] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.533201] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.533217] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2843 [D 20:42:25.533227] element 0: offset: 0x6572d0, size: 24 [D 20:42:25.533236] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 33/70. [D 20:42:25.563458] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2830 [D 20:42:25.563475] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 34/70. [D 20:42:25.563536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bdc000 rkey 4a40050 nic_wr_credit 4721. [D 20:42:25.563632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bfc000 rkey 4a40050 nic_wr_credit 4722. [D 20:42:25.563645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c1c000 rkey 4a40050 nic_wr_credit 4723. [D 20:42:25.563656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c3c000 rkey 4a40050 nic_wr_credit 4724. [D 20:42:25.563667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c5c000 rkey 4a40050 nic_wr_credit 4725. [D 20:42:25.563677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c7c000 rkey 4a40050 nic_wr_credit 4726. [D 20:42:25.563687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c9c000 rkey 4a40050 nic_wr_credit 4727. [D 20:42:25.563697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cbc000 rkey 4a40050 nic_wr_credit 4728. [D 20:42:25.563733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cdc000 rkey 4a40050 nic_wr_credit 4729. [D 20:42:25.563746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cfc000 rkey 4a40050 nic_wr_credit 4730. [D 20:42:25.563770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d1c000 rkey 4a40050 nic_wr_credit 4731. [D 20:42:25.563780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d3c000 rkey 4a40050 nic_wr_credit 4732. [D 20:42:25.563792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d5c000 rkey 4a40050 nic_wr_credit 4733. [D 20:42:25.563816] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d7c000 rkey 4a40050 nic_wr_credit 4734. [D 20:42:25.563829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d9c000 rkey 4a40050 nic_wr_credit 4735. [D 20:42:25.563851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dbc000 rkey 4a40050 nic_wr_credit 4736. [D 20:42:25.563863] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ddc000 rkey 4a40050 nic_wr_credit 4737. [D 20:42:25.563882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dfc000 rkey 4a40050 nic_wr_credit 4738. [D 20:42:25.563897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e1c000 rkey 4a40050 nic_wr_credit 4739. [D 20:42:25.563907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e3c000 rkey 4a40050 nic_wr_credit 4740. [D 20:42:25.563934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e5c000 rkey 4a40050 nic_wr_credit 4741. [D 20:42:25.563944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e7c000 rkey 4a40050 nic_wr_credit 4742. [D 20:42:25.563972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e9c000 rkey 4a40050 nic_wr_credit 4743. [D 20:42:25.563993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ebc000 rkey 4a40050 nic_wr_credit 4744. [D 20:42:25.564004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4edc000 rkey 4a40050 nic_wr_credit 4745. [D 20:42:25.564014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4efc000 rkey 4a40050 nic_wr_credit 4746. [D 20:42:25.564037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f1c000 rkey 4a40050 nic_wr_credit 4747. [D 20:42:25.564047] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f3c000 rkey 4a40050 nic_wr_credit 4748. [D 20:42:25.564067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f5c000 rkey 4a40050 nic_wr_credit 4749. [D 20:42:25.564078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f7c000 rkey 4a40050 nic_wr_credit 4750. [D 20:42:25.564088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f9c000 rkey 4a40050 nic_wr_credit 4751. [D 20:42:25.564110] openib_post_sr_rdmaw: ibv_post_send wr_id 63d880 to 10.1.4.240:38258 remote addr f4fbc000 rkey 4a40050 nic_wr_credit 4752. [D 20:42:25.569497] openib_check_cq: completed rdma wr_id 63d880, nic_wr_credit 4752. [D 20:42:25.569515] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 35/70. [D 20:42:25.569580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.569594] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.569603] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.575264] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.575278] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.575286] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.575302] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2845 [D 20:42:25.575311] element 0: offset: 0x5b0030, size: 24 [D 20:42:25.575322] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 36/70. [D 20:42:25.581475] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.581489] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.581497] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.581512] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2849 [D 20:42:25.581522] element 0: offset: 0x67eee0, size: 24 [D 20:42:25.581531] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 37/70. [D 20:42:25.708140] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2840 [D 20:42:25.708158] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 38/70. [D 20:42:25.708332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4752. [D 20:42:25.708400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4753. [D 20:42:25.708411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4754. [D 20:42:25.708422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4755. [D 20:42:25.708437] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4756. [D 20:42:25.708446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4757. [D 20:42:25.708456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4758. [D 20:42:25.708466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4759. [D 20:42:25.708477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4760. [D 20:42:25.708487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4761. [D 20:42:25.708496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4762. [D 20:42:25.708525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4763. [D 20:42:25.708535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4764. [D 20:42:25.708559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4765. [D 20:42:25.708569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4766. [D 20:42:25.708581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4767. [D 20:42:25.708590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4768. [D 20:42:25.708603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4769. [D 20:42:25.708617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4770. [D 20:42:25.708641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4771. [D 20:42:25.708653] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4772. [D 20:42:25.708663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4773. [D 20:42:25.708687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4774. [D 20:42:25.708697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4775. [D 20:42:25.708712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4776. [D 20:42:25.708724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4777. [D 20:42:25.708734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4778. [D 20:42:25.708758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4779. [D 20:42:25.708768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4780. [D 20:42:25.708783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4781. [D 20:42:25.708807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4782. [D 20:42:25.708818] openib_post_sr_rdmaw: ibv_post_send wr_id 63d880 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4783. [D 20:42:25.714259] openib_check_cq: completed rdma wr_id 63d880, nic_wr_credit 4783. [D 20:42:25.714277] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 39/70. [D 20:42:25.714345] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.714359] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.714368] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.735746] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2849 [D 20:42:25.735764] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 40/70. [D 20:42:25.735834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 4783. [D 20:42:25.735912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 4784. [D 20:42:25.735924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 4785. [D 20:42:25.735934] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 4786. [D 20:42:25.735949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 4787. [D 20:42:25.735959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 4788. [D 20:42:25.735969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 4789. [D 20:42:25.735984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 4790. [D 20:42:25.735994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 4791. [D 20:42:25.736003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 4792. [D 20:42:25.736060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 4793. [D 20:42:25.736071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 4794. [D 20:42:25.736081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 4795. [D 20:42:25.736092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 4796. [D 20:42:25.736116] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 4797. [D 20:42:25.736127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 4798. [D 20:42:25.736137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 4799. [D 20:42:25.736147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 4800. [D 20:42:25.736158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 4801. [D 20:42:25.736168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 4802. [D 20:42:25.736194] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 4803. [D 20:42:25.736209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 4804. [D 20:42:25.736219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 4805. [D 20:42:25.736228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 4806. [D 20:42:25.736257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 4807. [D 20:42:25.736268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 4808. [D 20:42:25.736281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 4809. [D 20:42:25.736291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 4810. [D 20:42:25.736300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 4811. [D 20:42:25.736314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 4812. [D 20:42:25.736338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 4813. [D 20:42:25.736348] openib_post_sr_rdmaw: ibv_post_send wr_id 625590 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 4814. [D 20:42:25.741829] openib_check_cq: completed rdma wr_id 625590, nic_wr_credit 4814. [D 20:42:25.741847] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 41/70. [D 20:42:25.741913] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.741927] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.741935] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.747506] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.747520] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.747528] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.747547] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2852 [D 20:42:25.747556] element 0: offset: 0x63dc60, size: 24 [D 20:42:25.747566] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 42/70. [D 20:42:25.820214] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2845 [D 20:42:25.820231] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 43/70. [D 20:42:25.820295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 4814. [D 20:42:25.820361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 4815. [D 20:42:25.820413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 4816. [D 20:42:25.820424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 4817. [D 20:42:25.820435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 4818. [D 20:42:25.820450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 4819. [D 20:42:25.820461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 4820. [D 20:42:25.820483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 4821. [D 20:42:25.820496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 4822. [D 20:42:25.820506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 4823. [D 20:42:25.820516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 4824. [D 20:42:25.820539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 4825. [D 20:42:25.820549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 4826. [D 20:42:25.820560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 4827. [D 20:42:25.820582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 4828. [D 20:42:25.820592] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 4829. [D 20:42:25.820602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 4830. [D 20:42:25.820612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 4831. [D 20:42:25.820622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 4832. [D 20:42:25.820632] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 4833. [D 20:42:25.820667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 4834. [D 20:42:25.820677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 4835. [D 20:42:25.820703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 4836. [D 20:42:25.820713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 4837. [D 20:42:25.820740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 4838. [D 20:42:25.820751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 4839. [D 20:42:25.820762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 4840. [D 20:42:25.820783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 4841. [D 20:42:25.820794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 4842. [D 20:42:25.820805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 4843. [D 20:42:25.820825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 4844. [D 20:42:25.820840] openib_post_sr_rdmaw: ibv_post_send wr_id 625590 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 4845. [D 20:42:25.826221] openib_check_cq: completed rdma wr_id 625590, nic_wr_credit 4845. [D 20:42:25.826238] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 44/70. [D 20:42:25.826302] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.826317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.826325] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:25.832242] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.832255] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.832264] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:25.832279] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2854 [D 20:42:25.832288] element 0: offset: 0x61fab0, size: 24 [D 20:42:25.832301] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 45/70. [D 20:42:25.848999] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.849013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.849021] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.849036] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2858 [D 20:42:25.849046] element 0: offset: 0x691fe0, size: 24 [D 20:42:25.849055] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 46/70. [D 20:42:25.855762] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2843 [D 20:42:25.855779] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 47/70. [D 20:42:25.855844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 4845. [D 20:42:25.855919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 4846. [D 20:42:25.855930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 4847. [D 20:42:25.855941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 4848. [D 20:42:25.855956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 4849. [D 20:42:25.855965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 4850. [D 20:42:25.855975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4851. [D 20:42:25.855985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4852. [D 20:42:25.855996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4853. [D 20:42:25.856006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 4854. [D 20:42:25.856015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 4855. [D 20:42:25.856030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 4856. [D 20:42:25.856040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 4857. [D 20:42:25.856050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 4858. [D 20:42:25.856060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4859. [D 20:42:25.856071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4860. [D 20:42:25.856080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4861. [D 20:42:25.856090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 4862. [D 20:42:25.856136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 4863. [D 20:42:25.856146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 4864. [D 20:42:25.856156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 4865. [D 20:42:25.856167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 4866. [D 20:42:25.856196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4867. [D 20:42:25.856209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4868. [D 20:42:25.856219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4869. [D 20:42:25.856229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 4870. [D 20:42:25.856243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 4871. [D 20:42:25.856252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 4872. [D 20:42:25.856262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 4873. [D 20:42:25.856293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 4874. [D 20:42:25.856304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4875. [D 20:42:25.856314] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4876. [D 20:42:25.867493] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 4876. [D 20:42:25.867534] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 48/70. [D 20:42:25.867602] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.867616] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.867625] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.873673] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.873686] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.873694] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.873711] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2861 [D 20:42:25.873720] element 0: offset: 0x654770, size: 24 [D 20:42:25.873731] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 49/70. [D 20:42:25.884191] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2852 [D 20:42:25.884208] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 50/70. [D 20:42:25.884375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4876. [D 20:42:25.884444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4877. [D 20:42:25.884455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4878. [D 20:42:25.884466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4879. [D 20:42:25.884480] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4880. [D 20:42:25.884490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4881. [D 20:42:25.884500] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4882. [D 20:42:25.884514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4883. [D 20:42:25.884524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4884. [D 20:42:25.884533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4885. [D 20:42:25.884550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4886. [D 20:42:25.884559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4887. [D 20:42:25.884569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4888. [D 20:42:25.884579] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4889. [D 20:42:25.884602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4890. [D 20:42:25.884612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4891. [D 20:42:25.884622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4892. [D 20:42:25.884645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4893. [D 20:42:25.884655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4894. [D 20:42:25.884665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4895. [D 20:42:25.884689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4896. [D 20:42:25.884699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4897. [D 20:42:25.884710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4898. [D 20:42:25.884729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4899. [D 20:42:25.884744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4900. [D 20:42:25.884754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4901. [D 20:42:25.884763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4902. [D 20:42:25.884785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4903. [D 20:42:25.884795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4904. [D 20:42:25.884805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4905. [D 20:42:25.884830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4906. [D 20:42:25.884841] openib_post_sr_rdmaw: ibv_post_send wr_id 627dc0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4907. [D 20:42:25.892212] openib_check_cq: completed rdma wr_id 627dc0, nic_wr_credit 4907. [D 20:42:25.892231] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 51/70. [D 20:42:25.892295] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.892310] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.892318] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.897732] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.897746] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.897754] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.897771] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2864 [D 20:42:25.897780] element 0: offset: 0x67eee0, size: 24 [D 20:42:25.897790] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 52/70. [D 20:42:25.956727] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2861 [D 20:42:25.956745] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 53/70. [D 20:42:25.956808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 4907. [D 20:42:25.956916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 4908. [D 20:42:25.956930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 4909. [D 20:42:25.956941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 4910. [D 20:42:25.956951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 4911. [D 20:42:25.956961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 4912. [D 20:42:25.956972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4913. [D 20:42:25.956982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4914. [D 20:42:25.956992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4915. [D 20:42:25.957001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 4916. [D 20:42:25.957020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 4917. [D 20:42:25.957030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 4918. [D 20:42:25.957040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 4919. [D 20:42:25.957049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 4920. [D 20:42:25.957060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4921. [D 20:42:25.957071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4922. [D 20:42:25.957081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4923. [D 20:42:25.957105] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 4924. [D 20:42:25.957115] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 4925. [D 20:42:25.957125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 4926. [D 20:42:25.957135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 4927. [D 20:42:25.957165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 4928. [D 20:42:25.957176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4929. [D 20:42:25.957190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4930. [D 20:42:25.957208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4931. [D 20:42:25.957219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 4932. [D 20:42:25.957229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 4933. [D 20:42:25.957239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 4934. [D 20:42:25.957249] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 4935. [D 20:42:25.957259] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 4936. [D 20:42:25.957269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4937. [D 20:42:25.957279] openib_post_sr_rdmaw: ibv_post_send wr_id 661aa0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 4938. [D 20:42:25.962849] openib_check_cq: completed rdma wr_id 661aa0, nic_wr_credit 4938. [D 20:42:25.962866] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 54/70. [D 20:42:25.962931] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:25.962946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.962954] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:25.968917] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:25.968931] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:25.968939] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:25.968956] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2867 [D 20:42:25.968965] element 0: offset: 0x61ee50, size: 24 [D 20:42:25.968976] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 55/70. [D 20:42:26.025968] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2864 [D 20:42:26.025986] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 56/70. [D 20:42:26.026046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 4938. [D 20:42:26.026119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 4939. [D 20:42:26.026173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 4940. [D 20:42:26.026184] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 4941. [D 20:42:26.026195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 4942. [D 20:42:26.026206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 4943. [D 20:42:26.026216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 4944. [D 20:42:26.026236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 4945. [D 20:42:26.026247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 4946. [D 20:42:26.026257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 4947. [D 20:42:26.026266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 4948. [D 20:42:26.026276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 4949. [D 20:42:26.026301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 4950. [D 20:42:26.026311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 4951. [D 20:42:26.026331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 4952. [D 20:42:26.026342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 4953. [D 20:42:26.026351] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 4954. [D 20:42:26.026376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 4955. [D 20:42:26.026387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 4956. [D 20:42:26.026400] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 4957. [D 20:42:26.026419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 4958. [D 20:42:26.026434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 4959. [D 20:42:26.026444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 4960. [D 20:42:26.026466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 4961. [D 20:42:26.026476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 4962. [D 20:42:26.026486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 4963. [D 20:42:26.026514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 4964. [D 20:42:26.026523] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 4965. [D 20:42:26.026537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 4966. [D 20:42:26.026562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 4967. [D 20:42:26.026573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 4968. [D 20:42:26.026583] openib_post_sr_rdmaw: ibv_post_send wr_id 627dc0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 4969. [D 20:42:26.032026] openib_check_cq: completed rdma wr_id 627dc0, nic_wr_credit 4969. [D 20:42:26.032044] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 57/70. [D 20:42:26.032111] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.032125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.032134] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.037548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.037562] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.037570] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.037586] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2870 [D 20:42:26.037595] element 0: offset: 0x5b0030, size: 24 [D 20:42:26.037607] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 58/70. [D 20:42:26.100891] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2867 [D 20:42:26.100908] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 59/70. [D 20:42:26.100966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 4969. [D 20:42:26.101063] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 4970. [D 20:42:26.101077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 4971. [D 20:42:26.101088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 4972. [D 20:42:26.101099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 4973. [D 20:42:26.101109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 4974. [D 20:42:26.101120] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 4975. [D 20:42:26.101130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 4976. [D 20:42:26.101140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 4977. [D 20:42:26.101178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 4978. [D 20:42:26.101203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 4979. [D 20:42:26.101213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 4980. [D 20:42:26.101235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 4981. [D 20:42:26.101245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 4982. [D 20:42:26.101257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 4983. [D 20:42:26.101276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 4984. [D 20:42:26.101287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 4985. [D 20:42:26.101297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 4986. [D 20:42:26.101327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 4987. [D 20:42:26.101337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 4988. [D 20:42:26.101359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 4989. [D 20:42:26.101369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 4990. [D 20:42:26.101390] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 4991. [D 20:42:26.101401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 4992. [D 20:42:26.101410] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 4993. [D 20:42:26.101432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 4994. [D 20:42:26.101443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 4995. [D 20:42:26.101455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 4996. [D 20:42:26.101477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 4997. [D 20:42:26.101488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 4998. [D 20:42:26.101508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 4999. [D 20:42:26.101518] openib_post_sr_rdmaw: ibv_post_send wr_id 627dc0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5000. [D 20:42:26.106993] openib_check_cq: completed rdma wr_id 627dc0, nic_wr_credit 5000. [D 20:42:26.107011] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 60/70. [D 20:42:26.107074] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.107088] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.107097] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.113079] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.113093] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.113102] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.113118] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2873 [D 20:42:26.113127] element 0: offset: 0x6572d0, size: 24 [D 20:42:26.113137] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 0/70. [D 20:42:26.180356] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2870 [D 20:42:26.180373] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 1/70. [D 20:42:26.180433] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5000. [D 20:42:26.180503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5001. [D 20:42:26.180557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5002. [D 20:42:26.180569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5003. [D 20:42:26.180580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5004. [D 20:42:26.180590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5005. [D 20:42:26.180600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5006. [D 20:42:26.180610] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5007. [D 20:42:26.180620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5008. [D 20:42:26.180630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5009. [D 20:42:26.180648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5010. [D 20:42:26.180658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5011. [D 20:42:26.180681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5012. [D 20:42:26.180692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5013. [D 20:42:26.180702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5014. [D 20:42:26.180712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5015. [D 20:42:26.180722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5016. [D 20:42:26.180732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5017. [D 20:42:26.180741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5018. [D 20:42:26.180751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5019. [D 20:42:26.180762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5020. [D 20:42:26.180773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5021. [D 20:42:26.180783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5022. [D 20:42:26.180793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5023. [D 20:42:26.180802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5024. [D 20:42:26.180813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5025. [D 20:42:26.180837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5026. [D 20:42:26.180847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5027. [D 20:42:26.180867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5028. [D 20:42:26.180878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5029. [D 20:42:26.180887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5030. [D 20:42:26.180914] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5031. [D 20:42:26.186406] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5031. [D 20:42:26.186422] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 2/70. [D 20:42:26.186488] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.186502] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.186510] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.191943] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.191957] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.191965] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.191981] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2876 [D 20:42:26.191991] element 0: offset: 0x63dc60, size: 24 [D 20:42:26.192001] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 3/70. [D 20:42:26.243438] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2876 [D 20:42:26.243455] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 4/70. [D 20:42:26.243519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5031. [D 20:42:26.243589] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5032. [D 20:42:26.243601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5033. [D 20:42:26.243611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5034. [D 20:42:26.243621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5035. [D 20:42:26.243638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5036. [D 20:42:26.243648] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5037. [D 20:42:26.243658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5038. [D 20:42:26.243668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5039. [D 20:42:26.243678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5040. [D 20:42:26.243688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5041. [D 20:42:26.243698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5042. [D 20:42:26.243771] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5043. [D 20:42:26.243782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5044. [D 20:42:26.243792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5045. [D 20:42:26.243802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5046. [D 20:42:26.243813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5047. [D 20:42:26.243824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5048. [D 20:42:26.243834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5049. [D 20:42:26.243844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5050. [D 20:42:26.243868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5051. [D 20:42:26.243878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5052. [D 20:42:26.243888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5053. [D 20:42:26.243914] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5054. [D 20:42:26.243924] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5055. [D 20:42:26.243948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5056. [D 20:42:26.243961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5057. [D 20:42:26.243974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5058. [D 20:42:26.243985] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5059. [D 20:42:26.243995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5060. [D 20:42:26.244005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5061. [D 20:42:26.244020] openib_post_sr_rdmaw: ibv_post_send wr_id 627dc0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5062. [D 20:42:26.249498] openib_check_cq: completed rdma wr_id 627dc0, nic_wr_credit 5062. [D 20:42:26.249515] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 5/70. [D 20:42:26.249579] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.249593] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.249602] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.255130] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.255144] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.255152] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.255169] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2879 [D 20:42:26.255178] element 0: offset: 0x654770, size: 24 [D 20:42:26.255188] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 6/70. [D 20:42:26.274710] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2858 [D 20:42:26.274726] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 7/70. [D 20:42:26.274790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5062. [D 20:42:26.274857] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5063. [D 20:42:26.274909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5064. [D 20:42:26.274920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5065. [D 20:42:26.274931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5066. [D 20:42:26.274941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5067. [D 20:42:26.274951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5068. [D 20:42:26.274977] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5069. [D 20:42:26.274992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5070. [D 20:42:26.275002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5071. [D 20:42:26.275012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5072. [D 20:42:26.275034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5073. [D 20:42:26.275044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5074. [D 20:42:26.275065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5075. [D 20:42:26.275075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5076. [D 20:42:26.275085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5077. [D 20:42:26.275099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5078. [D 20:42:26.275122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5079. [D 20:42:26.275134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5080. [D 20:42:26.275153] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5081. [D 20:42:26.275168] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5082. [D 20:42:26.275178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5083. [D 20:42:26.275201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5084. [D 20:42:26.275211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5085. [D 20:42:26.275235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5086. [D 20:42:26.275246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5087. [D 20:42:26.275256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5088. [D 20:42:26.275281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5089. [D 20:42:26.275291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5090. [D 20:42:26.275302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5091. [D 20:42:26.275324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5092. [D 20:42:26.275334] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5093. [D 20:42:26.280708] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5093. [D 20:42:26.280725] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 8/70. [D 20:42:26.280791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.280805] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.280814] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.286588] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.286602] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.286610] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.286626] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2882 [D 20:42:26.286635] element 0: offset: 0x628160, size: 24 [D 20:42:26.286646] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 9/70. [D 20:42:26.336328] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2854 [D 20:42:26.336344] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 10/70. [D 20:42:26.336405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5093. [D 20:42:26.336496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5094. [D 20:42:26.336510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5095. [D 20:42:26.336521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5096. [D 20:42:26.336532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5097. [D 20:42:26.336542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5098. [D 20:42:26.336552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5099. [D 20:42:26.336562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5100. [D 20:42:26.336602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5101. [D 20:42:26.336614] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5102. [D 20:42:26.336634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 5103. [D 20:42:26.336644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 5104. [D 20:42:26.336668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 5105. [D 20:42:26.336679] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 5106. [D 20:42:26.336689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 5107. [D 20:42:26.336710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5108. [D 20:42:26.336721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5109. [D 20:42:26.336734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5110. [D 20:42:26.336755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5111. [D 20:42:26.336766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5112. [D 20:42:26.336776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5113. [D 20:42:26.336786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5114. [D 20:42:26.336808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5115. [D 20:42:26.336818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5116. [D 20:42:26.336828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5117. [D 20:42:26.336842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5118. [D 20:42:26.336851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5119. [D 20:42:26.336861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5120. [D 20:42:26.336871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5121. [D 20:42:26.336888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5122. [D 20:42:26.336898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5123. [D 20:42:26.336907] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5124. [D 20:42:26.342352] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5124. [D 20:42:26.342369] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 11/70. [D 20:42:26.342434] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.342448] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.342457] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.347894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.347907] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.347915] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.347933] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2884 [D 20:42:26.347942] element 0: offset: 0x627f50, size: 24 [D 20:42:26.347952] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 12/70. [D 20:42:26.406560] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2873 [D 20:42:26.406577] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 13/70. [D 20:42:26.406634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 5124. [D 20:42:26.406731] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5125. [D 20:42:26.406743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5126. [D 20:42:26.406755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5127. [D 20:42:26.406766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5128. [D 20:42:26.406776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5129. [D 20:42:26.406786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5130. [D 20:42:26.406796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5131. [D 20:42:26.406806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5132. [D 20:42:26.406842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5133. [D 20:42:26.406852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5134. [D 20:42:26.406874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5135. [D 20:42:26.406889] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5136. [D 20:42:26.406910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5137. [D 20:42:26.406923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5138. [D 20:42:26.406933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5139. [D 20:42:26.406944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5140. [D 20:42:26.406956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5141. [D 20:42:26.406966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5142. [D 20:42:26.406976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5143. [D 20:42:26.406986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5144. [D 20:42:26.406997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5145. [D 20:42:26.407006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5146. [D 20:42:26.407016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5147. [D 20:42:26.407041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5148. [D 20:42:26.407052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5149. [D 20:42:26.407062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5150. [D 20:42:26.407072] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5151. [D 20:42:26.407083] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5152. [D 20:42:26.407093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5153. [D 20:42:26.407103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5154. [D 20:42:26.407118] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5155. [D 20:42:26.412585] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5155. [D 20:42:26.412602] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 14/70. [D 20:42:26.412669] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.412683] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.412691] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.550601] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.550615] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.550623] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.550638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2888 [D 20:42:26.550648] element 0: offset: 0x61f310, size: 24 [D 20:42:26.550658] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 15/70. [D 20:42:26.563187] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2879 [D 20:42:26.563203] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 16/70. [D 20:42:26.563262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5155. [D 20:42:26.563331] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5156. [D 20:42:26.563350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5157. [D 20:42:26.563361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5158. [D 20:42:26.563417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5159. [D 20:42:26.563427] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5160. [D 20:42:26.563438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5161. [D 20:42:26.563448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5162. [D 20:42:26.563458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5163. [D 20:42:26.563467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5164. [D 20:42:26.563498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5165. [D 20:42:26.563508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5166. [D 20:42:26.563517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5167. [D 20:42:26.563542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5168. [D 20:42:26.563552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5169. [D 20:42:26.563562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5170. [D 20:42:26.563572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5171. [D 20:42:26.563587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5172. [D 20:42:26.563597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5173. [D 20:42:26.563619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5174. [D 20:42:26.563630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5175. [D 20:42:26.563640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5176. [D 20:42:26.563650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5177. [D 20:42:26.563660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5178. [D 20:42:26.563670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5179. [D 20:42:26.563685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5180. [D 20:42:26.563717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5181. [D 20:42:26.563727] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5182. [D 20:42:26.563738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5183. [D 20:42:26.563747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5184. [D 20:42:26.563770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5185. [D 20:42:26.563781] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5186. [D 20:42:26.569186] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5186. [D 20:42:26.569202] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 17/70. [D 20:42:26.569267] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.569281] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.569289] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.574806] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.574819] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.574828] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.574843] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2891 [D 20:42:26.574853] element 0: offset: 0x67efc0, size: 24 [D 20:42:26.574862] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 18/70. [D 20:42:26.641354] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2882 [D 20:42:26.641371] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 19/70. [D 20:42:26.641428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5186. [D 20:42:26.641495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5187. [D 20:42:26.641506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5188. [D 20:42:26.641517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5189. [D 20:42:26.641527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5190. [D 20:42:26.641537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5191. [D 20:42:26.641547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5192. [D 20:42:26.641557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5193. [D 20:42:26.641567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5194. [D 20:42:26.641577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5195. [D 20:42:26.641587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5196. [D 20:42:26.641651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5197. [D 20:42:26.641662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5198. [D 20:42:26.641672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5199. [D 20:42:26.641682] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5200. [D 20:42:26.641692] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5201. [D 20:42:26.641708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5202. [D 20:42:26.641718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5203. [D 20:42:26.641728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5204. [D 20:42:26.641738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5205. [D 20:42:26.641748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5206. [D 20:42:26.641758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5207. [D 20:42:26.641785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5208. [D 20:42:26.641795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5209. [D 20:42:26.641805] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5210. [D 20:42:26.641821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5211. [D 20:42:26.641831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5212. [D 20:42:26.641841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5213. [D 20:42:26.641868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5214. [D 20:42:26.641878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5215. [D 20:42:26.641892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5216. [D 20:42:26.641902] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5217. [D 20:42:26.647349] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5217. [D 20:42:26.647366] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 20/70. [D 20:42:26.647430] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.647445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.647453] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.653285] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.653299] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.653307] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.653323] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2894 [D 20:42:26.653332] element 0: offset: 0x64da00, size: 24 [D 20:42:26.653342] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 21/70. [D 20:42:26.707519] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2884 [D 20:42:26.707536] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 22/70. [D 20:42:26.707594] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5217. [D 20:42:26.707684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5218. [D 20:42:26.707698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5219. [D 20:42:26.707709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5220. [D 20:42:26.707720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5221. [D 20:42:26.707730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5222. [D 20:42:26.707740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5223. [D 20:42:26.707749] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5224. [D 20:42:26.707765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5225. [D 20:42:26.707791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5226. [D 20:42:26.707807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 5227. [D 20:42:26.707824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 5228. [D 20:42:26.707834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 5229. [D 20:42:26.707856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 5230. [D 20:42:26.707866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 5231. [D 20:42:26.707876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5232. [D 20:42:26.707898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5233. [D 20:42:26.707908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5234. [D 20:42:26.707918] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5235. [D 20:42:26.707946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5236. [D 20:42:26.707956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5237. [D 20:42:26.707969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5238. [D 20:42:26.707980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5239. [D 20:42:26.707989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5240. [D 20:42:26.707999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5241. [D 20:42:26.708026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5242. [D 20:42:26.708037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5243. [D 20:42:26.708062] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5244. [D 20:42:26.708073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5245. [D 20:42:26.708085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5246. [D 20:42:26.708095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5247. [D 20:42:26.708105] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5248. [D 20:42:26.713516] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5248. [D 20:42:26.713534] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 23/70. [D 20:42:26.713598] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.713613] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.713621] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.719219] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.719233] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.719241] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.719257] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2896 [D 20:42:26.719267] element 0: offset: 0x63e800, size: 24 [D 20:42:26.719276] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 24/70. [D 20:42:26.777778] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2896 [D 20:42:26.777795] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 25/70. [D 20:42:26.777858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5248. [D 20:42:26.777954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5249. [D 20:42:26.777968] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5250. [D 20:42:26.777979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5251. [D 20:42:26.777990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5252. [D 20:42:26.778001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5253. [D 20:42:26.778011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5254. [D 20:42:26.778021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5255. [D 20:42:26.778059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5256. [D 20:42:26.778069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5257. [D 20:42:26.778080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 5258. [D 20:42:26.778090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 5259. [D 20:42:26.778099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 5260. [D 20:42:26.778110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 5261. [D 20:42:26.778133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 5262. [D 20:42:26.778143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5263. [D 20:42:26.778174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5264. [D 20:42:26.778185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5265. [D 20:42:26.778196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5266. [D 20:42:26.778216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5267. [D 20:42:26.778230] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5268. [D 20:42:26.778252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5269. [D 20:42:26.778266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5270. [D 20:42:26.778276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5271. [D 20:42:26.778296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5272. [D 20:42:26.778307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5273. [D 20:42:26.778327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5274. [D 20:42:26.778338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5275. [D 20:42:26.778348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5276. [D 20:42:26.778371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5277. [D 20:42:26.778382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5278. [D 20:42:26.778392] openib_post_sr_rdmaw: ibv_post_send wr_id 646ad0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5279. [D 20:42:26.783862] openib_check_cq: completed rdma wr_id 646ad0, nic_wr_credit 5279. [D 20:42:26.783879] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 26/70. [D 20:42:26.783946] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.783961] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.783969] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.789534] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.789548] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.789556] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.789572] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2899 [D 20:42:26.789582] element 0: offset: 0x67eee0, size: 24 [D 20:42:26.789591] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 27/70. [D 20:42:26.845176] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2891 [D 20:42:26.845193] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 28/70. [D 20:42:26.845253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5279. [D 20:42:26.845323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5280. [D 20:42:26.845378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5281. [D 20:42:26.845388] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5282. [D 20:42:26.845399] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5283. [D 20:42:26.845411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5284. [D 20:42:26.845426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5285. [D 20:42:26.845449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5286. [D 20:42:26.845461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5287. [D 20:42:26.845471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5288. [D 20:42:26.845481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5289. [D 20:42:26.845507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5290. [D 20:42:26.845517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5291. [D 20:42:26.845530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5292. [D 20:42:26.845540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5293. [D 20:42:26.845550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5294. [D 20:42:26.845559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5295. [D 20:42:26.845575] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5296. [D 20:42:26.845597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5297. [D 20:42:26.845608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5298. [D 20:42:26.845628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5299. [D 20:42:26.845640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5300. [D 20:42:26.845650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5301. [D 20:42:26.845669] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5302. [D 20:42:26.845686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5303. [D 20:42:26.845696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5304. [D 20:42:26.845722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5305. [D 20:42:26.845732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5306. [D 20:42:26.845742] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5307. [D 20:42:26.845773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5308. [D 20:42:26.845784] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5309. [D 20:42:26.845794] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5310. [D 20:42:26.851181] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5310. [D 20:42:26.851197] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 29/70. [D 20:42:26.851261] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.851275] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.851284] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.856824] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.856837] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.856846] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.856862] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2903 [D 20:42:26.856871] element 0: offset: 0x61ee50, size: 24 [D 20:42:26.856881] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 30/70. [D 20:42:26.913448] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2888 [D 20:42:26.913465] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 31/70. [D 20:42:26.913527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 5310. [D 20:42:26.913597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5311. [D 20:42:26.913652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5312. [D 20:42:26.913663] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5313. [D 20:42:26.913674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5314. [D 20:42:26.913684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5315. [D 20:42:26.913694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5316. [D 20:42:26.913716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5317. [D 20:42:26.913732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5318. [D 20:42:26.913741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5319. [D 20:42:26.913751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5320. [D 20:42:26.913775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5321. [D 20:42:26.913786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5322. [D 20:42:26.913796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5323. [D 20:42:26.913818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5324. [D 20:42:26.913829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5325. [D 20:42:26.913839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5326. [D 20:42:26.913865] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5327. [D 20:42:26.913875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5328. [D 20:42:26.913898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5329. [D 20:42:26.913910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5330. [D 20:42:26.913920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5331. [D 20:42:26.913942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5332. [D 20:42:26.913952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5333. [D 20:42:26.913972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5334. [D 20:42:26.913983] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5335. [D 20:42:26.913993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5336. [D 20:42:26.914004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5337. [D 20:42:26.914021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5338. [D 20:42:26.914031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5339. [D 20:42:26.914058] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5340. [D 20:42:26.914068] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5341. [D 20:42:26.919454] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5341. [D 20:42:26.919472] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 32/70. [D 20:42:26.919529] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:26.919544] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.919552] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:26.925517] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:26.925531] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:26.925539] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:26.925556] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2906 [D 20:42:26.925565] element 0: offset: 0x654770, size: 24 [D 20:42:26.925575] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 33/70. [D 20:42:27.033881] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2894 [D 20:42:27.033898] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 34/70. [D 20:42:27.034017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5341. [D 20:42:27.034122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5342. [D 20:42:27.034133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5343. [D 20:42:27.034143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5344. [D 20:42:27.034158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5345. [D 20:42:27.034167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5346. [D 20:42:27.034177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5347. [D 20:42:27.034193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5348. [D 20:42:27.034203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5349. [D 20:42:27.034216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5350. [D 20:42:27.034245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5351. [D 20:42:27.034256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5352. [D 20:42:27.034278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5353. [D 20:42:27.034289] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5354. [D 20:42:27.034299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5355. [D 20:42:27.034323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5356. [D 20:42:27.034333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5357. [D 20:42:27.034343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5358. [D 20:42:27.034366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5359. [D 20:42:27.034375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5360. [D 20:42:27.034385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5361. [D 20:42:27.034407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5362. [D 20:42:27.034417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5363. [D 20:42:27.034439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5364. [D 20:42:27.034449] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5365. [D 20:42:27.034471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5366. [D 20:42:27.034481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5367. [D 20:42:27.034503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5368. [D 20:42:27.034514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5369. [D 20:42:27.034526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5370. [D 20:42:27.034553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5371. [D 20:42:27.034563] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5372. [D 20:42:27.039976] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5372. [D 20:42:27.039993] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 35/70. [D 20:42:27.040060] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.040074] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.040083] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.046127] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.046141] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.046149] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.046165] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2909 [D 20:42:27.046175] element 0: offset: 0x628160, size: 24 [D 20:42:27.046185] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 36/70. [D 20:42:27.104923] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2903 [D 20:42:27.104940] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 37/70. [D 20:42:27.105000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5372. [D 20:42:27.105070] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5373. [D 20:42:27.105129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5374. [D 20:42:27.105140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5375. [D 20:42:27.105151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5376. [D 20:42:27.105161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5377. [D 20:42:27.105171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5378. [D 20:42:27.105193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5379. [D 20:42:27.105206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5380. [D 20:42:27.105216] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5381. [D 20:42:27.105226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5382. [D 20:42:27.105241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5383. [D 20:42:27.105251] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5384. [D 20:42:27.105261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5385. [D 20:42:27.105271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5386. [D 20:42:27.105293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5387. [D 20:42:27.105304] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5388. [D 20:42:27.105313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5389. [D 20:42:27.105330] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5390. [D 20:42:27.105340] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5391. [D 20:42:27.105350] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5392. [D 20:42:27.105375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5393. [D 20:42:27.105392] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5394. [D 20:42:27.105401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5395. [D 20:42:27.105422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5396. [D 20:42:27.105432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5397. [D 20:42:27.105442] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5398. [D 20:42:27.105462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5399. [D 20:42:27.105473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5400. [D 20:42:27.105483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5401. [D 20:42:27.105499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5402. [D 20:42:27.105519] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5403. [D 20:42:27.110927] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5403. [D 20:42:27.110945] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 38/70. [D 20:42:27.111009] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.111023] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.111031] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.158492] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2899 [D 20:42:27.158508] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 39/70. [D 20:42:27.158571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5403. [D 20:42:27.158677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5404. [D 20:42:27.158691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5405. [D 20:42:27.158701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5406. [D 20:42:27.158712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5407. [D 20:42:27.158723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5408. [D 20:42:27.158733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5409. [D 20:42:27.158743] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5410. [D 20:42:27.158753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5411. [D 20:42:27.158768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5412. [D 20:42:27.158779] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 5413. [D 20:42:27.158789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 5414. [D 20:42:27.158813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 5415. [D 20:42:27.158824] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 5416. [D 20:42:27.158834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 5417. [D 20:42:27.158844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5418. [D 20:42:27.158868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5419. [D 20:42:27.158877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5420. [D 20:42:27.158887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5421. [D 20:42:27.158910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5422. [D 20:42:27.158921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5423. [D 20:42:27.158931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5424. [D 20:42:27.158940] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5425. [D 20:42:27.158951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5426. [D 20:42:27.158963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5427. [D 20:42:27.158972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5428. [D 20:42:27.158982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5429. [D 20:42:27.159005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5430. [D 20:42:27.159015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5431. [D 20:42:27.159026] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5432. [D 20:42:27.159048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5433. [D 20:42:27.159057] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5434. [D 20:42:27.164542] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5434. [D 20:42:27.164559] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 40/70. [D 20:42:27.164625] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.164639] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.164647] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:27.170454] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.170468] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.170476] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:27.170493] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2911 [D 20:42:27.170502] element 0: offset: 0x62a370, size: 24 [D 20:42:27.170512] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 41/70. [D 20:42:27.216821] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2909 [D 20:42:27.216838] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 42/70. [D 20:42:27.216899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5434. [D 20:42:27.216966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5435. [D 20:42:27.217020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5436. [D 20:42:27.217031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5437. [D 20:42:27.217042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5438. [D 20:42:27.217057] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5439. [D 20:42:27.217068] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5440. [D 20:42:27.217095] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5441. [D 20:42:27.217106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5442. [D 20:42:27.217117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5443. [D 20:42:27.217127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5444. [D 20:42:27.217151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5445. [D 20:42:27.217160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5446. [D 20:42:27.217185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5447. [D 20:42:27.217196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5448. [D 20:42:27.217209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5449. [D 20:42:27.217236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5450. [D 20:42:27.217246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5451. [D 20:42:27.217271] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5452. [D 20:42:27.217281] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5453. [D 20:42:27.217302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5454. [D 20:42:27.217313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5455. [D 20:42:27.217324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5456. [D 20:42:27.217334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5457. [D 20:42:27.217363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5458. [D 20:42:27.217376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5459. [D 20:42:27.217397] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5460. [D 20:42:27.217409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5461. [D 20:42:27.217419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5462. [D 20:42:27.217428] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5463. [D 20:42:27.217450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5464. [D 20:42:27.217460] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5465. [D 20:42:27.222827] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5465. [D 20:42:27.222845] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 43/70. [D 20:42:27.222908] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.222922] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.222930] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:27.229315] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.229329] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.229337] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:27.229354] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2915 [D 20:42:27.229363] element 0: offset: 0x691fe0, size: 24 [D 20:42:27.229373] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 44/70. [D 20:42:27.245366] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.245380] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.245388] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.245404] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2918 [D 20:42:27.245413] element 0: offset: 0x63e800, size: 24 [D 20:42:27.245423] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 45/70. [D 20:42:27.250986] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2906 [D 20:42:27.251002] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 46/70. [D 20:42:27.251154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 5465. [D 20:42:27.251220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5466. [D 20:42:27.251232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5467. [D 20:42:27.251242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5468. [D 20:42:27.251256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5469. [D 20:42:27.251266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5470. [D 20:42:27.251275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5471. [D 20:42:27.251291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5472. [D 20:42:27.251300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5473. [D 20:42:27.251310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5474. [D 20:42:27.251326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5475. [D 20:42:27.251335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5476. [D 20:42:27.251345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5477. [D 20:42:27.251383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5478. [D 20:42:27.251395] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5479. [D 20:42:27.251405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5480. [D 20:42:27.251416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5481. [D 20:42:27.251444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5482. [D 20:42:27.251455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5483. [D 20:42:27.251465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5484. [D 20:42:27.251475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5485. [D 20:42:27.251499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5486. [D 20:42:27.251514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5487. [D 20:42:27.251524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5488. [D 20:42:27.251534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5489. [D 20:42:27.251544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5490. [D 20:42:27.251573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5491. [D 20:42:27.251584] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5492. [D 20:42:27.251598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5493. [D 20:42:27.251607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5494. [D 20:42:27.251617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5495. [D 20:42:27.251633] openib_post_sr_rdmaw: ibv_post_send wr_id 62d5f0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5496. [D 20:42:27.260950] openib_check_cq: completed rdma wr_id 62d5f0, nic_wr_credit 5496. [D 20:42:27.260969] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 47/70. [D 20:42:27.261036] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.261050] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.261058] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.266964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.266977] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.266985] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.267001] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2921 [D 20:42:27.267011] element 0: offset: 0x67efc0, size: 24 [D 20:42:27.267021] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 48/70. [D 20:42:27.303748] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2911 [D 20:42:27.303765] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 49/70. [D 20:42:27.303823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5496. [D 20:42:27.303894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5497. [D 20:42:27.303948] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 5498. [D 20:42:27.303959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 5499. [D 20:42:27.303970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 5500. [D 20:42:27.303981] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 5501. [D 20:42:27.303990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 5502. [D 20:42:27.304011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5503. [D 20:42:27.304022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5504. [D 20:42:27.304032] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5505. [D 20:42:27.304042] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 5506. [D 20:42:27.304052] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 5507. [D 20:42:27.304078] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 5508. [D 20:42:27.304087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 5509. [D 20:42:27.304108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 5510. [D 20:42:27.304118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5511. [D 20:42:27.304127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5512. [D 20:42:27.304155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5513. [D 20:42:27.304165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 5514. [D 20:42:27.304178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 5515. [D 20:42:27.304188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 5516. [D 20:42:27.304198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 5517. [D 20:42:27.304222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 5518. [D 20:42:27.304232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5519. [D 20:42:27.304242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5520. [D 20:42:27.304258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5521. [D 20:42:27.304293] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 5522. [D 20:42:27.304314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 5523. [D 20:42:27.304329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 5524. [D 20:42:27.304348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 5525. [D 20:42:27.304358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 5526. [D 20:42:27.304369] openib_post_sr_rdmaw: ibv_post_send wr_id 62d720 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5527. [D 20:42:27.309752] openib_check_cq: completed rdma wr_id 62d720, nic_wr_credit 5527. [D 20:42:27.309770] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 50/70. [D 20:42:27.309836] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.309850] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.309859] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.315510] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.315523] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.315531] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.315548] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2923 [D 20:42:27.315560] element 0: offset: 0x61f310, size: 24 [D 20:42:27.315570] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 51/70. [D 20:42:27.354071] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2923 [D 20:42:27.354088] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 52/70. [D 20:42:27.354146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43dc000 rkey 4a4004e nic_wr_credit 5527. [D 20:42:27.354212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43fc000 rkey 4a4004e nic_wr_credit 5528. [D 20:42:27.354270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f441c000 rkey 4a4004e nic_wr_credit 5529. [D 20:42:27.354284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f443c000 rkey 4a4004e nic_wr_credit 5530. [D 20:42:27.354295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f445c000 rkey 4a4004e nic_wr_credit 5531. [D 20:42:27.354306] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f447c000 rkey 4a4004e nic_wr_credit 5532. [D 20:42:27.354316] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f449c000 rkey 4a4004e nic_wr_credit 5533. [D 20:42:27.354327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44bc000 rkey 4a4004e nic_wr_credit 5534. [D 20:42:27.354337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44dc000 rkey 4a4004e nic_wr_credit 5535. [D 20:42:27.354363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44fc000 rkey 4a4004e nic_wr_credit 5536. [D 20:42:27.354374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f451c000 rkey 4a4004e nic_wr_credit 5537. [D 20:42:27.354385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f453c000 rkey 4a4004e nic_wr_credit 5538. [D 20:42:27.354394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f455c000 rkey 4a4004e nic_wr_credit 5539. [D 20:42:27.354404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f457c000 rkey 4a4004e nic_wr_credit 5540. [D 20:42:27.354420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f459c000 rkey 4a4004e nic_wr_credit 5541. [D 20:42:27.354446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45bc000 rkey 4a4004e nic_wr_credit 5542. [D 20:42:27.354456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45dc000 rkey 4a4004e nic_wr_credit 5543. [D 20:42:27.354467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45fc000 rkey 4a4004e nic_wr_credit 5544. [D 20:42:27.354477] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f461c000 rkey 4a4004e nic_wr_credit 5545. [D 20:42:27.354499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f463c000 rkey 4a4004e nic_wr_credit 5546. [D 20:42:27.354511] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f465c000 rkey 4a4004e nic_wr_credit 5547. [D 20:42:27.354521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f467c000 rkey 4a4004e nic_wr_credit 5548. [D 20:42:27.354535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f469c000 rkey 4a4004e nic_wr_credit 5549. [D 20:42:27.354545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46bc000 rkey 4a4004e nic_wr_credit 5550. [D 20:42:27.354555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46dc000 rkey 4a4004e nic_wr_credit 5551. [D 20:42:27.354581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46fc000 rkey 4a4004e nic_wr_credit 5552. [D 20:42:27.354591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f471c000 rkey 4a4004e nic_wr_credit 5553. [D 20:42:27.354605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f473c000 rkey 4a4004e nic_wr_credit 5554. [D 20:42:27.354615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f475c000 rkey 4a4004e nic_wr_credit 5555. [D 20:42:27.354625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f477c000 rkey 4a4004e nic_wr_credit 5556. [D 20:42:27.354655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f479c000 rkey 4a4004e nic_wr_credit 5557. [D 20:42:27.354665] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f47bc000 rkey 4a4004e nic_wr_credit 5558. [D 20:42:27.360143] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5558. [D 20:42:27.360161] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 53/70. [D 20:42:27.362305] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.362321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.362331] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.402087] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2921 [D 20:42:27.402105] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 54/70. [D 20:42:27.402166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 5558. [D 20:42:27.402233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5559. [D 20:42:27.402296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5560. [D 20:42:27.402308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5561. [D 20:42:27.402318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5562. [D 20:42:27.402329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5563. [D 20:42:27.402339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5564. [D 20:42:27.402349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5565. [D 20:42:27.402361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5566. [D 20:42:27.402377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5567. [D 20:42:27.402387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5568. [D 20:42:27.402396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5569. [D 20:42:27.402407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5570. [D 20:42:27.402424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5571. [D 20:42:27.402434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5572. [D 20:42:27.402444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5573. [D 20:42:27.402461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5574. [D 20:42:27.402471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5575. [D 20:42:27.402495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5576. [D 20:42:27.402506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5577. [D 20:42:27.402516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5578. [D 20:42:27.402527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5579. [D 20:42:27.402537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5580. [D 20:42:27.402546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5581. [D 20:42:27.402556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5582. [D 20:42:27.402588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5583. [D 20:42:27.402598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5584. [D 20:42:27.402611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5585. [D 20:42:27.402621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5586. [D 20:42:27.402630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5587. [D 20:42:27.402646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5588. [D 20:42:27.402656] openib_post_sr_rdmaw: ibv_post_send wr_id 62d720 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5589. [D 20:42:27.408093] openib_check_cq: completed rdma wr_id 62d720, nic_wr_credit 5589. [D 20:42:27.408110] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 55/70. [D 20:42:27.410369] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.410384] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.410394] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:27.416719] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.416734] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.416745] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:27.416779] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2927 [D 20:42:27.416791] element 0: offset: 0x64da00, size: 24 [D 20:42:27.416803] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 56/70. [D 20:42:27.459307] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2915 [D 20:42:27.459325] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 57/70. [D 20:42:27.459386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 5589. [D 20:42:27.459462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 5590. [D 20:42:27.459473] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 5591. [D 20:42:27.459484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 5592. [D 20:42:27.459495] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 5593. [D 20:42:27.459505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 5594. [D 20:42:27.459521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 5595. [D 20:42:27.459531] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 5596. [D 20:42:27.459541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 5597. [D 20:42:27.459556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 5598. [D 20:42:27.459613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 5599. [D 20:42:27.459624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 5600. [D 20:42:27.459639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 5601. [D 20:42:27.459649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 5602. [D 20:42:27.459661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 5603. [D 20:42:27.459677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 5604. [D 20:42:27.459703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 5605. [D 20:42:27.459718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 5606. [D 20:42:27.459728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 5607. [D 20:42:27.459738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 5608. [D 20:42:27.459752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 5609. [D 20:42:27.459762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 5610. [D 20:42:27.459772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 5611. [D 20:42:27.459787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 5612. [D 20:42:27.459812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 5613. [D 20:42:27.459825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 5614. [D 20:42:27.459835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 5615. [D 20:42:27.459845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 5616. [D 20:42:27.459869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 5617. [D 20:42:27.459879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 5618. [D 20:42:27.459893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 5619. [D 20:42:27.459903] openib_post_sr_rdmaw: ibv_post_send wr_id 61f9e0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 5620. [D 20:42:27.465326] openib_check_cq: completed rdma wr_id 61f9e0, nic_wr_credit 5620. [D 20:42:27.465344] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 58/70. [D 20:42:27.467550] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.467605] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.467616] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:27.473879] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.473893] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.473903] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:27.473936] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2930 [D 20:42:27.473947] element 0: offset: 0x67eee0, size: 24 [D 20:42:27.473959] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 59/70. [D 20:42:27.498383] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.498445] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.498456] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.498493] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2932 [D 20:42:27.498504] element 0: offset: 0x61ee50, size: 24 [D 20:42:27.498520] openib_post_sr: 10.1.4.240:38258 bh 18 len 40 wr 60/70. [D 20:42:27.517892] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2927 [D 20:42:27.517910] openib_post_sr: 10.1.4.240:38258 bh 19 len 32 wr 0/70. [D 20:42:27.517975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 5620. [D 20:42:27.518055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5621. [D 20:42:27.518066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5622. [D 20:42:27.518077] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5623. [D 20:42:27.518088] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5624. [D 20:42:27.518097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5625. [D 20:42:27.518112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5626. [D 20:42:27.518122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5627. [D 20:42:27.518132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5628. [D 20:42:27.518147] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5629. [D 20:42:27.518214] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5630. [D 20:42:27.518225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5631. [D 20:42:27.518235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5632. [D 20:42:27.518245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5633. [D 20:42:27.518255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5634. [D 20:42:27.518265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5635. [D 20:42:27.518296] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5636. [D 20:42:27.518307] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5637. [D 20:42:27.518318] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5638. [D 20:42:27.518329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5639. [D 20:42:27.518338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5640. [D 20:42:27.518349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5641. [D 20:42:27.518359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5642. [D 20:42:27.518369] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5643. [D 20:42:27.518379] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5644. [D 20:42:27.518389] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5645. [D 20:42:27.518408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5646. [D 20:42:27.518418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5647. [D 20:42:27.518443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5648. [D 20:42:27.518453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5649. [D 20:42:27.518463] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5650. [D 20:42:27.518472] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5651. [D 20:42:27.523907] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5651. [D 20:42:27.523924] openib_post_sr: 10.1.4.240:38258 bh 0 len 16 wr 1/70. [D 20:42:27.526120] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.526135] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.526145] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.531999] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.532035] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.532046] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.532082] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2936 [D 20:42:27.532093] element 0: offset: 0x649100, size: 24 [D 20:42:27.532106] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 2/70. [D 20:42:27.552852] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2918 [D 20:42:27.552870] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 3/70. [D 20:42:27.552931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5651. [D 20:42:27.553001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5652. [D 20:42:27.553021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5653. [D 20:42:27.553034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5654. [D 20:42:27.553045] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5655. [D 20:42:27.553055] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5656. [D 20:42:27.553065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5657. [D 20:42:27.553075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5658. [D 20:42:27.553090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5659. [D 20:42:27.553100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5660. [D 20:42:27.553156] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5661. [D 20:42:27.553179] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5662. [D 20:42:27.553190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5663. [D 20:42:27.553200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5664. [D 20:42:27.553210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5665. [D 20:42:27.553226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5666. [D 20:42:27.553250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5667. [D 20:42:27.553262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5668. [D 20:42:27.553272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5669. [D 20:42:27.553282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5670. [D 20:42:27.553309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5671. [D 20:42:27.553319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5672. [D 20:42:27.553334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5673. [D 20:42:27.553343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5674. [D 20:42:27.553353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5675. [D 20:42:27.553376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5676. [D 20:42:27.553386] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5677. [D 20:42:27.553396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5678. [D 20:42:27.553407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5679. [D 20:42:27.553417] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5680. [D 20:42:27.553445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5681. [D 20:42:27.553456] openib_post_sr_rdmaw: ibv_post_send wr_id 648f70 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5682. [D 20:42:27.558856] openib_check_cq: completed rdma wr_id 648f70, nic_wr_credit 5682. [D 20:42:27.558873] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 4/70. [D 20:42:27.559600] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.559615] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.559625] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.566400] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.566415] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.566426] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.566460] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2939 [D 20:42:27.566471] element 0: offset: 0x627f50, size: 24 [D 20:42:27.566483] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 5/70. [D 20:42:27.601632] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2930 [D 20:42:27.601650] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 6/70. [D 20:42:27.601708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5682. [D 20:42:27.601775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5683. [D 20:42:27.601795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5684. [D 20:42:27.601809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5685. [D 20:42:27.601819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5686. [D 20:42:27.601830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5687. [D 20:42:27.601839] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5688. [D 20:42:27.601849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5689. [D 20:42:27.601861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5690. [D 20:42:27.601877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5691. [D 20:42:27.601887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5692. [D 20:42:27.601897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5693. [D 20:42:27.601906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5694. [D 20:42:27.601919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5695. [D 20:42:27.601938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5696. [D 20:42:27.601986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5697. [D 20:42:27.601997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5698. [D 20:42:27.602007] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5699. [D 20:42:27.602017] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5700. [D 20:42:27.602028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5701. [D 20:42:27.602039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5702. [D 20:42:27.602048] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5703. [D 20:42:27.602080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5704. [D 20:42:27.602091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5705. [D 20:42:27.602102] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5706. [D 20:42:27.602112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5707. [D 20:42:27.602122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5708. [D 20:42:27.602132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5709. [D 20:42:27.602160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5710. [D 20:42:27.602170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5711. [D 20:42:27.602181] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5712. [D 20:42:27.602191] openib_post_sr_rdmaw: ibv_post_send wr_id 646ad0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5713. [D 20:42:27.607633] openib_check_cq: completed rdma wr_id 646ad0, nic_wr_credit 5713. [D 20:42:27.607651] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 7/70. [D 20:42:27.609967] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.609981] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.609991] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.616181] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.616198] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.616210] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.616244] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2942 [D 20:42:27.616255] element 0: offset: 0x62a370, size: 24 [D 20:42:27.616266] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 8/70. [D 20:42:27.661363] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2939 [D 20:42:27.661382] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 9/70. [D 20:42:27.661443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5713. [D 20:42:27.661513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5714. [D 20:42:27.661534] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5715. [D 20:42:27.661544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5716. [D 20:42:27.661555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5717. [D 20:42:27.661565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5718. [D 20:42:27.661581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5719. [D 20:42:27.661591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5720. [D 20:42:27.661600] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5721. [D 20:42:27.661655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5722. [D 20:42:27.661666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5723. [D 20:42:27.661678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5724. [D 20:42:27.661703] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5725. [D 20:42:27.661713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5726. [D 20:42:27.661724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5727. [D 20:42:27.661738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5728. [D 20:42:27.661748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5729. [D 20:42:27.661757] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5730. [D 20:42:27.661790] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5731. [D 20:42:27.661800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5732. [D 20:42:27.661811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5733. [D 20:42:27.661821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5734. [D 20:42:27.661837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5735. [D 20:42:27.661847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5736. [D 20:42:27.661868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5737. [D 20:42:27.661878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5738. [D 20:42:27.661888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5739. [D 20:42:27.661900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5740. [D 20:42:27.661929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5741. [D 20:42:27.661939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5742. [D 20:42:27.661950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5743. [D 20:42:27.661960] openib_post_sr_rdmaw: ibv_post_send wr_id 648f70 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5744. [D 20:42:27.667367] openib_check_cq: completed rdma wr_id 648f70, nic_wr_credit 5744. [D 20:42:27.667384] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 10/70. [D 20:42:27.669591] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.669606] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.669617] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:27.674826] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:27.674841] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.674852] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:27.674886] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2945 [D 20:42:27.674897] element 0: offset: 0x627dd0, size: 24 [D 20:42:27.674911] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 11/70. [D 20:42:27.989003] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2936 [D 20:42:27.989022] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 12/70. [D 20:42:27.989155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 5744. [D 20:42:27.989236] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5745. [D 20:42:27.989247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5746. [D 20:42:27.989258] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5747. [D 20:42:27.989272] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5748. [D 20:42:27.989282] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5749. [D 20:42:27.989294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5750. [D 20:42:27.989309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5751. [D 20:42:27.989319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5752. [D 20:42:27.989329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5753. [D 20:42:27.989403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5754. [D 20:42:27.989413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5755. [D 20:42:27.989426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5756. [D 20:42:27.989441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5757. [D 20:42:27.989451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5758. [D 20:42:27.989460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5759. [D 20:42:27.989476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5760. [D 20:42:27.989494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5761. [D 20:42:27.989504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5762. [D 20:42:27.989519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5763. [D 20:42:27.989529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5764. [D 20:42:27.989549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5765. [D 20:42:27.989560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5766. [D 20:42:27.989571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5767. [D 20:42:27.989581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5768. [D 20:42:27.989591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5769. [D 20:42:27.989609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5770. [D 20:42:27.989619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5771. [D 20:42:27.989643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5772. [D 20:42:27.989655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5773. [D 20:42:27.989665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5774. [D 20:42:27.989676] openib_post_sr_rdmaw: ibv_post_send wr_id 648f70 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5775. [D 20:42:27.995156] openib_check_cq: completed rdma wr_id 648f70, nic_wr_credit 5775. [D 20:42:27.995174] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 13/70. [D 20:42:27.997422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:27.997438] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:27.997448] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.003612] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.003628] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.003638] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.003684] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2948 [D 20:42:28.003698] element 0: offset: 0x5b0030, size: 24 [D 20:42:28.003710] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 14/70. [D 20:42:28.089949] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2942 [D 20:42:28.089967] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 15/70. [D 20:42:28.090064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5775. [D 20:42:28.090140] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5776. [D 20:42:28.090151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5777. [D 20:42:28.090162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5778. [D 20:42:28.090175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5779. [D 20:42:28.090185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5780. [D 20:42:28.090195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5781. [D 20:42:28.090210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5782. [D 20:42:28.090220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5783. [D 20:42:28.090229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5784. [D 20:42:28.090287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5785. [D 20:42:28.090298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5786. [D 20:42:28.090308] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5787. [D 20:42:28.090332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5788. [D 20:42:28.090342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5789. [D 20:42:28.090353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5790. [D 20:42:28.090363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5791. [D 20:42:28.090373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5792. [D 20:42:28.090393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5793. [D 20:42:28.090420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5794. [D 20:42:28.090434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5795. [D 20:42:28.090445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5796. [D 20:42:28.090454] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5797. [D 20:42:28.090481] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5798. [D 20:42:28.090492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5799. [D 20:42:28.090503] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5800. [D 20:42:28.090513] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5801. [D 20:42:28.090528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5802. [D 20:42:28.090553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5803. [D 20:42:28.090564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5804. [D 20:42:28.090574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5805. [D 20:42:28.090584] openib_post_sr_rdmaw: ibv_post_send wr_id 648f70 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5806. [D 20:42:28.095997] openib_check_cq: completed rdma wr_id 648f70, nic_wr_credit 5806. [D 20:42:28.096014] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 16/70. [D 20:42:28.098298] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.098313] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.098323] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.104595] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.104609] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.104619] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.104652] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2951 [D 20:42:28.104663] element 0: offset: 0x63e800, size: 24 [D 20:42:28.104675] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 17/70. [D 20:42:28.172598] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2945 [D 20:42:28.172616] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 18/70. [D 20:42:28.172674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5806. [D 20:42:28.172745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5807. [D 20:42:28.172755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5808. [D 20:42:28.172766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5809. [D 20:42:28.172777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5810. [D 20:42:28.172787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5811. [D 20:42:28.172796] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5812. [D 20:42:28.172807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5813. [D 20:42:28.172817] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5814. [D 20:42:28.172827] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5815. [D 20:42:28.172837] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5816. [D 20:42:28.172899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5817. [D 20:42:28.172910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5818. [D 20:42:28.172931] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5819. [D 20:42:28.172945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5820. [D 20:42:28.172955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5821. [D 20:42:28.172965] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5822. [D 20:42:28.172979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5823. [D 20:42:28.172989] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5824. [D 20:42:28.172999] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5825. [D 20:42:28.173024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5826. [D 20:42:28.173034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5827. [D 20:42:28.173044] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5828. [D 20:42:28.173054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5829. [D 20:42:28.173064] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5830. [D 20:42:28.173075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5831. [D 20:42:28.173099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5832. [D 20:42:28.173110] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5833. [D 20:42:28.173119] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5834. [D 20:42:28.173130] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5835. [D 20:42:28.173146] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5836. [D 20:42:28.173165] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5837. [D 20:42:28.178600] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 5837. [D 20:42:28.178616] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 19/70. [D 20:42:28.181004] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.181020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.181030] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.186005] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.186020] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.186030] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.186064] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2954 [D 20:42:28.186075] element 0: offset: 0x654770, size: 24 [D 20:42:28.186087] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 20/70. [D 20:42:28.242498] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2954 [D 20:42:28.242516] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 21/70. [D 20:42:28.242577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5837. [D 20:42:28.242658] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5838. [D 20:42:28.242670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5839. [D 20:42:28.242683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5840. [D 20:42:28.242693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5841. [D 20:42:28.242704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5842. [D 20:42:28.242714] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5843. [D 20:42:28.242724] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5844. [D 20:42:28.242734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5845. [D 20:42:28.242745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5846. [D 20:42:28.242755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5847. [D 20:42:28.242765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5848. [D 20:42:28.242775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5849. [D 20:42:28.242794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5850. [D 20:42:28.242804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5851. [D 20:42:28.242814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5852. [D 20:42:28.242867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5853. [D 20:42:28.242878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5854. [D 20:42:28.242888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5855. [D 20:42:28.242898] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5856. [D 20:42:28.242909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5857. [D 20:42:28.242919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5858. [D 20:42:28.242928] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5859. [D 20:42:28.242938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5860. [D 20:42:28.242957] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5861. [D 20:42:28.242967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5862. [D 20:42:28.242987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5863. [D 20:42:28.243001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5864. [D 20:42:28.243011] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5865. [D 20:42:28.243021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5866. [D 20:42:28.243036] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5867. [D 20:42:28.243046] openib_post_sr_rdmaw: ibv_post_send wr_id 63d880 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5868. [D 20:42:28.248591] openib_check_cq: completed rdma wr_id 63d880, nic_wr_credit 5868. [D 20:42:28.248609] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 22/70. [D 20:42:28.250817] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.250832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.250842] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.255649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.255663] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.255674] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.255706] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2957 [D 20:42:28.255717] element 0: offset: 0x63fd80, size: 24 [D 20:42:28.255729] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 23/70. [D 20:42:28.320791] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2948 [D 20:42:28.320810] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 24/70. [D 20:42:28.320869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 5868. [D 20:42:28.320938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 5869. [D 20:42:28.320958] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 5870. [D 20:42:28.320972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 5871. [D 20:42:28.320982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 5872. [D 20:42:28.320993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 5873. [D 20:42:28.321004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 5874. [D 20:42:28.321014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 5875. [D 20:42:28.321024] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 5876. [D 20:42:28.321034] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 5877. [D 20:42:28.321086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 5878. [D 20:42:28.321097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 5879. [D 20:42:28.321108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 5880. [D 20:42:28.321129] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 5881. [D 20:42:28.321139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 5882. [D 20:42:28.321149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 5883. [D 20:42:28.321165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 5884. [D 20:42:28.321191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 5885. [D 20:42:28.321202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 5886. [D 20:42:28.321213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 5887. [D 20:42:28.321222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 5888. [D 20:42:28.321233] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 5889. [D 20:42:28.321243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 5890. [D 20:42:28.321253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 5891. [D 20:42:28.321280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 5892. [D 20:42:28.321290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 5893. [D 20:42:28.321300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 5894. [D 20:42:28.321323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 5895. [D 20:42:28.321333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 5896. [D 20:42:28.321343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 5897. [D 20:42:28.321354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 5898. [D 20:42:28.321364] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 5899. [D 20:42:28.326837] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 5899. [D 20:42:28.326854] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 25/70. [D 20:42:28.329042] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.329057] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.329068] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.335058] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.335073] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.335084] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.335117] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2960 [D 20:42:28.335127] element 0: offset: 0x61f310, size: 24 [D 20:42:28.335139] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 26/70. [D 20:42:28.391141] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2932 [D 20:42:28.391160] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 27/70. [D 20:42:28.391222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5899. [D 20:42:28.391299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5900. [D 20:42:28.391310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5901. [D 20:42:28.391321] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5902. [D 20:42:28.391332] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5903. [D 20:42:28.391342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5904. [D 20:42:28.391358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5905. [D 20:42:28.391368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5906. [D 20:42:28.391378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 5907. [D 20:42:28.391393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 5908. [D 20:42:28.391443] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 5909. [D 20:42:28.391455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 5910. [D 20:42:28.391465] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 5911. [D 20:42:28.391491] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 5912. [D 20:42:28.391501] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 5913. [D 20:42:28.391512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 5914. [D 20:42:28.391522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 5915. [D 20:42:28.391532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 5916. [D 20:42:28.391543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 5917. [D 20:42:28.391571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 5918. [D 20:42:28.391586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 5919. [D 20:42:28.391595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 5920. [D 20:42:28.391605] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 5921. [D 20:42:28.391619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 5922. [D 20:42:28.391636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 5923. [D 20:42:28.391647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 5924. [D 20:42:28.391694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 5925. [D 20:42:28.391708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 5926. [D 20:42:28.391719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 5927. [D 20:42:28.391729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 5928. [D 20:42:28.391739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 5929. [D 20:42:28.391749] openib_post_sr_rdmaw: ibv_post_send wr_id 63d880 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 5930. [D 20:42:28.397164] openib_check_cq: completed rdma wr_id 63d880, nic_wr_credit 5930. [D 20:42:28.397181] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 28/70. [D 20:42:28.399496] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.399511] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.399521] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.403644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.403662] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.403673] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.403708] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2962 [D 20:42:28.403718] element 0: offset: 0x64da00, size: 24 [D 20:42:28.403731] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 29/70. [D 20:42:28.463705] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2951 [D 20:42:28.463723] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 30/70. [D 20:42:28.463782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 5930. [D 20:42:28.463849] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 5931. [D 20:42:28.463869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 5932. [D 20:42:28.463879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 5933. [D 20:42:28.463890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 5934. [D 20:42:28.463900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 5935. [D 20:42:28.463916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 5936. [D 20:42:28.463925] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 5937. [D 20:42:28.463935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 5938. [D 20:42:28.463950] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 5939. [D 20:42:28.463960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 5940. [D 20:42:28.463970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 5941. [D 20:42:28.463980] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 5942. [D 20:42:28.463990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 5943. [D 20:42:28.464000] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 5944. [D 20:42:28.464010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 5945. [D 20:42:28.464020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 5946. [D 20:42:28.464073] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 5947. [D 20:42:28.464084] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 5948. [D 20:42:28.464094] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 5949. [D 20:42:28.464117] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 5950. [D 20:42:28.464127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 5951. [D 20:42:28.464137] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 5952. [D 20:42:28.464151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 5953. [D 20:42:28.464161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 5954. [D 20:42:28.464171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 5955. [D 20:42:28.464195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 5956. [D 20:42:28.464205] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 5957. [D 20:42:28.464215] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 5958. [D 20:42:28.464225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 5959. [D 20:42:28.464235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 5960. [D 20:42:28.464245] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 5961. [D 20:42:28.469704] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 5961. [D 20:42:28.469720] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 31/70. [D 20:42:28.472016] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.472031] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.472041] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.524015] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2957 [D 20:42:28.524033] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 32/70. [D 20:42:28.524093] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 5961. [D 20:42:28.524162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 5962. [D 20:42:28.524182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 5963. [D 20:42:28.524192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 5964. [D 20:42:28.524203] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 5965. [D 20:42:28.524213] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 5966. [D 20:42:28.524227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 5967. [D 20:42:28.524237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 5968. [D 20:42:28.524247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 5969. [D 20:42:28.524263] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 5970. [D 20:42:28.524314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 5971. [D 20:42:28.524325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 5972. [D 20:42:28.524352] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 5973. [D 20:42:28.524363] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 5974. [D 20:42:28.524372] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 5975. [D 20:42:28.524383] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 5976. [D 20:42:28.524408] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 5977. [D 20:42:28.524418] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 5978. [D 20:42:28.524431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 5979. [D 20:42:28.524441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 5980. [D 20:42:28.524451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 5981. [D 20:42:28.524466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 5982. [D 20:42:28.524476] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 5983. [D 20:42:28.524486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 5984. [D 20:42:28.524496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 5985. [D 20:42:28.524514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 5986. [D 20:42:28.524524] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 5987. [D 20:42:28.524551] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 5988. [D 20:42:28.524561] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 5989. [D 20:42:28.524571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 5990. [D 20:42:28.524581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 5991. [D 20:42:28.524591] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 5992. [D 20:42:28.530018] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 5992. [D 20:42:28.530034] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 33/70. [D 20:42:28.532358] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.532374] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.532385] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:28.537804] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.537824] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.537833] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:28.537868] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2966 [D 20:42:28.537879] element 0: offset: 0x627dd0, size: 24 [D 20:42:28.537892] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 34/70. [D 20:42:28.606133] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.606197] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.606207] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.606245] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2969 [D 20:42:28.606256] element 0: offset: 0x67efc0, size: 24 [D 20:42:28.606272] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 35/70. [D 20:42:28.621430] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2962 [D 20:42:28.621450] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 36/70. [D 20:42:28.621507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 5992. [D 20:42:28.621572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 5993. [D 20:42:28.621624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 5994. [D 20:42:28.621634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 5995. [D 20:42:28.621645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 5996. [D 20:42:28.621656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 5997. [D 20:42:28.621666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 5998. [D 20:42:28.621676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 5999. [D 20:42:28.621700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6000. [D 20:42:28.621710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6001. [D 20:42:28.621720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 6002. [D 20:42:28.621748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 6003. [D 20:42:28.621758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 6004. [D 20:42:28.621783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 6005. [D 20:42:28.621794] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 6006. [D 20:42:28.621806] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6007. [D 20:42:28.621830] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6008. [D 20:42:28.621842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6009. [D 20:42:28.621852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6010. [D 20:42:28.621876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6011. [D 20:42:28.621886] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6012. [D 20:42:28.621907] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6013. [D 20:42:28.621917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6014. [D 20:42:28.621927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6015. [D 20:42:28.621954] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6016. [D 20:42:28.621964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6017. [D 20:42:28.621974] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6018. [D 20:42:28.621995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6019. [D 20:42:28.622005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6020. [D 20:42:28.622015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6021. [D 20:42:28.622030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6022. [D 20:42:28.622041] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6023. [D 20:42:28.627473] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 6023. [D 20:42:28.627491] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 37/70. [D 20:42:28.629789] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.629804] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.629815] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.635347] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.635361] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.635371] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.635403] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2971 [D 20:42:28.635414] element 0: offset: 0x654770, size: 24 [D 20:42:28.635426] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 38/70. [D 20:42:28.640400] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2960 [D 20:42:28.640419] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 39/70. [D 20:42:28.640580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 6023. [D 20:42:28.640634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 6024. [D 20:42:28.640645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 6025. [D 20:42:28.640656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 6026. [D 20:42:28.640666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 6027. [D 20:42:28.640677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 6028. [D 20:42:28.640687] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 6029. [D 20:42:28.640697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 6030. [D 20:42:28.640707] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 6031. [D 20:42:28.640716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 6032. [D 20:42:28.640726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 6033. [D 20:42:28.640758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 6034. [D 20:42:28.640768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 6035. [D 20:42:28.640780] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 6036. [D 20:42:28.640802] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 6037. [D 20:42:28.640813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 6038. [D 20:42:28.640823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 6039. [D 20:42:28.640844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 6040. [D 20:42:28.640854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 6041. [D 20:42:28.640864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 6042. [D 20:42:28.640892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 6043. [D 20:42:28.640902] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 6044. [D 20:42:28.640916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 6045. [D 20:42:28.640927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 6046. [D 20:42:28.640936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 6047. [D 20:42:28.640963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 6048. [D 20:42:28.640973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 6049. [D 20:42:28.640987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 6050. [D 20:42:28.640996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 6051. [D 20:42:28.641019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 6052. [D 20:42:28.641029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 6053. [D 20:42:28.641049] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 6054. [D 20:42:28.648544] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6054. [D 20:42:28.648563] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 40/70. [D 20:42:28.650976] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.650992] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.651002] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.655668] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.655687] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.655698] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.655732] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2975 [D 20:42:28.655743] element 0: offset: 0x5b0030, size: 24 [D 20:42:28.655757] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 41/70. [D 20:42:28.685283] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2971 [D 20:42:28.685302] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 42/70. [D 20:42:28.685361] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6054. [D 20:42:28.685458] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6055. [D 20:42:28.685472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 6056. [D 20:42:28.685484] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 6057. [D 20:42:28.685494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 6058. [D 20:42:28.685505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 6059. [D 20:42:28.685516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 6060. [D 20:42:28.685526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6061. [D 20:42:28.685562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6062. [D 20:42:28.685573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6063. [D 20:42:28.685595] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 6064. [D 20:42:28.685606] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 6065. [D 20:42:28.685617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 6066. [D 20:42:28.685644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 6067. [D 20:42:28.685655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 6068. [D 20:42:28.685675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6069. [D 20:42:28.685690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6070. [D 20:42:28.685712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6071. [D 20:42:28.685723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6072. [D 20:42:28.685733] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6073. [D 20:42:28.685752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6074. [D 20:42:28.685767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6075. [D 20:42:28.685788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6076. [D 20:42:28.685803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6077. [D 20:42:28.685825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6078. [D 20:42:28.685838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6079. [D 20:42:28.685861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6080. [D 20:42:28.685873] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6081. [D 20:42:28.685883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6082. [D 20:42:28.685908] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6083. [D 20:42:28.685917] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6084. [D 20:42:28.685942] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6085. [D 20:42:28.691313] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 6085. [D 20:42:28.691330] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 43/70. [D 20:42:28.693538] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.693553] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.693563] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.699125] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.699140] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.699150] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.699182] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2977 [D 20:42:28.699193] element 0: offset: 0x61f7d0, size: 24 [D 20:42:28.699205] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 44/70. [D 20:42:28.734572] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2966 [D 20:42:28.734591] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 45/70. [D 20:42:28.734657] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6085. [D 20:42:28.734735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6086. [D 20:42:28.734746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6087. [D 20:42:28.734756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6088. [D 20:42:28.734767] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6089. [D 20:42:28.734777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6090. [D 20:42:28.734793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6091. [D 20:42:28.734803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6092. [D 20:42:28.734813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6093. [D 20:42:28.734866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6094. [D 20:42:28.734877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6095. [D 20:42:28.734890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6096. [D 20:42:28.734916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6097. [D 20:42:28.734927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6098. [D 20:42:28.734936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6099. [D 20:42:28.734967] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6100. [D 20:42:28.734984] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6101. [D 20:42:28.734994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6102. [D 20:42:28.735004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6103. [D 20:42:28.735020] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6104. [D 20:42:28.735030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6105. [D 20:42:28.735040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6106. [D 20:42:28.735050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6107. [D 20:42:28.735061] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6108. [D 20:42:28.735071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6109. [D 20:42:28.735097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6110. [D 20:42:28.735113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6111. [D 20:42:28.735124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6112. [D 20:42:28.735133] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6113. [D 20:42:28.735148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6114. [D 20:42:28.735158] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6115. [D 20:42:28.735168] openib_post_sr_rdmaw: ibv_post_send wr_id 658580 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6116. [D 20:42:28.740590] openib_check_cq: completed rdma wr_id 658580, nic_wr_credit 6116. [D 20:42:28.740607] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 46/70. [D 20:42:28.742815] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.742830] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.742841] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.748440] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.748457] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.748467] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.748501] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2981 [D 20:42:28.748512] element 0: offset: 0x62a370, size: 24 [D 20:42:28.748526] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 47/70. [D 20:42:28.786442] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2975 [D 20:42:28.786460] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 48/70. [D 20:42:28.786528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 6116. [D 20:42:28.786607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 6117. [D 20:42:28.786618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 6118. [D 20:42:28.786629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 6119. [D 20:42:28.786640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 6120. [D 20:42:28.786650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 6121. [D 20:42:28.786664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 6122. [D 20:42:28.786674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 6123. [D 20:42:28.786684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 6124. [D 20:42:28.786699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 6125. [D 20:42:28.786750] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 6126. [D 20:42:28.786763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 6127. [D 20:42:28.786773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 6128. [D 20:42:28.786783] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 6129. [D 20:42:28.786799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 6130. [D 20:42:28.786809] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 6131. [D 20:42:28.786819] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 6132. [D 20:42:28.786829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 6133. [D 20:42:28.786840] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 6134. [D 20:42:28.786852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 6135. [D 20:42:28.786862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 6136. [D 20:42:28.786872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 6137. [D 20:42:28.786883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 6138. [D 20:42:28.786893] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 6139. [D 20:42:28.786903] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 6140. [D 20:42:28.786913] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 6141. [D 20:42:28.786941] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 6142. [D 20:42:28.786952] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 6143. [D 20:42:28.786962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 6144. [D 20:42:28.786972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 6145. [D 20:42:28.786982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 6146. [D 20:42:28.786993] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 6147. [D 20:42:28.792465] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6147. [D 20:42:28.792484] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 49/70. [D 20:42:28.794690] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.794705] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.794715] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.859158] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2977 [D 20:42:28.859176] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 50/70. [D 20:42:28.859239] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6147. [D 20:42:28.859312] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6148. [D 20:42:28.859324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 6149. [D 20:42:28.859335] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 6150. [D 20:42:28.859345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 6151. [D 20:42:28.859355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 6152. [D 20:42:28.859371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 6153. [D 20:42:28.859381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6154. [D 20:42:28.859391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6155. [D 20:42:28.859407] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6156. [D 20:42:28.859456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 6157. [D 20:42:28.859469] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 6158. [D 20:42:28.859494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 6159. [D 20:42:28.859504] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 6160. [D 20:42:28.859514] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 6161. [D 20:42:28.859525] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6162. [D 20:42:28.859549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6163. [D 20:42:28.859559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6164. [D 20:42:28.859573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6165. [D 20:42:28.859583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6166. [D 20:42:28.859593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6167. [D 20:42:28.859608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6168. [D 20:42:28.859618] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6169. [D 20:42:28.859628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6170. [D 20:42:28.859638] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6171. [D 20:42:28.859656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6172. [D 20:42:28.859678] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6173. [D 20:42:28.859688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6174. [D 20:42:28.859698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6175. [D 20:42:28.859708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6176. [D 20:42:28.859725] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6177. [D 20:42:28.859737] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6178. [D 20:42:28.865171] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6178. [D 20:42:28.865188] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 51/70. [D 20:42:28.867499] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.867514] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.867524] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:28.871688] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.871703] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.871714] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:28.871748] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2983 [D 20:42:28.871759] element 0: offset: 0x691fe0, size: 24 [D 20:42:28.871773] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 52/70. [D 20:42:28.931547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.931612] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.931622] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.931659] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2987 [D 20:42:28.931676] element 0: offset: 0x61f310, size: 24 [D 20:42:28.931691] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 53/70. [D 20:42:28.946372] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2981 [D 20:42:28.946391] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 54/70. [D 20:42:28.946448] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6178. [D 20:42:28.946497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6179. [D 20:42:28.946509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6180. [D 20:42:28.946519] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6181. [D 20:42:28.946545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6182. [D 20:42:28.946554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6183. [D 20:42:28.946565] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6184. [D 20:42:28.946576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6185. [D 20:42:28.946586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6186. [D 20:42:28.946596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6187. [D 20:42:28.946633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6188. [D 20:42:28.946645] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6189. [D 20:42:28.946655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6190. [D 20:42:28.946670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6191. [D 20:42:28.946681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6192. [D 20:42:28.946709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6193. [D 20:42:28.946719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6194. [D 20:42:28.946729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6195. [D 20:42:28.946753] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6196. [D 20:42:28.946763] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6197. [D 20:42:28.946773] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6198. [D 20:42:28.946787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6199. [D 20:42:28.946797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6200. [D 20:42:28.946807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6201. [D 20:42:28.946823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6202. [D 20:42:28.946844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6203. [D 20:42:28.946855] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6204. [D 20:42:28.946866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6205. [D 20:42:28.946876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6206. [D 20:42:28.946900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6207. [D 20:42:28.946910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6208. [D 20:42:28.946920] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6209. [D 20:42:28.952425] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6209. [D 20:42:28.952441] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 55/70. [D 20:42:28.954746] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:28.954761] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.954771] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:28.960350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:28.960365] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:28.960376] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:28.960405] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2990 [D 20:42:28.960416] element 0: offset: 0x649100, size: 24 [D 20:42:28.960427] openib_post_sr: 10.1.4.240:38258 bh 15 len 40 wr 56/70. [D 20:42:28.997492] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2990 [D 20:42:28.997510] openib_post_sr: 10.1.4.240:38258 bh 16 len 32 wr 57/70. [D 20:42:28.997572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6209. [D 20:42:28.997652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6210. [D 20:42:28.997664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6211. [D 20:42:28.997677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6212. [D 20:42:28.997688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6213. [D 20:42:28.997698] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6214. [D 20:42:28.997708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6215. [D 20:42:28.997718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6216. [D 20:42:28.997734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6217. [D 20:42:28.997744] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6218. [D 20:42:28.997754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6219. [D 20:42:28.997764] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6220. [D 20:42:28.997774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6221. [D 20:42:28.997793] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6222. [D 20:42:28.997803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6223. [D 20:42:28.997813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6224. [D 20:42:28.997823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6225. [D 20:42:28.997833] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6226. [D 20:42:28.997844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6227. [D 20:42:28.997854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6228. [D 20:42:28.997864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6229. [D 20:42:28.997874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6230. [D 20:42:28.997884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6231. [D 20:42:28.997894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6232. [D 20:42:28.997904] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6233. [D 20:42:28.997959] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6234. [D 20:42:28.997969] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6235. [D 20:42:28.997979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6236. [D 20:42:28.998004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6237. [D 20:42:28.998014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6238. [D 20:42:28.998025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6239. [D 20:42:28.998035] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6240. [D 20:42:29.003579] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6240. [D 20:42:29.003597] openib_post_sr: 10.1.4.240:38258 bh 17 len 16 wr 58/70. [D 20:42:29.005918] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.005933] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.005944] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.027888] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2969 [D 20:42:29.027906] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 59/70. [D 20:42:29.027963] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 6240. [D 20:42:29.028028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 6241. [D 20:42:29.028080] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 6242. [D 20:42:29.028092] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 6243. [D 20:42:29.028103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 6244. [D 20:42:29.028113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 6245. [D 20:42:29.028124] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 6246. [D 20:42:29.028134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 6247. [D 20:42:29.028145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 6248. [D 20:42:29.028154] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 6249. [D 20:42:29.028165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 6250. [D 20:42:29.028174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 6251. [D 20:42:29.028206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 6252. [D 20:42:29.028217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 6253. [D 20:42:29.028228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 6254. [D 20:42:29.028238] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 6255. [D 20:42:29.028248] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 6256. [D 20:42:29.028274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 6257. [D 20:42:29.028284] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 6258. [D 20:42:29.028299] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 6259. [D 20:42:29.028309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 6260. [D 20:42:29.028319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 6261. [D 20:42:29.028337] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 6262. [D 20:42:29.028347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 6263. [D 20:42:29.028357] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 6264. [D 20:42:29.028367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 6265. [D 20:42:29.028384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 6266. [D 20:42:29.028405] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 6267. [D 20:42:29.028415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 6268. [D 20:42:29.028426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 6269. [D 20:42:29.028436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 6270. [D 20:42:29.028446] openib_post_sr_rdmaw: ibv_post_send wr_id 661da0 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 6271. [D 20:42:29.033891] openib_check_cq: completed rdma wr_id 661da0, nic_wr_credit 6271. [D 20:42:29.033908] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 60/70. [D 20:42:29.035720] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.035735] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.035746] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:29.042234] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.042249] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.042260] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:29.042293] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2993 [D 20:42:29.042304] element 0: offset: 0x61f7d0, size: 24 [D 20:42:29.042319] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 0/70. [D 20:42:29.089182] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2993 [D 20:42:29.089200] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 1/70. [D 20:42:29.089267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6271. [D 20:42:29.089344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6272. [D 20:42:29.089355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6273. [D 20:42:29.089366] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6274. [D 20:42:29.089377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6275. [D 20:42:29.089387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6276. [D 20:42:29.089403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6277. [D 20:42:29.089413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6278. [D 20:42:29.089422] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6279. [D 20:42:29.089439] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6280. [D 20:42:29.089490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6281. [D 20:42:29.089502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6282. [D 20:42:29.089529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6283. [D 20:42:29.089539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6284. [D 20:42:29.089549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6285. [D 20:42:29.089559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6286. [D 20:42:29.089583] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6287. [D 20:42:29.089593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6288. [D 20:42:29.089603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6289. [D 20:42:29.089613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6290. [D 20:42:29.089624] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6291. [D 20:42:29.089634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6292. [D 20:42:29.089644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6293. [D 20:42:29.089654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6294. [D 20:42:29.089664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6295. [D 20:42:29.089683] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6296. [D 20:42:29.089693] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6297. [D 20:42:29.089719] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6298. [D 20:42:29.089730] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6299. [D 20:42:29.089740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6300. [D 20:42:29.089756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6301. [D 20:42:29.089766] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6302. [D 20:42:29.095205] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6302. [D 20:42:29.095222] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 2/70. [D 20:42:29.097388] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.097404] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.097414] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:29.103700] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.103715] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.103725] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:29.103759] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2996 [D 20:42:29.103783] element 0: offset: 0x63e800, size: 24 [D 20:42:29.104047] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 3/70. [D 20:42:29.142039] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.142104] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.142114] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.142152] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 2999 [D 20:42:29.142165] element 0: offset: 0x66e790, size: 24 [D 20:42:29.142179] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 4/70. [D 20:42:29.151309] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 2987 [D 20:42:29.151328] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 5/70. [D 20:42:29.151464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6302. [D 20:42:29.151494] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 6303. [D 20:42:29.151506] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 6304. [D 20:42:29.151516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 6305. [D 20:42:29.151527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 6306. [D 20:42:29.151537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 6307. [D 20:42:29.151547] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6308. [D 20:42:29.151562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6309. [D 20:42:29.151573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6310. [D 20:42:29.151582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 6311. [D 20:42:29.151593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 6312. [D 20:42:29.151608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 6313. [D 20:42:29.151639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 6314. [D 20:42:29.151649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 6315. [D 20:42:29.151659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6316. [D 20:42:29.151685] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6317. [D 20:42:29.151729] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6318. [D 20:42:29.151755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6319. [D 20:42:29.151768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6320. [D 20:42:29.151778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6321. [D 20:42:29.151789] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6322. [D 20:42:29.151799] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6323. [D 20:42:29.151808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6324. [D 20:42:29.151818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6325. [D 20:42:29.151842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6326. [D 20:42:29.151853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6327. [D 20:42:29.151868] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6328. [D 20:42:29.151879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6329. [D 20:42:29.151900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6330. [D 20:42:29.151910] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6331. [D 20:42:29.151920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6332. [D 20:42:29.151930] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6333. [D 20:42:29.158656] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 6333. [D 20:42:29.158672] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 6/70. [D 20:42:29.160949] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.160963] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.160973] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.166445] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.166459] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.166470] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.166493] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3002 [D 20:42:29.166503] element 0: offset: 0x62a370, size: 24 [D 20:42:29.166514] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 7/70. [D 20:42:29.247680] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 2996 [D 20:42:29.247702] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 8/70. [D 20:42:29.247856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6333. [D 20:42:29.247923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6334. [D 20:42:29.247935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6335. [D 20:42:29.247945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6336. [D 20:42:29.247960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6337. [D 20:42:29.247970] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6338. [D 20:42:29.247979] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6339. [D 20:42:29.247994] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6340. [D 20:42:29.248004] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6341. [D 20:42:29.248014] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6342. [D 20:42:29.248054] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6343. [D 20:42:29.248065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6344. [D 20:42:29.248075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6345. [D 20:42:29.248085] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6346. [D 20:42:29.248122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6347. [D 20:42:29.248135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6348. [D 20:42:29.248145] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6349. [D 20:42:29.248155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6350. [D 20:42:29.248165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6351. [D 20:42:29.248175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6352. [D 20:42:29.248185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6353. [D 20:42:29.248200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6354. [D 20:42:29.248211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6355. [D 20:42:29.248221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6356. [D 20:42:29.248231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6357. [D 20:42:29.248241] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6358. [D 20:42:29.248266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6359. [D 20:42:29.248277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6360. [D 20:42:29.248290] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6361. [D 20:42:29.248300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6362. [D 20:42:29.248310] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6363. [D 20:42:29.248339] openib_post_sr_rdmaw: ibv_post_send wr_id 66e540 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6364. [D 20:42:29.253776] openib_check_cq: completed rdma wr_id 66e540, nic_wr_credit 6364. [D 20:42:29.253793] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 9/70. [D 20:42:29.256110] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.256125] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.256135] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.262633] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.262647] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.262658] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.262690] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3005 [D 20:42:29.262701] element 0: offset: 0x649100, size: 24 [D 20:42:29.262713] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 10/70. [D 20:42:29.287635] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 2983 [D 20:42:29.287654] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 11/70. [D 20:42:29.287716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 6364. [D 20:42:29.287785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 6365. [D 20:42:29.287804] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 6366. [D 20:42:29.287815] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 6367. [D 20:42:29.287826] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 6368. [D 20:42:29.287836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 6369. [D 20:42:29.287851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 6370. [D 20:42:29.287861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6371. [D 20:42:29.287871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6372. [D 20:42:29.287887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6373. [D 20:42:29.287938] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 6374. [D 20:42:29.287949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 6375. [D 20:42:29.287976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 6376. [D 20:42:29.287986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 6377. [D 20:42:29.287996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 6378. [D 20:42:29.288028] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6379. [D 20:42:29.288039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6380. [D 20:42:29.288050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6381. [D 20:42:29.288060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 6382. [D 20:42:29.288071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 6383. [D 20:42:29.288082] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 6384. [D 20:42:29.288103] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 6385. [D 20:42:29.288118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 6386. [D 20:42:29.288128] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6387. [D 20:42:29.288138] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6388. [D 20:42:29.288148] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6389. [D 20:42:29.288165] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 6390. [D 20:42:29.288175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 6391. [D 20:42:29.288185] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 6392. [D 20:42:29.288195] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 6393. [D 20:42:29.288206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 6394. [D 20:42:29.288216] openib_post_sr_rdmaw: ibv_post_send wr_id 643340 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6395. [D 20:42:29.293644] openib_check_cq: completed rdma wr_id 643340, nic_wr_credit 6395. [D 20:42:29.293662] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 12/70. [D 20:42:29.295776] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.295792] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.295802] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.301644] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.301659] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.301669] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.301701] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3007 [D 20:42:29.301712] element 0: offset: 0x67efc0, size: 24 [D 20:42:29.301724] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 13/70. [D 20:42:29.437930] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3007 [D 20:42:29.437948] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 14/70. [D 20:42:29.438067] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 6395. [D 20:42:29.438171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 6396. [D 20:42:29.438182] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 6397. [D 20:42:29.438193] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 6398. [D 20:42:29.438208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 6399. [D 20:42:29.438218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 6400. [D 20:42:29.438227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 6401. [D 20:42:29.438242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6402. [D 20:42:29.438252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6403. [D 20:42:29.438262] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6404. [D 20:42:29.438294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 6405. [D 20:42:29.438305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 6406. [D 20:42:29.438327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 6407. [D 20:42:29.438341] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 6408. [D 20:42:29.438360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 6409. [D 20:42:29.438371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6410. [D 20:42:29.438381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6411. [D 20:42:29.438391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6412. [D 20:42:29.438401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 6413. [D 20:42:29.438412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 6414. [D 20:42:29.438421] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 6415. [D 20:42:29.438431] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 6416. [D 20:42:29.438441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 6417. [D 20:42:29.438451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6418. [D 20:42:29.438462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6419. [D 20:42:29.438472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6420. [D 20:42:29.438482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 6421. [D 20:42:29.438502] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 6422. [D 20:42:29.438520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 6423. [D 20:42:29.438530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 6424. [D 20:42:29.438552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 6425. [D 20:42:29.438562] openib_post_sr_rdmaw: ibv_post_send wr_id 643340 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6426. [D 20:42:29.444094] openib_check_cq: completed rdma wr_id 643340, nic_wr_credit 6426. [D 20:42:29.444112] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 15/70. [D 20:42:29.446417] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.446431] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.446441] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.451724] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.451738] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.451749] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.451781] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3010 [D 20:42:29.451792] element 0: offset: 0x61f7d0, size: 24 [D 20:42:29.451804] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 16/70. [D 20:42:29.546988] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3002 [D 20:42:29.547006] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 17/70. [D 20:42:29.547113] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6426. [D 20:42:29.547223] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 6427. [D 20:42:29.547235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 6428. [D 20:42:29.547246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 6429. [D 20:42:29.547260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 6430. [D 20:42:29.547270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 6431. [D 20:42:29.547280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6432. [D 20:42:29.547295] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6433. [D 20:42:29.547305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6434. [D 20:42:29.547315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 6435. [D 20:42:29.547344] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 6436. [D 20:42:29.547355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 6437. [D 20:42:29.547382] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 6438. [D 20:42:29.547393] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 6439. [D 20:42:29.547403] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6440. [D 20:42:29.547430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6441. [D 20:42:29.547441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6442. [D 20:42:29.547462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6443. [D 20:42:29.547472] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6444. [D 20:42:29.547483] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6445. [D 20:42:29.547510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6446. [D 20:42:29.547521] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6447. [D 20:42:29.547533] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6448. [D 20:42:29.547552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6449. [D 20:42:29.547563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6450. [D 20:42:29.547573] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6451. [D 20:42:29.547598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6452. [D 20:42:29.547609] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6453. [D 20:42:29.547629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6454. [D 20:42:29.547643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6455. [D 20:42:29.547662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6456. [D 20:42:29.547673] openib_post_sr_rdmaw: ibv_post_send wr_id 6433c0 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6457. [D 20:42:29.553084] openib_check_cq: completed rdma wr_id 6433c0, nic_wr_credit 6457. [D 20:42:29.553101] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 18/70. [D 20:42:29.555422] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.555437] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.555448] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.560842] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.560856] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.560867] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.560899] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3014 [D 20:42:29.560910] element 0: offset: 0x62a220, size: 24 [D 20:42:29.560922] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 19/70. [D 20:42:29.606400] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3005 [D 20:42:29.606419] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 20/70. [D 20:42:29.606482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6457. [D 20:42:29.606549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6458. [D 20:42:29.606570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6459. [D 20:42:29.606580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6460. [D 20:42:29.606591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6461. [D 20:42:29.606601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6462. [D 20:42:29.606615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6463. [D 20:42:29.606625] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6464. [D 20:42:29.606634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6465. [D 20:42:29.606651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6466. [D 20:42:29.606664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6467. [D 20:42:29.606674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6468. [D 20:42:29.606684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6469. [D 20:42:29.606700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6470. [D 20:42:29.606710] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6471. [D 20:42:29.606720] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6472. [D 20:42:29.606770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6473. [D 20:42:29.606781] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6474. [D 20:42:29.606791] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6475. [D 20:42:29.606801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6476. [D 20:42:29.606825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6477. [D 20:42:29.606836] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6478. [D 20:42:29.606847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6479. [D 20:42:29.606856] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6480. [D 20:42:29.606867] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6481. [D 20:42:29.606877] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6482. [D 20:42:29.606887] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6483. [D 20:42:29.606912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6484. [D 20:42:29.606929] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6485. [D 20:42:29.606939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6486. [D 20:42:29.606949] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6487. [D 20:42:29.606959] openib_post_sr_rdmaw: ibv_post_send wr_id 66e540 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6488. [D 20:42:29.612455] openib_check_cq: completed rdma wr_id 66e540, nic_wr_credit 6488. [D 20:42:29.612471] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 21/70. [D 20:42:29.614631] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.614646] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.614658] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.619747] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.619762] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.619772] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.619805] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3017 [D 20:42:29.619816] element 0: offset: 0x654830, size: 24 [D 20:42:29.621219] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 22/70. [D 20:42:29.687355] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3010 [D 20:42:29.687373] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 23/70. [D 20:42:29.687429] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 6488. [D 20:42:29.687497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 6489. [D 20:42:29.687517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 6490. [D 20:42:29.687528] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 6491. [D 20:42:29.687539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 6492. [D 20:42:29.687549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 6493. [D 20:42:29.687562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 6494. [D 20:42:29.687572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6495. [D 20:42:29.687582] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6496. [D 20:42:29.687599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6497. [D 20:42:29.687647] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 6498. [D 20:42:29.687660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 6499. [D 20:42:29.687670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 6500. [D 20:42:29.687695] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 6501. [D 20:42:29.687705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 6502. [D 20:42:29.687715] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6503. [D 20:42:29.687726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6504. [D 20:42:29.687735] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6505. [D 20:42:29.687766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 6506. [D 20:42:29.687776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 6507. [D 20:42:29.687787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 6508. [D 20:42:29.687797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 6509. [D 20:42:29.687807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 6510. [D 20:42:29.687818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6511. [D 20:42:29.687828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6512. [D 20:42:29.687852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6513. [D 20:42:29.687866] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 6514. [D 20:42:29.687876] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 6515. [D 20:42:29.687899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 6516. [D 20:42:29.687909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 6517. [D 20:42:29.687919] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 6518. [D 20:42:29.687934] openib_post_sr_rdmaw: ibv_post_send wr_id 657130 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6519. [D 20:42:29.693353] openib_check_cq: completed rdma wr_id 657130, nic_wr_credit 6519. [D 20:42:29.693369] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 24/70. [D 20:42:29.695541] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.695556] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.695566] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.701222] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.701237] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.701247] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.701281] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3019 [D 20:42:29.701292] element 0: offset: 0x627f50, size: 24 [D 20:42:29.701306] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 25/70. [D 20:42:29.777557] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3017 [D 20:42:29.777576] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 26/70. [D 20:42:29.777665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6519. [D 20:42:29.777740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6520. [D 20:42:29.777752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6521. [D 20:42:29.777762] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6522. [D 20:42:29.777777] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6523. [D 20:42:29.777786] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6524. [D 20:42:29.777797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6525. [D 20:42:29.777810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6526. [D 20:42:29.777820] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6527. [D 20:42:29.777829] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6528. [D 20:42:29.777869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6529. [D 20:42:29.777880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6530. [D 20:42:29.777890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6531. [D 20:42:29.777900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6532. [D 20:42:29.777933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6533. [D 20:42:29.777944] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6534. [D 20:42:29.777955] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6535. [D 20:42:29.777964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6536. [D 20:42:29.777975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6537. [D 20:42:29.777986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6538. [D 20:42:29.778010] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6539. [D 20:42:29.778021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6540. [D 20:42:29.778031] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6541. [D 20:42:29.778041] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6542. [D 20:42:29.778056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6543. [D 20:42:29.778076] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6544. [D 20:42:29.778087] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6545. [D 20:42:29.778097] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6546. [D 20:42:29.778107] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6547. [D 20:42:29.778118] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6548. [D 20:42:29.778142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6549. [D 20:42:29.778158] openib_post_sr_rdmaw: ibv_post_send wr_id 657260 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6550. [D 20:42:29.783634] openib_check_cq: completed rdma wr_id 657260, nic_wr_credit 6550. [D 20:42:29.783650] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 27/70. [D 20:42:29.785998] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.786013] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.786023] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.791773] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.791789] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.791800] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.791833] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3023 [D 20:42:29.791844] element 0: offset: 0x627dd0, size: 24 [D 20:42:29.791856] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 28/70. [D 20:42:29.845048] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3014 [D 20:42:29.845067] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 29/70. [D 20:42:29.845127] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6550. [D 20:42:29.845208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 6551. [D 20:42:29.845219] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 6552. [D 20:42:29.845229] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 6553. [D 20:42:29.845240] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 6554. [D 20:42:29.845250] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 6555. [D 20:42:29.845267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6556. [D 20:42:29.845276] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6557. [D 20:42:29.845286] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6558. [D 20:42:29.845302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 6559. [D 20:42:29.845355] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 6560. [D 20:42:29.845365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 6561. [D 20:42:29.845376] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 6562. [D 20:42:29.845401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 6563. [D 20:42:29.845411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6564. [D 20:42:29.845425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6565. [D 20:42:29.845435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6566. [D 20:42:29.845445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6567. [D 20:42:29.845474] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6568. [D 20:42:29.845485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6569. [D 20:42:29.845496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6570. [D 20:42:29.845505] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6571. [D 20:42:29.845516] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6572. [D 20:42:29.845527] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6573. [D 20:42:29.845553] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6574. [D 20:42:29.845568] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6575. [D 20:42:29.845578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6576. [D 20:42:29.845588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6577. [D 20:42:29.845604] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6578. [D 20:42:29.845631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6579. [D 20:42:29.845646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6580. [D 20:42:29.845656] openib_post_sr_rdmaw: ibv_post_send wr_id 657260 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6581. [D 20:42:29.851064] openib_check_cq: completed rdma wr_id 657260, nic_wr_credit 6581. [D 20:42:29.851081] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 30/70. [D 20:42:29.853273] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.853289] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.853300] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.858894] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.858946] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.858955] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.858993] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3026 [D 20:42:29.859005] element 0: offset: 0x67efc0, size: 24 [D 20:42:29.859018] openib_post_sr: 10.1.4.240:38258 bh 11 len 40 wr 31/70. [D 20:42:29.904661] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3023 [D 20:42:29.904680] openib_post_sr: 10.1.4.240:38258 bh 12 len 32 wr 32/70. [D 20:42:29.904741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6581. [D 20:42:29.904808] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6582. [D 20:42:29.904828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6583. [D 20:42:29.904841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6584. [D 20:42:29.904852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6585. [D 20:42:29.904862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6586. [D 20:42:29.904872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6587. [D 20:42:29.904882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6588. [D 20:42:29.904895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6589. [D 20:42:29.904935] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6590. [D 20:42:29.904946] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6591. [D 20:42:29.904956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6592. [D 20:42:29.904966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6593. [D 20:42:29.905003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6594. [D 20:42:29.905015] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6595. [D 20:42:29.905025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6596. [D 20:42:29.905035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6597. [D 20:42:29.905060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6598. [D 20:42:29.905071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6599. [D 20:42:29.905081] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6600. [D 20:42:29.905091] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6601. [D 20:42:29.905101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6602. [D 20:42:29.905111] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6603. [D 20:42:29.905136] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6604. [D 20:42:29.905151] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6605. [D 20:42:29.905161] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6606. [D 20:42:29.905171] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6607. [D 20:42:29.905187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6608. [D 20:42:29.905210] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6609. [D 20:42:29.905225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6610. [D 20:42:29.905235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6611. [D 20:42:29.905245] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6612. [D 20:42:29.910716] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 6612. [D 20:42:29.910734] openib_post_sr: 10.1.4.240:38258 bh 13 len 16 wr 33/70. [D 20:42:29.911824] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.911839] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.911850] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.919294] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.919308] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.919320] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.919352] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3029 [D 20:42:29.919363] element 0: offset: 0x5b0030, size: 24 [D 20:42:29.919375] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 34/70. [D 20:42:29.932030] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 2999 [D 20:42:29.932048] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 35/70. [D 20:42:29.932108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 6612. [D 20:42:29.932178] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 6613. [D 20:42:29.932198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 6614. [D 20:42:29.932212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 6615. [D 20:42:29.932222] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 6616. [D 20:42:29.932232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 6617. [D 20:42:29.932243] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 6618. [D 20:42:29.932253] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 6619. [D 20:42:29.932268] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 6620. [D 20:42:29.932278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 6621. [D 20:42:29.932288] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 6622. [D 20:42:29.932298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 6623. [D 20:42:29.932314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 6624. [D 20:42:29.932324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 6625. [D 20:42:29.932334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 6626. [D 20:42:29.932391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 6627. [D 20:42:29.932402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 6628. [D 20:42:29.932412] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 6629. [D 20:42:29.932436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 6630. [D 20:42:29.932446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 6631. [D 20:42:29.932457] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 6632. [D 20:42:29.932468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 6633. [D 20:42:29.932478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 6634. [D 20:42:29.932488] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 6635. [D 20:42:29.932498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 6636. [D 20:42:29.932508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 6637. [D 20:42:29.932518] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 6638. [D 20:42:29.932554] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 6639. [D 20:42:29.932564] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 6640. [D 20:42:29.932574] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 6641. [D 20:42:29.932590] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 6642. [D 20:42:29.932613] openib_post_sr_rdmaw: ibv_post_send wr_id 657260 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 6643. [D 20:42:29.938035] openib_check_cq: completed rdma wr_id 657260, nic_wr_credit 6643. [D 20:42:29.938051] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 36/70. [D 20:42:29.940358] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.940373] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.940384] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:29.945663] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:29.945684] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.945694] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:29.945727] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3032 [D 20:42:29.945738] element 0: offset: 0x61f7d0, size: 24 [D 20:42:29.945753] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 37/70. [D 20:42:29.972027] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3019 [D 20:42:29.972046] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 38/70. [D 20:42:29.972106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fdc000 rkey 4a40044 nic_wr_credit 6643. [D 20:42:29.972176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3ffc000 rkey 4a40044 nic_wr_credit 6644. [D 20:42:29.972196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f401c000 rkey 4a40044 nic_wr_credit 6645. [D 20:42:29.972206] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f403c000 rkey 4a40044 nic_wr_credit 6646. [D 20:42:29.972217] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f405c000 rkey 4a40044 nic_wr_credit 6647. [D 20:42:29.972227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f407c000 rkey 4a40044 nic_wr_credit 6648. [D 20:42:29.972242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f409c000 rkey 4a40044 nic_wr_credit 6649. [D 20:42:29.972252] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40bc000 rkey 4a40044 nic_wr_credit 6650. [D 20:42:29.972261] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40dc000 rkey 4a40044 nic_wr_credit 6651. [D 20:42:29.972277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40fc000 rkey 4a40044 nic_wr_credit 6652. [D 20:42:29.972325] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f411c000 rkey 4a40044 nic_wr_credit 6653. [D 20:42:29.972336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f413c000 rkey 4a40044 nic_wr_credit 6654. [D 20:42:29.972346] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f415c000 rkey 4a40044 nic_wr_credit 6655. [D 20:42:29.972371] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f417c000 rkey 4a40044 nic_wr_credit 6656. [D 20:42:29.972381] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f419c000 rkey 4a40044 nic_wr_credit 6657. [D 20:42:29.972391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41bc000 rkey 4a40044 nic_wr_credit 6658. [D 20:42:29.972404] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41dc000 rkey 4a40044 nic_wr_credit 6659. [D 20:42:29.972414] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41fc000 rkey 4a40044 nic_wr_credit 6660. [D 20:42:29.972424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f421c000 rkey 4a40044 nic_wr_credit 6661. [D 20:42:29.972451] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f423c000 rkey 4a40044 nic_wr_credit 6662. [D 20:42:29.972462] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f425c000 rkey 4a40044 nic_wr_credit 6663. [D 20:42:29.972475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f427c000 rkey 4a40044 nic_wr_credit 6664. [D 20:42:29.972485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f429c000 rkey 4a40044 nic_wr_credit 6665. [D 20:42:29.972498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42bc000 rkey 4a40044 nic_wr_credit 6666. [D 20:42:29.972526] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42dc000 rkey 4a40044 nic_wr_credit 6667. [D 20:42:29.972537] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42fc000 rkey 4a40044 nic_wr_credit 6668. [D 20:42:29.972548] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f431c000 rkey 4a40044 nic_wr_credit 6669. [D 20:42:29.972559] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f433c000 rkey 4a40044 nic_wr_credit 6670. [D 20:42:29.972580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f435c000 rkey 4a40044 nic_wr_credit 6671. [D 20:42:29.972593] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f437c000 rkey 4a40044 nic_wr_credit 6672. [D 20:42:29.972603] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f439c000 rkey 4a40044 nic_wr_credit 6673. [D 20:42:29.972612] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f43bc000 rkey 4a40044 nic_wr_credit 6674. [D 20:42:29.978031] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 6674. [D 20:42:29.978048] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 39/70. [D 20:42:29.980390] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:29.980406] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:29.980417] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.026424] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3026 [D 20:42:30.026443] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 40/70. [D 20:42:30.026507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ec000 rkey 4a4004f nic_wr_credit 6674. [D 20:42:30.026597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f480c000 rkey 4a4004f nic_wr_credit 6675. [D 20:42:30.026611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f482c000 rkey 4a4004f nic_wr_credit 6676. [D 20:42:30.026622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f484c000 rkey 4a4004f nic_wr_credit 6677. [D 20:42:30.026633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f486c000 rkey 4a4004f nic_wr_credit 6678. [D 20:42:30.026643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f488c000 rkey 4a4004f nic_wr_credit 6679. [D 20:42:30.026654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ac000 rkey 4a4004f nic_wr_credit 6680. [D 20:42:30.026664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48cc000 rkey 4a4004f nic_wr_credit 6681. [D 20:42:30.026691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48ec000 rkey 4a4004f nic_wr_credit 6682. [D 20:42:30.026702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f490c000 rkey 4a4004f nic_wr_credit 6683. [D 20:42:30.026713] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f492c000 rkey 4a4004f nic_wr_credit 6684. [D 20:42:30.026739] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f494c000 rkey 4a4004f nic_wr_credit 6685. [D 20:42:30.026754] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f496c000 rkey 4a4004f nic_wr_credit 6686. [D 20:42:30.026775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f498c000 rkey 4a4004f nic_wr_credit 6687. [D 20:42:30.026788] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ac000 rkey 4a4004f nic_wr_credit 6688. [D 20:42:30.026807] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49cc000 rkey 4a4004f nic_wr_credit 6689. [D 20:42:30.026818] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49ec000 rkey 4a4004f nic_wr_credit 6690. [D 20:42:30.026828] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a0c000 rkey 4a4004f nic_wr_credit 6691. [D 20:42:30.026851] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a2c000 rkey 4a4004f nic_wr_credit 6692. [D 20:42:30.026861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a4c000 rkey 4a4004f nic_wr_credit 6693. [D 20:42:30.026872] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a6c000 rkey 4a4004f nic_wr_credit 6694. [D 20:42:30.026882] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a8c000 rkey 4a4004f nic_wr_credit 6695. [D 20:42:30.026892] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aac000 rkey 4a4004f nic_wr_credit 6696. [D 20:42:30.026921] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4acc000 rkey 4a4004f nic_wr_credit 6697. [D 20:42:30.026932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4aec000 rkey 4a4004f nic_wr_credit 6698. [D 20:42:30.026942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b0c000 rkey 4a4004f nic_wr_credit 6699. [D 20:42:30.026964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b2c000 rkey 4a4004f nic_wr_credit 6700. [D 20:42:30.026990] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b4c000 rkey 4a4004f nic_wr_credit 6701. [D 20:42:30.027001] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b6c000 rkey 4a4004f nic_wr_credit 6702. [D 20:42:30.027012] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b8c000 rkey 4a4004f nic_wr_credit 6703. [D 20:42:30.027022] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bac000 rkey 4a4004f nic_wr_credit 6704. [D 20:42:30.027032] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bcc000 rkey 4a4004f nic_wr_credit 6705. [D 20:42:30.032458] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6705. [D 20:42:30.032475] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 41/70. [D 20:42:30.034772] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.034787] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.034797] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:30.040822] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.040836] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.040847] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:30.040880] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3035 [D 20:42:30.040891] element 0: offset: 0x691fe0, size: 24 [D 20:42:30.040903] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 42/70. [D 20:42:30.098032] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3029 [D 20:42:30.098051] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 43/70. [D 20:42:30.098109] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6705. [D 20:42:30.098177] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6706. [D 20:42:30.098188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6707. [D 20:42:30.098199] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6708. [D 20:42:30.098209] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6709. [D 20:42:30.098225] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6710. [D 20:42:30.098235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6711. [D 20:42:30.098245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6712. [D 20:42:30.098260] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6713. [D 20:42:30.098270] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6714. [D 20:42:30.098280] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6715. [D 20:42:30.098347] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6716. [D 20:42:30.098360] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6717. [D 20:42:30.098373] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6718. [D 20:42:30.098394] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6719. [D 20:42:30.098406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6720. [D 20:42:30.098416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6721. [D 20:42:30.098426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6722. [D 20:42:30.098441] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6723. [D 20:42:30.098466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6724. [D 20:42:30.098478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6725. [D 20:42:30.098496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6726. [D 20:42:30.098507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6727. [D 20:42:30.098517] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6728. [D 20:42:30.098536] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6729. [D 20:42:30.098550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6730. [D 20:42:30.098572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6731. [D 20:42:30.098586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6732. [D 20:42:30.098608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6733. [D 20:42:30.098619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6734. [D 20:42:30.098629] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6735. [D 20:42:30.098652] openib_post_sr_rdmaw: ibv_post_send wr_id 6621b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6736. [D 20:42:30.104044] openib_check_cq: completed rdma wr_id 6621b0, nic_wr_credit 6736. [D 20:42:30.104061] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 44/70. [D 20:42:30.106378] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.106393] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.106403] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:30.112965] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.112980] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.112991] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:30.113023] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3038 [D 20:42:30.113035] element 0: offset: 0x627dd0, size: 24 [D 20:42:30.113047] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 45/70. [D 20:42:30.115855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.115870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.115880] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.115895] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3040 [D 20:42:30.115909] element 0: offset: 0x61ee50, size: 24 [D 20:42:30.115918] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 46/70. [D 20:42:30.172686] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3032 [D 20:42:30.172704] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 47/70. [D 20:42:30.172768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 6736. [D 20:42:30.172879] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 6737. [D 20:42:30.172894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 6738. [D 20:42:30.172905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 6739. [D 20:42:30.172915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 6740. [D 20:42:30.172926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 6741. [D 20:42:30.172936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 6742. [D 20:42:30.172961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 6743. [D 20:42:30.172972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 6744. [D 20:42:30.172982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 6745. [D 20:42:30.172992] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 6746. [D 20:42:30.173002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 6747. [D 20:42:30.173025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 6748. [D 20:42:30.173039] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 6749. [D 20:42:30.173060] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 6750. [D 20:42:30.173074] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 6751. [D 20:42:30.173101] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 6752. [D 20:42:30.173112] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 6753. [D 20:42:30.173122] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 6754. [D 20:42:30.173132] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 6755. [D 20:42:30.173142] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 6756. [D 20:42:30.173152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 6757. [D 20:42:30.173175] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 6758. [D 20:42:30.173190] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 6759. [D 20:42:30.173200] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 6760. [D 20:42:30.173226] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 6761. [D 20:42:30.173246] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 6762. [D 20:42:30.173256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 6763. [D 20:42:30.173266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 6764. [D 20:42:30.173285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 6765. [D 20:42:30.173301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 6766. [D 20:42:30.173311] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 6767. [D 20:42:30.178736] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6767. [D 20:42:30.178755] openib_post_sr: 10.1.4.240:38258 bh 8 len 16 wr 48/70. [D 20:42:30.181786] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.181801] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.181812] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.187818] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.187850] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.187860] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.187896] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3044 [D 20:42:30.187907] element 0: offset: 0x66e790, size: 24 [D 20:42:30.187921] openib_post_sr: 10.1.4.240:38258 bh 9 len 40 wr 49/70. [D 20:42:30.244189] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3044 [D 20:42:30.244207] openib_post_sr: 10.1.4.240:38258 bh 10 len 32 wr 50/70. [D 20:42:30.244273] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 6767. [D 20:42:30.244384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 6768. [D 20:42:30.244398] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 6769. [D 20:42:30.244409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 6770. [D 20:42:30.244419] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 6771. [D 20:42:30.244430] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 6772. [D 20:42:30.244440] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 6773. [D 20:42:30.244450] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 6774. [D 20:42:30.244460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 6775. [D 20:42:30.244470] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 6776. [D 20:42:30.244487] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 6777. [D 20:42:30.244497] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 6778. [D 20:42:30.244520] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 6779. [D 20:42:30.244532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 6780. [D 20:42:30.244542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 6781. [D 20:42:30.244570] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 6782. [D 20:42:30.244581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 6783. [D 20:42:30.244591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 6784. [D 20:42:30.244602] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 6785. [D 20:42:30.244612] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 6786. [D 20:42:30.244623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 6787. [D 20:42:30.244646] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 6788. [D 20:42:30.244656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 6789. [D 20:42:30.244666] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 6790. [D 20:42:30.244676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 6791. [D 20:42:30.244686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 6792. [D 20:42:30.244717] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 6793. [D 20:42:30.244728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 6794. [D 20:42:30.244740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 6795. [D 20:42:30.244759] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 6796. [D 20:42:30.244770] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 6797. [D 20:42:30.244780] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 6798. [D 20:42:30.250299] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6798. [D 20:42:30.250315] openib_post_sr: 10.1.4.240:38258 bh 11 len 16 wr 51/70. [D 20:42:30.251855] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.251870] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.251881] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.257954] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.257969] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.257979] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.258012] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3047 [D 20:42:30.258023] element 0: offset: 0x67efc0, size: 24 [D 20:42:30.258037] openib_post_sr: 10.1.4.240:38258 bh 12 len 40 wr 52/70. [D 20:42:30.300587] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3038 [D 20:42:30.300606] openib_post_sr: 10.1.4.240:38258 bh 13 len 32 wr 53/70. [D 20:42:30.300668] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6798. [D 20:42:30.300737] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6799. [D 20:42:30.300798] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6800. [D 20:42:30.300810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6801. [D 20:42:30.300821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6802. [D 20:42:30.300831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6803. [D 20:42:30.300853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6804. [D 20:42:30.300864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6805. [D 20:42:30.300874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6806. [D 20:42:30.300884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6807. [D 20:42:30.300900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6808. [D 20:42:30.300923] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6809. [D 20:42:30.300939] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6810. [D 20:42:30.300961] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6811. [D 20:42:30.300972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6812. [D 20:42:30.300997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6813. [D 20:42:30.301008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6814. [D 20:42:30.301021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6815. [D 20:42:30.301049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6816. [D 20:42:30.301059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6817. [D 20:42:30.301079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6818. [D 20:42:30.301089] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6819. [D 20:42:30.301099] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6820. [D 20:42:30.301123] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6821. [D 20:42:30.301134] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6822. [D 20:42:30.301143] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6823. [D 20:42:30.301166] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6824. [D 20:42:30.301176] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6825. [D 20:42:30.301198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6826. [D 20:42:30.301208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6827. [D 20:42:30.301218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6828. [D 20:42:30.301229] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6829. [D 20:42:30.306592] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6829. [D 20:42:30.306609] openib_post_sr: 10.1.4.240:38258 bh 14 len 16 wr 54/70. [D 20:42:30.308964] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.308979] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.308990] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.336260] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3047 [D 20:42:30.336279] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 55/70. [D 20:42:30.336342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 6829. [D 20:42:30.336420] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 6830. [D 20:42:30.336432] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 6831. [D 20:42:30.336445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 6832. [D 20:42:30.336455] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 6833. [D 20:42:30.336466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 6834. [D 20:42:30.336475] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 6835. [D 20:42:30.336486] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 6836. [D 20:42:30.336496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 6837. [D 20:42:30.336512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 6838. [D 20:42:30.336522] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 6839. [D 20:42:30.336532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 6840. [D 20:42:30.336542] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 6841. [D 20:42:30.336552] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 6842. [D 20:42:30.336562] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 6843. [D 20:42:30.336572] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 6844. [D 20:42:30.336622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 6845. [D 20:42:30.336634] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 6846. [D 20:42:30.336644] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 6847. [D 20:42:30.336655] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 6848. [D 20:42:30.336665] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 6849. [D 20:42:30.336686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 6850. [D 20:42:30.336701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 6851. [D 20:42:30.336711] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 6852. [D 20:42:30.336721] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 6853. [D 20:42:30.336748] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 6854. [D 20:42:30.336758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 6855. [D 20:42:30.336772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 6856. [D 20:42:30.336782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 6857. [D 20:42:30.336795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 6858. [D 20:42:30.336822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 6859. [D 20:42:30.336832] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 6860. [D 20:42:30.342278] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6860. [D 20:42:30.342295] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 56/70. [D 20:42:30.344656] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.344671] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.344682] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:30.350350] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.350364] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.350375] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:30.350408] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3050 [D 20:42:30.350419] element 0: offset: 0x61f310, size: 24 [D 20:42:30.350431] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 57/70. [D 20:42:30.397134] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3035 [D 20:42:30.397152] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 58/70. [D 20:42:30.397221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 6860. [D 20:42:30.397313] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 6861. [D 20:42:30.397327] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 6862. [D 20:42:30.397338] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 6863. [D 20:42:30.397349] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 6864. [D 20:42:30.397359] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 6865. [D 20:42:30.397370] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 6866. [D 20:42:30.397380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 6867. [D 20:42:30.397391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 6868. [D 20:42:30.397416] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 6869. [D 20:42:30.397426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 6870. [D 20:42:30.397453] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 6871. [D 20:42:30.397464] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 6872. [D 20:42:30.397485] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 6873. [D 20:42:30.397496] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 6874. [D 20:42:30.397507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 6875. [D 20:42:30.397529] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 6876. [D 20:42:30.397539] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 6877. [D 20:42:30.397549] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 6878. [D 20:42:30.397571] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 6879. [D 20:42:30.397581] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 6880. [D 20:42:30.397591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 6881. [D 20:42:30.397616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 6882. [D 20:42:30.397626] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 6883. [D 20:42:30.397649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 6884. [D 20:42:30.397659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 6885. [D 20:42:30.397674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 6886. [D 20:42:30.397684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 6887. [D 20:42:30.397694] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 6888. [D 20:42:30.397704] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 6889. [D 20:42:30.397722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 6890. [D 20:42:30.397745] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 6891. [D 20:42:30.403171] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6891. [D 20:42:30.403188] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 59/70. [D 20:42:30.405306] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.405321] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.405332] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:30.411835] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.411850] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.411860] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:30.411892] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3053 [D 20:42:30.411904] element 0: offset: 0x5b0030, size: 24 [D 20:42:30.411916] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 60/70. [D 20:42:30.448838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.448904] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.448914] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.448952] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3056 [D 20:42:30.448966] element 0: offset: 0x63e800, size: 24 [D 20:42:30.448979] openib_post_sr: 10.1.4.240:38258 bh 1 len 40 wr 0/70. [D 20:42:30.454021] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3050 [D 20:42:30.454039] openib_post_sr: 10.1.4.240:38258 bh 2 len 32 wr 1/70. [D 20:42:30.454187] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6891. [D 20:42:30.454256] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6892. [D 20:42:30.454267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6893. [D 20:42:30.454278] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6894. [D 20:42:30.454292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6895. [D 20:42:30.454302] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6896. [D 20:42:30.454314] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6897. [D 20:42:30.454329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6898. [D 20:42:30.454339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6899. [D 20:42:30.454348] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6900. [D 20:42:30.454365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6901. [D 20:42:30.454374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6902. [D 20:42:30.454384] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6903. [D 20:42:30.454438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6904. [D 20:42:30.454460] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6905. [D 20:42:30.454471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6906. [D 20:42:30.454482] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 6907. [D 20:42:30.454492] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 6908. [D 20:42:30.454508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 6909. [D 20:42:30.454540] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 6910. [D 20:42:30.454550] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 6911. [D 20:42:30.454560] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 6912. [D 20:42:30.454576] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 6913. [D 20:42:30.454586] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 6914. [D 20:42:30.454596] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 6915. [D 20:42:30.454620] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 6916. [D 20:42:30.454631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 6917. [D 20:42:30.454654] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 6918. [D 20:42:30.454664] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 6919. [D 20:42:30.454674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 6920. [D 20:42:30.454684] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 6921. [D 20:42:30.454694] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 6922. [D 20:42:30.462349] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6922. [D 20:42:30.462366] openib_post_sr: 10.1.4.240:38258 bh 3 len 16 wr 2/70. [D 20:42:30.464649] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.464665] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.464675] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.470201] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.470215] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.470226] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.470258] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3059 [D 20:42:30.470269] element 0: offset: 0x61f7d0, size: 24 [D 20:42:30.470281] openib_post_sr: 10.1.4.240:38258 bh 4 len 40 wr 3/70. [D 20:42:30.496428] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3040 [D 20:42:30.496446] openib_post_sr: 10.1.4.240:38258 bh 5 len 32 wr 4/70. [D 20:42:30.496507] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6922. [D 20:42:30.496615] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6923. [D 20:42:30.496628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 6924. [D 20:42:30.496640] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 6925. [D 20:42:30.496650] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 6926. [D 20:42:30.496661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 6927. [D 20:42:30.496671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 6928. [D 20:42:30.496681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6929. [D 20:42:30.496691] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6930. [D 20:42:30.496701] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6931. [D 20:42:30.496718] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 6932. [D 20:42:30.496728] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 6933. [D 20:42:30.496738] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 6934. [D 20:42:30.496747] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 6935. [D 20:42:30.496758] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 6936. [D 20:42:30.496768] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6937. [D 20:42:30.496778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6938. [D 20:42:30.496803] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6939. [D 20:42:30.496813] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6940. [D 20:42:30.496823] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6941. [D 20:42:30.496834] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6942. [D 20:42:30.496844] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6943. [D 20:42:30.496854] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6944. [D 20:42:30.496864] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6945. [D 20:42:30.496895] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6946. [D 20:42:30.496912] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6947. [D 20:42:30.496922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6948. [D 20:42:30.496932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6949. [D 20:42:30.496956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6950. [D 20:42:30.496966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6951. [D 20:42:30.496987] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6952. [D 20:42:30.496997] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6953. [D 20:42:30.502474] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6953. [D 20:42:30.502491] openib_post_sr: 10.1.4.240:38258 bh 6 len 16 wr 5/70. [D 20:42:30.504817] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.504832] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.504843] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.510258] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.510272] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.510283] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.510356] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3061 [D 20:42:30.510370] element 0: offset: 0x67efc0, size: 24 [D 20:42:30.510381] openib_post_sr: 10.1.4.240:38258 bh 7 len 40 wr 6/70. [D 20:42:30.585271] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3061 [D 20:42:30.585290] openib_post_sr: 10.1.4.240:38258 bh 8 len 32 wr 7/70. [D 20:42:30.585467] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 6953. [D 20:42:30.585535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 6954. [D 20:42:30.585546] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 6955. [D 20:42:30.585557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 6956. [D 20:42:30.585567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 6957. [D 20:42:30.585578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 6958. [D 20:42:30.585588] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 6959. [D 20:42:30.585598] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 6960. [D 20:42:30.585607] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 6961. [D 20:42:30.585617] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 6962. [D 20:42:30.585627] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 6963. [D 20:42:30.585659] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 6964. [D 20:42:30.585675] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 6965. [D 20:42:30.585697] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 6966. [D 20:42:30.585712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 6967. [D 20:42:30.585734] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 6968. [D 20:42:30.585746] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 6969. [D 20:42:30.585756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 6970. [D 20:42:30.585778] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 6971. [D 20:42:30.585787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 6972. [D 20:42:30.585797] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 6973. [D 20:42:30.585812] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 6974. [D 20:42:30.585822] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 6975. [D 20:42:30.585832] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 6976. [D 20:42:30.585842] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 6977. [D 20:42:30.585874] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 6978. [D 20:42:30.585884] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 6979. [D 20:42:30.585894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 6980. [D 20:42:30.585916] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 6981. [D 20:42:30.585927] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 6982. [D 20:42:30.585937] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 6983. [D 20:42:30.585959] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 6984. [D 20:42:30.591464] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 6984. [D 20:42:30.591482] openib_post_sr: 10.1.4.240:38258 bh 9 len 16 wr 8/70. [D 20:42:30.593838] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.593853] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.593863] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.599299] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.599317] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.599328] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.599362] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3064 [D 20:42:30.599373] element 0: offset: 0x655bd0, size: 24 [D 20:42:30.599387] openib_post_sr: 10.1.4.240:38258 bh 10 len 40 wr 9/70. [D 20:42:30.673640] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3059 [D 20:42:30.673659] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 10/70. [D 20:42:30.673766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 6984. [D 20:42:30.673883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 6985. [D 20:42:30.673894] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 6986. [D 20:42:30.673905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 6987. [D 20:42:30.673920] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 6988. [D 20:42:30.673930] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 6989. [D 20:42:30.673945] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 6990. [D 20:42:30.673956] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 6991. [D 20:42:30.673966] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 6992. [D 20:42:30.673976] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 6993. [D 20:42:30.674002] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 6994. [D 20:42:30.674013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 6995. [D 20:42:30.674035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 6996. [D 20:42:30.674046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 6997. [D 20:42:30.674056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 6998. [D 20:42:30.674079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 6999. [D 20:42:30.674090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7000. [D 20:42:30.674100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7001. [D 20:42:30.674125] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7002. [D 20:42:30.674135] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7003. [D 20:42:30.674160] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7004. [D 20:42:30.674170] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7005. [D 20:42:30.674192] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7006. [D 20:42:30.674202] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7007. [D 20:42:30.674212] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7008. [D 20:42:30.674235] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7009. [D 20:42:30.674245] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7010. [D 20:42:30.674266] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7011. [D 20:42:30.674277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7012. [D 20:42:30.674287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7013. [D 20:42:30.674298] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7014. [D 20:42:30.674319] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7015. [D 20:42:30.679787] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7015. [D 20:42:30.679806] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 11/70. [D 20:42:30.682121] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.682136] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.682146] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.687783] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.687798] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.687809] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.687840] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3068 [D 20:42:30.687854] element 0: offset: 0x62a350, size: 24 [D 20:42:30.687866] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 12/70. [D 20:42:30.736454] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3053 [D 20:42:30.736473] openib_post_sr: 10.1.4.240:38258 bh 14 len 32 wr 13/70. [D 20:42:30.736532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 7015. [D 20:42:30.736608] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7016. [D 20:42:30.736619] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7017. [D 20:42:30.736630] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7018. [D 20:42:30.736641] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7019. [D 20:42:30.736651] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7020. [D 20:42:30.736667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7021. [D 20:42:30.736677] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7022. [D 20:42:30.736686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7023. [D 20:42:30.736740] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7024. [D 20:42:30.736752] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7025. [D 20:42:30.736765] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7026. [D 20:42:30.736775] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7027. [D 20:42:30.736801] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7028. [D 20:42:30.736811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7029. [D 20:42:30.736825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7030. [D 20:42:30.736835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7031. [D 20:42:30.736845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7032. [D 20:42:30.736875] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7033. [D 20:42:30.736890] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7034. [D 20:42:30.736900] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7035. [D 20:42:30.736911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7036. [D 20:42:30.736926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7037. [D 20:42:30.736936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7038. [D 20:42:30.736962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7039. [D 20:42:30.736972] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7040. [D 20:42:30.736982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7041. [D 20:42:30.736995] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7042. [D 20:42:30.737006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7043. [D 20:42:30.737029] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7044. [D 20:42:30.737040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7045. [D 20:42:30.737050] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7046. [D 20:42:30.742457] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7046. [D 20:42:30.742474] openib_post_sr: 10.1.4.240:38258 bh 15 len 16 wr 14/70. [D 20:42:30.744791] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.744806] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.744817] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.750580] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.750595] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.750606] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.750638] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3071 [D 20:42:30.750649] element 0: offset: 0x61f310, size: 24 [D 20:42:30.750661] openib_post_sr: 10.1.4.240:38258 bh 16 len 40 wr 15/70. [D 20:42:30.817857] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3068 [D 20:42:30.817875] openib_post_sr: 10.1.4.240:38258 bh 17 len 32 wr 16/70. [D 20:42:30.817933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7046. [D 20:42:30.818005] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7047. [D 20:42:30.818025] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7048. [D 20:42:30.818038] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7049. [D 20:42:30.818049] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7050. [D 20:42:30.818059] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7051. [D 20:42:30.818069] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7052. [D 20:42:30.818079] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7053. [D 20:42:30.818090] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7054. [D 20:42:30.818100] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7055. [D 20:42:30.818155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7056. [D 20:42:30.818167] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7057. [D 20:42:30.818191] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7058. [D 20:42:30.818201] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7059. [D 20:42:30.818211] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7060. [D 20:42:30.818227] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7061. [D 20:42:30.818237] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7062. [D 20:42:30.818247] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7063. [D 20:42:30.818257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7064. [D 20:42:30.818267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7065. [D 20:42:30.818277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7066. [D 20:42:30.818287] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7067. [D 20:42:30.818297] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7068. [D 20:42:30.818322] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7069. [D 20:42:30.818333] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7070. [D 20:42:30.818343] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7071. [D 20:42:30.818358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7072. [D 20:42:30.818368] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7073. [D 20:42:30.818378] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7074. [D 20:42:30.818401] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7075. [D 20:42:30.818411] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7076. [D 20:42:30.818421] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7077. [D 20:42:30.823914] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7077. [D 20:42:30.823932] openib_post_sr: 10.1.4.240:38258 bh 18 len 16 wr 17/70. [D 20:42:30.826246] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.826261] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.826271] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.831800] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.831815] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.831826] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.831859] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3074 [D 20:42:30.831873] element 0: offset: 0x66e790, size: 24 [D 20:42:30.831885] openib_post_sr: 10.1.4.240:38258 bh 19 len 40 wr 18/70. [D 20:42:30.884141] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3071 [D 20:42:30.884160] openib_post_sr: 10.1.4.240:38258 bh 0 len 32 wr 19/70. [D 20:42:30.884221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 7077. [D 20:42:30.884292] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7078. [D 20:42:30.884323] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7079. [D 20:42:30.884334] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7080. [D 20:42:30.884345] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7081. [D 20:42:30.884356] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7082. [D 20:42:30.884367] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7083. [D 20:42:30.884377] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7084. [D 20:42:30.884387] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7085. [D 20:42:30.884415] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7086. [D 20:42:30.884426] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7087. [D 20:42:30.884436] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7088. [D 20:42:30.884446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7089. [D 20:42:30.884456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7090. [D 20:42:30.884466] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7091. [D 20:42:30.884489] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7092. [D 20:42:30.884499] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7093. [D 20:42:30.884510] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7094. [D 20:42:30.884532] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7095. [D 20:42:30.884541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7096. [D 20:42:30.884567] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7097. [D 20:42:30.884577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7098. [D 20:42:30.884591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7099. [D 20:42:30.884601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7100. [D 20:42:30.884616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7101. [D 20:42:30.884642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7102. [D 20:42:30.884656] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7103. [D 20:42:30.884667] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7104. [D 20:42:30.884689] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7105. [D 20:42:30.884699] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7106. [D 20:42:30.884709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7107. [D 20:42:30.884733] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7108. [D 20:42:30.890228] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7108. [D 20:42:30.890244] openib_post_sr: 10.1.4.240:38258 bh 1 len 16 wr 20/70. [D 20:42:30.892547] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.892562] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.892573] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.898548] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.898562] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.898571] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.898604] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3077 [D 20:42:30.898615] element 0: offset: 0x61ee50, size: 24 [D 20:42:30.898627] openib_post_sr: 10.1.4.240:38258 bh 2 len 40 wr 21/70. [D 20:42:30.969316] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3064 [D 20:42:30.969335] openib_post_sr: 10.1.4.240:38258 bh 3 len 32 wr 22/70. [D 20:42:30.969438] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 7108. [D 20:42:30.969544] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 7109. [D 20:42:30.969556] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 7110. [D 20:42:30.969566] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 7111. [D 20:42:30.969577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 7112. [D 20:42:30.969587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 7113. [D 20:42:30.969597] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 7114. [D 20:42:30.969613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 7115. [D 20:42:30.969623] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 7116. [D 20:42:30.969633] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 7117. [D 20:42:30.969643] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 7118. [D 20:42:30.969671] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 7119. [D 20:42:30.969681] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 7120. [D 20:42:30.969702] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 7121. [D 20:42:30.969712] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 7122. [D 20:42:30.969723] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 7123. [D 20:42:30.969745] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 7124. [D 20:42:30.969756] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 7125. [D 20:42:30.969766] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 7126. [D 20:42:30.969776] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 7127. [D 20:42:30.969787] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 7128. [D 20:42:30.969810] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 7129. [D 20:42:30.969821] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 7130. [D 20:42:30.969831] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 7131. [D 20:42:30.969841] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 7132. [D 20:42:30.969853] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 7133. [D 20:42:30.969878] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 7134. [D 20:42:30.969888] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 7135. [D 20:42:30.969899] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 7136. [D 20:42:30.969909] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 7137. [D 20:42:30.969933] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 7138. [D 20:42:30.969944] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 7139. [D 20:42:30.975402] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7139. [D 20:42:30.975419] openib_post_sr: 10.1.4.240:38258 bh 4 len 16 wr 23/70. [D 20:42:30.975905] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:30.975920] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.975930] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:30.983082] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:30.983097] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:30.983107] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:30.983140] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3079 [D 20:42:30.983150] element 0: offset: 0x67efc0, size: 24 [D 20:42:30.983162] openib_post_sr: 10.1.4.240:38258 bh 5 len 40 wr 24/70. [D 20:42:31.058377] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3079 [D 20:42:31.058396] openib_post_sr: 10.1.4.240:38258 bh 6 len 32 wr 25/70. [D 20:42:31.058509] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 7139. [D 20:42:31.058616] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 7140. [D 20:42:31.058628] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 7141. [D 20:42:31.058639] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 7142. [D 20:42:31.058649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 7143. [D 20:42:31.058660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 7144. [D 20:42:31.058670] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 7145. [D 20:42:31.058680] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 7146. [D 20:42:31.058690] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 7147. [D 20:42:31.058700] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 7148. [D 20:42:31.058709] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 7149. [D 20:42:31.058741] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 7150. [D 20:42:31.058751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 7151. [D 20:42:31.058772] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 7152. [D 20:42:31.058782] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 7153. [D 20:42:31.058792] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 7154. [D 20:42:31.058814] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 7155. [D 20:42:31.058825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 7156. [D 20:42:31.058838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 7157. [D 20:42:31.058852] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 7158. [D 20:42:31.058862] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 7159. [D 20:42:31.058885] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 7160. [D 20:42:31.058897] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 7161. [D 20:42:31.058911] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 7162. [D 20:42:31.058926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 7163. [D 20:42:31.058960] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 7164. [D 20:42:31.058982] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 7165. [D 20:42:31.058993] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 7166. [D 20:42:31.059003] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 7167. [D 20:42:31.059021] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 7168. [D 20:42:31.059037] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 7169. [D 20:42:31.059047] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 7170. [D 20:42:31.064541] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7170. [D 20:42:31.064559] openib_post_sr: 10.1.4.240:38258 bh 7 len 16 wr 26/70. [D 20:42:31.066878] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.066893] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.066903] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.072391] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.072407] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.072417] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.072451] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3082 [D 20:42:31.072462] element 0: offset: 0x5b0030, size: 24 [D 20:42:31.072473] openib_post_sr: 10.1.4.240:38258 bh 8 len 40 wr 27/70. [D 20:42:31.124804] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3074 [D 20:42:31.124822] openib_post_sr: 10.1.4.240:38258 bh 9 len 32 wr 28/70. [D 20:42:31.124883] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7170. [D 20:42:31.124953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7171. [D 20:42:31.125008] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7172. [D 20:42:31.125019] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7173. [D 20:42:31.125030] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7174. [D 20:42:31.125040] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7175. [D 20:42:31.125050] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7176. [D 20:42:31.125071] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7177. [D 20:42:31.125086] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7178. [D 20:42:31.125096] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7179. [D 20:42:31.125106] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7180. [D 20:42:31.125139] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7181. [D 20:42:31.125149] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7182. [D 20:42:31.125173] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7183. [D 20:42:31.125186] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7184. [D 20:42:31.125196] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7185. [D 20:42:31.125221] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7186. [D 20:42:31.125231] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7187. [D 20:42:31.125242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7188. [D 20:42:31.125264] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7189. [D 20:42:31.125274] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7190. [D 20:42:31.125285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7191. [D 20:42:31.125309] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7192. [D 20:42:31.125319] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7193. [D 20:42:31.125329] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7194. [D 20:42:31.125354] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7195. [D 20:42:31.125365] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7196. [D 20:42:31.125375] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7197. [D 20:42:31.125385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7198. [D 20:42:31.125396] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7199. [D 20:42:31.125406] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7200. [D 20:42:31.125428] openib_post_sr_rdmaw: ibv_post_send wr_id 6517b0 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7201. [D 20:42:31.130850] openib_check_cq: completed rdma wr_id 6517b0, nic_wr_credit 7201. [D 20:42:31.130866] openib_post_sr: 10.1.4.240:38258 bh 10 len 16 wr 29/70. [D 20:42:31.131960] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.131975] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.131986] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.150765] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3077 [D 20:42:31.150784] openib_post_sr: 10.1.4.240:38258 bh 11 len 32 wr 30/70. [D 20:42:31.150847] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40044 nic_wr_credit 7201. [D 20:42:31.150915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7202. [D 20:42:31.150943] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7203. [D 20:42:31.150953] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7204. [D 20:42:31.150964] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7205. [D 20:42:31.150975] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7206. [D 20:42:31.150986] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7207. [D 20:42:31.150996] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7208. [D 20:42:31.151006] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7209. [D 20:42:31.151016] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7210. [D 20:42:31.151065] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7211. [D 20:42:31.151075] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7212. [D 20:42:31.151108] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7213. [D 20:42:31.151121] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7214. [D 20:42:31.151131] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7215. [D 20:42:31.151141] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7216. [D 20:42:31.151152] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7217. [D 20:42:31.151162] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7218. [D 20:42:31.151172] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7219. [D 20:42:31.151188] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7220. [D 20:42:31.151198] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7221. [D 20:42:31.151208] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7222. [D 20:42:31.151218] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7223. [D 20:42:31.151228] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7224. [D 20:42:31.151255] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7225. [D 20:42:31.151265] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7226. [D 20:42:31.151275] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7227. [D 20:42:31.151285] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7228. [D 20:42:31.151300] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7229. [D 20:42:31.151324] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7230. [D 20:42:31.151339] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7231. [D 20:42:31.151351] openib_post_sr_rdmaw: ibv_post_send wr_id 6517b0 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7232. [D 20:42:31.156781] openib_check_cq: completed rdma wr_id 6517b0, nic_wr_credit 7232. [D 20:42:31.156799] openib_post_sr: 10.1.4.240:38258 bh 12 len 16 wr 31/70. [D 20:42:31.159003] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.159018] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.159028] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 2 [D 20:42:31.275741] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.275765] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.275776] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 3 [D 20:42:31.275810] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3086 [D 20:42:31.275821] element 0: offset: 0x62a350, size: 24 [D 20:42:31.275834] openib_post_sr: 10.1.4.240:38258 bh 13 len 40 wr 32/70. [D 20:42:31.293393] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.293456] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.293466] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.293503] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3089 [D 20:42:31.293514] element 0: offset: 0x64b790, size: 24 [D 20:42:31.293528] openib_post_sr: 10.1.4.240:38258 bh 14 len 40 wr 33/70. [D 20:42:31.300959] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3056 [D 20:42:31.300978] openib_post_sr: 10.1.4.240:38258 bh 15 len 32 wr 34/70. [D 20:42:31.301155] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 7232. [D 20:42:31.301220] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 7233. [D 20:42:31.301232] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 7234. [D 20:42:31.301242] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 7235. [D 20:42:31.301257] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 7236. [D 20:42:31.301267] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 7237. [D 20:42:31.301277] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 7238. [D 20:42:31.301291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 7239. [D 20:42:31.301301] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 7240. [D 20:42:31.301311] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d0c000 rkey 4a40050 nic_wr_credit 7241. [D 20:42:31.301342] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d2c000 rkey 4a40050 nic_wr_credit 7242. [D 20:42:31.301353] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d4c000 rkey 4a40050 nic_wr_credit 7243. [D 20:42:31.301380] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d6c000 rkey 4a40050 nic_wr_credit 7244. [D 20:42:31.301391] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4d8c000 rkey 4a40050 nic_wr_credit 7245. [D 20:42:31.301402] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dac000 rkey 4a40050 nic_wr_credit 7246. [D 20:42:31.301424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dcc000 rkey 4a40050 nic_wr_credit 7247. [D 20:42:31.301434] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4dec000 rkey 4a40050 nic_wr_credit 7248. [D 20:42:31.301444] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e0c000 rkey 4a40050 nic_wr_credit 7249. [D 20:42:31.301468] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e2c000 rkey 4a40050 nic_wr_credit 7250. [D 20:42:31.301478] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e4c000 rkey 4a40050 nic_wr_credit 7251. [D 20:42:31.301512] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e6c000 rkey 4a40050 nic_wr_credit 7252. [D 20:42:31.301535] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4e8c000 rkey 4a40050 nic_wr_credit 7253. [D 20:42:31.301545] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eac000 rkey 4a40050 nic_wr_credit 7254. [D 20:42:31.301555] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ecc000 rkey 4a40050 nic_wr_credit 7255. [D 20:42:31.301577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4eec000 rkey 4a40050 nic_wr_credit 7256. [D 20:42:31.301587] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f0c000 rkey 4a40050 nic_wr_credit 7257. [D 20:42:31.301611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f2c000 rkey 4a40050 nic_wr_credit 7258. [D 20:42:31.301622] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f4c000 rkey 4a40050 nic_wr_credit 7259. [D 20:42:31.301636] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f6c000 rkey 4a40050 nic_wr_credit 7260. [D 20:42:31.301660] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4f8c000 rkey 4a40050 nic_wr_credit 7261. [D 20:42:31.301674] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4fac000 rkey 4a40050 nic_wr_credit 7262. [D 20:42:31.301684] openib_post_sr_rdmaw: ibv_post_send wr_id 632a50 to 10.1.4.240:38258 remote addr f4fcc000 rkey 4a40050 nic_wr_credit 7263. [D 20:42:31.308683] openib_check_cq: completed rdma wr_id 632a50, nic_wr_credit 7263. [D 20:42:31.308733] openib_post_sr: 10.1.4.240:38258 bh 16 len 16 wr 35/70. [D 20:42:31.311011] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.311027] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.311038] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.316797] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.316827] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.316837] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.316871] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3092 [D 20:42:31.316882] element 0: offset: 0x62a780, size: 24 [D 20:42:31.316896] openib_post_sr: 10.1.4.240:38258 bh 17 len 40 wr 36/70. [D 20:42:31.336096] BMI_post_send: addr: 6416064, offset: 0x2aaaaafe7010, size: 2097152, tag: 3082 [D 20:42:31.336114] openib_post_sr: 10.1.4.240:38258 bh 18 len 32 wr 37/70. [D 20:42:31.336174] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47dc000 rkey 4a4004f nic_wr_credit 7263. [D 20:42:31.336269] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47fc000 rkey 4a4004f nic_wr_credit 7264. [D 20:42:31.336283] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f481c000 rkey 4a4004f nic_wr_credit 7265. [D 20:42:31.336294] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f483c000 rkey 4a4004f nic_wr_credit 7266. [D 20:42:31.336305] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f485c000 rkey 4a4004f nic_wr_credit 7267. [D 20:42:31.336315] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f487c000 rkey 4a4004f nic_wr_credit 7268. [D 20:42:31.336326] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f489c000 rkey 4a4004f nic_wr_credit 7269. [D 20:42:31.336336] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48bc000 rkey 4a4004f nic_wr_credit 7270. [D 20:42:31.336374] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48dc000 rkey 4a4004f nic_wr_credit 7271. [D 20:42:31.336385] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f48fc000 rkey 4a4004f nic_wr_credit 7272. [D 20:42:31.336409] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f491c000 rkey 4a4004f nic_wr_credit 7273. [D 20:42:31.336425] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f493c000 rkey 4a4004f nic_wr_credit 7274. [D 20:42:31.336447] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f495c000 rkey 4a4004f nic_wr_credit 7275. [D 20:42:31.336461] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f497c000 rkey 4a4004f nic_wr_credit 7276. [D 20:42:31.336471] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f499c000 rkey 4a4004f nic_wr_credit 7277. [D 20:42:31.336498] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49bc000 rkey 4a4004f nic_wr_credit 7278. [D 20:42:31.336508] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49dc000 rkey 4a4004f nic_wr_credit 7279. [D 20:42:31.336530] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f49fc000 rkey 4a4004f nic_wr_credit 7280. [D 20:42:31.336541] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a1c000 rkey 4a4004f nic_wr_credit 7281. [D 20:42:31.336563] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a3c000 rkey 4a4004f nic_wr_credit 7282. [D 20:42:31.336578] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a5c000 rkey 4a4004f nic_wr_credit 7283. [D 20:42:31.336599] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a7c000 rkey 4a4004f nic_wr_credit 7284. [D 20:42:31.336613] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4a9c000 rkey 4a4004f nic_wr_credit 7285. [D 20:42:31.336637] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4abc000 rkey 4a4004f nic_wr_credit 7286. [D 20:42:31.336652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4adc000 rkey 4a4004f nic_wr_credit 7287. [D 20:42:31.336676] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4afc000 rkey 4a4004f nic_wr_credit 7288. [D 20:42:31.336688] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b1c000 rkey 4a4004f nic_wr_credit 7289. [D 20:42:31.336708] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b3c000 rkey 4a4004f nic_wr_credit 7290. [D 20:42:31.336722] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b5c000 rkey 4a4004f nic_wr_credit 7291. [D 20:42:31.336732] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b7c000 rkey 4a4004f nic_wr_credit 7292. [D 20:42:31.336755] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4b9c000 rkey 4a4004f nic_wr_credit 7293. [D 20:42:31.336765] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f4bbc000 rkey 4a4004f nic_wr_credit 7294. [D 20:42:31.342123] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7294. [D 20:42:31.342140] openib_post_sr: 10.1.4.240:38258 bh 19 len 16 wr 38/70. [D 20:42:31.343938] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.343953] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.343963] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.349988] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.350002] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.350013] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.350044] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3094 [D 20:42:31.350055] element 0: offset: 0x691fe0, size: 24 [D 20:42:31.350067] openib_post_sr: 10.1.4.240:38258 bh 0 len 40 wr 39/70. [D 20:42:31.403471] BMI_post_send: addr: 6416064, offset: 0x2aaaab300010, size: 2097152, tag: 3086 [D 20:42:31.403514] openib_post_sr: 10.1.4.240:38258 bh 1 len 32 wr 40/70. [D 20:42:31.403577] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f3fec000 rkey 4a40042 nic_wr_credit 7294. [D 20:42:31.403649] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f400c000 rkey 4a40044 nic_wr_credit 7295. [D 20:42:31.403661] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f402c000 rkey 4a40044 nic_wr_credit 7296. [D 20:42:31.403672] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f404c000 rkey 4a40044 nic_wr_credit 7297. [D 20:42:31.403686] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f406c000 rkey 4a40044 nic_wr_credit 7298. [D 20:42:31.403696] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f408c000 rkey 4a40044 nic_wr_credit 7299. [D 20:42:31.403706] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ac000 rkey 4a40044 nic_wr_credit 7300. [D 20:42:31.403716] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40cc000 rkey 4a40044 nic_wr_credit 7301. [D 20:42:31.403726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f40ec000 rkey 4a40044 nic_wr_credit 7302. [D 20:42:31.403736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f410c000 rkey 4a40044 nic_wr_credit 7303. [D 20:42:31.403800] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f412c000 rkey 4a40044 nic_wr_credit 7304. [D 20:42:31.403811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f414c000 rkey 4a40044 nic_wr_credit 7305. [D 20:42:31.403825] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f416c000 rkey 4a40044 nic_wr_credit 7306. [D 20:42:31.403835] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f418c000 rkey 4a40044 nic_wr_credit 7307. [D 20:42:31.403845] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ac000 rkey 4a40044 nic_wr_credit 7308. [D 20:42:31.403861] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41cc000 rkey 4a40044 nic_wr_credit 7309. [D 20:42:31.403871] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f41ec000 rkey 4a40044 nic_wr_credit 7310. [D 20:42:31.403881] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f420c000 rkey 4a40044 nic_wr_credit 7311. [D 20:42:31.403896] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f422c000 rkey 4a40044 nic_wr_credit 7312. [D 20:42:31.403906] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f424c000 rkey 4a40044 nic_wr_credit 7313. [D 20:42:31.403922] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f426c000 rkey 4a40044 nic_wr_credit 7314. [D 20:42:31.403932] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f428c000 rkey 4a40044 nic_wr_credit 7315. [D 20:42:31.403942] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ac000 rkey 4a40044 nic_wr_credit 7316. [D 20:42:31.403951] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42cc000 rkey 4a40044 nic_wr_credit 7317. [D 20:42:31.403973] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f42ec000 rkey 4a40044 nic_wr_credit 7318. [D 20:42:31.403997] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f430c000 rkey 4a40044 nic_wr_credit 7319. [D 20:42:31.404013] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f432c000 rkey 4a40044 nic_wr_credit 7320. [D 20:42:31.404035] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f434c000 rkey 4a40044 nic_wr_credit 7321. [D 20:42:31.404046] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f436c000 rkey 4a40044 nic_wr_credit 7322. [D 20:42:31.404056] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f438c000 rkey 4a40044 nic_wr_credit 7323. [D 20:42:31.404066] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ac000 rkey 4a40044 nic_wr_credit 7324. [D 20:42:31.404077] openib_post_sr_rdmaw: ibv_post_send wr_id 63fe40 to 10.1.4.240:38258 remote addr f43cc000 rkey 4a40044 nic_wr_credit 7325. [D 20:42:31.409507] openib_check_cq: completed rdma wr_id 63fe40, nic_wr_credit 7325. [D 20:42:31.409523] openib_post_sr: 10.1.4.240:38258 bh 2 len 16 wr 41/70. [D 20:42:31.411820] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.411835] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.411845] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.415927] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.415941] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.415952] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.415984] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3098 [D 20:42:31.415995] element 0: offset: 0x61ee50, size: 24 [D 20:42:31.416010] openib_post_sr: 10.1.4.240:38258 bh 3 len 40 wr 42/70. [D 20:42:31.509359] BMI_post_send: addr: 6416064, offset: 0x2aaaaabe5010, size: 2097152, tag: 3089 [D 20:42:31.509378] openib_post_sr: 10.1.4.240:38258 bh 4 len 32 wr 43/70. [D 20:42:31.509445] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f43ec000 rkey 4a4004e nic_wr_credit 7325. [D 20:42:31.509543] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f440c000 rkey 4a4004e nic_wr_credit 7326. [D 20:42:31.509557] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f442c000 rkey 4a4004e nic_wr_credit 7327. [D 20:42:31.509569] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f444c000 rkey 4a4004e nic_wr_credit 7328. [D 20:42:31.509580] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f446c000 rkey 4a4004e nic_wr_credit 7329. [D 20:42:31.509591] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f448c000 rkey 4a4004e nic_wr_credit 7330. [D 20:42:31.509601] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ac000 rkey 4a4004e nic_wr_credit 7331. [D 20:42:31.509611] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44cc000 rkey 4a4004e nic_wr_credit 7332. [D 20:42:31.509621] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f44ec000 rkey 4a4004e nic_wr_credit 7333. [D 20:42:31.509631] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f450c000 rkey 4a4004e nic_wr_credit 7334. [D 20:42:31.509642] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f452c000 rkey 4a4004e nic_wr_credit 7335. [D 20:42:31.509652] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f454c000 rkey 4a4004e nic_wr_credit 7336. [D 20:42:31.509662] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f456c000 rkey 4a4004e nic_wr_credit 7337. [D 20:42:31.509705] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f458c000 rkey 4a4004e nic_wr_credit 7338. [D 20:42:31.509726] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ac000 rkey 4a4004e nic_wr_credit 7339. [D 20:42:31.509736] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45cc000 rkey 4a4004e nic_wr_credit 7340. [D 20:42:31.509751] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f45ec000 rkey 4a4004e nic_wr_credit 7341. [D 20:42:31.509774] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f460c000 rkey 4a4004e nic_wr_credit 7342. [D 20:42:31.509785] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f462c000 rkey 4a4004e nic_wr_credit 7343. [D 20:42:31.509795] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f464c000 rkey 4a4004e nic_wr_credit 7344. [D 20:42:31.509811] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f466c000 rkey 4a4004e nic_wr_credit 7345. [D 20:42:31.509838] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f468c000 rkey 4a4004e nic_wr_credit 7346. [D 20:42:31.509848] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ac000 rkey 4a4004e nic_wr_credit 7347. [D 20:42:31.509858] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46cc000 rkey 4a4004e nic_wr_credit 7348. [D 20:42:31.509869] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f46ec000 rkey 4a4004e nic_wr_credit 7349. [D 20:42:31.509880] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f470c000 rkey 4a4004e nic_wr_credit 7350. [D 20:42:31.509905] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f472c000 rkey 4a4004e nic_wr_credit 7351. [D 20:42:31.509915] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f474c000 rkey 4a4004e nic_wr_credit 7352. [D 20:42:31.509926] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f476c000 rkey 4a4004e nic_wr_credit 7353. [D 20:42:31.509936] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f478c000 rkey 4a4004e nic_wr_credit 7354. [D 20:42:31.509962] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f47ac000 rkey 4a4004e nic_wr_credit 7355. [D 20:42:31.509972] openib_post_sr_rdmaw: ibv_post_send wr_id 6b2260 to 10.1.4.240:38258 remote addr f47cc000 rkey 4a4004e nic_wr_credit 7356. [D 20:42:31.515402] openib_check_cq: completed rdma wr_id 6b2260, nic_wr_credit 7356. [D 20:42:31.515419] openib_post_sr: 10.1.4.240:38258 bh 5 len 16 wr 44/70. [D 20:42:31.517562] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 6 [D 20:42:31.517578] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.517589] [BMI CONTROL]: BMI_set_info: decremented ref 6416064 to: 3 [D 20:42:31.523260] [BMI CONTROL]: BMI_set_info: set_info: 6416064 option: 5 [D 20:42:31.523275] [BMI CONTROL]: BMI_set_info: searching for ref 6416064 [D 20:42:31.523285] [BMI CONTROL]: BMI_set_info: incremented ref 6416064 to: 4 [D 20:42:31.523317] BMI_post_send_list: addr: 6416064, count: 1, total_size: 24, tag: 3101 [D 20:42:31.523328] element 0: offset: 0x63e800, size: 24 [D 20:42:31.523340] openib_post_sr: 10.1.4.240:38258 bh 6 len 40 wr 45/70. [D 20:42:31.548215] BMI_post_send: addr: 6416064, offset: 0x2aaaaade6010, size: 2097152, tag: 3092 [D 20:42:31.548233] openib_post_sr: 10.1.4.240:38258 bh 7 len 32 wr 46/70. [D 20:42:31.548291] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4bec000 rkey 4a40050 nic_wr_credit 7356. [D 20:42:31.548358] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c0c000 rkey 4a40050 nic_wr_credit 7357. [D 20:42:31.548413] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c2c000 rkey 4a40050 nic_wr_credit 7358. [D 20:42:31.548424] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c4c000 rkey 4a40050 nic_wr_credit 7359. [D 20:42:31.548435] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c6c000 rkey 4a40050 nic_wr_credit 7360. [D 20:42:31.548446] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4c8c000 rkey 4a40050 nic_wr_credit 7361. [D 20:42:31.548456] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cac000 rkey 4a40050 nic_wr_credit 7362. [D 20:42:31.548479] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4ccc000 rkey 4a40050 nic_wr_credit 7363. [D 20:42:31.548490] openib_post_sr_rdmaw: ibv_post_send wr_id 0 to 10.1.4.240:38258 remote addr f4cec000 rkey 4a40050 nic_wr_credit 7364. [D 20:42:31.5485