Home

rocm-axiio Wiki

Welcome to the rocm-axiio wiki!

RDMA API Discussion (from Allen)

One of the deficiencies imo of the shmem interface is nonblocking/async style. There are nonblocking fire-and-forget methods to post a work request, where the only reason to block is to make space in the queue. Some kinds of requests, like atomic operations, have no asyncronous interface: those functions return the atomic fetch value and thus must block for the duration the request is outstanding. If the upper layer wants to check on the progress of a particular request, or requests up to a certain point, there's no way to poll one time to observe that progress without blocking. For blocking, the provided quiet() waits for all outstanding work to complete, there is no interface provided to block for progress up to a specified point. Is that something being considered in the new library?