Inference

This folder contains the disaggregated inference scripts: from retrieval server to inference client, as well as a number of demo scripts. The client and server communicate with each other via gRPC.