Physical limitations on fundamental efficiency of set-based brownian circuits