max-num-seqs

Flag for max concurrently batched requests; trades throughput against latency and memory.