Online vs offline serving

Online = live users, latency-sensitive. Offline = batch jobs, throughput is everything.