Speaker(s):

How the sausage gets made: Dataflow under the covers

The team that builds the Dataflow runner likes to say it “just works”. But how does it really work? How does it decide to autoscale? What happens on failures? Where is state data stored? Can I have infinite state data? What goes into Dataflow’s latency? What’s the checkpoint logic?

These and other questions to be answered in this session!