Beam in Production: Working with DataFlow Flex temples and Cloud Build

Understanding how to integrate Apache Beam into your production workflow is critical for large scale enterprises who are looking to automate the deployment and integration of their pipelines with the appropriate environments.

In this session, we will look into how to get a Beam pipeline successfully deployed via a CICD framework (Google’s cloud build) by utilising Dataflow’s flex temples and discuss lessons learned along the way.

Code used in presentation available at https://github.com/ragyibrahim/apache-beam-cicd