How does a data engineer develop a data pipeline? — Developing a new data pipeline is a long process. It usually starts with the business justification, defining metrics, researching available data and tables, and finally, developing and launching the pipeline. In this article, I specifically focus on the development stage. Assume, at this step; you know the business requirements, worked…