Design batch and streaming ETL pipelines
A data engineering onsite round on pipelines: design how product events are ingested, cleaned and aggregated into tables that analysts use, first as daily batch jobs and then as near real-time streaming. Cover table design, how updates and late data are handled, aggregation, and how you would check data quality.
No answer yet. Write the first one; the best answer gets endorsed.
