I have recently come across this presentation https://www.infoq.com/presentations/etl-streams?utm_source=infoq&utm_medium=popular_widget&utm_campaign=popular_content_list&utm_content=homepage
Should every data integration or data processing pipeline should be built based on stream processing architecture, even though there is no need for such a thing from day zero? The argument i hear for doing so is that in future we might have a need for real time processing. Would like to hear what others are thinking.
7 comments
Ask HN: Is ETL (data integration in batch processing mode) really dead? | Heykuki News