Lightning-fast querying of hundreds of millions of records using Azure Data Explorer
Have you ever ingested data from thousands of IoT devices? Are you struggling to daily store millions of records and provide sub-second responses to queries that touch hundreds of millions of records? Please join Henry in this session to learn about the journey his customer made to using Azure Data Explorer. We'll start by exploring how the previous solution used hourly, daily, weekly and monthly batch-processing runs to create pre-aggregated datasets and all of the problems this solution brought. From there we'll follow the evolution of the platform, ending at a solution that uses Azure Data Explorer and no more manual (pre)processing. Oh, and by the way: we're still on the cheapest production-tier instance of Data Explorer and expect to process up to billions of records by the time you come to this session! So, I hope to see you soon!
Sprecher
Henry Been
DevOps & Azure Architect | Microsoft MVP
Henry Been is an independent architect and developer from The Netherlands. He enjoys working with software development teams to create and deliver software for the Azure cloud. His interests include Azure, Agile, DevOps, software architecture and the design and implementation of testable and maintainable software. Besides his work he is a speaker at international conferences, is the author of two books, and creates online training courses for Pluralsight and A Cloud Guru. For his work in the com... mehr erfahren