{"id":17979,"date":"2022-02-25T10:25:46","date_gmt":"2022-02-25T04:55:46","guid":{"rendered":"http:\/\/onlineappsdba.com\/?p=17979"},"modified":"2022-02-25T10:29:14","modified_gmt":"2022-02-25T04:59:14","slug":"structured-streaming-with-azure-event-hubs","status":"publish","type":"post","link":"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/","title":{"rendered":"Structured Streaming With Azure Event Hubs"},"content":{"rendered":"<p>In this blog, we are covering Structured Streaming, Events Hubs, Streaming With Event Hubs<\/p>\n<p><strong>What Is Structured Streaming <\/strong><\/p>\n<p>Apache Spark Structured Streaming is a fast, scalable, and fault-tolerant stream processing API. You can use it to perform analytics on your streaming data in near real-time. With Structured Streaming, you can use SQL queries to process streaming data in the same way that you would process static data. The API continuously increments and updates the final data.<\/p>\n<p><strong>What Is Event Hub <\/strong><\/p>\n<p>Azure Event Hubs is a scalable real-time data ingestion service that processes millions of data in a matter of seconds. It can receive large amounts of data from multiple sources and stream the prepared data to Azure Data Lake or Azure Blob storage.<\/p>\n<p>Azure Event Hubs can be integrated with Spark Structured Streaming to perform the processing of messages in near real-time. You can query and analyze the processed data as it comes by using a Structured Streaming query and Spark SQL.<\/p>\n<p>Want to know more about Structured Streaming With Azure Event Hubs Read the blog post at <a href=\"https:\/\/k21academy.com\/microsoft-azure\/data-engineer\/structured-streaming-with-azure-event-hubs\/?utm_source=onlineappsdba&amp;utm_medium=referral&amp;utm_campaign=azurede42_feb2022\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>https:\/\/k21academy.com\/azurede42<\/strong><\/a><\/p>\n<p><strong> Topics we\u2019ll cover: <\/strong><\/p>\n<p>What is structured streaming<\/p>\n<p>What is Event Hub Component of Azure Event Hubs<\/p>\n<p>What is Event Hub Streaming With Event Hubs<\/p>\n<p>\ud83d\udcab Want even more in-depth training? Check the FREE CLASS now at\u00a0<a href=\"https:\/\/k21academy.com\/free-class-azure-data-engineer-certification\/?utm_source=onlineappsdba&amp;utm_medium=referral&amp;utm_campaign=azurede02_feb22\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/k21academy.com\/azurede02<\/a><\/p>\n<p><a href=\"https:\/\/k21academy.com\/free-class-azure-data-engineer-certification\/?utm_source=onlineappsdba&amp;utm_medium=referral&amp;utm_campaign=azurede02_feb22\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter\" src=\"https:\/\/k21academy.com\/wp-content\/uploads\/2021\/06\/CU_DP203_GIF1.gif\" alt=\"https:\/\/k21academy.com\/wp-content\/uploads\/2021\/06\/CU_DP203_GIF1.gif\" width=\"1354\" height=\"203\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this blog, we are covering Structured Streaming, Events Hubs, Streaming With Event Hubs What Is Structured Streaming Apache Spark [&hellip;]<\/p>\n","protected":false},"author":115,"featured_media":17980,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[570,540],"tags":[],"class_list":["post-17979","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-engineer","category-microsoft-azure"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Structured Streaming With Azure Event Hubs | K21 Academy<\/title>\n<meta name=\"description\" content=\"In this blog, we are covering Structured Streaming, Events Hubs, Streaming With Event Hubs. Structured Streaming With Azure Event Hubs.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Structured Streaming With Azure Event Hubs | K21 Academy\" \/>\n<meta property=\"og:description\" content=\"In this blog, we are covering Structured Streaming, Events Hubs, Streaming With Event Hubs. Structured Streaming With Azure Event Hubs.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/\" \/>\n<meta property=\"article:published_time\" content=\"2022-02-25T04:55:46+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-02-25T04:59:14+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2022\/02\/AzureEventHubs_BlogImage-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1920\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Masroof Ahmad\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Masroof Ahmad\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/\",\"url\":\"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/\",\"name\":\"Structured Streaming With Azure Event Hubs | K21 Academy\",\"isPartOf\":{\"@id\":\"https:\/\/onlineappsdba.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2022\/02\/AzureEventHubs_BlogImage-1.png\",\"datePublished\":\"2022-02-25T04:55:46+00:00\",\"dateModified\":\"2022-02-25T04:59:14+00:00\",\"author\":{\"@id\":\"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb\"},\"description\":\"In this blog, we are covering Structured Streaming, Events Hubs, Streaming With Event Hubs. Structured Streaming With Azure Event Hubs.\",\"breadcrumb\":{\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/#primaryimage\",\"url\":\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2022\/02\/AzureEventHubs_BlogImage-1.png\",\"contentUrl\":\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2022\/02\/AzureEventHubs_BlogImage-1.png\",\"width\":1920,\"height\":1080},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/onlineappsdba.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Structured Streaming With Azure Event Hubs\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/onlineappsdba.com\/#website\",\"url\":\"https:\/\/onlineappsdba.com\/\",\"name\":\"\",\"description\":\"Oracle Implementation &amp; Training Experts\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/onlineappsdba.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb\",\"name\":\"Masroof Ahmad\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/onlineappsdba.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g\",\"caption\":\"Masroof Ahmad\"},\"url\":\"https:\/\/onlineappsdba.com\/index.php\/author\/masroof\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Structured Streaming With Azure Event Hubs | K21 Academy","description":"In this blog, we are covering Structured Streaming, Events Hubs, Streaming With Event Hubs. Structured Streaming With Azure Event Hubs.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/","og_locale":"en_US","og_type":"article","og_title":"Structured Streaming With Azure Event Hubs | K21 Academy","og_description":"In this blog, we are covering Structured Streaming, Events Hubs, Streaming With Event Hubs. Structured Streaming With Azure Event Hubs.","og_url":"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/","article_published_time":"2022-02-25T04:55:46+00:00","article_modified_time":"2022-02-25T04:59:14+00:00","og_image":[{"width":1920,"height":1080,"url":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2022\/02\/AzureEventHubs_BlogImage-1.png","type":"image\/png"}],"author":"Masroof Ahmad","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Masroof Ahmad","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/","url":"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/","name":"Structured Streaming With Azure Event Hubs | K21 Academy","isPartOf":{"@id":"https:\/\/onlineappsdba.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/#primaryimage"},"image":{"@id":"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/#primaryimage"},"thumbnailUrl":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2022\/02\/AzureEventHubs_BlogImage-1.png","datePublished":"2022-02-25T04:55:46+00:00","dateModified":"2022-02-25T04:59:14+00:00","author":{"@id":"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb"},"description":"In this blog, we are covering Structured Streaming, Events Hubs, Streaming With Event Hubs. Structured Streaming With Azure Event Hubs.","breadcrumb":{"@id":"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/#primaryimage","url":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2022\/02\/AzureEventHubs_BlogImage-1.png","contentUrl":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2022\/02\/AzureEventHubs_BlogImage-1.png","width":1920,"height":1080},{"@type":"BreadcrumbList","@id":"https:\/\/onlineappsdba.com\/index.php\/2022\/02\/25\/structured-streaming-with-azure-event-hubs\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/onlineappsdba.com\/"},{"@type":"ListItem","position":2,"name":"Structured Streaming With Azure Event Hubs"}]},{"@type":"WebSite","@id":"https:\/\/onlineappsdba.com\/#website","url":"https:\/\/onlineappsdba.com\/","name":"","description":"Oracle Implementation &amp; Training Experts","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/onlineappsdba.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb","name":"Masroof Ahmad","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/onlineappsdba.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g","caption":"Masroof Ahmad"},"url":"https:\/\/onlineappsdba.com\/index.php\/author\/masroof\/"}]}},"_links":{"self":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/posts\/17979","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/users\/115"}],"replies":[{"embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/comments?post=17979"}],"version-history":[{"count":0,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/posts\/17979\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/media\/17980"}],"wp:attachment":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/media?parent=17979"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/categories?post=17979"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/tags?post=17979"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}