{"id":16941,"date":"2021-08-14T17:40:50","date_gmt":"2021-08-14T12:10:50","guid":{"rendered":"http:\/\/onlineappsdba.com\/?p=16941"},"modified":"2021-08-14T17:40:50","modified_gmt":"2021-08-14T12:10:50","slug":"apache-spark-architecture-fundamentals","status":"publish","type":"post","link":"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/","title":{"rendered":"\ud835\udc00\ud835\udc29\ud835\udc1a\ud835\udc1c\ud835\udc21\ud835\udc1e \ud835\udc12\ud835\udc29\ud835\udc1a\ud835\udc2b\ud835\udc24 \ud835\udc00\ud835\udc2b\ud835\udc1c\ud835\udc21\ud835\udc22\ud835\udc2d\ud835\udc1e\ud835\udc1c\ud835\udc2d\ud835\udc2e\ud835\udc2b\ud835\udc1e \ud835\udc05\ud835\udc2e\ud835\udc27\ud835\udc1d\ud835\udc1a\ud835\udc26\ud835\udc1e\ud835\udc27\ud835\udc2d\ud835\udc1a\ud835\udc25\ud835\udc2c"},"content":{"rendered":"

\ud83d\udccc In this blog, we are going to cover \ud835\udc00\ud835\udc29\ud835\udc1a\ud835\udc1c\ud835\udc21\ud835\udc1e \ud835\udc12\ud835\udc29\ud835\udc1a\ud835\udc2b\ud835\udc24 \ud835\udc00\ud835\udc2b\ud835\udc1c\ud835\udc21\ud835\udc22\ud835\udc2d\ud835\udc1e\ud835\udc1c\ud835\udc2d\ud835\udc2e\ud835\udc2b\ud835\udc1e \ud835\udc05\ud835\udc2e\ud835\udc27\ud835\udc1d\ud835\udc1a\ud835\udc26\ud835\udc1e\ud835\udc27\ud835\udc2d\ud835\udc1a\ud835\udc25\ud835\udc2c which is an open-source computing framework and a unified analytics engine for a large amount of data processing and machine learning.<\/p>\n

\ud83d\udccc Apache Spark Architecture is not only used for \ud835\udc2b\ud835\udc1e\ud835\udc1a\ud835\udc25-\ud835\udc2d\ud835\udc22\ud835\udc26\ud835\udc1e \ud835\udc29\ud835\udc2b\ud835\udc28\ud835\udc1c\ud835\udc1e\ud835\udc2c\ud835\udc2c\ud835\udc22\ud835\udc27\ud835\udc20 but it is also used for batch processing and it can give you a hundred times faster performance than the traditional map-reduce which comes around with Hadoop.<\/p>\n

\ud83d\udccc Spark Architecture or Apache Spark is a parallel processing framework that supports in-memory processing to boost the performance of big-data analytical applications and the Apache Spark core engine of which its resources are managed by YARN. In simple words, \ud835\udc12\ud835\udc29\ud835\udc1a\ud835\udc2b\ud835\udc24 \ud835\udc00\ud835\udc2b\ud835\udc1c\ud835\udc21\ud835\udc22\ud835\udc2d\ud835\udc1e\ud835\udc1c\ud835\udc2d\ud835\udc2e\ud835\udc2b\ud835\udc1e \ud835\udc22\ud835\udc2c \ud835\udc24\ud835\udc27\ud835\udc28\ud835\udc30\ud835\udc27 \ud835\udc1f\ud835\udc28\ud835\udc2b \ud835\udc22\ud835\udc2d\ud835\udc2c \ud835\udc2c\ud835\udc29\ud835\udc1e\ud835\udc1e\ud835\udc1d \ud835\udc1a\ud835\udc27\ud835\udc1d \ud835\udc1e\ud835\udc1f\ud835\udc1f\ud835\udc22\ud835\udc1c\ud835\udc22\ud835\udc1e\ud835\udc27\ud835\udc1c\ud835\udc32.<\/p>\n

Want to know more\ud83e\udd14 about Apache Spark Architecture Fundamentals, read the blog post at https:\/\/k21academy.com\/dp20321<\/strong><\/em><\/a> to learn more.<\/p>\n

Topics, we\u2019ll cover:<\/p>\n

\ud83d\udd17 What are Spark Architecture Fundamentals<\/p>\n

\ud83d\udd17 What is Azure Databricks Spark Cluster<\/p>\n

\ud83d\udd17 How to Create Cluster.<\/p>\n

\ud83d\udd17 Understanding the Architecture of Spark job.<\/p>\n

\ud83d\udd17 Jobs and Stages in Spark Architecture<\/p>\n

\ud83d\udd17 Cluster Management in Spark Architecture<\/p>\n

Register for the FREE CLASS now at https:\/\/k21academy.com\/dp20302<\/strong><\/em><\/a> and learn from the Microsoft Certified Trainers.<\/p>\n

\"https:\/\/k21academy.com\/wp-content\/uploads\/2021\/06\/CU_DP203_GIF1.gif\"<\/strong><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

\ud83d\udccc In this blog, we are going to cover \ud835\udc00\ud835\udc29\ud835\udc1a\ud835\udc1c\ud835\udc21\ud835\udc1e \ud835\udc12\ud835\udc29\ud835\udc1a\ud835\udc2b\ud835\udc24 \ud835\udc00\ud835\udc2b\ud835\udc1c\ud835\udc21\ud835\udc22\ud835\udc2d\ud835\udc1e\ud835\udc1c\ud835\udc2d\ud835\udc2e\ud835\udc2b\ud835\udc1e \ud835\udc05\ud835\udc2e\ud835\udc27\ud835\udc1d\ud835\udc1a\ud835\udc26\ud835\udc1e\ud835\udc27\ud835\udc2d\ud835\udc1a\ud835\udc25\ud835\udc2c which is an open-source computing framework and […]<\/p>\n","protected":false},"author":115,"featured_media":16942,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[570,540],"tags":[],"class_list":["post-16941","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-engineer","category-microsoft-azure"],"yoast_head":"\nApache Spark Architecture Fundamentals | K21 Academy<\/title>\n<meta name=\"description\" content=\"In this blog, we are going to cover Apache Spark Architecture Fundamentals which is an open-source computing framework and a unified analytics engine.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Apache Spark Architecture Fundamentals | K21 Academy\" \/>\n<meta property=\"og:description\" content=\"In this blog, we are going to cover Apache Spark Architecture Fundamentals which is an open-source computing framework and a unified analytics engine.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/\" \/>\n<meta property=\"article:published_time\" content=\"2021-08-14T12:10:50+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/08\/Spark_BlogImage.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1125\" \/>\n\t<meta property=\"og:image:height\" content=\"629\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Masroof Ahmad\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Masroof Ahmad\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/\",\"url\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/\",\"name\":\"Apache Spark Architecture Fundamentals | K21 Academy\",\"isPartOf\":{\"@id\":\"https:\/\/onlineappsdba.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/08\/Spark_BlogImage.png\",\"datePublished\":\"2021-08-14T12:10:50+00:00\",\"author\":{\"@id\":\"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb\"},\"description\":\"In this blog, we are going to cover Apache Spark Architecture Fundamentals which is an open-source computing framework and a unified analytics engine.\",\"breadcrumb\":{\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/#primaryimage\",\"url\":\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/08\/Spark_BlogImage.png\",\"contentUrl\":\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/08\/Spark_BlogImage.png\",\"width\":1125,\"height\":629},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/onlineappsdba.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\ud835\udc00\ud835\udc29\ud835\udc1a\ud835\udc1c\ud835\udc21\ud835\udc1e \ud835\udc12\ud835\udc29\ud835\udc1a\ud835\udc2b\ud835\udc24 \ud835\udc00\ud835\udc2b\ud835\udc1c\ud835\udc21\ud835\udc22\ud835\udc2d\ud835\udc1e\ud835\udc1c\ud835\udc2d\ud835\udc2e\ud835\udc2b\ud835\udc1e \ud835\udc05\ud835\udc2e\ud835\udc27\ud835\udc1d\ud835\udc1a\ud835\udc26\ud835\udc1e\ud835\udc27\ud835\udc2d\ud835\udc1a\ud835\udc25\ud835\udc2c\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/onlineappsdba.com\/#website\",\"url\":\"https:\/\/onlineappsdba.com\/\",\"name\":\"\",\"description\":\"Oracle Implementation & Training Experts\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/onlineappsdba.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb\",\"name\":\"Masroof Ahmad\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/onlineappsdba.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g\",\"caption\":\"Masroof Ahmad\"},\"url\":\"https:\/\/onlineappsdba.com\/index.php\/author\/masroof\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Apache Spark Architecture Fundamentals | K21 Academy","description":"In this blog, we are going to cover Apache Spark Architecture Fundamentals which is an open-source computing framework and a unified analytics engine.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/","og_locale":"en_US","og_type":"article","og_title":"Apache Spark Architecture Fundamentals | K21 Academy","og_description":"In this blog, we are going to cover Apache Spark Architecture Fundamentals which is an open-source computing framework and a unified analytics engine.","og_url":"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/","article_published_time":"2021-08-14T12:10:50+00:00","og_image":[{"width":1125,"height":629,"url":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/08\/Spark_BlogImage.png","type":"image\/png"}],"author":"Masroof Ahmad","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Masroof Ahmad","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/","url":"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/","name":"Apache Spark Architecture Fundamentals | K21 Academy","isPartOf":{"@id":"https:\/\/onlineappsdba.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/#primaryimage"},"image":{"@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/#primaryimage"},"thumbnailUrl":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/08\/Spark_BlogImage.png","datePublished":"2021-08-14T12:10:50+00:00","author":{"@id":"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb"},"description":"In this blog, we are going to cover Apache Spark Architecture Fundamentals which is an open-source computing framework and a unified analytics engine.","breadcrumb":{"@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/#primaryimage","url":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/08\/Spark_BlogImage.png","contentUrl":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/08\/Spark_BlogImage.png","width":1125,"height":629},{"@type":"BreadcrumbList","@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/08\/14\/apache-spark-architecture-fundamentals\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/onlineappsdba.com\/"},{"@type":"ListItem","position":2,"name":"\ud835\udc00\ud835\udc29\ud835\udc1a\ud835\udc1c\ud835\udc21\ud835\udc1e \ud835\udc12\ud835\udc29\ud835\udc1a\ud835\udc2b\ud835\udc24 \ud835\udc00\ud835\udc2b\ud835\udc1c\ud835\udc21\ud835\udc22\ud835\udc2d\ud835\udc1e\ud835\udc1c\ud835\udc2d\ud835\udc2e\ud835\udc2b\ud835\udc1e \ud835\udc05\ud835\udc2e\ud835\udc27\ud835\udc1d\ud835\udc1a\ud835\udc26\ud835\udc1e\ud835\udc27\ud835\udc2d\ud835\udc1a\ud835\udc25\ud835\udc2c"}]},{"@type":"WebSite","@id":"https:\/\/onlineappsdba.com\/#website","url":"https:\/\/onlineappsdba.com\/","name":"","description":"Oracle Implementation & Training Experts","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/onlineappsdba.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb","name":"Masroof Ahmad","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/onlineappsdba.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g","caption":"Masroof Ahmad"},"url":"https:\/\/onlineappsdba.com\/index.php\/author\/masroof\/"}]}},"_links":{"self":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/posts\/16941","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/users\/115"}],"replies":[{"embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/comments?post=16941"}],"version-history":[{"count":0,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/posts\/16941\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/media\/16942"}],"wp:attachment":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/media?parent=16941"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/categories?post=16941"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/tags?post=16941"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}