{"id":17604,"date":"2021-11-22T18:48:32","date_gmt":"2021-11-22T13:18:32","guid":{"rendered":"http:\/\/onlineappsdba.com\/?p=17604"},"modified":"2021-11-22T18:48:32","modified_gmt":"2021-11-22T13:18:32","slug":"day8-faqs","status":"publish","type":"post","link":"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/","title":{"rendered":"Introduction to Apache Spark (PySpark) Q &#038; A: Day 8 Live Session Review"},"content":{"rendered":"<p><b data-stringify-type=\"bold\">Apache Spark<\/b><br \/>\nApache Spark is a lightning-fast cluster computing technology, designed for fast computation. It is based on Hadoop MapReduce and it extends the MapReduce model to efficiently use it for more types of computations, which includes interactive queries and stream processing. The main feature of Spark is its\u00a0<b data-stringify-type=\"bold\">in-memory cluster computing<\/b>\u00a0that increases the processing speed of an application.<\/p>\n<p><b data-stringify-type=\"bold\">PySpark<\/b><br \/>\nPySpark is a Python API to support Python with Apache Spark. PySpark provides the\u00a0<b data-stringify-type=\"bold\">Py4j library,<\/b>\u00a0with the help of this library, Python can be easily integrated with Apache Spark. PySpark plays an essential role when it needs to work with a vast dataset or analyze them.<\/p>\n<p>To know more about these NumPy and Pandas covered in our Day 8 session check my blog at:\u00a0<a class=\"c-link\" tabindex=\"-1\" href=\"https:\/\/k21academy.com\/datascience\/python\/day8-faqs\/?utm_source=onlineappsdba&amp;utm_medium=referral&amp;utm_campaign=pythonday8\" target=\"_blank\" rel=\"noopener noreferrer\" data-stringify-link=\"https:\/\/k21academy.com\/datascience\/python\/da\" data-sk=\"tooltip_parent\" data-remove-tab-index=\"true\">https:\/\/k21academy.com\/pythonday8<\/a><\/p>\n<p>Join our\u00a0<a href=\"https:\/\/k21academy.com\/python-certification-free-class?utm_source=onlineappsdba&amp;utm_medium=referral&amp;utm_campaign=python02_november21\" target=\"_blank\" rel=\"noopener noreferrer\"><strong><em>Free Class<\/em><\/strong><\/a>\u00a0to know more about it.<\/p>\n<p><a href=\"https:\/\/k21academy.com\/python-certification-free-class?utm_source=onlineappsdba&amp;utm_medium=referral&amp;utm_campaign=python02_november21\"><img decoding=\"async\" class=\"aligncenter\" src=\"https:\/\/k21academy.com\/wp-content\/uploads\/2021\/10\/CU_FC_Pythongif.gif\" alt=\"Free Class Python\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Apache Spark Apache Spark is a lightning-fast cluster computing technology, designed for fast computation. It is based on Hadoop MapReduce [&hellip;]<\/p>\n","protected":false},"author":115,"featured_media":17605,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[555,574],"tags":[],"class_list":["post-17604","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-science","category-python"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Introduction to Apache Spark (PySpark) Q &amp; A: Day 8 Live Session Review<\/title>\n<meta name=\"description\" content=\"In this blog, we are going to cover some questions and answers asked us in Python for DS\/DE Day 8 Live session covering Basics of Apache Spark in Python.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Introduction to Apache Spark (PySpark) Q &amp; A: Day 8 Live Session Review\" \/>\n<meta property=\"og:description\" content=\"In this blog, we are going to cover some questions and answers asked us in Python for DS\/DE Day 8 Live session covering Basics of Apache Spark in Python.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/\" \/>\n<meta property=\"article:published_time\" content=\"2021-11-22T13:18:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/11\/image-53-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1274\" \/>\n\t<meta property=\"og:image:height\" content=\"716\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Masroof Ahmad\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Masroof Ahmad\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/\",\"url\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/\",\"name\":\"Introduction to Apache Spark (PySpark) Q & A: Day 8 Live Session Review\",\"isPartOf\":{\"@id\":\"https:\/\/onlineappsdba.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/11\/image-53-1.png\",\"datePublished\":\"2021-11-22T13:18:32+00:00\",\"author\":{\"@id\":\"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb\"},\"description\":\"In this blog, we are going to cover some questions and answers asked us in Python for DS\/DE Day 8 Live session covering Basics of Apache Spark in Python.\",\"breadcrumb\":{\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/#primaryimage\",\"url\":\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/11\/image-53-1.png\",\"contentUrl\":\"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/11\/image-53-1.png\",\"width\":1274,\"height\":716},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/onlineappsdba.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Introduction to Apache Spark (PySpark) Q &#038; A: Day 8 Live Session Review\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/onlineappsdba.com\/#website\",\"url\":\"https:\/\/onlineappsdba.com\/\",\"name\":\"\",\"description\":\"Oracle Implementation &amp; Training Experts\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/onlineappsdba.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb\",\"name\":\"Masroof Ahmad\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/onlineappsdba.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g\",\"caption\":\"Masroof Ahmad\"},\"url\":\"https:\/\/onlineappsdba.com\/index.php\/author\/masroof\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Introduction to Apache Spark (PySpark) Q & A: Day 8 Live Session Review","description":"In this blog, we are going to cover some questions and answers asked us in Python for DS\/DE Day 8 Live session covering Basics of Apache Spark in Python.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/","og_locale":"en_US","og_type":"article","og_title":"Introduction to Apache Spark (PySpark) Q & A: Day 8 Live Session Review","og_description":"In this blog, we are going to cover some questions and answers asked us in Python for DS\/DE Day 8 Live session covering Basics of Apache Spark in Python.","og_url":"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/","article_published_time":"2021-11-22T13:18:32+00:00","og_image":[{"width":1274,"height":716,"url":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/11\/image-53-1.png","type":"image\/png"}],"author":"Masroof Ahmad","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Masroof Ahmad","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/","url":"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/","name":"Introduction to Apache Spark (PySpark) Q & A: Day 8 Live Session Review","isPartOf":{"@id":"https:\/\/onlineappsdba.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/#primaryimage"},"image":{"@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/#primaryimage"},"thumbnailUrl":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/11\/image-53-1.png","datePublished":"2021-11-22T13:18:32+00:00","author":{"@id":"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb"},"description":"In this blog, we are going to cover some questions and answers asked us in Python for DS\/DE Day 8 Live session covering Basics of Apache Spark in Python.","breadcrumb":{"@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/#primaryimage","url":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/11\/image-53-1.png","contentUrl":"https:\/\/onlineappsdba.com\/wp-content\/uploads\/2021\/11\/image-53-1.png","width":1274,"height":716},{"@type":"BreadcrumbList","@id":"https:\/\/onlineappsdba.com\/index.php\/2021\/11\/22\/day8-faqs\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/onlineappsdba.com\/"},{"@type":"ListItem","position":2,"name":"Introduction to Apache Spark (PySpark) Q &#038; A: Day 8 Live Session Review"}]},{"@type":"WebSite","@id":"https:\/\/onlineappsdba.com\/#website","url":"https:\/\/onlineappsdba.com\/","name":"","description":"Oracle Implementation &amp; Training Experts","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/onlineappsdba.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/onlineappsdba.com\/#\/schema\/person\/909a876ed58d400faf82caf81d61bfdb","name":"Masroof Ahmad","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/onlineappsdba.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/10f9db7bdbbd7f9ccfbe9b2d208e5978fc28315e9c704383e639a926ea0fce5f?s=96&d=mm&r=g","caption":"Masroof Ahmad"},"url":"https:\/\/onlineappsdba.com\/index.php\/author\/masroof\/"}]}},"_links":{"self":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/posts\/17604","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/users\/115"}],"replies":[{"embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/comments?post=17604"}],"version-history":[{"count":0,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/posts\/17604\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/media\/17605"}],"wp:attachment":[{"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/media?parent=17604"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/categories?post=17604"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/onlineappsdba.com\/index.php\/wp-json\/wp\/v2\/tags?post=17604"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}