Useful Code Snippets in Python and Pyspark
#1. create a sample dataframe # create a sample dataframe data = [ (“Sam”,”Sales”, 50000), (“Ram”,”Sales”, 60000), (“Dan”,”Sales”, 70000),...
Read MoreCategory: How To
How to Write Perfect Pseudocode- Syntax , Standards, Terms
Syntax Rules for Pseudocode Natural Language: Use simple and clear natural language to describe steps. Keywords: Use standard control flow keywords such as: IF, ELSE, ENDIF FOR, WHILE, ENDWHILE FUNCTION, CALL INPUT, OUTPUT...
Read MorePySpark Projects:- Scenario Based Complex ETL projects Part3
I have divided a pyspark big script in many steps –by using steps1=”’ some codes”’ till steps7, i want to execute all these steps one after another and also if needed some steps can be not be...
Read MorePySpark Projects:- Scenario Based Complex ETL projects Part2
How to code in Pyspark a Complete ETL job using only Pyspark sql api not dataframe specific API? Here’s an example of a complete ETL (Extract, Transform, Load) job using PySpark SQL API: from pyspark.sql import...
Read MorePySpark Projects:- Scenario Based Complex ETL projects Part1
1.Exploratory Data Analysis (EDA) with Pandas in Banking – Converted in Pyspark While searching for A free Pandas Project on Google Found this link -Exploratory Data Analysis (EDA) with Pandas in Banking . I have tried to...
Read More