SQLite: Integrating Python and SQL
In this blog post, I will talk about a SQL library “SQLite” and how can we use that using python. Please note that this article …
Category: Python
NamedTuple: A pythonic way for writing your code
This article is inspired by an a blog post in RealPython.com, link to that article can be found here. The article on RealPython focuses on …
Live Weather using BeautifulSoup
Let’s start with a basic command-line app to get weather using a simple google search. I will use the BeautifulSoup and Requests library in python …
Dropbox API: Automating Dropbox downloads using Python
I started to track my expenses on my phone, and the app that I was using had a feature where I could export my expenses …
PySpark Project: Using PySpark for some basic ETL process
While doing a Tableau course, I came across this ETL process where I had to combine multiple CSV files and pivot them. Unfortunately, Tableau doesn’t …
User-Defined Functions (UDF) in PySpark
The general idea of a UDF is to use a regular python function and translate that to a PySpark function which can be applied to …
Handling Null Values in PySpark: Using dropna() and fillna() methods
In this article, I will go over two different methods for handling null values in PySpark dropna() -> used for dropping the null values fillna() …
The Basics of Data Manipulation in PySpark
In this article, I will go over the following topics: Viewing Schema Selecting column/s Showing rows Dropping column/s Renaming column/s Importing Data The files used …
Grouping, Aggregating, and Ordering our Data Frame in PySpark
Grouping, Aggregating, and Ordering are the most commonly used functions in PySpark. With the help of this article, I will try to explain how we …
Python DefaultDict – Ability to assign default values to your keys
A common problem with Python dictionaries is trying to access or modify a key that doesn’t exist. If we try to access or modify a …