Data Processing with Python (Udemy.com)

Learn how to use Python and Pandas for cleaning and reorganizing huge amounts of data.

Created by: Ardit Sulce

Produced in 2021

icon
What you will learn

  • Build 10 advanced Python scripts which together make up a data analysis and visualization program.
  • Solve six exercises related to processing, analyzing and visualizing US income data with Python.
  • Learn the fundamental blocks of the Python programming language such as variables, datatypes, loops, conditionals, functions and more.
  • Use Python to batch download files from FTP sites, extract, rename and store remote files locally.
  • Import data into Python for analysis and visualization from various sources such as CSV and delimited TXT files.
  • Keep the data organized inside Python in easily manageable pandas dataframes.
  • Merge large datasets taken from various data file formats.
  • Create pivot tables in Python out of large datasets.
  • Perform various operations among data columns and rows.
  • Query data from Python pandas dataframes.
  • Export data from Python into various formats such as TXT, CSV, Excel, HTML and mo

icon
Quality Score

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 88 / 100

icon
Course Description

Data scientists spend only 20 percent of their time on building machine learning algorithms and 80 percent of their time finding, cleaning, and reorganizing huge amounts of data. That mostly happen because many use graphical tools such as Excel to process their data. However, if you use a programming language such as Python you can drastically reduce the time it takes for processing your data and make them ready for use in your project. This course will show how Python can be used to manage, clean, and organize huge amounts of data.
This course assumes you have basic knowledge of variables, functions, for loops, and conditionals. In the course you will be given access to a million records of raw historical weather data and you will use Python in every single step to deal with that dataset. That includes learning how to use Python to batch download and extract the data files, load thousands of files in Python via pandas, cleaning the data, concatenating and joining data from different sources, converting between fields, aggregating, conditioning, and many more data processing operations. On top of that, you will also learn how to calculate statistics and visualize the final data. The course also covers a series of exercises where you will be given some sample data then practice what you learned by cleaning and reorganizing those data using Python. Who this course is for:
  • Those who come from any technology field that deals with any kind of data.
  • Those who want to leverage the power of the Python programming language for handling data.
  • Those who need to learn Python basics and want to quickly advance their skills by learning how to perform data cleaning, analysis and visualization with Python - all in one single course.
  • Those who want to switch from programming languages such as Java, C, R, Matlab, etc. to Python.

icon
Instructor Details

placeholder

Hi, I am Ardit! I am a Python programmer and a Python teacher. I have worked with companies from all over the world both as an employee and as self-employed using Python as both a data science tool and as a language to develop applications. Some of the projects I have worked on have been using Python together with the Center for Conservation Geography to map and understand the Australian ecosystems, processing drone land images with the Swiss in-Terra, and performing data mining to gain business insights with the Australian Rapid Intelligence.
The vast range of things you can do with Python is just mindblowing. I have used that experience to teach Python to others from all over the world. I especially take care to explain the programming concepts always assuming my students don't have a computer science background. Indeed, you don't need a computer science degree to become a programmer. I was graduated with a Master of Science in Geospatial Technologies from the University of Muenster in Germany.
I am also the founder and author of PythonHow, a Python learning resource designed particularly for people with no previous programming experience. Try out my and you will be on for a very interesting ride.

icon
Reviews

4.4

96 total reviews

5 star 4 star 3 star 2 star 1 star
% Complete
% Complete
% Complete
% Complete
% Complete

Simply- wonderful course. I love the content as well as the way you organised the projects. !

Thanks a lot,

Concise and comprehensive.

Ardit is an engaging instructor.

Ardit answers all the questions and for me this is the best part of the course.

Thanks

UPDATE: your course and a few others have helped secure my dream job. I landed a temp job, was hired FT w/ a raise and bonus (BIG BONUS!), survived a layoff, and have jumped ahead two positions to BI Analyst- for a global online retailer based in seattle. Pandas has been instrumental in my work. Back to the last review: Course is learning by doing from an interesting and concise instructor. He's not verbose, he doesn't bore you with extraneous/unnecessary detail, or useless slides. Well organized, sequential, bite-sized presentations that build on previous learning. While this is not all inclusive python language tutorial, the syllabus is accurate, and the learning gives you enough to feel confident to take on more. Students: don't reward crappy teaching (monitone slide show, outdated material/technology, verbose explanations, sometimes little to no demonstrating...)!! Instead, reward teachers like this one. He puts you in the driver's seat and teaches you to drive. So to speak. I don't often give a 5 star rating, so this guy is highly recommended.

Clear and concise explanation of the installation and setup of Python.

Very helpful in understanding the foundations of using Python for Data Analysis.

Enjoyed the course.

The instructor is very clear. He's very easy to follow. The content is useful even to an experienced Python programmer like myself. I've written a number of complex Python programs over the past 3 years and have taken half a dozen machine learning courses that use Python but I still find the course useful and instructive.

Hi ..I've completed this course and iwould to thank you instructor Ardit ..ifound this course really useful and interesting experiment as a begginer in python ...due to practical examples ...thank you again for this chance ......keep Going ..waiting for more

Best regards

The course is well organized, and fairly easy to follow, but I had a hard time organizing all my files and scripts together (in the course you will be downloading and extracting dozens of files). I spent a lot of time just trying to remember and input all the various file paths and extraction paths--which is probably good practice for the various os module commands. But for a complete beginner to Pandas, I wonder if it might have been easier to start with simpler data files instead of with data files that have hundreds or thousands of data. That way it would be easier to understand how to merge and align values. I also think it would have been nice as a "final project" to give us a simple data set and have us perform various data cleaning methods as a way of testing ourselves.

First course I've ever done where the trainers runs through what we will be learning first to check if the course is what you want.

Issues:

1) Does not cover xml file types which is very common now

2) Spyder crashes when tring to opencloseetc files using Anaconda 3.6 64 bit so installed 32 bit version instead and that worked ok.

9/10. I would have give 10/10 if covered xml.

I am really happy with the course. I'm a GIS Specialist, and this is far better for me than the instructor-led ESRI Python training. I'm really motivated to learn more now thanks to Ardit.

great course to learn Python, very clear and informative also comprehensive. It's more than I expected. I enjoyed the lecture. Thankyou very much Ardit.

Excellent Course!

The course does a great job of building Python skills in a step by step manner, first explaining the process then reinforcing the new skill through an assignment that requires the student to put their new skills to use.

In addition, the end product of the course is a collection of methods that can serve as a basis for real work.

The content of this Python step by step course is well organized and supported by appropriate exercises. The lecturer is clear, precise and available for any question you may need.

Five stars well deserved.