Computational Thinking and Big Data
Learn the core concepts of computational thinking and how to collect, clean and consolidate large-scale datasets.
Created by: Gavin Meredith
Quality Score
Overall Score : 0 / 100
Course Description
In this course, part of the Big Data MicroMasters program, you will learn how to apply computational thinking in data science. You will learn core computational thinking concepts including decomposition, pattern recognition, abstraction, and algorithmic thinking.
You will also learn about data representation and analysis and the processes of cleaning, presenting, and visualizing data. You will develop skills in data-driven problem design and algorithms for big data.
The course will also explain mathematical representations, probabilistic and statistical models, dimension reduction and Bayesian models.
You will use tools such as R and Java data processing libraries in associated language environments.
Section 1: Data in R Identify the components of RStudio; Identify the subjects and types of variables in R; Summarise and visualise univariate data, including histograms and box plots. Section 2: Visualising relationships Produce plots in ggplot2 in R to illustrate the relationship between pairs of variables; Understand which type of plot to use for different variables; Identify methods to deal with large datasets. Section 3: Manipulating and joining data Organise different data types, including strings, dates and times; Filter subjects in a data frame, select individual variables, group data by variables and calculate summary statistics; Join separate dataframes into a single dataframe; Learn how to implement these methods in mapReduce. Section 4: Transforming data and dimension reduction Transform data so that it is more appropriate for modelling; Use various methods to transform variables, including q-q plots and Box-Cox transformation, so that they are distributed normally Reduce the number of variables using PCA; Learn how to implement these techniques into modelling data with linear models. Section 5: Summarising data Estimate model parameters, both point and interval estimates; Differentiate between the statistical concepts or parameters and statistics; Use statistical summaries to infer population characteristics; Utilise strings; Learn about k-mers in genomics and their relationship to perfect hash functions as an example of text manipulation. Section 6: Introduction to Java Use complex data structures; Implement your own data structures to organise data; Explain the differences between classes and objects; Motivate object-orientation. Section 7: Graphs Encode directed and undirected graphs in different data structures, such as matrices and adjacency lists; Execute basic algorithms, such as depth-first search and breadth-first search. Section 8: Probability Determine the probability of events occurring when the probability distribution is discrete; How to approximate. Section 9: Hashing Apply hash functions on basic data structures in Java; Implement your own hash functions and execute, these as well as built-in ones; Differentiate good from bad hash functions based on the concept of collisions. Section 10: Bringing it all together Understand the context of big data in programming.
Instructor Details
- 0.0 Rating
0 Reviews
Gavin Meredith
Gavin is a research associate and tutor in the School of Computer Science at the University of Adelaide. He has been developing courses for the Big Data MicroMasters program and tutoring students in several first and second year computer science courses, including Introduction to Programming, Object Oriented Programming, Algorithm Design and Data Structures, and Problem Solving and Software Development.
More design thinking courses
NodeJS 3 in 1: Basics of NodeJS & Express With Projects (2017)
4.7 (50 Reviews)
Provider: Udemy
Time: 10h
$11.99
Design Thinking + Entrepreneurship: My 8-Step Launch Program (2019)
4.6 (136 Reviews)
Provider: Udemy
Time: 7h
$11.99






