Coursera Computing in Data Analysis Assignment 1 Part 3 Week 2
Write a function that takes a directory of data files and a threshold for complete cases and calculates the correlation between
sulfate and nitrate for monitor locations where the number of completely observed cases (on all variables) is greater than the
threshold. The function should return a vector of correlations for the monitors that meet the threshold requirement. If no
monitors meet the threshold requirement, then the function should return a numeric vector of length 0.
For this function you will need to use the 'cor' function in R which calculates the correlation between two vectors. Please read
the help page for this function via '?cor' and make sure that you know how to use it.
Please save your code to a file named corr.R. To run the test script for this part, make sure your working directory has the
file corr.R in it and the run:
The course will end with a statistics primer, showing how various statistical measures can be applied to pandas DataFrames. By the end of the course, students will be able to take tabular data, clean it, manipulate it, and run basic inferential statistical analyses.
This course should be taken before any of the other Applied Data Science with Python courses: Applied Plotting, Charting & Data Representation in Python, Applied Machine Learning in Python, Applied Text Mining in Python, Applied Social Network Analysis in Python.
Who is this class for: This course is part of the skills-based specialization “Applied Data Science with Python“ and is intended for learners who have basic python or programming background, and want to apply statistics, machine learning, information visualization, social network analysis, and text analysis techniques to gain new insight into data. Only minimal statistics background is expected, and the first course contains a refresh of these basic concepts. There are no geographic restrictions. Learners with a formal training in Computer Science but without formal training in data science will still find the skills they acquire in these courses valuable in their studies and careers.
Course 1 of 5 in the Applied Data Science with Python Specialization.
In this week you'll get an introduction to the field of data science, review common Python functionality and features which data scientists use, and be introduced to the Coursera Jupyter Notebook for the lectures. All of the course information on grading, prerequisites, and expectations are on the course syllabus, and you can find more information about the Jupyter Notebooks on our Course Resources page.
Graded: Week One Quiz
In this week of the course you'll learn the fundamentals of one of the most important toolkits Python has for data cleaning and processing -- pandas. You'll learn how to read in data into DataFrame structures, how to query these structures, and the details about such structures are indexed. The module ends with a programming assignment and a discussion question.
Graded: Assignment 2 Submission
In this week you'll deepen your understanding of the python pandas library by learning how to merge DataFrames, generate summary tables, group data into logical pieces, and manipulate dates. We'll also refresh your understanding of scales of data, and discuss issues with creating metrics for analysis. The week ends with a more significant programming assignment.
Graded: Assignment 3 Submission
In this week of the course you'll be introduced to a variety of statistical techniques such a distributions, sampling and t-tests. The majority of the week will be dedicated to your course project, where you'll engage in a real-world data cleaning activity and provide evidence for (or against!) a given hypothesis. This project is suitable for a data science portfolio, and will test your knowledge of cleaning, merging, manipulating, and test for significance in data. The week ends with two discussions of science and the rise of the fourth paradigm -- data driven discovery.
Graded: Assignment 4 Submission