Machine Learning with Python

Part 1: Overview of Data Science

1. Data Science as a Quantitative Discipline
   • How to define Data Science scopes
   • The many faces of Data Science: Data Mining, Data Analysis, Data Analytics, Machine Learning, Predictive Modeling, Statistical Learning, Mathematical Modeling. What are these all about?
   • Data Mining as a data exploration process
   • Machine Learning: supervised vs. unsupervised
   • Machine Learning vs. Predictive Analytics
   • Big Data Analytics: what is it and why it's important
2. Overview of a Data Mining Process Cycle
   • Understanding business needs and identifying new business opportunities
   • Formulating a business problem and associated requirements
   • Defining key quantitative metrics to measure success and evaluating business benefits
   • Translating business requirements into technical requirements and documentation
   • Formulating data models based on business and technical requirements
   • Identifying a set of quantitative models based on technical requirements and metrics of success
   • Running the models and evaluating results
   • Selecting the best model
   • Deploying the model

Part 2: The Data Foundation

1. Data Sources
2. Types of Data
   • Structured vs. unstructured data
   • Static data vs. real-time data
   • Types of data attributes: numerical vs. categorical
   • Role of time factor and time trends in data analysis
3. Working with Missing Values
   • Main causes of missing data
   • Understanding the importance of missing information
   • Types of missing information
   • Restoring missing values
   • Imputing missing values and selecting imputation techniques
   • Understanding and evaluating potential consequences of manipulating records with missing values
4. Working with Outliers
   • Defining quantitative criteria for outlier detection in 1D cases
   • Understanding role of outliers in model building
   • Deciding on outlier removal
   • Defining outlier detection metrics in multi-dimensional space
5. Working with Duplicate Records
   • Defining duplicates
   • Understanding sources of duplicates
   • Deciding on duplicate removal

Part 3: Sampling and Hypothesis Testing

1. Why Sampling May be Important for Machine Learning
2. Sampling Techniques and Sample Bias
3. Statistical Hypothesis
4. Z-score, T-score and F statistic
5. P-values
6. Implementation of Hypothesis Testing for Model Evaluation Analysis

Part 4: Machine Learning Fundamentals

1. What is Machine Learning?
2. Supervised vs. Unsupervised Learning
3. Overview of Supervised Machine Learning
   • Regression Models
   • Classification Models
4. Overview of Unsupervised Machine Learning
   • Clustering Methods
   • Principal Component Analysis and Dimension Reduction
   • Association Rules
5. Overview of Major Steps in Building and Testing Quantitative Models
   • Criteria for model selection
   • How to prepare a training set
   • Criteria for selecting model attributes/predictors
   • Working with collinear variables
   • Addressing imbalance problem
   • Dealing with over-fitting; bias-variance tradeoff
   • Validation and cross-validation

Part 5: Building a Linear Regression Model with Python

1. Univariate Regression vs. Multiple Regression
2. Mathematical Foundation of Linear Regression Overview: least square method vs. maximum likelihood method
3. Model Assumptions
4. Working with Continuous Attributes
5. Dealing with Collinear Variable
6. Model Subset Selection:
   • Forward stepwise selection
   • Backward selection
   • Shrinkage methods: ridge regression and Lasso
   • Dimension reduction
   • Information criteria
7. Automating Model Selection Procedure
8. Model Parameter Evaluation, R squared vs. adjusted R squared
9. Validating the Model
10. Working with Categorical Variables
11. Considering Input Variable Interactions

Part 6: Example of building a Classification Model with Python

1. Dealing with Imbalanced Training Sets
2. Understanding Confusion Matrix
3. Evaluating Binary Classifiers using ROC / AUC

Part 7: Example of Cluster Analysis with Python

1. Overview of Cluster Analysis Mathematical Foundation
2. K-means Clustering Method
   • Algorithm overview
   • Convergence criteria
   • How to determine the number of clusters

Part 8: Dimension Reduction techniques with Python

1. What is Dimension Reduction?
2. The Practical Goals of Dimension Reduction Implementation
3. Principal Component Analysis vs. Singular Value Decomposition
4. How Many Components to Choose

Part 9: Class Conclusion

1. What was Not Covered in the Class
2. Big Data Analytics – the Future of Machine Learning: Main Tools and Concepts

Intermediate level data analysts interested in expanding their data mining processes. We emphasize Data Foundation and Machine Learning concepts. All exercises are performed using Python.

• Address business needs and identifying new business opportunities using machine learning
• Work with missing values, outlines, and duplicate records with Python
• Implement hypothesis testing for model evaluation analysis
• Utilize both supervised and unsupervised machine learning
• Build a linear regression model with Python
• Build a classification model with Python
• Use the K-means clustering method for cluster analysis with Python