PyTorch for Data Scientists: Tensors, Neural Networks, and Transfer Learning
Empower your data science skillset with PyTorch: master tensors, build neural networks, and leverage transfer learning for real-world applications.
...
Share
Introduction to PyTorch and Tensors
Unit 1: PyTorch Fundamentals
Why PyTorch?
Setting Up PyTorch
Tensors: The Basics
Tensor Data Types
Tensor Operations
Unit 2: Tensor Manipulation
Tensor Indexing
Slicing Tensors
Reshaping Tensors
Adding/Removing Dims
Transposing Tensors
Unit 3: Advanced Tensor Operations
Element-wise Operations
Broadcasting
Math Functions
Matrix Operations
Tensor Concatenation
Building Neural Networks with `nn.Module`
Unit 1: Neural Network Fundamentals
Neural Networks: The Big Pic
Activation Functions
Layers: The Building Blocks
Weights and Biases
Forward Propagation
Unit 2: Introduction to `nn.Module`
What is `nn.Module`?
Creating a Custom Module
Linear Layers in `nn.Module`
Activation Layers
Sequential Models
Unit 3: Connecting the Dots: Building More Complex Networks
Connecting Layers
Multiple Layer Networks
Parameter Initialization
Inspecting Model Parameters
Custom Layers
Automatic Differentiation with `torch.autograd`
Unit 1: Understanding Automatic Differentiation
What is Autograd?
Autograd Under the Hood
The requires_grad Flag
Inspecting Gradients
Autograd in Action
Unit 2: Backpropagation and Gradient Descent
Backpropagation Basics
Implementing Backprop
Gradient Descent
Impact of Learning Rate
Autograd in Neural Nets
Unit 3: Advanced Autograd Techniques
Custom Autograd Functions
Extending Autograd
Autograd Profiling
Debugging Autograd
Autograd Best Practices
Optimization with `torch.optim`
Unit 1: Introduction to Optimization Algorithms
What is Optimization?
Gradient Descent Intro
Challenges with GD
Intro to `torch.optim`
Using an Optimizer
Unit 2: Popular Optimization Algorithms
Stochastic GD (SGD)
Momentum Intro
RMSprop
Adam
Adam vs. SGD
Unit 3: Learning Rates and Schedules
Importance of LR
LR Tuning Strategies
LR Schedulers Intro
Step Decay
Cosine Annealing
Data Loading and Preprocessing with `torchvision` and `DataLoader`
Unit 1: Loading Data with `torchvision.datasets`
Intro to torchvision
Loading Image Datasets
Loading Tabular Datasets
Dataset Attributes
Downloading Datasets
Unit 2: Transforming Data with `torchvision.transforms`
Intro to Transforms
Common Transforms
Data Augmentation
Combining Transforms
Custom Transforms
Unit 3: Efficient Data Loading with `DataLoader`
Intro to DataLoader
Creating a DataLoader
Iterating Through Batches
Custom Collate Functions
DataLoader and GPU
Unit 4: Creating Custom Datasets
Custom Dataset Intro
Loading Data
Implementing __len__
Implementing __getitem__
Using the Custom Set
Transfer Learning with Pre-trained Models
Unit 1: Understanding Transfer Learning
What is Transfer Learning?
Why Use Transfer Learning?
Common TL Architectures
Unit 2: Loading and Preparing Pre-trained Models
Loading Models
Model Zoo
Understanding Model Output
Unit 3: Fine-tuning Pre-trained Models
Freezing Layers
Unfreezing Layers
Modifying the Classifier
Setting the Optimizer
Unit 4: Evaluating Transfer Learning Performance
Setting up Evaluation
Metrics for Success
Visualizing Results
A/B Testing
Unit 5: Advanced Transfer Learning Techniques
Domain Adaptation
Training Best Practices and Regularization
Unit 1: Overfitting and Monitoring Training
Intro to Overfitting
Train/Val/Test Splits
Monitoring Training Loss
Visualizing Performance
Unit 2: Regularization Techniques
Intro to Regularization
L1 Regularization (Lasso)
L2 Regularization (Ridge)
Dropout
Batch Normalization
Unit 3: Early Stopping and Data Preprocessing
Early Stopping
Data Normalization
Data Standardization
Weight Initialization
Gradient Clipping
Advanced Techniques and Model Deployment
Unit 1: Convolutional Neural Networks (CNNs)
CNN Intro for Data Sci
Convolutional Layers
Pooling Layers
CNN Architectures
CNNs in PyTorch
Unit 2: Recurrent Neural Networks (RNNs)
RNN Intro for Data Sci
RNN Cell Mechanics
LSTMs and GRUs
RNNs in PyTorch
Unit 3: Improving Model Performance
Batch Normalization
Residual Connections
Other Performance Boosts
Unit 4: Model Deployment
Saving Models
Loading Models
Model Deployment Options
Inference