The Regularization Cookbook: Explore practical recipes to improve the functionality of your ML models
by Vincent Vandenbussche (Author), Akin Osman Kazakci (Foreword)
Publisher finelybook 出版社: Packt Publishing (July 31, 2023)
Language 语言: English
Print Length 页数: 424 pages
ISBN-10: 1837634084
ISBN-13: 9781837634088
Book Description
Methodologies and recipes to regularize nearly any machine learning and deep learning model using cutting-edge technologies such as Stable Diffusion, Dall-E and GPT-3.
Key Features
Learn how to diagnose whether regularization is needed for any machine learning model
Regularize different types of ML models using a broad range of techniques and methods
Get the best of your models using state of the art Computer Vision and NLP
Book Description
Deploying machine learning solutions is all about getting robust results on new, unseen data. To achieve such results, one way is regularization. Regularization can take many forms and can be used in many ways, and not all methods apply to all cases. This book aims at providing the right tools and methods to handle any case properly, with ready-to-use working codes as well as theoretical explanations whenever possible.
After an introduction to regularization and methods to diagnose when to use it, we will start implementing regularization techniques on linear models such as linear and logistic regression, and tree-based models such as random forest and gradient boosting.
The book will then introduce specific regularization methods based on data. High cardinality features and imbalanced datasets may require specific regularization methods that will be explored.
In the last five chapters, the book will cover regularization for deep learning models. After reviewing general methods that apply to any type of neural network, the book will dive into more NLP-specific methods for RNNs and transformers, as well as using BERT or GPT-3. We will close with regularization for Computer Vision, covering CNN specifics, as well as the use of generative models such as Stable Diffusion and Dall-E.
What you will learn
How to diagnose overfitting properly and when regularization is needed
Regularizing common linear models such as logistic regression
Get a deeper knowledge of regularizing tree-based models such as XGBoost
Leverage structured data to regularize ML models
Learn general techniques to regularize deep learning models
Discover specific regularization techniques for NLP problems using Transformers
Understand the regularization in Computer Vision models and CNN architectures
Apply cutting-edge computer vision regularization with generative models
Who This Book Is For
Whether you are a data scientist, a machine learning engineer, or just a machine learning enthusiast, if you want to get hands-on knowledge of the available methods to improve the performances of your models, this book is for you.
Basic, hands-on knowledge of Python is expected to get the most out of the proposed codes. Also, basic concepts of ML and DL are reminded to smooth the learning curve, no matter their level. This book is also aimed at experienced professionals willing to use state-of-the-art methods for regularization.
Table of Contents
1.An Overview of Regularization
2.Machine Learning Refresher
3.Regularization with Linear Models
4.Regularization with Tree-based Models
5.Regularization with Data
6.Deep Learning Reminders
7.Deep Learning Regularization
8.Regularization with Recurrent Neural Networks
9.Advanced Regularization in Natural Language Processing
10.Regularization in Computer Vision
11.Regularization in Computer Vision -synthetic image generation
