Natural Language Processing with Transformers, Revised Edition
14 sold in last 24 hours
Estimated shipping
Select a product to estimate shipping.From the Preface
W ho Is This Book For?
This book is written for data scientists and machine learning engineers who may have heard about the recent breakthroughs involving transformers, but are lacking an in-depth guide to help them adapt these models to their own use cases. The book is not meant to be an introduction to machine learning, and we assume you are comfortable programming in Python and has a basic understanding of deep learning frameworks like PyTorch and TensorFlow. We also assume you have some practical experience with training models on GPUs. Although the book focuses on the PyTorch API of Transformers, Chapter 2 shows you how to translate all the examples to TensorFlow.
What You Will Learn
The goal of this book is to enable you to build your own language applications. To that end, it focuses on practical use cases, and delves into theory only where necessary. The style of the book is hands-on, and we highly recommend you experiment by running the code examples yourself.
The book covers all the major applications of transformers in NLP by having each chapter (with a few exceptions) dedicated to one task, combined with a realistic use case and dataset. Each chapter also introduces some additional concepts. Here’s a high-level overview of the tasks and topics we’ll cover:
- Chapter 1, Hello Transformers, introduces transformers and puts them into context. It also provides an introduction to the Hugging Face ecosystem.
- Chapter 2, Text Classification, focuses on the task of sentiment analysis (a common text classification problem) and introduces the Trainer API.
- Chapter 3, Transformer Anatomy, dives into the Transformer architecture in more depth, to prepare you for the chapters that follow.
- Chapter 4, Multilingual Named Entity Recognition, focuses on the task of identifying entities in texts in multiple languages (a token classification problem).
- Chapter 5, Text Generation, explores the ability of transformer models to generate text, and introduces decoding strategies and metrics.
- Chapter 6, Summarization, digs into the complex sequence-to-sequence task of text summarization and explores the metrics used for this task.
- Chapter 7, Question Answering, focuses on building a review-based question answering system and introduces retrieval with Haystack.
- Chapter 8, Making Transformers Efficient in Production, focuses on model performance. We’ll look at the task of intent detection (a type of sequence classification problem) and explore techniques such a knowledge distillation, quantization, and pruning.
- Chapter 9, Dealing with Few to No Labels, looks at ways to improve model performance in the absence of large amounts of labeled data. We’ll build a GitHub issues tagger and explore techniques such as zero-shot classification and data augmentation.
- Chapter 10, Training Transformers from Scratch, shows you how to build and train a model for autocompleting Python source code from scratch. We’ll look at dataset streaming and large-scale training, and build our own tokenizer.
- Chapter 11, Future Directions, explores the challenges transformers face and some of the exciting new directions that research in this area is going into.
Product details
| Main Specification | |
|---|---|
| Marka | by Lewis Tunstall (Author) or Leandro von Werra (Author) or Thomas Wolf (Author) & 0 more Format: Paperback |
| Data publikacji | 2022 or July 5 |
| Pozycja Waga | 7.4 uncji |
| Product information | |
| Język | Angielski |
| Others | |
| Typ produktu | Intelligence & Semantics |
| Edycja | 1. |
| Wydawca | O'Reilly Media |
| Długość wydruku | 406 pages |
| ISBN- 10 | 1098136799 |
| ISBN- 13 | 978-1098136796 |
| Wymiary | 7 x 1 x 9.25 inches |
| ISBN10 | 1098136799 |
| ISBN13 | 978-1098136796 |