Mastering Large Datasets with Python:Parallelize and Distribute Your Python Code


Mastering Large Datasets with Python:Parallelize and Distribute Your Python Code
Authors:John T. Wolohan
ISBN-10 书号:1617296236
ISBN-13 书号:9781617296239
Edition 版次:1st
Release Finelybook 出版日期:2020-01-21
pages 页数:312 pages


Book Description
Modern data science solutions need to be clean, easy to read, and scalable. In Mastering Large Datasets with Python, author J.T. Wolohan teaches you how to take a small project and scale it up using a functionally influenced approach to Python coding. You’ll explore methods and built-in Python tools that lend themselves to clarity and scalability, like the high-performing parallelism method, as well as distributed technologies that allow for high data throughput. The abundant hands-on exercises in this practical tutorial will lock in these essential skills for any large-scale data science project.
Programming techniques that work well on laptop-sized data can slow to a crawl—or fail altogether—when applied to massive files or distributed datasets. By mastering the powerful map and reduce paradigm, along with the Python-based tools that support it, you can write data-centric applications that scale efficiently without requiring codebase rewrites as your requirements change.
Mastering Large Datasets with Python teaches you to write code that can handle datasets of any size. You’ll start with laptop-sized datasets that teach you to parallelize data analysis by breaking large tasks into smaller ones that can run simultaneously. You’ll then scale those same programs to industrial-sized datasets on a cluster of cloud servers. With the map and reduce paradigm firmly in place, you’ll explore tools like Hadoop and PySpark to efficiently process massive distributed datasets, speed up decision-making with machine learning, and simplify your data storage with AWS S3.
What’s inside

An introduction to the map and reduce paradigm
Parallelization with the multiprocessing module and pathos framework
Hadoop and Spark for distributed computing
Running AWS jobs to process large datasets


下载地址:

Mastering Large Datasets with Python 9781617296239.zip

赞(0) 觉得文章有用就打赏一下
未经允许不得转载:finelybook » Mastering Large Datasets with Python:Parallelize and Distribute Your Python Code

评论 下载问题及网盘链接失效反馈!

评论前必须登录!

觉得文章有用就打赏一下

支付宝扫一扫打赏

微信扫一扫打赏