Chapter 8. Joins 连接译者：https://snaildove.github.io Chapter 7 covered aggregating single datasets, which is helpful, but more often than not, your Spark applications are going to bring together a lar ...

Chapter 6. Working with Different Types of Data 处理不同类型的数据译者：https://snaildove.github.io Chapter 5 presented basic DataFrame concepts and abstractions. This chapter covers building expressions, whic ...

Chapter 22 Event-Time and Stateful ProcessingChapter 21 covered the core concepts and basic APIs; this chapter dives into event-time and stateful processing. Event-time processing is a hot topic bec ...

Chapter 21 Structured Streaming Basics 结构化流基础Now that we have covered a brief overview of stream processing, let’s dive right into Structured Streaming. In this chapter, we will, again, state some o ...

Chapter 20 Stream Processing Fundamentals 流处理基础Stream processing is a key requirement in many big data applications. As soon as an application computes something of value—say, a report about custome ...

Preface写这个阅读笔记之前，Hadoop YARN 的稳定发行版是：2.9.2 。 YARN Federation 思想源自：HDFS Federation，官方文档介绍，HDFS Federation 解决的是 NameNode 的横向扩展，HDFS HA 解决的是 NameNode 的单点问题。 PurposeYARN is known to scale to thousands of ...