深入了解Spark Shuffle的原理,分別對Spark Shuffle過程和Spark Shuffle過程做了比較深入的講解?
課程內容如下:?
1、課程內容?
2、MapOutputTracker?
3、HashShuffleWriter?
4、SortShuffleWriter?
5、UnsafeShuffleWriter?
6、BypassMergeSortShuffleWriter?
7、ShuffleReader?
8、ShuffleManager+MemoryManager+StorageManager