Apache Spark (Pt. 2): MLlib - ML 074

Apache Spark (Pt. 2): MLlib - ML 074

June 02, 2022

Powered by RedCircle

Show Notes

MLlib is Apache Spark's scalable machine learning library. Today, Ben and Michael discuss the ease of use, performance, algorithms, and utilities included in this library and how to execute the best ML workflow with MLlib.

In this episode...

  1. Why stick with Spark libraries vs. a single node operation?
  2. What algorithms are not in Spark Lib?
  3. What is the min. package set to use for supervised learning?
  4. Modeling and validation
  5. Down-sampling your data
  6. MLlib vs. scikit-learn
  7. Resources