分布式部署lightgbm总结

Lightgbm

• aws
  – LightGBM 算法框架运行在Amazon Sagemaker :
  https://aws.amazon.com/cn/blogs/china/the-lightgbm-algorithm-framework-runs-on-amazon-sagemaker/
  – https://docs.aws.amazon.com/search/doc-search.html?searchPath=documentation&searchQuery=lightgbm
• spark部署： https://blog.51cto.com/u_16213591/10676903
• lightgbm官方文档： https://lightgbm.readthedocs.io/en/latest/Parallel-Learning-Guide.html
  – lightgbm 官方案例：https://github.com/microsoft/LightGBM/tree/master/examples/parallel_learning
  – github官方说明：https://github.com/microsoft/LightGBM/blob/master/docs/Parallel-Learning-Guide.rst
• 优点说明：https://github.com/microsoft/LightGBM/blob/master/docs/Features.rst#optimization-in-distributed-learning
• https://aws.amazon.com/cn/blogs/machine-learning/amazon-sagemaker-built-in-lightgbm-now-offers-distributed-training-using-dask/
• dask: https://ml.dask.org/xgboost.html

Xgboost

Catboost