Integrating Apache Spark with PyCharm

岸芷汀兰whu

于 2016-04-01 13:41:39 发布

阅读量652

点赞数

CC 4.0 BY-SA版权

分类专栏： python spark 文章标签： spark python pycharm

本文链接：https://blog.csdn.net/u012432611/article/details/51036263

spark 同时被 2 个专栏收录

66 篇文章

订阅专栏

python

11 篇文章

订阅专栏

在本教程中，我们将指导您如何在PyCharm中配置Spark环境，通过创建虚拟环境并添加必要的路径来解决环境配置问题。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

参考
在/Applications/PyCharm CE.app/Contents/bin
下写了一个pycharm.sh

export PYTHONPATH=/usr/local/share/spark1626/python/:/usr/local/share/spark1626/python/lib/py4j-0.9-src.zip
export SPARK_HOME=/usr/local/share/spark1626

没解决，不知道怎么回事

参考这篇评论

I have a better way:

Create a new Python virtual environment:
Go to PyCharm -> Preferences -> Project:
On the “Project Interpreter” Line, create a new virtual environment (Click on the gear icon on the right)
Once the virtual environment is created, go to the same menu, click “More” and see a list of all project interpreters. Make sure your virtual environment is selected
Click “Show paths for the selected interpreter” button at the bottom
On the next dialog click on the “+” icon to add paths. You will need to add SPARK_HOME/python and SPARK_HOME/python/lib/py4j-0.8.2.1-src.zip
This should set you up to run and debug.

貌似还需要把SPARK_HOME添加到PYTHONHOME下