Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
230 views
in Technique[技术] by (71.8m points)

python - how to run Dask pypy

I am new to the Dask framework, therefore, kindly forgive me if my question sounds silly to you.

Currently, I am using Dask-distributed (2020.12.0 from conda) to run my task in LocalCluster, which is quite fast, but my concern is related to the pypy support with Dask. As I saw the GitHub blog by @mrocklin where it is stated that if we use pypy to run Dask scheduler than we can get a speedup of around 2X-5X. But my concern is how to register Dask-scheduler to use pypy. I also visited the Dak documentation?but not able to find the?required solution. Currently, I created a conda environment with pypy (Blog), but not able to use pypy with Dask.? ??

if there is some script or modification required to register scheduler (as we write to for cython), kindly let me know.

Kindly advise me in this?regard, any help will be highly appreciated.

question from:https://stackoverflow.com/questions/65951356/how-to-run-dask-pypy

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Answer

0 votes
by (71.8m points)
Waitting for answers

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

...