在ipython / jupyter笔记本中运行单元格的新线程

问题描述

有时运行单个单元需要很长时间，而它正在运行，我想在同一个笔记本中编写并运行其他单元，在同一个上下文中访问变量。

Sometimes it takes a long time to run a single cell, while it is running, I would like to write and run other cells in the same notebook, accessing the variables in the same context.

是否有任何可以使用的ipython魔法，当它被添加到单元格时，运行单元格将自动创建一个新线程并使用共享的全局数据运行笔记本？

Is there any ipython magic that can be used such that when it is added to a cell, running the cell will automatically create a new thread and run with shared global data in the notebook?

推荐答案

这可能不是一个答案，而是它的方向。我没有看到类似的东西，我仍然对此感兴趣。

It may not be an answer, but rather the direction to it. I did not saw anything like that, still I'm interested in this too.

我目前的发现表明需要定义它的自己的自定义单元魔法即可。好的参考资料将是文档中的自定义单元格魔术部分以及我要考虑的两个示例：

My current findings suggesting that one need to define it's own custom cell magic. Good references would be the custom cell magic section in the documentation and two examples that I would consider:

• memit ：IPython的魔术内存使用工具


• 说明Python多线程与多处理：

• memit: magic memory usage benching for IPython https://gist.github.com/vene/3022718
• Illustrating Python multithreading vs multiprocessing: http://nathangrigg.net/2015/04/python-threading-vs-processes/

这两个链接包裹着线程中的代码。这可能是一个起点。

Both those links wrapping the code in a thread. That could be a starting point.

更新： github上的ngcm-tutorial描述了后台作业类

UPDATE: ngcm-tutorial at github has description of background jobs class

##github.com/jupyter/ngcm-tutorial/blob/master/Day-1/IPython%20Kernel/Background%20Jobs.ipynb
from IPython.lib import backgroundjobs as bg
jobs = bg.BackgroundJobManager()

def printfunc(interval=1, reps=5):
    for n in range(reps):
        time.sleep(interval)
        print('In the background... %i' % n)
        sys.stdout.flush()
    print('All done!')
    sys.stdout.flush()

jobs.new('printfunc(1,3)')
jobs.status()

更新2：另一种选择：

from IPython.display import display
from ipywidgets import IntProgress

import threading

class App(object):
    def __init__(self, nloops=2000):
        self.nloops = nloops
        self.pb = IntProgress(description='Thread loops', min=0, max=self.nloops)

    def start(self):
        display(self.pb)
        while self.pb.value < self.nloops:
            self.pb.value += 1
        self.pb.color = 'red'

app = App(nloops=20000)

t = threading.Thread(target=app.start)

t.start()
#t.join()

这篇关于在ipython / jupyter笔记本中运行单元格的新线程的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！