Remote Functions: continuous output (generators)

[psukys]

Currently trying to run a function that yields results (is a generator), doesn't work.

Remote function file foo.py:

def func():
    for i in range(100):
        yield i


if __name__ == '__channelexec__':
    for item in channel:
        channel.send(eval(item))

Execution code:

import remoto, logging, foo
logging.basicConfig(level=logging.DEBUG)
logger = logging.getLogger('otherhostname')
conn = remoto.Connection('otherhostname', logger=logger)
remote_foo = conn.import_module(foo)
foo.func()

Received output after executing last line in Execution code:
RuntimeError: DumpError: can't serialize <class 'generator'>

Is there a possible workflow for receiving continuous output from remote function?

[alfredodeza]

Correct, this is a caveat of the serializing that execnet provides. If you need to continuously receive output, you should look at remoto/log.py and how it is used in remoto/process.py

[psukys]

I see, my general thoughts on this could be that the function/module could reuse channel to send back (instead of yield), but then ModuleExecute wrapper only does a single channel.receive(). I find it difficult to find consistent documentation on execnet's channel.receive functionality, but maybe it's possible to tell when channel is closed/finished?