Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Start an Executor with specific job to run only #33

Open
baminou opened this issue Aug 3, 2018 · 1 comment
Open

Start an Executor with specific job to run only #33

baminou opened this issue Aug 3, 2018 · 1 comment

Comments

@baminou
Copy link

baminou commented Aug 3, 2018

No description provided.

@junjun-zhang junjun-zhang changed the title Run a worker with specific jobs to run only Start an Executor with specific job(s) to run only Aug 3, 2018
@junjun-zhang junjun-zhang changed the title Start an Executor with specific job(s) to run only Start an Executor with specific job to run only Aug 3, 2018
@junjun-zhang
Copy link
Contributor

Normally a job in queued state can be picked up by any running Executor. If we want an executor to pick up a particular job, it may not always succeed since there is an opportunity that another executor may have already picked up the specific job. In order to guarantee a specific job only picked by a specific executor there are two options (maybe more):

  1. add a piece of information for preferred executor to a job when the job enters into queued state.
  2. put the job into the on-hold state to prevent it from being picked by any executor, then specify the job_id when starting the executor the user wants it pick up the specific job

The second option is more plausible in terms of implementation and on-hold state is something useful on it own when investigation is needed for certain jobs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants