Running Background Jobs
Sometimes you may not want a user request to be executed immediately but added to a queue that will be executed by a background worker. The advantage of doing this is that your web workers remain free to execute other requests and longer jobs do not eat up all of your resources.
Frappe uses Python RQ to run background jobs. The following example illustrates how you can enqueue a job:
import frappe
def long_job(arg1, arg2):
frappe.publish_realtime('msgprint', 'Starting long job...')
# this job takes a long time to process
frappe.publish_realtime('msgprint', 'Ending long job...')
def enqueue_long_job(arg1, args2):
frappe.enqueue('myapp.mymodule.long_job', arg1=arg1, arg2=arg2)
This will enqueue long_job
to the queue default
. Other available queues are long
and short
. You should choose the appropriate queue based on how long you estimate your enqueued job to execute.
Starting Version 14, you can also enqueue jobs at front of the queue by passing at_front
as True
in your enqueue call.
Called delayed actions on Document objects
You can also called delayed actions on document objects, for example in Stock Reconciliation if there are more than 100 items, it is executed as a background job.
Example: you can call doc.queue_action('submit')
Note: This only works for save
, submit
, cancel
You can also push certain actions to the background if you anticipate the execution is very large.
For example:
def submit(self): if len(self.items) > 100: self.queue_action('submit') else: self._submit()
Debugging
If you are on bench start
You will see logs in your terminal.
Note: default worker does not auto restart, so you will have to kill bench and start again after you make changes.