blob: 62269e6ef01b56d521853ded90b5c7ee19359b4e [file] [log] [blame] [view]
fdoraybacba4a22017-05-10 21:10:001# Threading and Tasks in Chrome
2
3[TOC]
4
Gabriel Charette8917f4c2018-11-22 15:50:285Note: See [Threading and Tasks FAQ](threading_and_tasks_faq.md) for more
6examples.
7
fdoraybacba4a22017-05-10 21:10:008## Overview
9
Gabriel Charette39db4c62019-04-29 19:52:3810Chrome has a [multi-process
11architecture](https://www.chromium.org/developers/design-documents/multi-process-architecture)
12and each process is heavily multi-threaded. In this document we will go over the
13basic threading system shared by each process. The main goal is to keep the main
14thread (a.k.a. "UI" thread in the browser process) and IO thread (each process'
15thread for handling
16[IPC](https://en.wikipedia.org/wiki/Inter-process_communication)) responsive.
17This means offloading any blocking I/O or other expensive operations to other
18threads. Our approach is to use message passing as the way of communicating
19between threads. We discourage locking and thread-safe objects. Instead, objects
20live on only one (often virtual -- we'll get to that later!) thread and we pass
21messages between those threads for communication.
22
23This documentation assumes familiarity with computer science
24[threading concepts](https://en.wikipedia.org/wiki/Thread_(computing)).
Gabriel Charette90480312018-02-16 15:10:0525
Gabriel Charette364a16a2019-02-06 21:12:1526### Nomenclature
Gabriel Charette39db4c62019-04-29 19:52:3827
28## Core Concepts
29 * **Task**: A unit of work to be processed. Effectively a function pointer with
30 optionally associated state. In Chrome this is `base::Callback` created via
31 `base::Bind`
32 ([documentation](https://chromium.googlesource.com/chromium/src/+/HEAD/docs/callback.md)).
33 * **Task queue**: A queue of tasks to be processed.
34 * **Physical thread**: An operating system provided thread (e.g. pthread on
35 POSIX or CreateThread() on Windows). The Chrome cross-platform abstraction
36 is `base::PlatformThread`. You should pretty much never use this directly.
37 * **`base::Thread`**: A physical thread forever processing messages from a
38 dedicated task queue until Quit(). You should pretty much never be creating
39 your own `base::Thread`'s.
40 * **Thread pool**: A pool of physical threads with a shared task queue. In
Gabriel Charette0b20ee6c2019-09-18 14:06:1241 Chrome, this is `base::ThreadPoolInstance`. There's exactly one instance per
42 Chrome process, it serves tasks posted through
Gabriel Charette39db4c62019-04-29 19:52:3843 [`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette43fd3702019-05-29 16:36:5144 and as such you should rarely need to use the `base::ThreadPoolInstance` API
Gabriel Charette39db4c62019-04-29 19:52:3845 directly (more on posting tasks later).
46 * **Sequence** or **Virtual thread**: A chrome-managed thread of execution.
47 Like a physical thread, only one task can run on a given sequence / virtual
48 thread at any given moment and each task sees the side-effects of the
49 preceding tasks. Tasks are executed sequentially but may hop physical
50 threads between each one.
51 * **Task runner**: An interface through which tasks can be posted. In Chrome
52 this is `base::TaskRunner`.
53 * **Sequenced task runner**: A task runner which guarantees that tasks posted
54 to it will run sequentially, in posted order. Each such task is guaranteed to
55 see the side-effects of the task preceding it. Tasks posted to a sequenced
56 task runner are typically processed by a single thread (virtual or physical).
57 In Chrome this is `base::SequencedTaskRunner` which is-a
58 `base::TaskRunner`.
59 * **Single-thread task runner**: A sequenced task runner which guarantees that
60 all tasks will be processed by the same physical thread. In Chrome this is
61 `base::SingleThreadTaskRunner` which is-a `base::SequencedTaskRunner`. We
62 [prefer sequences to threads](#prefer-sequences-to-physical-threads) whenever
63 possible.
64
65## Threading Lexicon
66Note to the reader: the following terms are an attempt to bridge the gap between
67common threading nomenclature and the way we use them in Chrome. It might be a
68bit heavy if you're just getting started. Should this be hard to parse, consider
69skipping to the more detailed sections below and referring back to this as
70necessary.
71
72 * **Thread-unsafe**: The vast majority of types in Chrome are thread-unsafe
73 (by design). Access to such types/methods must be externally synchronized.
74 Typically thread-unsafe types require that all tasks accessing their state be
75 posted to the same `base::SequencedTaskRunner` and they verify this in debug
76 builds with a `SEQUENCE_CHECKER` member. Locks are also an option to
77 synchronize access but in Chrome we strongly
78 [prefer sequences to locks](#Using-Sequences-Instead-of-Locks).
Gabriel Charette364a16a2019-02-06 21:12:1579 * **Thread-affine**: Such types/methods need to be always accessed from the
Gabriel Charetteb984d672019-02-12 21:53:2780 same physical thread (i.e. from the same `base::SingleThreadTaskRunner`) and
Gabriel Charette39db4c62019-04-29 19:52:3881 typically have a `THREAD_CHECKER` member to verify that they are. Short of
82 using a third-party API or having a leaf dependency which is thread-affine:
83 there's pretty much no reason for a type to be thread-affine in Chrome.
84 Note that `base::SingleThreadTaskRunner` is-a `base::SequencedTaskRunner` so
Gabriel Charetteb984d672019-02-12 21:53:2785 thread-affine is a subset of thread-unsafe. Thread-affine is also sometimes
86 referred to as **thread-hostile**.
Gabriel Charette364a16a2019-02-06 21:12:1587 * **Thread-safe**: Such types/methods can be safely accessed concurrently.
Gabriel Charetteb984d672019-02-12 21:53:2788 * **Thread-compatible**: Such types provide safe concurrent access to const
89 methods but require synchronization for non-const (or mixed const/non-const
Gabriel Charette39db4c62019-04-29 19:52:3890 access). Chrome doesn't expose reader-writer locks; as such, the only use
Gabriel Charetteb984d672019-02-12 21:53:2791 case for this is objects (typically globals) which are initialized once in a
Gabriel Charette364a16a2019-02-06 21:12:1592 thread-safe manner (either in the single-threaded phase of startup or lazily
93 through a thread-safe static-local-initialization paradigm a la
Gabriel Charetteb984d672019-02-12 21:53:2794 `base::NoDestructor`) and forever after immutable.
95 * **Immutable**: A subset of thread-compatible types which cannot be modified
96 after construction.
Gabriel Charette364a16a2019-02-06 21:12:1597 * **Sequence-friendly**: Such types/methods are thread-unsafe types which
98 support being invoked from a `base::SequencedTaskRunner`. Ideally this would
99 be the case for all thread-unsafe types but legacy code sometimes has
100 overzealous checks that enforce thread-affinity in mere thread-unsafe
Gabriel Charette39db4c62019-04-29 19:52:38101 scenarios. See [Prefer Sequences to
102 Threads](#prefer-sequences-to-physical-threads) below for more details.
Gabriel Charette364a16a2019-02-06 21:12:15103
fdoraybacba4a22017-05-10 21:10:00104### Threads
105
106Every Chrome process has
107
108* a main thread
Gabriel Charette39db4c62019-04-29 19:52:38109 * in the browser process (BrowserThread::UI): updates the UI
110 * in renderer processes (Blink main thread): runs most of Blink
fdoraybacba4a22017-05-10 21:10:00111* an IO thread
Gabriel Charette39db4c62019-04-29 19:52:38112 * in the browser process (BrowserThread::IO): handles IPCs and network requests
fdoraybacba4a22017-05-10 21:10:00113 * in renderer processes: handles IPCs
114* a few more special-purpose threads
115* and a pool of general-purpose threads
116
117Most threads have a loop that gets tasks from a queue and runs them (the queue
118may be shared between multiple threads).
119
120### Tasks
121
122A task is a `base::OnceClosure` added to a queue for asynchronous execution.
123
124A `base::OnceClosure` stores a function pointer and arguments. It has a `Run()`
125method that invokes the function pointer using the bound arguments. It is
126created using `base::BindOnce`. (ref. [Callback<> and Bind()
127documentation](callback.md)).
128
129```
130void TaskA() {}
131void TaskB(int v) {}
132
133auto task_a = base::BindOnce(&TaskA);
134auto task_b = base::BindOnce(&TaskB, 42);
135```
136
137A group of tasks can be executed in one of the following ways:
138
139* [Parallel](#Posting-a-Parallel-Task): No task execution ordering, possibly all
140 at once on any thread
141* [Sequenced](#Posting-a-Sequenced-Task): Tasks executed in posting order, one
142 at a time on any thread.
143* [Single Threaded](#Posting-Multiple-Tasks-to-the-Same-Thread): Tasks executed
144 in posting order, one at a time on a single thread.
Drew Stonebraker653a3ba2019-07-02 19:24:23145 * [COM Single Threaded](#Posting-Tasks-to-a-COM-Single_Thread-Apartment-STA_Thread-Windows):
fdoraybacba4a22017-05-10 21:10:00146 A variant of single threaded with COM initialized.
147
Gabriel Charette39db4c62019-04-29 19:52:38148### Prefer Sequences to Physical Threads
gab2a4576052017-06-07 23:36:12149
Gabriel Charette39db4c62019-04-29 19:52:38150Sequenced execution (on virtual threads) is strongly preferred to
151single-threaded execution (on physical threads). Except for types/methods bound
152to the main thread (UI) or IO threads: thread-safety is better achieved via
153`base::SequencedTaskRunner` than through managing your own physical threads
154(ref. [Posting a Sequenced Task](#posting-a-sequenced-task) below).
gab2a4576052017-06-07 23:36:12155
Gabriel Charette39db4c62019-04-29 19:52:38156All APIs which are exposed for "current physical thread" have an equivalent for
157"current sequence"
158([mapping](threading_and_tasks_faq.md#How-to-migrate-from-SingleThreadTaskRunner-to-SequencedTaskRunner)).
gab2a4576052017-06-07 23:36:12159
Gabriel Charette39db4c62019-04-29 19:52:38160If you find yourself writing a sequence-friendly type and it fails
161thread-affinity checks (e.g., `THREAD_CHECKER`) in a leaf dependency: consider
162making that dependency sequence-friendly as well. Most core APIs in Chrome are
163sequence-friendly, but some legacy types may still over-zealously use
164ThreadChecker/ThreadTaskRunnerHandle/SingleThreadTaskRunner when they could
165instead rely on the "current sequence" and no longer be thread-affine.
fdoraybacba4a22017-05-10 21:10:00166
167## Posting a Parallel Task
168
Gabriel Charette52fa3ae2019-04-15 21:44:37169### Direct Posting to the Thread Pool
fdoraybacba4a22017-05-10 21:10:00170
171A task that can run on any thread and doesn’t have ordering or mutual exclusion
172requirements with other tasks should be posted using one of the
173`base::PostTask*()` functions defined in
Gabriel Charette04b138f2018-08-06 00:03:22174[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h).
fdoraybacba4a22017-05-10 21:10:00175
176```cpp
177base::PostTask(FROM_HERE, base::BindOnce(&Task));
178```
179
180This posts tasks with default traits.
181
Sami Kyostila831c60b2019-07-31 13:31:23182The `base::PostTask*()` functions allow the caller to provide additional details
183about the task via TaskTraits (ref. [Annotating Tasks with TaskTraits](#Annotating-Tasks-with-TaskTraits)).
fdoraybacba4a22017-05-10 21:10:00184
185```cpp
Sami Kyostila831c60b2019-07-31 13:31:23186base::PostTask(
Gabriel Charetteb10aeebc2018-07-26 20:15:00187 FROM_HERE, {base::TaskPriority::BEST_EFFORT, MayBlock()},
fdoraybacba4a22017-05-10 21:10:00188 base::BindOnce(&Task));
189```
190
fdoray52bf5552017-05-11 12:43:59191### Posting via a TaskRunner
fdoraybacba4a22017-05-10 21:10:00192
193A parallel
Gabriel Charette39db4c62019-04-29 19:52:38194[`base::TaskRunner`](https://cs.chromium.org/chromium/src/base/task_runner.h) is
195an alternative to calling `base::PostTask*()` directly. This is mainly useful
196when it isn’t known in advance whether tasks will be posted in parallel, in
197sequence, or to a single-thread (ref. [Posting a Sequenced
198Task](#Posting-a-Sequenced-Task), [Posting Multiple Tasks to the Same
199Thread](#Posting-Multiple-Tasks-to-the-Same-Thread)). Since `base::TaskRunner`
200is the base class of `base::SequencedTaskRunner` and
201`base::SingleThreadTaskRunner`, a `scoped_refptr<TaskRunner>` member can hold a
202`base::TaskRunner`, a `base::SequencedTaskRunner` or a
203`base::SingleThreadTaskRunner`.
fdoraybacba4a22017-05-10 21:10:00204
205```cpp
206class A {
207 public:
208 A() = default;
209
fdoraybacba4a22017-05-10 21:10:00210 void DoSomething() {
fdoraybacba4a22017-05-10 21:10:00211 task_runner_->PostTask(FROM_HERE, base::BindOnce(&A));
212 }
213
214 private:
215 scoped_refptr<base::TaskRunner> task_runner_ =
Sami Kyostila831c60b2019-07-31 13:31:23216 base::CreateTaskRunner({base::TaskPriority::USER_VISIBLE});
fdoraybacba4a22017-05-10 21:10:00217};
218```
219
220Unless a test needs to control precisely how tasks are executed, it is preferred
221to call `base::PostTask*()` directly (ref. [Testing](#Testing) for less invasive
222ways of controlling tasks in tests).
223
224## Posting a Sequenced Task
225
226A sequence is a set of tasks that run one at a time in posting order (not
227necessarily on the same thread). To post tasks as part of a sequence, use a
Gabriel Charette39db4c62019-04-29 19:52:38228[`base::SequencedTaskRunner`](https://cs.chromium.org/chromium/src/base/sequenced_task_runner.h).
fdoraybacba4a22017-05-10 21:10:00229
230### Posting to a New Sequence
231
Gabriel Charette39db4c62019-04-29 19:52:38232A `base::SequencedTaskRunner` can be created by
Sami Kyostila831c60b2019-07-31 13:31:23233`base::CreateSequencedTaskRunner()`.
fdoraybacba4a22017-05-10 21:10:00234
235```cpp
236scoped_refptr<SequencedTaskRunner> sequenced_task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23237 base::CreateSequencedTaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00238
239// TaskB runs after TaskA completes.
240sequenced_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskA));
241sequenced_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskB));
242```
243
Alex Clarke0dd499562019-10-18 19:45:09244### Posting to the Current (Virtual) Thread
245
Gabriel Charettefee55662019-11-20 21:06:28246The preferred way of posting to the current (virtual) thread is via
247`base::SequencedTaskRunnerHandle::Get()`.
Alex Clarke0dd499562019-10-18 19:45:09248
249```cpp
250// The task will run on the current (virtual) thread's default task queue.
Gabriel Charettefee55662019-11-20 21:06:28251base::SequencedTaskRunnerHandle::Get()->PostTask(
252 FROM_HERE, base::BindOnce(&Task);
Alex Clarke0dd499562019-10-18 19:45:09253```
254
Gabriel Charettefee55662019-11-20 21:06:28255Note that SequencedTaskRunnerHandle::Get() returns the default queue for the
256current virtual thread. On threads with multiple task queues (e.g.
257BrowserThread::UI) this can be a different queue than the one the current task
258belongs to. The "current" task runner is intentionally not exposed via a static
259getter. Either you know it already and can post to it directly or you don't and
260the only sensible destination is the default queue.
Alex Clarke0dd499562019-10-18 19:45:09261
fdoraybacba4a22017-05-10 21:10:00262## Using Sequences Instead of Locks
263
264Usage of locks is discouraged in Chrome. Sequences inherently provide
Gabriel Charettea3ccc972018-11-13 14:43:12265thread-safety. Prefer classes that are always accessed from the same
266sequence to managing your own thread-safety with locks.
267
268**Thread-safe but not thread-affine; how so?** Tasks posted to the same sequence
269will run in sequential order. After a sequenced task completes, the next task
270may be picked up by a different worker thread, but that task is guaranteed to
271see any side-effects caused by the previous one(s) on its sequence.
fdoraybacba4a22017-05-10 21:10:00272
273```cpp
274class A {
275 public:
276 A() {
277 // Do not require accesses to be on the creation sequence.
isherman8c33b8a2017-06-27 19:18:30278 DETACH_FROM_SEQUENCE(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00279 }
280
281 void AddValue(int v) {
282 // Check that all accesses are on the same sequence.
isherman8c33b8a2017-06-27 19:18:30283 DCHECK_CALLED_ON_VALID_SEQUENCE(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00284 values_.push_back(v);
285}
286
287 private:
isherman8c33b8a2017-06-27 19:18:30288 SEQUENCE_CHECKER(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00289
290 // No lock required, because all accesses are on the
291 // same sequence.
292 std::vector<int> values_;
293};
294
295A a;
296scoped_refptr<SequencedTaskRunner> task_runner_for_a = ...;
Mike Bjorged3a09842018-05-15 18:37:28297task_runner_for_a->PostTask(FROM_HERE,
298 base::BindOnce(&A::AddValue, base::Unretained(&a), 42));
299task_runner_for_a->PostTask(FROM_HERE,
300 base::BindOnce(&A::AddValue, base::Unretained(&a), 27));
fdoraybacba4a22017-05-10 21:10:00301
302// Access from a different sequence causes a DCHECK failure.
303scoped_refptr<SequencedTaskRunner> other_task_runner = ...;
304other_task_runner->PostTask(FROM_HERE,
Mike Bjorged3a09842018-05-15 18:37:28305 base::BindOnce(&A::AddValue, base::Unretained(&a), 1));
fdoraybacba4a22017-05-10 21:10:00306```
307
Gabriel Charette90480312018-02-16 15:10:05308Locks should only be used to swap in a shared data structure that can be
309accessed on multiple threads. If one thread updates it based on expensive
310computation or through disk access, then that slow work should be done without
Gabriel Charette39db4c62019-04-29 19:52:38311holding the lock. Only when the result is available should the lock be used to
312swap in the new data. An example of this is in PluginList::LoadPlugins
313([`content/browser/plugin_list.cc`](https://cs.chromium.org/chromium/src/content/browser/plugin_list.cc).
314If you must use locks,
Gabriel Charette90480312018-02-16 15:10:05315[here](https://www.chromium.org/developers/lock-and-condition-variable) are some
316best practices and pitfalls to avoid.
317
Gabriel Charette39db4c62019-04-29 19:52:38318In order to write non-blocking code, many APIs in Chrome are asynchronous.
Gabriel Charette90480312018-02-16 15:10:05319Usually this means that they either need to be executed on a particular
320thread/sequence and will return results via a custom delegate interface, or they
321take a `base::Callback<>` object that is called when the requested operation is
322completed. Executing work on a specific thread/sequence is covered in the
323PostTask sections above.
324
fdoraybacba4a22017-05-10 21:10:00325## Posting Multiple Tasks to the Same Thread
326
327If multiple tasks need to run on the same thread, post them to a
Gabriel Charette39db4c62019-04-29 19:52:38328[`base::SingleThreadTaskRunner`](https://cs.chromium.org/chromium/src/base/single_thread_task_runner.h).
329All tasks posted to the same `base::SingleThreadTaskRunner` run on the same thread in
fdoraybacba4a22017-05-10 21:10:00330posting order.
331
332### Posting to the Main Thread or to the IO Thread in the Browser Process
333
Eric Seckler6cf08db82018-08-30 12:01:55334To post tasks to the main thread or to the IO thread, use
Sami Kyostila831c60b2019-07-31 13:31:23335`base::PostTask()` or get the appropriate SingleThreadTaskRunner using
336`base::CreateSingleThreadTaskRunner`, supplying a `BrowserThread::ID`
Eric Seckler6cf08db82018-08-30 12:01:55337as trait. For this, you'll also need to include
338[`content/public/browser/browser_task_traits.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_task_traits.h).
fdoraybacba4a22017-05-10 21:10:00339
340```cpp
Sami Kyostila831c60b2019-07-31 13:31:23341base::PostTask(FROM_HERE, {content::BrowserThread::UI}, ...);
fdoraybacba4a22017-05-10 21:10:00342
Sami Kyostila831c60b2019-07-31 13:31:23343base::CreateSingleThreadTaskRunner({content::BrowserThread::IO})
fdoraybacba4a22017-05-10 21:10:00344 ->PostTask(FROM_HERE, ...);
345```
346
347The main thread and the IO thread are already super busy. Therefore, prefer
fdoray52bf5552017-05-11 12:43:59348posting to a general purpose thread when possible (ref.
349[Posting a Parallel Task](#Posting-a-Parallel-Task),
350[Posting a Sequenced task](#Posting-a-Sequenced-Task)).
351Good reasons to post to the main thread are to update the UI or access objects
352that are bound to it (e.g. `Profile`). A good reason to post to the IO thread is
353to access the internals of components that are bound to it (e.g. IPCs, network).
354Note: It is not necessary to have an explicit post task to the IO thread to
355send/receive an IPC or send/receive data on the network.
fdoraybacba4a22017-05-10 21:10:00356
357### Posting to the Main Thread in a Renderer Process
358TODO
359
360### Posting to a Custom SingleThreadTaskRunner
361
362If multiple tasks need to run on the same thread and that thread doesn’t have to
Gabriel Charette39db4c62019-04-29 19:52:38363be the main thread or the IO thread, post them to a `base::SingleThreadTaskRunner`
Sami Kyostila831c60b2019-07-31 13:31:23364created by `base::CreateSingleThreadTaskRunner`.
fdoraybacba4a22017-05-10 21:10:00365
366```cpp
Dominic Farolinodbe9769b2019-05-31 04:06:03367scoped_refptr<SingleThreadTaskRunner> single_thread_task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23368 base::CreateSingleThreadTaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00369
370// TaskB runs after TaskA completes. Both tasks run on the same thread.
371single_thread_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskA));
372single_thread_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskB));
373```
374
Gabriel Charette39db4c62019-04-29 19:52:38375Remember that we [prefer sequences to physical
376threads](#prefer-sequences-to-physical-threads) and that this thus should rarely
377be necessary.
fdoraybacba4a22017-05-10 21:10:00378
Alexander Timine653dfc2020-01-07 17:55:06379### Posting to the Current Thread
380
381*** note
382**IMPORTANT:** To post a task that needs mutual exclusion with the current
383sequence of tasks but doesn’t absolutely need to run on the current physical thread,
384use `base::SequencedTaskRunnerHandle::Get()` instead of
385`base::ThreadTaskRunnerHandle::Get()` (ref. [Posting to the Current
386Sequence](#Posting-to-the-Current-Virtual_Thread)). That will better document the
387requirements of the posted task and will avoid unnecessarily making your API
388physical thread-affine. In a single-thread task, `base::SequencedTaskRunnerHandle::Get()`
389is equivalent to `base::ThreadTaskRunnerHandle::Get()`.
390***
391
392If you must post a task to the current physical thread nonetheless, use
393[`base::ThreadTaskRunnerHandle`](https://cs.chromium.org/chromium/src/base/threading/thread_task_runner_handle.h).
394
395```cpp
396// The task will run on the current thread in the future.
397base::ThreadTaskRunnerHandle::Get()->PostTask(
398 FROM_HERE, base::BindOnce(&Task));
399```
400
fdoraybacba4a22017-05-10 21:10:00401## Posting Tasks to a COM Single-Thread Apartment (STA) Thread (Windows)
402
403Tasks that need to run on a COM Single-Thread Apartment (STA) thread must be
Gabriel Charette39db4c62019-04-29 19:52:38404posted to a `base::SingleThreadTaskRunner` returned by
Sami Kyostila831c60b2019-07-31 13:31:23405`base::CreateCOMSTATaskRunner()`. As mentioned in [Posting Multiple Tasks to the
406Same Thread](#Posting-Multiple-Tasks-to-the-Same-Thread), all tasks posted to
407the same `base::SingleThreadTaskRunner` run on the same thread in posting order.
fdoraybacba4a22017-05-10 21:10:00408
409```cpp
410// Task(A|B|C)UsingCOMSTA will run on the same COM STA thread.
411
412void TaskAUsingCOMSTA() {
413 // [ This runs on a COM STA thread. ]
414
415 // Make COM STA calls.
416 // ...
417
418 // Post another task to the current COM STA thread.
419 base::ThreadTaskRunnerHandle::Get()->PostTask(
420 FROM_HERE, base::BindOnce(&TaskCUsingCOMSTA));
421}
422void TaskBUsingCOMSTA() { }
423void TaskCUsingCOMSTA() { }
424
Sami Kyostila831c60b2019-07-31 13:31:23425auto com_sta_task_runner = base::CreateCOMSTATaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00426com_sta_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskAUsingCOMSTA));
427com_sta_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskBUsingCOMSTA));
428```
429
430## Annotating Tasks with TaskTraits
431
Gabriel Charette39db4c62019-04-29 19:52:38432[`base::TaskTraits`](https://cs.chromium.org/chromium/src/base/task/task_traits.h)
Gabriel Charette52fa3ae2019-04-15 21:44:37433encapsulate information about a task that helps the thread pool make better
fdoraybacba4a22017-05-10 21:10:00434scheduling decisions.
435
Gabriel Charette39db4c62019-04-29 19:52:38436All `base::PostTask*()` functions in
Gabriel Charette04b138f2018-08-06 00:03:22437[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette39db4c62019-04-29 19:52:38438have an overload that takes `base::TaskTraits` as argument and one that doesn’t.
439The overload that doesn’t take `base::TaskTraits` as argument is appropriate for
440tasks that:
fdoraybacba4a22017-05-10 21:10:00441- Don’t block (ref. MayBlock and WithBaseSyncPrimitives).
442- Prefer inheriting the current priority to specifying their own.
Gabriel Charette52fa3ae2019-04-15 21:44:37443- Can either block shutdown or be skipped on shutdown (thread pool is free to
444 choose a fitting default).
fdoraybacba4a22017-05-10 21:10:00445Tasks that don’t match this description must be posted with explicit TaskTraits.
446
Gabriel Charette04b138f2018-08-06 00:03:22447[`base/task/task_traits.h`](https://cs.chromium.org/chromium/src/base/task/task_traits.h)
Eric Seckler6cf08db82018-08-30 12:01:55448provides exhaustive documentation of available traits. The content layer also
449provides additional traits in
450[`content/public/browser/browser_task_traits.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_task_traits.h)
451to facilitate posting a task onto a BrowserThread.
452
Gabriel Charette39db4c62019-04-29 19:52:38453Below are some examples of how to specify `base::TaskTraits`.
fdoraybacba4a22017-05-10 21:10:00454
455```cpp
456// This task has no explicit TaskTraits. It cannot block. Its priority
457// is inherited from the calling context (e.g. if it is posted from
Gabriel Charette141a442582018-07-27 21:23:25458// a BEST_EFFORT task, it will have a BEST_EFFORT priority). It will either
fdoraybacba4a22017-05-10 21:10:00459// block shutdown or be skipped on shutdown.
460base::PostTask(FROM_HERE, base::BindOnce(...));
461
Gabriel Charette52fa3ae2019-04-15 21:44:37462// This task has the highest priority. The thread pool will try to
Gabriel Charette141a442582018-07-27 21:23:25463// run it before USER_VISIBLE and BEST_EFFORT tasks.
Sami Kyostila831c60b2019-07-31 13:31:23464base::PostTask(
fdoraybacba4a22017-05-10 21:10:00465 FROM_HERE, {base::TaskPriority::USER_BLOCKING},
466 base::BindOnce(...));
467
468// This task has the lowest priority and is allowed to block (e.g. it
469// can read a file from disk).
Sami Kyostila831c60b2019-07-31 13:31:23470base::PostTask(
Gabriel Charetteb10aeebc2018-07-26 20:15:00471 FROM_HERE, {base::TaskPriority::BEST_EFFORT, base::MayBlock()},
fdoraybacba4a22017-05-10 21:10:00472 base::BindOnce(...));
473
474// This task blocks shutdown. The process won't exit before its
475// execution is complete.
Sami Kyostila831c60b2019-07-31 13:31:23476base::PostTask(
fdoraybacba4a22017-05-10 21:10:00477 FROM_HERE, {base::TaskShutdownBehavior::BLOCK_SHUTDOWN},
478 base::BindOnce(...));
Eric Seckler6cf08db82018-08-30 12:01:55479
480// This task will run on the Browser UI thread.
Sami Kyostila831c60b2019-07-31 13:31:23481base::PostTask(
Eric Seckler6cf08db82018-08-30 12:01:55482 FROM_HERE, {content::BrowserThread::UI},
483 base::BindOnce(...));
fdoraybacba4a22017-05-10 21:10:00484```
485
486## Keeping the Browser Responsive
487
488Do not perform expensive work on the main thread, the IO thread or any sequence
489that is expected to run tasks with a low latency. Instead, perform expensive
490work asynchronously using `base::PostTaskAndReply*()` or
Gabriel Charette39db4c62019-04-29 19:52:38491`base::SequencedTaskRunner::PostTaskAndReply()`. Note that
492asynchronous/overlapped I/O on the IO thread are fine.
fdoraybacba4a22017-05-10 21:10:00493
494Example: Running the code below on the main thread will prevent the browser from
495responding to user input for a long time.
496
497```cpp
498// GetHistoryItemsFromDisk() may block for a long time.
499// AddHistoryItemsToOmniboxDropDown() updates the UI and therefore must
500// be called on the main thread.
501AddHistoryItemsToOmniboxDropdown(GetHistoryItemsFromDisk("keyword"));
502```
503
504The code below solves the problem by scheduling a call to
505`GetHistoryItemsFromDisk()` in a thread pool followed by a call to
506`AddHistoryItemsToOmniboxDropdown()` on the origin sequence (the main thread in
507this case). The return value of the first call is automatically provided as
508argument to the second call.
509
510```cpp
Sami Kyostila831c60b2019-07-31 13:31:23511base::PostTaskAndReplyWithResult(
fdoraybacba4a22017-05-10 21:10:00512 FROM_HERE, {base::MayBlock()},
513 base::BindOnce(&GetHistoryItemsFromDisk, "keyword"),
514 base::BindOnce(&AddHistoryItemsToOmniboxDropdown));
515```
516
517## Posting a Task with a Delay
518
519### Posting a One-Off Task with a Delay
520
521To post a task that must run once after a delay expires, use
Gabriel Charette39db4c62019-04-29 19:52:38522`base::PostDelayedTask*()` or `base::TaskRunner::PostDelayedTask()`.
fdoraybacba4a22017-05-10 21:10:00523
524```cpp
Sami Kyostila831c60b2019-07-31 13:31:23525base::PostDelayedTask(
Gabriel Charetteb10aeebc2018-07-26 20:15:00526 FROM_HERE, {base::TaskPriority::BEST_EFFORT}, base::BindOnce(&Task),
fdoraybacba4a22017-05-10 21:10:00527 base::TimeDelta::FromHours(1));
528
529scoped_refptr<base::SequencedTaskRunner> task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23530 base::CreateSequencedTaskRunner({base::TaskPriority::BEST_EFFORT});
fdoraybacba4a22017-05-10 21:10:00531task_runner->PostDelayedTask(
532 FROM_HERE, base::BindOnce(&Task), base::TimeDelta::FromHours(1));
533```
534
535*** note
536**NOTE:** A task that has a 1-hour delay probably doesn’t have to run right away
Gabriel Charetteb10aeebc2018-07-26 20:15:00537when its delay expires. Specify `base::TaskPriority::BEST_EFFORT` to prevent it
fdoraybacba4a22017-05-10 21:10:00538from slowing down the browser when its delay expires.
539***
540
541### Posting a Repeating Task with a Delay
542To post a task that must run at regular intervals,
543use [`base::RepeatingTimer`](https://cs.chromium.org/chromium/src/base/timer/timer.h).
544
545```cpp
546class A {
547 public:
548 ~A() {
549 // The timer is stopped automatically when it is deleted.
550 }
551 void StartDoingStuff() {
552 timer_.Start(FROM_HERE, TimeDelta::FromSeconds(1),
553 this, &MyClass::DoStuff);
554 }
555 void StopDoingStuff() {
556 timer_.Stop();
557 }
558 private:
559 void DoStuff() {
560 // This method is called every second on the sequence that invoked
561 // StartDoingStuff().
562 }
563 base::RepeatingTimer timer_;
564};
565```
566
567## Cancelling a Task
568
569### Using base::WeakPtr
570
571[`base::WeakPtr`](https://cs.chromium.org/chromium/src/base/memory/weak_ptr.h)
572can be used to ensure that any callback bound to an object is canceled when that
573object is destroyed.
574
575```cpp
576int Compute() { … }
577
578class A {
579 public:
fdoraybacba4a22017-05-10 21:10:00580 void ComputeAndStore() {
581 // Schedule a call to Compute() in a thread pool followed by
582 // a call to A::Store() on the current sequence. The call to
583 // A::Store() is canceled when |weak_ptr_factory_| is destroyed.
584 // (guarantees that |this| will not be used-after-free).
585 base::PostTaskAndReplyWithResult(
586 FROM_HERE, base::BindOnce(&Compute),
587 base::BindOnce(&A::Store, weak_ptr_factory_.GetWeakPtr()));
588 }
589
590 private:
591 void Store(int value) { value_ = value; }
592
593 int value_;
Jeremy Roman0dd0b2f2019-07-16 21:00:43594 base::WeakPtrFactory<A> weak_ptr_factory_{this};
fdoraybacba4a22017-05-10 21:10:00595};
596```
597
598Note: `WeakPtr` is not thread-safe: `GetWeakPtr()`, `~WeakPtrFactory()`, and
599`Compute()` (bound to a `WeakPtr`) must all run on the same sequence.
600
601### Using base::CancelableTaskTracker
602
603[`base::CancelableTaskTracker`](https://cs.chromium.org/chromium/src/base/task/cancelable_task_tracker.h)
604allows cancellation to happen on a different sequence than the one on which
605tasks run. Keep in mind that `CancelableTaskTracker` cannot cancel tasks that
606have already started to run.
607
608```cpp
Sami Kyostila831c60b2019-07-31 13:31:23609auto task_runner = base::CreateTaskRunner({base::ThreadPool()});
fdoraybacba4a22017-05-10 21:10:00610base::CancelableTaskTracker cancelable_task_tracker;
611cancelable_task_tracker.PostTask(task_runner.get(), FROM_HERE,
Peter Kasting341e1fb2018-02-24 00:03:01612 base::DoNothing());
fdoraybacba4a22017-05-10 21:10:00613// Cancels Task(), only if it hasn't already started running.
614cancelable_task_tracker.TryCancelAll();
615```
616
Etienne Pierre-dorayd3882992020-01-14 20:34:11617## Posting a Job to run in parallel
618
619The [`base::PostJob`](https://cs.chromium.org/chromium/src/base/task/post_job.h)
620is a power user API to be able to schedule a single base::RepeatingCallback
621worker task and request that ThreadPool workers invoke it concurrently.
622This avoids degenerate cases:
623* Calling `PostTask()` for each work item, causing significant overhead.
624* Fixed number of `PostTask()` calls that split the work and might run for a
625 long time. This is problematic when many components post “num cores” tasks and
626 all expect to use all the cores. In these cases, the scheduler lacks context
627 to be fair to multiple same-priority requests and/or ability to request lower
628 priority work to yield when high priority work comes in.
629
630```cpp
631// A canonical implementation of |worker_task|.
632void WorkerTask(base::JobDelegate* job_delegate) {
633 while (!job_delegate->ShouldYield()) {
634 auto work_item = TakeWorkItem(); // Smallest unit of work.
635 if (!work_item)
636 return:
637 ProcessWork(work_item);
638 }
639}
640
641// Returns the latest thread-safe number of incomplete work items.
642void NumIncompleteWorkItems();
643
644base::PostJob(FROM_HERE,
645 {base::ThreadPool()},
646 base::BindRepeating(&WorkerTask),
647 base::BindRepeating(&NumIncompleteWorkItems));
648```
649
650By doing as much work as possible in a loop when invoked, the worker task avoids
651scheduling overhead. Meanwhile `base::JobDelegate::ShouldYield()` is
652periodically invoked to conditionally exit and let the scheduler prioritize
653other work. This yield-semantic allows, for example, a user-visible job to use
654all cores but get out of the way when a user-blocking task comes in.
655
656### Adding additional work to a running job.
657
658When new work items are added and the API user wants additional threads to
659invoke the worker task concurrently,
660`JobHandle/JobDelegate::NotifyConcurrencyIncrease()` *must* be invoked shortly
661after max concurrency increases.
662
fdoraybacba4a22017-05-10 21:10:00663## Testing
664
Gabriel Charette0b20ee6c2019-09-18 14:06:12665For more details see [Testing Components Which Post
666Tasks](threading_and_tasks_testing.md).
667
fdoraybacba4a22017-05-10 21:10:00668To test code that uses `base::ThreadTaskRunnerHandle`,
669`base::SequencedTaskRunnerHandle` or a function in
Gabriel Charette39db4c62019-04-29 19:52:38670[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h),
671instantiate a
Gabriel Charette0b20ee6c2019-09-18 14:06:12672[`base::test::TaskEnvironment`](https://cs.chromium.org/chromium/src/base/test/task_environment.h)
Gabriel Charette39db4c62019-04-29 19:52:38673for the scope of the test. If you need BrowserThreads, use
Gabriel Charette798fde72019-08-20 22:24:04674`content::BrowserTaskEnvironment` instead of
Gabriel Charette694c3c332019-08-19 14:53:05675`base::test::TaskEnvironment`.
fdoraybacba4a22017-05-10 21:10:00676
Gabriel Charette694c3c332019-08-19 14:53:05677Tests can run the `base::test::TaskEnvironment`'s message pump using a
Gabriel Charette39db4c62019-04-29 19:52:38678`base::RunLoop`, which can be made to run until `Quit()` (explicitly or via
679`RunLoop::QuitClosure()`), or to `RunUntilIdle()` ready-to-run tasks and
680immediately return.
Wezd9e4cb772019-01-09 03:07:03681
Gabriel Charette694c3c332019-08-19 14:53:05682TaskEnvironment configures RunLoop::Run() to LOG(FATAL) if it hasn't been
Wezd9e4cb772019-01-09 03:07:03683explicitly quit after TestTimeouts::action_timeout(). This is preferable to
684having the test hang if the code under test fails to trigger the RunLoop to
685quit. The timeout can be overridden with ScopedRunTimeoutForTest.
686
fdoraybacba4a22017-05-10 21:10:00687```cpp
688class MyTest : public testing::Test {
689 public:
690 // ...
691 protected:
Gabriel Charette694c3c332019-08-19 14:53:05692 base::test::TaskEnvironment task_environment_;
fdoraybacba4a22017-05-10 21:10:00693};
694
695TEST(MyTest, MyTest) {
696 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&A));
697 base::SequencedTaskRunnerHandle::Get()->PostTask(FROM_HERE,
698 base::BindOnce(&B));
699 base::ThreadTaskRunnerHandle::Get()->PostDelayedTask(
700 FROM_HERE, base::BindOnce(&C), base::TimeDelta::Max());
701
702 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until it is empty.
703 // Delayed tasks are not added to the queue until they are ripe for execution.
704 base::RunLoop().RunUntilIdle();
705 // A and B have been executed. C is not ripe for execution yet.
706
707 base::RunLoop run_loop;
708 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&D));
709 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, run_loop.QuitClosure());
710 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&E));
711
712 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until QuitClosure is
713 // invoked.
714 run_loop.Run();
715 // D and run_loop.QuitClosure() have been executed. E is still in the queue.
716
Gabriel Charette52fa3ae2019-04-15 21:44:37717 // Tasks posted to thread pool run asynchronously as they are posted.
Sami Kyostila831c60b2019-07-31 13:31:23718 base::PostTask(FROM_HERE, {base::ThreadPool()}, base::BindOnce(&F));
fdoraybacba4a22017-05-10 21:10:00719 auto task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23720 base::CreateSequencedTaskRunner({base::ThreadPool()});
fdoraybacba4a22017-05-10 21:10:00721 task_runner->PostTask(FROM_HERE, base::BindOnce(&G));
722
Gabriel Charette52fa3ae2019-04-15 21:44:37723 // To block until all tasks posted to thread pool are done running:
Gabriel Charette43fd3702019-05-29 16:36:51724 base::ThreadPoolInstance::Get()->FlushForTesting();
fdoraybacba4a22017-05-10 21:10:00725 // F and G have been executed.
726
Sami Kyostila831c60b2019-07-31 13:31:23727 base::PostTaskAndReplyWithResult(
fdoraybacba4a22017-05-10 21:10:00728 FROM_HERE, base::TaskTrait(),
729 base::BindOnce(&H), base::BindOnce(&I));
730
731 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until both the
732 // (Thread|Sequenced)TaskRunnerHandle queue and the TaskSchedule queue are
733 // empty:
Gabriel Charette694c3c332019-08-19 14:53:05734 task_environment_.RunUntilIdle();
fdoraybacba4a22017-05-10 21:10:00735 // E, H, I have been executed.
736}
737```
738
Gabriel Charette52fa3ae2019-04-15 21:44:37739## Using ThreadPool in a New Process
fdoraybacba4a22017-05-10 21:10:00740
Gabriel Charette43fd3702019-05-29 16:36:51741ThreadPoolInstance needs to be initialized in a process before the functions in
Gabriel Charette04b138f2018-08-06 00:03:22742[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette43fd3702019-05-29 16:36:51743can be used. Initialization of ThreadPoolInstance in the Chrome browser process
744and child processes (renderer, GPU, utility) has already been taken care of. To
745use ThreadPoolInstance in another process, initialize ThreadPoolInstance early
746in the main function:
fdoraybacba4a22017-05-10 21:10:00747
748```cpp
Gabriel Charette43fd3702019-05-29 16:36:51749// This initializes and starts ThreadPoolInstance with default params.
750base::ThreadPoolInstance::CreateAndStartWithDefaultParams(“process_name”);
751// The base/task/post_task.h API can now be used with base::ThreadPool trait.
752// Tasks will be // scheduled as they are posted.
fdoraybacba4a22017-05-10 21:10:00753
Gabriel Charette43fd3702019-05-29 16:36:51754// This initializes ThreadPoolInstance.
755base::ThreadPoolInstance::Create(“process_name”);
756// The base/task/post_task.h API can now be used with base::ThreadPool trait. No
757// threads will be created and no tasks will be scheduled until after Start() is
758// called.
759base::ThreadPoolInstance::Get()->Start(params);
Gabriel Charette52fa3ae2019-04-15 21:44:37760// ThreadPool can now create threads and schedule tasks.
fdoraybacba4a22017-05-10 21:10:00761```
762
Gabriel Charette43fd3702019-05-29 16:36:51763And shutdown ThreadPoolInstance late in the main function:
fdoraybacba4a22017-05-10 21:10:00764
765```cpp
Gabriel Charette43fd3702019-05-29 16:36:51766base::ThreadPoolInstance::Get()->Shutdown();
fdoraybacba4a22017-05-10 21:10:00767// Tasks posted with TaskShutdownBehavior::BLOCK_SHUTDOWN and
768// tasks posted with TaskShutdownBehavior::SKIP_ON_SHUTDOWN that
769// have started to run before the Shutdown() call have now completed their
770// execution. Tasks posted with
771// TaskShutdownBehavior::CONTINUE_ON_SHUTDOWN may still be
772// running.
773```
Gabriel Charetteb86e5fe62017-06-08 19:39:28774## TaskRunner ownership (encourage no dependency injection)
Sebastien Marchandc95489b2017-05-25 16:39:34775
776TaskRunners shouldn't be passed through several components. Instead, the
777components that uses a TaskRunner should be the one that creates it.
778
779See [this example](https://codereview.chromium.org/2885173002/) of a
780refactoring where a TaskRunner was passed through a lot of components only to be
781used in an eventual leaf. The leaf can and should now obtain its TaskRunner
782directly from
Gabriel Charette04b138f2018-08-06 00:03:22783[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h).
Gabriel Charetteb86e5fe62017-06-08 19:39:28784
Gabriel Charette694c3c332019-08-19 14:53:05785As mentioned above, `base::test::TaskEnvironment` allows unit tests to
Gabriel Charette39db4c62019-04-29 19:52:38786control tasks posted from underlying TaskRunners. In rare cases where a test
787needs to more precisely control task ordering: dependency injection of
788TaskRunners can be useful. For such cases the preferred approach is the
789following:
Gabriel Charetteb86e5fe62017-06-08 19:39:28790
791```cpp
Gabriel Charette39db4c62019-04-29 19:52:38792class Foo {
Gabriel Charetteb86e5fe62017-06-08 19:39:28793 public:
794
Gabriel Charette39db4c62019-04-29 19:52:38795 // Overrides |background_task_runner_| in tests.
Gabriel Charetteb86e5fe62017-06-08 19:39:28796 void SetBackgroundTaskRunnerForTesting(
Gabriel Charette39db4c62019-04-29 19:52:38797 scoped_refptr<base::SequencedTaskRunner> background_task_runner) {
798 background_task_runner_ = std::move(background_task_runner);
799 }
Gabriel Charetteb86e5fe62017-06-08 19:39:28800
801 private:
michaelpg12c04572017-06-26 23:25:06802 scoped_refptr<base::SequencedTaskRunner> background_task_runner_ =
Sami Kyostila831c60b2019-07-31 13:31:23803 base::CreateSequencedTaskRunner(
Gabriel Charetteb10aeebc2018-07-26 20:15:00804 {base::MayBlock(), base::TaskPriority::BEST_EFFORT});
Gabriel Charetteb86e5fe62017-06-08 19:39:28805}
806```
807
808Note that this still allows removing all layers of plumbing between //chrome and
809that component since unit tests will use the leaf layer directly.
Gabriel Charette8917f4c2018-11-22 15:50:28810
811## FAQ
812See [Threading and Tasks FAQ](threading_and_tasks_faq.md) for more examples.