blob: bb1a7257271b1f8f2ecea2598034ec20c807df87 [file] [log] [blame] [view]
fdoraybacba4a22017-05-10 21:10:001# Threading and Tasks in Chrome
2
3[TOC]
4
Gabriel Charette8917f4c2018-11-22 15:50:285Note: See [Threading and Tasks FAQ](threading_and_tasks_faq.md) for more
6examples.
7
fdoraybacba4a22017-05-10 21:10:008## Overview
9
Gabriel Charette39db4c62019-04-29 19:52:3810Chrome has a [multi-process
11architecture](https://www.chromium.org/developers/design-documents/multi-process-architecture)
12and each process is heavily multi-threaded. In this document we will go over the
13basic threading system shared by each process. The main goal is to keep the main
14thread (a.k.a. "UI" thread in the browser process) and IO thread (each process'
15thread for handling
16[IPC](https://en.wikipedia.org/wiki/Inter-process_communication)) responsive.
17This means offloading any blocking I/O or other expensive operations to other
18threads. Our approach is to use message passing as the way of communicating
19between threads. We discourage locking and thread-safe objects. Instead, objects
20live on only one (often virtual -- we'll get to that later!) thread and we pass
21messages between those threads for communication.
22
23This documentation assumes familiarity with computer science
24[threading concepts](https://en.wikipedia.org/wiki/Thread_(computing)).
Gabriel Charette90480312018-02-16 15:10:0525
Gabriel Charette364a16a2019-02-06 21:12:1526### Nomenclature
Gabriel Charette39db4c62019-04-29 19:52:3827
28## Core Concepts
29 * **Task**: A unit of work to be processed. Effectively a function pointer with
30 optionally associated state. In Chrome this is `base::Callback` created via
31 `base::Bind`
32 ([documentation](https://chromium.googlesource.com/chromium/src/+/HEAD/docs/callback.md)).
33 * **Task queue**: A queue of tasks to be processed.
34 * **Physical thread**: An operating system provided thread (e.g. pthread on
35 POSIX or CreateThread() on Windows). The Chrome cross-platform abstraction
36 is `base::PlatformThread`. You should pretty much never use this directly.
37 * **`base::Thread`**: A physical thread forever processing messages from a
38 dedicated task queue until Quit(). You should pretty much never be creating
39 your own `base::Thread`'s.
40 * **Thread pool**: A pool of physical threads with a shared task queue. In
Gabriel Charette0b20ee62019-09-18 14:06:1241 Chrome, this is `base::ThreadPoolInstance`. There's exactly one instance per
42 Chrome process, it serves tasks posted through
Gabriel Charette39db4c62019-04-29 19:52:3843 [`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette43fd3702019-05-29 16:36:5144 and as such you should rarely need to use the `base::ThreadPoolInstance` API
Gabriel Charette39db4c62019-04-29 19:52:3845 directly (more on posting tasks later).
46 * **Sequence** or **Virtual thread**: A chrome-managed thread of execution.
47 Like a physical thread, only one task can run on a given sequence / virtual
48 thread at any given moment and each task sees the side-effects of the
49 preceding tasks. Tasks are executed sequentially but may hop physical
50 threads between each one.
51 * **Task runner**: An interface through which tasks can be posted. In Chrome
52 this is `base::TaskRunner`.
53 * **Sequenced task runner**: A task runner which guarantees that tasks posted
54 to it will run sequentially, in posted order. Each such task is guaranteed to
55 see the side-effects of the task preceding it. Tasks posted to a sequenced
56 task runner are typically processed by a single thread (virtual or physical).
57 In Chrome this is `base::SequencedTaskRunner` which is-a
58 `base::TaskRunner`.
59 * **Single-thread task runner**: A sequenced task runner which guarantees that
60 all tasks will be processed by the same physical thread. In Chrome this is
61 `base::SingleThreadTaskRunner` which is-a `base::SequencedTaskRunner`. We
62 [prefer sequences to threads](#prefer-sequences-to-physical-threads) whenever
63 possible.
64
65## Threading Lexicon
66Note to the reader: the following terms are an attempt to bridge the gap between
67common threading nomenclature and the way we use them in Chrome. It might be a
68bit heavy if you're just getting started. Should this be hard to parse, consider
69skipping to the more detailed sections below and referring back to this as
70necessary.
71
72 * **Thread-unsafe**: The vast majority of types in Chrome are thread-unsafe
73 (by design). Access to such types/methods must be externally synchronized.
74 Typically thread-unsafe types require that all tasks accessing their state be
75 posted to the same `base::SequencedTaskRunner` and they verify this in debug
76 builds with a `SEQUENCE_CHECKER` member. Locks are also an option to
77 synchronize access but in Chrome we strongly
78 [prefer sequences to locks](#Using-Sequences-Instead-of-Locks).
Gabriel Charette364a16a2019-02-06 21:12:1579 * **Thread-affine**: Such types/methods need to be always accessed from the
Gabriel Charetteb984d672019-02-12 21:53:2780 same physical thread (i.e. from the same `base::SingleThreadTaskRunner`) and
Gabriel Charette39db4c62019-04-29 19:52:3881 typically have a `THREAD_CHECKER` member to verify that they are. Short of
82 using a third-party API or having a leaf dependency which is thread-affine:
83 there's pretty much no reason for a type to be thread-affine in Chrome.
84 Note that `base::SingleThreadTaskRunner` is-a `base::SequencedTaskRunner` so
Gabriel Charetteb984d672019-02-12 21:53:2785 thread-affine is a subset of thread-unsafe. Thread-affine is also sometimes
86 referred to as **thread-hostile**.
Gabriel Charette364a16a2019-02-06 21:12:1587 * **Thread-safe**: Such types/methods can be safely accessed concurrently.
Gabriel Charetteb984d672019-02-12 21:53:2788 * **Thread-compatible**: Such types provide safe concurrent access to const
89 methods but require synchronization for non-const (or mixed const/non-const
Gabriel Charette39db4c62019-04-29 19:52:3890 access). Chrome doesn't expose reader-writer locks; as such, the only use
Gabriel Charetteb984d672019-02-12 21:53:2791 case for this is objects (typically globals) which are initialized once in a
Gabriel Charette364a16a2019-02-06 21:12:1592 thread-safe manner (either in the single-threaded phase of startup or lazily
93 through a thread-safe static-local-initialization paradigm a la
Gabriel Charetteb984d672019-02-12 21:53:2794 `base::NoDestructor`) and forever after immutable.
95 * **Immutable**: A subset of thread-compatible types which cannot be modified
96 after construction.
Gabriel Charette364a16a2019-02-06 21:12:1597 * **Sequence-friendly**: Such types/methods are thread-unsafe types which
98 support being invoked from a `base::SequencedTaskRunner`. Ideally this would
99 be the case for all thread-unsafe types but legacy code sometimes has
100 overzealous checks that enforce thread-affinity in mere thread-unsafe
Gabriel Charette39db4c62019-04-29 19:52:38101 scenarios. See [Prefer Sequences to
102 Threads](#prefer-sequences-to-physical-threads) below for more details.
Gabriel Charette364a16a2019-02-06 21:12:15103
fdoraybacba4a22017-05-10 21:10:00104### Threads
105
106Every Chrome process has
107
108* a main thread
Gabriel Charette39db4c62019-04-29 19:52:38109 * in the browser process (BrowserThread::UI): updates the UI
110 * in renderer processes (Blink main thread): runs most of Blink
fdoraybacba4a22017-05-10 21:10:00111* an IO thread
Gabriel Charette39db4c62019-04-29 19:52:38112 * in the browser process (BrowserThread::IO): handles IPCs and network requests
fdoraybacba4a22017-05-10 21:10:00113 * in renderer processes: handles IPCs
114* a few more special-purpose threads
115* and a pool of general-purpose threads
116
117Most threads have a loop that gets tasks from a queue and runs them (the queue
118may be shared between multiple threads).
119
120### Tasks
121
122A task is a `base::OnceClosure` added to a queue for asynchronous execution.
123
124A `base::OnceClosure` stores a function pointer and arguments. It has a `Run()`
125method that invokes the function pointer using the bound arguments. It is
126created using `base::BindOnce`. (ref. [Callback<> and Bind()
127documentation](callback.md)).
128
129```
130void TaskA() {}
131void TaskB(int v) {}
132
133auto task_a = base::BindOnce(&TaskA);
134auto task_b = base::BindOnce(&TaskB, 42);
135```
136
137A group of tasks can be executed in one of the following ways:
138
139* [Parallel](#Posting-a-Parallel-Task): No task execution ordering, possibly all
140 at once on any thread
141* [Sequenced](#Posting-a-Sequenced-Task): Tasks executed in posting order, one
142 at a time on any thread.
143* [Single Threaded](#Posting-Multiple-Tasks-to-the-Same-Thread): Tasks executed
144 in posting order, one at a time on a single thread.
Drew Stonebraker653a3ba2019-07-02 19:24:23145 * [COM Single Threaded](#Posting-Tasks-to-a-COM-Single_Thread-Apartment-STA_Thread-Windows):
fdoraybacba4a22017-05-10 21:10:00146 A variant of single threaded with COM initialized.
147
Gabriel Charette39db4c62019-04-29 19:52:38148### Prefer Sequences to Physical Threads
gab2a4576052017-06-07 23:36:12149
Gabriel Charette39db4c62019-04-29 19:52:38150Sequenced execution (on virtual threads) is strongly preferred to
151single-threaded execution (on physical threads). Except for types/methods bound
152to the main thread (UI) or IO threads: thread-safety is better achieved via
153`base::SequencedTaskRunner` than through managing your own physical threads
154(ref. [Posting a Sequenced Task](#posting-a-sequenced-task) below).
gab2a4576052017-06-07 23:36:12155
Gabriel Charette39db4c62019-04-29 19:52:38156All APIs which are exposed for "current physical thread" have an equivalent for
157"current sequence"
158([mapping](threading_and_tasks_faq.md#How-to-migrate-from-SingleThreadTaskRunner-to-SequencedTaskRunner)).
gab2a4576052017-06-07 23:36:12159
Gabriel Charette39db4c62019-04-29 19:52:38160If you find yourself writing a sequence-friendly type and it fails
161thread-affinity checks (e.g., `THREAD_CHECKER`) in a leaf dependency: consider
162making that dependency sequence-friendly as well. Most core APIs in Chrome are
163sequence-friendly, but some legacy types may still over-zealously use
164ThreadChecker/ThreadTaskRunnerHandle/SingleThreadTaskRunner when they could
165instead rely on the "current sequence" and no longer be thread-affine.
fdoraybacba4a22017-05-10 21:10:00166
167## Posting a Parallel Task
168
Gabriel Charette52fa3ae2019-04-15 21:44:37169### Direct Posting to the Thread Pool
fdoraybacba4a22017-05-10 21:10:00170
171A task that can run on any thread and doesn’t have ordering or mutual exclusion
172requirements with other tasks should be posted using one of the
173`base::PostTask*()` functions defined in
Gabriel Charette04b138f2018-08-06 00:03:22174[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h).
fdoraybacba4a22017-05-10 21:10:00175
176```cpp
177base::PostTask(FROM_HERE, base::BindOnce(&Task));
178```
179
180This posts tasks with default traits.
181
Sami Kyostila831c60b2019-07-31 13:31:23182The `base::PostTask*()` functions allow the caller to provide additional details
183about the task via TaskTraits (ref. [Annotating Tasks with TaskTraits](#Annotating-Tasks-with-TaskTraits)).
fdoraybacba4a22017-05-10 21:10:00184
185```cpp
Sami Kyostila831c60b2019-07-31 13:31:23186base::PostTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00187 FROM_HERE, {base::TaskPriority::BEST_EFFORT, MayBlock()},
fdoraybacba4a22017-05-10 21:10:00188 base::BindOnce(&Task));
189```
190
fdoray52bf5552017-05-11 12:43:59191### Posting via a TaskRunner
fdoraybacba4a22017-05-10 21:10:00192
193A parallel
Gabriel Charette39db4c62019-04-29 19:52:38194[`base::TaskRunner`](https://cs.chromium.org/chromium/src/base/task_runner.h) is
195an alternative to calling `base::PostTask*()` directly. This is mainly useful
196when it isn’t known in advance whether tasks will be posted in parallel, in
197sequence, or to a single-thread (ref. [Posting a Sequenced
198Task](#Posting-a-Sequenced-Task), [Posting Multiple Tasks to the Same
199Thread](#Posting-Multiple-Tasks-to-the-Same-Thread)). Since `base::TaskRunner`
200is the base class of `base::SequencedTaskRunner` and
201`base::SingleThreadTaskRunner`, a `scoped_refptr<TaskRunner>` member can hold a
202`base::TaskRunner`, a `base::SequencedTaskRunner` or a
203`base::SingleThreadTaskRunner`.
fdoraybacba4a22017-05-10 21:10:00204
205```cpp
206class A {
207 public:
208 A() = default;
209
fdoraybacba4a22017-05-10 21:10:00210 void DoSomething() {
fdoraybacba4a22017-05-10 21:10:00211 task_runner_->PostTask(FROM_HERE, base::BindOnce(&A));
212 }
213
214 private:
215 scoped_refptr<base::TaskRunner> task_runner_ =
Sami Kyostila831c60b2019-07-31 13:31:23216 base::CreateTaskRunner({base::TaskPriority::USER_VISIBLE});
fdoraybacba4a22017-05-10 21:10:00217};
218```
219
220Unless a test needs to control precisely how tasks are executed, it is preferred
221to call `base::PostTask*()` directly (ref. [Testing](#Testing) for less invasive
222ways of controlling tasks in tests).
223
224## Posting a Sequenced Task
225
226A sequence is a set of tasks that run one at a time in posting order (not
227necessarily on the same thread). To post tasks as part of a sequence, use a
Gabriel Charette39db4c62019-04-29 19:52:38228[`base::SequencedTaskRunner`](https://cs.chromium.org/chromium/src/base/sequenced_task_runner.h).
fdoraybacba4a22017-05-10 21:10:00229
230### Posting to a New Sequence
231
Gabriel Charette39db4c62019-04-29 19:52:38232A `base::SequencedTaskRunner` can be created by
Sami Kyostila831c60b2019-07-31 13:31:23233`base::CreateSequencedTaskRunner()`.
fdoraybacba4a22017-05-10 21:10:00234
235```cpp
236scoped_refptr<SequencedTaskRunner> sequenced_task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23237 base::CreateSequencedTaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00238
239// TaskB runs after TaskA completes.
240sequenced_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskA));
241sequenced_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskB));
242```
243
Alex Clarke0dd499562019-10-18 19:45:09244### Posting to the Current (Virtual) Thread
245
Gabriel Charettefee55662019-11-20 21:06:28246The preferred way of posting to the current (virtual) thread is via
247`base::SequencedTaskRunnerHandle::Get()`.
Alex Clarke0dd499562019-10-18 19:45:09248
249```cpp
250// The task will run on the current (virtual) thread's default task queue.
Gabriel Charettefee55662019-11-20 21:06:28251base::SequencedTaskRunnerHandle::Get()->PostTask(
252 FROM_HERE, base::BindOnce(&Task);
Alex Clarke0dd499562019-10-18 19:45:09253```
254
Gabriel Charettefee55662019-11-20 21:06:28255Note that SequencedTaskRunnerHandle::Get() returns the default queue for the
256current virtual thread. On threads with multiple task queues (e.g.
257BrowserThread::UI) this can be a different queue than the one the current task
258belongs to. The "current" task runner is intentionally not exposed via a static
259getter. Either you know it already and can post to it directly or you don't and
260the only sensible destination is the default queue.
Alex Clarke0dd499562019-10-18 19:45:09261
fdoraybacba4a22017-05-10 21:10:00262## Using Sequences Instead of Locks
263
264Usage of locks is discouraged in Chrome. Sequences inherently provide
Gabriel Charettea3ccc972018-11-13 14:43:12265thread-safety. Prefer classes that are always accessed from the same
266sequence to managing your own thread-safety with locks.
267
268**Thread-safe but not thread-affine; how so?** Tasks posted to the same sequence
269will run in sequential order. After a sequenced task completes, the next task
270may be picked up by a different worker thread, but that task is guaranteed to
271see any side-effects caused by the previous one(s) on its sequence.
fdoraybacba4a22017-05-10 21:10:00272
273```cpp
274class A {
275 public:
276 A() {
277 // Do not require accesses to be on the creation sequence.
isherman8c33b8a2017-06-27 19:18:30278 DETACH_FROM_SEQUENCE(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00279 }
280
281 void AddValue(int v) {
282 // Check that all accesses are on the same sequence.
isherman8c33b8a2017-06-27 19:18:30283 DCHECK_CALLED_ON_VALID_SEQUENCE(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00284 values_.push_back(v);
285}
286
287 private:
isherman8c33b8a2017-06-27 19:18:30288 SEQUENCE_CHECKER(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00289
290 // No lock required, because all accesses are on the
291 // same sequence.
292 std::vector<int> values_;
293};
294
295A a;
296scoped_refptr<SequencedTaskRunner> task_runner_for_a = ...;
Mike Bjorged3a09842018-05-15 18:37:28297task_runner_for_a->PostTask(FROM_HERE,
298 base::BindOnce(&A::AddValue, base::Unretained(&a), 42));
299task_runner_for_a->PostTask(FROM_HERE,
300 base::BindOnce(&A::AddValue, base::Unretained(&a), 27));
fdoraybacba4a22017-05-10 21:10:00301
302// Access from a different sequence causes a DCHECK failure.
303scoped_refptr<SequencedTaskRunner> other_task_runner = ...;
304other_task_runner->PostTask(FROM_HERE,
Mike Bjorged3a09842018-05-15 18:37:28305 base::BindOnce(&A::AddValue, base::Unretained(&a), 1));
fdoraybacba4a22017-05-10 21:10:00306```
307
Gabriel Charette90480312018-02-16 15:10:05308Locks should only be used to swap in a shared data structure that can be
309accessed on multiple threads. If one thread updates it based on expensive
310computation or through disk access, then that slow work should be done without
Gabriel Charette39db4c62019-04-29 19:52:38311holding the lock. Only when the result is available should the lock be used to
312swap in the new data. An example of this is in PluginList::LoadPlugins
313([`content/browser/plugin_list.cc`](https://cs.chromium.org/chromium/src/content/browser/plugin_list.cc).
314If you must use locks,
Gabriel Charette90480312018-02-16 15:10:05315[here](https://www.chromium.org/developers/lock-and-condition-variable) are some
316best practices and pitfalls to avoid.
317
Gabriel Charette39db4c62019-04-29 19:52:38318In order to write non-blocking code, many APIs in Chrome are asynchronous.
Gabriel Charette90480312018-02-16 15:10:05319Usually this means that they either need to be executed on a particular
320thread/sequence and will return results via a custom delegate interface, or they
321take a `base::Callback<>` object that is called when the requested operation is
322completed. Executing work on a specific thread/sequence is covered in the
323PostTask sections above.
324
fdoraybacba4a22017-05-10 21:10:00325## Posting Multiple Tasks to the Same Thread
326
327If multiple tasks need to run on the same thread, post them to a
Gabriel Charette39db4c62019-04-29 19:52:38328[`base::SingleThreadTaskRunner`](https://cs.chromium.org/chromium/src/base/single_thread_task_runner.h).
329All tasks posted to the same `base::SingleThreadTaskRunner` run on the same thread in
fdoraybacba4a22017-05-10 21:10:00330posting order.
331
332### Posting to the Main Thread or to the IO Thread in the Browser Process
333
Eric Seckler6cf08db82018-08-30 12:01:55334To post tasks to the main thread or to the IO thread, use
Sami Kyostila831c60b2019-07-31 13:31:23335`base::PostTask()` or get the appropriate SingleThreadTaskRunner using
336`base::CreateSingleThreadTaskRunner`, supplying a `BrowserThread::ID`
Eric Seckler6cf08db82018-08-30 12:01:55337as trait. For this, you'll also need to include
338[`content/public/browser/browser_task_traits.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_task_traits.h).
fdoraybacba4a22017-05-10 21:10:00339
340```cpp
Sami Kyostila831c60b2019-07-31 13:31:23341base::PostTask(FROM_HERE, {content::BrowserThread::UI}, ...);
fdoraybacba4a22017-05-10 21:10:00342
Sami Kyostila831c60b2019-07-31 13:31:23343base::CreateSingleThreadTaskRunner({content::BrowserThread::IO})
fdoraybacba4a22017-05-10 21:10:00344 ->PostTask(FROM_HERE, ...);
345```
346
347The main thread and the IO thread are already super busy. Therefore, prefer
fdoray52bf5552017-05-11 12:43:59348posting to a general purpose thread when possible (ref.
349[Posting a Parallel Task](#Posting-a-Parallel-Task),
350[Posting a Sequenced task](#Posting-a-Sequenced-Task)).
351Good reasons to post to the main thread are to update the UI or access objects
352that are bound to it (e.g. `Profile`). A good reason to post to the IO thread is
353to access the internals of components that are bound to it (e.g. IPCs, network).
354Note: It is not necessary to have an explicit post task to the IO thread to
355send/receive an IPC or send/receive data on the network.
fdoraybacba4a22017-05-10 21:10:00356
357### Posting to the Main Thread in a Renderer Process
358TODO
359
360### Posting to a Custom SingleThreadTaskRunner
361
362If multiple tasks need to run on the same thread and that thread doesn’t have to
Gabriel Charette39db4c62019-04-29 19:52:38363be the main thread or the IO thread, post them to a `base::SingleThreadTaskRunner`
Sami Kyostila831c60b2019-07-31 13:31:23364created by `base::CreateSingleThreadTaskRunner`.
fdoraybacba4a22017-05-10 21:10:00365
366```cpp
Dominic Farolinodbe9769b2019-05-31 04:06:03367scoped_refptr<SingleThreadTaskRunner> single_thread_task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23368 base::CreateSingleThreadTaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00369
370// TaskB runs after TaskA completes. Both tasks run on the same thread.
371single_thread_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskA));
372single_thread_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskB));
373```
374
Gabriel Charette39db4c62019-04-29 19:52:38375Remember that we [prefer sequences to physical
376threads](#prefer-sequences-to-physical-threads) and that this thus should rarely
377be necessary.
fdoraybacba4a22017-05-10 21:10:00378
fdoraybacba4a22017-05-10 21:10:00379## Posting Tasks to a COM Single-Thread Apartment (STA) Thread (Windows)
380
381Tasks that need to run on a COM Single-Thread Apartment (STA) thread must be
Gabriel Charette39db4c62019-04-29 19:52:38382posted to a `base::SingleThreadTaskRunner` returned by
Sami Kyostila831c60b2019-07-31 13:31:23383`base::CreateCOMSTATaskRunner()`. As mentioned in [Posting Multiple Tasks to the
384Same Thread](#Posting-Multiple-Tasks-to-the-Same-Thread), all tasks posted to
385the same `base::SingleThreadTaskRunner` run on the same thread in posting order.
fdoraybacba4a22017-05-10 21:10:00386
387```cpp
388// Task(A|B|C)UsingCOMSTA will run on the same COM STA thread.
389
390void TaskAUsingCOMSTA() {
391 // [ This runs on a COM STA thread. ]
392
393 // Make COM STA calls.
394 // ...
395
396 // Post another task to the current COM STA thread.
397 base::ThreadTaskRunnerHandle::Get()->PostTask(
398 FROM_HERE, base::BindOnce(&TaskCUsingCOMSTA));
399}
400void TaskBUsingCOMSTA() { }
401void TaskCUsingCOMSTA() { }
402
Sami Kyostila831c60b2019-07-31 13:31:23403auto com_sta_task_runner = base::CreateCOMSTATaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00404com_sta_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskAUsingCOMSTA));
405com_sta_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskBUsingCOMSTA));
406```
407
408## Annotating Tasks with TaskTraits
409
Gabriel Charette39db4c62019-04-29 19:52:38410[`base::TaskTraits`](https://cs.chromium.org/chromium/src/base/task/task_traits.h)
Gabriel Charette52fa3ae2019-04-15 21:44:37411encapsulate information about a task that helps the thread pool make better
fdoraybacba4a22017-05-10 21:10:00412scheduling decisions.
413
Gabriel Charette39db4c62019-04-29 19:52:38414All `base::PostTask*()` functions in
Gabriel Charette04b138f2018-08-06 00:03:22415[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette39db4c62019-04-29 19:52:38416have an overload that takes `base::TaskTraits` as argument and one that doesn’t.
417The overload that doesn’t take `base::TaskTraits` as argument is appropriate for
418tasks that:
fdoraybacba4a22017-05-10 21:10:00419- Don’t block (ref. MayBlock and WithBaseSyncPrimitives).
420- Prefer inheriting the current priority to specifying their own.
Gabriel Charette52fa3ae2019-04-15 21:44:37421- Can either block shutdown or be skipped on shutdown (thread pool is free to
422 choose a fitting default).
fdoraybacba4a22017-05-10 21:10:00423Tasks that don’t match this description must be posted with explicit TaskTraits.
424
Gabriel Charette04b138f2018-08-06 00:03:22425[`base/task/task_traits.h`](https://cs.chromium.org/chromium/src/base/task/task_traits.h)
Eric Seckler6cf08db82018-08-30 12:01:55426provides exhaustive documentation of available traits. The content layer also
427provides additional traits in
428[`content/public/browser/browser_task_traits.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_task_traits.h)
429to facilitate posting a task onto a BrowserThread.
430
Gabriel Charette39db4c62019-04-29 19:52:38431Below are some examples of how to specify `base::TaskTraits`.
fdoraybacba4a22017-05-10 21:10:00432
433```cpp
434// This task has no explicit TaskTraits. It cannot block. Its priority
435// is inherited from the calling context (e.g. if it is posted from
Gabriel Charette141a442582018-07-27 21:23:25436// a BEST_EFFORT task, it will have a BEST_EFFORT priority). It will either
fdoraybacba4a22017-05-10 21:10:00437// block shutdown or be skipped on shutdown.
438base::PostTask(FROM_HERE, base::BindOnce(...));
439
Gabriel Charette52fa3ae2019-04-15 21:44:37440// This task has the highest priority. The thread pool will try to
Gabriel Charette141a442582018-07-27 21:23:25441// run it before USER_VISIBLE and BEST_EFFORT tasks.
Sami Kyostila831c60b2019-07-31 13:31:23442base::PostTask(
fdoraybacba4a22017-05-10 21:10:00443 FROM_HERE, {base::TaskPriority::USER_BLOCKING},
444 base::BindOnce(...));
445
446// This task has the lowest priority and is allowed to block (e.g. it
447// can read a file from disk).
Sami Kyostila831c60b2019-07-31 13:31:23448base::PostTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00449 FROM_HERE, {base::TaskPriority::BEST_EFFORT, base::MayBlock()},
fdoraybacba4a22017-05-10 21:10:00450 base::BindOnce(...));
451
452// This task blocks shutdown. The process won't exit before its
453// execution is complete.
Sami Kyostila831c60b2019-07-31 13:31:23454base::PostTask(
fdoraybacba4a22017-05-10 21:10:00455 FROM_HERE, {base::TaskShutdownBehavior::BLOCK_SHUTDOWN},
456 base::BindOnce(...));
Eric Seckler6cf08db82018-08-30 12:01:55457
458// This task will run on the Browser UI thread.
Sami Kyostila831c60b2019-07-31 13:31:23459base::PostTask(
Eric Seckler6cf08db82018-08-30 12:01:55460 FROM_HERE, {content::BrowserThread::UI},
461 base::BindOnce(...));
fdoraybacba4a22017-05-10 21:10:00462```
463
464## Keeping the Browser Responsive
465
466Do not perform expensive work on the main thread, the IO thread or any sequence
467that is expected to run tasks with a low latency. Instead, perform expensive
468work asynchronously using `base::PostTaskAndReply*()` or
Gabriel Charette39db4c62019-04-29 19:52:38469`base::SequencedTaskRunner::PostTaskAndReply()`. Note that
470asynchronous/overlapped I/O on the IO thread are fine.
fdoraybacba4a22017-05-10 21:10:00471
472Example: Running the code below on the main thread will prevent the browser from
473responding to user input for a long time.
474
475```cpp
476// GetHistoryItemsFromDisk() may block for a long time.
477// AddHistoryItemsToOmniboxDropDown() updates the UI and therefore must
478// be called on the main thread.
479AddHistoryItemsToOmniboxDropdown(GetHistoryItemsFromDisk("keyword"));
480```
481
482The code below solves the problem by scheduling a call to
483`GetHistoryItemsFromDisk()` in a thread pool followed by a call to
484`AddHistoryItemsToOmniboxDropdown()` on the origin sequence (the main thread in
485this case). The return value of the first call is automatically provided as
486argument to the second call.
487
488```cpp
Sami Kyostila831c60b2019-07-31 13:31:23489base::PostTaskAndReplyWithResult(
fdoraybacba4a22017-05-10 21:10:00490 FROM_HERE, {base::MayBlock()},
491 base::BindOnce(&GetHistoryItemsFromDisk, "keyword"),
492 base::BindOnce(&AddHistoryItemsToOmniboxDropdown));
493```
494
495## Posting a Task with a Delay
496
497### Posting a One-Off Task with a Delay
498
499To post a task that must run once after a delay expires, use
Gabriel Charette39db4c62019-04-29 19:52:38500`base::PostDelayedTask*()` or `base::TaskRunner::PostDelayedTask()`.
fdoraybacba4a22017-05-10 21:10:00501
502```cpp
Sami Kyostila831c60b2019-07-31 13:31:23503base::PostDelayedTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00504 FROM_HERE, {base::TaskPriority::BEST_EFFORT}, base::BindOnce(&Task),
fdoraybacba4a22017-05-10 21:10:00505 base::TimeDelta::FromHours(1));
506
507scoped_refptr<base::SequencedTaskRunner> task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23508 base::CreateSequencedTaskRunner({base::TaskPriority::BEST_EFFORT});
fdoraybacba4a22017-05-10 21:10:00509task_runner->PostDelayedTask(
510 FROM_HERE, base::BindOnce(&Task), base::TimeDelta::FromHours(1));
511```
512
513*** note
514**NOTE:** A task that has a 1-hour delay probably doesn’t have to run right away
Gabriel Charetteb10aeeb2018-07-26 20:15:00515when its delay expires. Specify `base::TaskPriority::BEST_EFFORT` to prevent it
fdoraybacba4a22017-05-10 21:10:00516from slowing down the browser when its delay expires.
517***
518
519### Posting a Repeating Task with a Delay
520To post a task that must run at regular intervals,
521use [`base::RepeatingTimer`](https://cs.chromium.org/chromium/src/base/timer/timer.h).
522
523```cpp
524class A {
525 public:
526 ~A() {
527 // The timer is stopped automatically when it is deleted.
528 }
529 void StartDoingStuff() {
530 timer_.Start(FROM_HERE, TimeDelta::FromSeconds(1),
531 this, &MyClass::DoStuff);
532 }
533 void StopDoingStuff() {
534 timer_.Stop();
535 }
536 private:
537 void DoStuff() {
538 // This method is called every second on the sequence that invoked
539 // StartDoingStuff().
540 }
541 base::RepeatingTimer timer_;
542};
543```
544
545## Cancelling a Task
546
547### Using base::WeakPtr
548
549[`base::WeakPtr`](https://cs.chromium.org/chromium/src/base/memory/weak_ptr.h)
550can be used to ensure that any callback bound to an object is canceled when that
551object is destroyed.
552
553```cpp
554int Compute() { … }
555
556class A {
557 public:
fdoraybacba4a22017-05-10 21:10:00558 void ComputeAndStore() {
559 // Schedule a call to Compute() in a thread pool followed by
560 // a call to A::Store() on the current sequence. The call to
561 // A::Store() is canceled when |weak_ptr_factory_| is destroyed.
562 // (guarantees that |this| will not be used-after-free).
563 base::PostTaskAndReplyWithResult(
564 FROM_HERE, base::BindOnce(&Compute),
565 base::BindOnce(&A::Store, weak_ptr_factory_.GetWeakPtr()));
566 }
567
568 private:
569 void Store(int value) { value_ = value; }
570
571 int value_;
Jeremy Roman0dd0b2f2019-07-16 21:00:43572 base::WeakPtrFactory<A> weak_ptr_factory_{this};
fdoraybacba4a22017-05-10 21:10:00573};
574```
575
576Note: `WeakPtr` is not thread-safe: `GetWeakPtr()`, `~WeakPtrFactory()`, and
577`Compute()` (bound to a `WeakPtr`) must all run on the same sequence.
578
579### Using base::CancelableTaskTracker
580
581[`base::CancelableTaskTracker`](https://cs.chromium.org/chromium/src/base/task/cancelable_task_tracker.h)
582allows cancellation to happen on a different sequence than the one on which
583tasks run. Keep in mind that `CancelableTaskTracker` cannot cancel tasks that
584have already started to run.
585
586```cpp
Sami Kyostila831c60b2019-07-31 13:31:23587auto task_runner = base::CreateTaskRunner({base::ThreadPool()});
fdoraybacba4a22017-05-10 21:10:00588base::CancelableTaskTracker cancelable_task_tracker;
589cancelable_task_tracker.PostTask(task_runner.get(), FROM_HERE,
Peter Kasting341e1fb2018-02-24 00:03:01590 base::DoNothing());
fdoraybacba4a22017-05-10 21:10:00591// Cancels Task(), only if it hasn't already started running.
592cancelable_task_tracker.TryCancelAll();
593```
594
595## Testing
596
Gabriel Charette0b20ee62019-09-18 14:06:12597For more details see [Testing Components Which Post
598Tasks](threading_and_tasks_testing.md).
599
fdoraybacba4a22017-05-10 21:10:00600To test code that uses `base::ThreadTaskRunnerHandle`,
601`base::SequencedTaskRunnerHandle` or a function in
Gabriel Charette39db4c62019-04-29 19:52:38602[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h),
603instantiate a
Gabriel Charette0b20ee62019-09-18 14:06:12604[`base::test::TaskEnvironment`](https://cs.chromium.org/chromium/src/base/test/task_environment.h)
Gabriel Charette39db4c62019-04-29 19:52:38605for the scope of the test. If you need BrowserThreads, use
Gabriel Charette798fde72019-08-20 22:24:04606`content::BrowserTaskEnvironment` instead of
Gabriel Charette694c3c332019-08-19 14:53:05607`base::test::TaskEnvironment`.
fdoraybacba4a22017-05-10 21:10:00608
Gabriel Charette694c3c332019-08-19 14:53:05609Tests can run the `base::test::TaskEnvironment`'s message pump using a
Gabriel Charette39db4c62019-04-29 19:52:38610`base::RunLoop`, which can be made to run until `Quit()` (explicitly or via
611`RunLoop::QuitClosure()`), or to `RunUntilIdle()` ready-to-run tasks and
612immediately return.
Wezd9e4cb772019-01-09 03:07:03613
Gabriel Charette694c3c332019-08-19 14:53:05614TaskEnvironment configures RunLoop::Run() to LOG(FATAL) if it hasn't been
Wezd9e4cb772019-01-09 03:07:03615explicitly quit after TestTimeouts::action_timeout(). This is preferable to
616having the test hang if the code under test fails to trigger the RunLoop to
617quit. The timeout can be overridden with ScopedRunTimeoutForTest.
618
fdoraybacba4a22017-05-10 21:10:00619```cpp
620class MyTest : public testing::Test {
621 public:
622 // ...
623 protected:
Gabriel Charette694c3c332019-08-19 14:53:05624 base::test::TaskEnvironment task_environment_;
fdoraybacba4a22017-05-10 21:10:00625};
626
627TEST(MyTest, MyTest) {
628 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&A));
629 base::SequencedTaskRunnerHandle::Get()->PostTask(FROM_HERE,
630 base::BindOnce(&B));
631 base::ThreadTaskRunnerHandle::Get()->PostDelayedTask(
632 FROM_HERE, base::BindOnce(&C), base::TimeDelta::Max());
633
634 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until it is empty.
635 // Delayed tasks are not added to the queue until they are ripe for execution.
636 base::RunLoop().RunUntilIdle();
637 // A and B have been executed. C is not ripe for execution yet.
638
639 base::RunLoop run_loop;
640 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&D));
641 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, run_loop.QuitClosure());
642 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&E));
643
644 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until QuitClosure is
645 // invoked.
646 run_loop.Run();
647 // D and run_loop.QuitClosure() have been executed. E is still in the queue.
648
Gabriel Charette52fa3ae2019-04-15 21:44:37649 // Tasks posted to thread pool run asynchronously as they are posted.
Sami Kyostila831c60b2019-07-31 13:31:23650 base::PostTask(FROM_HERE, {base::ThreadPool()}, base::BindOnce(&F));
fdoraybacba4a22017-05-10 21:10:00651 auto task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23652 base::CreateSequencedTaskRunner({base::ThreadPool()});
fdoraybacba4a22017-05-10 21:10:00653 task_runner->PostTask(FROM_HERE, base::BindOnce(&G));
654
Gabriel Charette52fa3ae2019-04-15 21:44:37655 // To block until all tasks posted to thread pool are done running:
Gabriel Charette43fd3702019-05-29 16:36:51656 base::ThreadPoolInstance::Get()->FlushForTesting();
fdoraybacba4a22017-05-10 21:10:00657 // F and G have been executed.
658
Sami Kyostila831c60b2019-07-31 13:31:23659 base::PostTaskAndReplyWithResult(
fdoraybacba4a22017-05-10 21:10:00660 FROM_HERE, base::TaskTrait(),
661 base::BindOnce(&H), base::BindOnce(&I));
662
663 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until both the
664 // (Thread|Sequenced)TaskRunnerHandle queue and the TaskSchedule queue are
665 // empty:
Gabriel Charette694c3c332019-08-19 14:53:05666 task_environment_.RunUntilIdle();
fdoraybacba4a22017-05-10 21:10:00667 // E, H, I have been executed.
668}
669```
670
Gabriel Charette52fa3ae2019-04-15 21:44:37671## Using ThreadPool in a New Process
fdoraybacba4a22017-05-10 21:10:00672
Gabriel Charette43fd3702019-05-29 16:36:51673ThreadPoolInstance needs to be initialized in a process before the functions in
Gabriel Charette04b138f2018-08-06 00:03:22674[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette43fd3702019-05-29 16:36:51675can be used. Initialization of ThreadPoolInstance in the Chrome browser process
676and child processes (renderer, GPU, utility) has already been taken care of. To
677use ThreadPoolInstance in another process, initialize ThreadPoolInstance early
678in the main function:
fdoraybacba4a22017-05-10 21:10:00679
680```cpp
Gabriel Charette43fd3702019-05-29 16:36:51681// This initializes and starts ThreadPoolInstance with default params.
682base::ThreadPoolInstance::CreateAndStartWithDefaultParams(“process_name”);
683// The base/task/post_task.h API can now be used with base::ThreadPool trait.
684// Tasks will be // scheduled as they are posted.
fdoraybacba4a22017-05-10 21:10:00685
Gabriel Charette43fd3702019-05-29 16:36:51686// This initializes ThreadPoolInstance.
687base::ThreadPoolInstance::Create(“process_name”);
688// The base/task/post_task.h API can now be used with base::ThreadPool trait. No
689// threads will be created and no tasks will be scheduled until after Start() is
690// called.
691base::ThreadPoolInstance::Get()->Start(params);
Gabriel Charette52fa3ae2019-04-15 21:44:37692// ThreadPool can now create threads and schedule tasks.
fdoraybacba4a22017-05-10 21:10:00693```
694
Gabriel Charette43fd3702019-05-29 16:36:51695And shutdown ThreadPoolInstance late in the main function:
fdoraybacba4a22017-05-10 21:10:00696
697```cpp
Gabriel Charette43fd3702019-05-29 16:36:51698base::ThreadPoolInstance::Get()->Shutdown();
fdoraybacba4a22017-05-10 21:10:00699// Tasks posted with TaskShutdownBehavior::BLOCK_SHUTDOWN and
700// tasks posted with TaskShutdownBehavior::SKIP_ON_SHUTDOWN that
701// have started to run before the Shutdown() call have now completed their
702// execution. Tasks posted with
703// TaskShutdownBehavior::CONTINUE_ON_SHUTDOWN may still be
704// running.
705```
Gabriel Charetteb86e5fe62017-06-08 19:39:28706## TaskRunner ownership (encourage no dependency injection)
Sebastien Marchandc95489b2017-05-25 16:39:34707
708TaskRunners shouldn't be passed through several components. Instead, the
709components that uses a TaskRunner should be the one that creates it.
710
711See [this example](https://codereview.chromium.org/2885173002/) of a
712refactoring where a TaskRunner was passed through a lot of components only to be
713used in an eventual leaf. The leaf can and should now obtain its TaskRunner
714directly from
Gabriel Charette04b138f2018-08-06 00:03:22715[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h).
Gabriel Charetteb86e5fe62017-06-08 19:39:28716
Gabriel Charette694c3c332019-08-19 14:53:05717As mentioned above, `base::test::TaskEnvironment` allows unit tests to
Gabriel Charette39db4c62019-04-29 19:52:38718control tasks posted from underlying TaskRunners. In rare cases where a test
719needs to more precisely control task ordering: dependency injection of
720TaskRunners can be useful. For such cases the preferred approach is the
721following:
Gabriel Charetteb86e5fe62017-06-08 19:39:28722
723```cpp
Gabriel Charette39db4c62019-04-29 19:52:38724class Foo {
Gabriel Charetteb86e5fe62017-06-08 19:39:28725 public:
726
Gabriel Charette39db4c62019-04-29 19:52:38727 // Overrides |background_task_runner_| in tests.
Gabriel Charetteb86e5fe62017-06-08 19:39:28728 void SetBackgroundTaskRunnerForTesting(
Gabriel Charette39db4c62019-04-29 19:52:38729 scoped_refptr<base::SequencedTaskRunner> background_task_runner) {
730 background_task_runner_ = std::move(background_task_runner);
731 }
Gabriel Charetteb86e5fe62017-06-08 19:39:28732
733 private:
michaelpg12c04572017-06-26 23:25:06734 scoped_refptr<base::SequencedTaskRunner> background_task_runner_ =
Sami Kyostila831c60b2019-07-31 13:31:23735 base::CreateSequencedTaskRunner(
Gabriel Charetteb10aeeb2018-07-26 20:15:00736 {base::MayBlock(), base::TaskPriority::BEST_EFFORT});
Gabriel Charetteb86e5fe62017-06-08 19:39:28737}
738```
739
740Note that this still allows removing all layers of plumbing between //chrome and
741that component since unit tests will use the leaf layer directly.
Gabriel Charette8917f4c2018-11-22 15:50:28742
743## FAQ
744See [Threading and Tasks FAQ](threading_and_tasks_faq.md) for more examples.