blob: 73817d6e428f7085b9a220acd345b99aa2e426d3 [file] [log] [blame] [view]
fdoraybacba4a22017-05-10 21:10:001# Threading and Tasks in Chrome
2
3[TOC]
4
Gabriel Charette8917f4c2018-11-22 15:50:285Note: See [Threading and Tasks FAQ](threading_and_tasks_faq.md) for more
6examples.
7
fdoraybacba4a22017-05-10 21:10:008## Overview
9
Gabriel Charette39db4c62019-04-29 19:52:3810Chrome has a [multi-process
11architecture](https://www.chromium.org/developers/design-documents/multi-process-architecture)
12and each process is heavily multi-threaded. In this document we will go over the
13basic threading system shared by each process. The main goal is to keep the main
14thread (a.k.a. "UI" thread in the browser process) and IO thread (each process'
15thread for handling
16[IPC](https://en.wikipedia.org/wiki/Inter-process_communication)) responsive.
17This means offloading any blocking I/O or other expensive operations to other
18threads. Our approach is to use message passing as the way of communicating
19between threads. We discourage locking and thread-safe objects. Instead, objects
20live on only one (often virtual -- we'll get to that later!) thread and we pass
21messages between those threads for communication.
22
23This documentation assumes familiarity with computer science
24[threading concepts](https://en.wikipedia.org/wiki/Thread_(computing)).
Gabriel Charette90480312018-02-16 15:10:0525
Gabriel Charette364a16a2019-02-06 21:12:1526### Nomenclature
Gabriel Charette39db4c62019-04-29 19:52:3827
28## Core Concepts
29 * **Task**: A unit of work to be processed. Effectively a function pointer with
30 optionally associated state. In Chrome this is `base::Callback` created via
31 `base::Bind`
32 ([documentation](https://chromium.googlesource.com/chromium/src/+/HEAD/docs/callback.md)).
33 * **Task queue**: A queue of tasks to be processed.
34 * **Physical thread**: An operating system provided thread (e.g. pthread on
35 POSIX or CreateThread() on Windows). The Chrome cross-platform abstraction
36 is `base::PlatformThread`. You should pretty much never use this directly.
37 * **`base::Thread`**: A physical thread forever processing messages from a
38 dedicated task queue until Quit(). You should pretty much never be creating
39 your own `base::Thread`'s.
40 * **Thread pool**: A pool of physical threads with a shared task queue. In
Gabriel Charette43fd3702019-05-29 16:36:5141 Chrome, this is `base::ThreadPoolInstance`. There's exactly one instance per Chrome
Gabriel Charette39db4c62019-04-29 19:52:3842 process, it serves tasks posted through
43 [`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette43fd3702019-05-29 16:36:5144 and as such you should rarely need to use the `base::ThreadPoolInstance` API
Gabriel Charette39db4c62019-04-29 19:52:3845 directly (more on posting tasks later).
46 * **Sequence** or **Virtual thread**: A chrome-managed thread of execution.
47 Like a physical thread, only one task can run on a given sequence / virtual
48 thread at any given moment and each task sees the side-effects of the
49 preceding tasks. Tasks are executed sequentially but may hop physical
50 threads between each one.
51 * **Task runner**: An interface through which tasks can be posted. In Chrome
52 this is `base::TaskRunner`.
53 * **Sequenced task runner**: A task runner which guarantees that tasks posted
54 to it will run sequentially, in posted order. Each such task is guaranteed to
55 see the side-effects of the task preceding it. Tasks posted to a sequenced
56 task runner are typically processed by a single thread (virtual or physical).
57 In Chrome this is `base::SequencedTaskRunner` which is-a
58 `base::TaskRunner`.
59 * **Single-thread task runner**: A sequenced task runner which guarantees that
60 all tasks will be processed by the same physical thread. In Chrome this is
61 `base::SingleThreadTaskRunner` which is-a `base::SequencedTaskRunner`. We
62 [prefer sequences to threads](#prefer-sequences-to-physical-threads) whenever
63 possible.
64
65## Threading Lexicon
66Note to the reader: the following terms are an attempt to bridge the gap between
67common threading nomenclature and the way we use them in Chrome. It might be a
68bit heavy if you're just getting started. Should this be hard to parse, consider
69skipping to the more detailed sections below and referring back to this as
70necessary.
71
72 * **Thread-unsafe**: The vast majority of types in Chrome are thread-unsafe
73 (by design). Access to such types/methods must be externally synchronized.
74 Typically thread-unsafe types require that all tasks accessing their state be
75 posted to the same `base::SequencedTaskRunner` and they verify this in debug
76 builds with a `SEQUENCE_CHECKER` member. Locks are also an option to
77 synchronize access but in Chrome we strongly
78 [prefer sequences to locks](#Using-Sequences-Instead-of-Locks).
Gabriel Charette364a16a2019-02-06 21:12:1579 * **Thread-affine**: Such types/methods need to be always accessed from the
Gabriel Charetteb984d672019-02-12 21:53:2780 same physical thread (i.e. from the same `base::SingleThreadTaskRunner`) and
Gabriel Charette39db4c62019-04-29 19:52:3881 typically have a `THREAD_CHECKER` member to verify that they are. Short of
82 using a third-party API or having a leaf dependency which is thread-affine:
83 there's pretty much no reason for a type to be thread-affine in Chrome.
84 Note that `base::SingleThreadTaskRunner` is-a `base::SequencedTaskRunner` so
Gabriel Charetteb984d672019-02-12 21:53:2785 thread-affine is a subset of thread-unsafe. Thread-affine is also sometimes
86 referred to as **thread-hostile**.
Gabriel Charette364a16a2019-02-06 21:12:1587 * **Thread-safe**: Such types/methods can be safely accessed concurrently.
Gabriel Charetteb984d672019-02-12 21:53:2788 * **Thread-compatible**: Such types provide safe concurrent access to const
89 methods but require synchronization for non-const (or mixed const/non-const
Gabriel Charette39db4c62019-04-29 19:52:3890 access). Chrome doesn't expose reader-writer locks; as such, the only use
Gabriel Charetteb984d672019-02-12 21:53:2791 case for this is objects (typically globals) which are initialized once in a
Gabriel Charette364a16a2019-02-06 21:12:1592 thread-safe manner (either in the single-threaded phase of startup or lazily
93 through a thread-safe static-local-initialization paradigm a la
Gabriel Charetteb984d672019-02-12 21:53:2794 `base::NoDestructor`) and forever after immutable.
95 * **Immutable**: A subset of thread-compatible types which cannot be modified
96 after construction.
Gabriel Charette364a16a2019-02-06 21:12:1597 * **Sequence-friendly**: Such types/methods are thread-unsafe types which
98 support being invoked from a `base::SequencedTaskRunner`. Ideally this would
99 be the case for all thread-unsafe types but legacy code sometimes has
100 overzealous checks that enforce thread-affinity in mere thread-unsafe
Gabriel Charette39db4c62019-04-29 19:52:38101 scenarios. See [Prefer Sequences to
102 Threads](#prefer-sequences-to-physical-threads) below for more details.
Gabriel Charette364a16a2019-02-06 21:12:15103
fdoraybacba4a22017-05-10 21:10:00104### Threads
105
106Every Chrome process has
107
108* a main thread
Gabriel Charette39db4c62019-04-29 19:52:38109 * in the browser process (BrowserThread::UI): updates the UI
110 * in renderer processes (Blink main thread): runs most of Blink
fdoraybacba4a22017-05-10 21:10:00111* an IO thread
Gabriel Charette39db4c62019-04-29 19:52:38112 * in the browser process (BrowserThread::IO): handles IPCs and network requests
fdoraybacba4a22017-05-10 21:10:00113 * in renderer processes: handles IPCs
114* a few more special-purpose threads
115* and a pool of general-purpose threads
116
117Most threads have a loop that gets tasks from a queue and runs them (the queue
118may be shared between multiple threads).
119
120### Tasks
121
122A task is a `base::OnceClosure` added to a queue for asynchronous execution.
123
124A `base::OnceClosure` stores a function pointer and arguments. It has a `Run()`
125method that invokes the function pointer using the bound arguments. It is
126created using `base::BindOnce`. (ref. [Callback<> and Bind()
127documentation](callback.md)).
128
129```
130void TaskA() {}
131void TaskB(int v) {}
132
133auto task_a = base::BindOnce(&TaskA);
134auto task_b = base::BindOnce(&TaskB, 42);
135```
136
137A group of tasks can be executed in one of the following ways:
138
139* [Parallel](#Posting-a-Parallel-Task): No task execution ordering, possibly all
140 at once on any thread
141* [Sequenced](#Posting-a-Sequenced-Task): Tasks executed in posting order, one
142 at a time on any thread.
143* [Single Threaded](#Posting-Multiple-Tasks-to-the-Same-Thread): Tasks executed
144 in posting order, one at a time on a single thread.
Drew Stonebraker653a3ba2019-07-02 19:24:23145 * [COM Single Threaded](#Posting-Tasks-to-a-COM-Single_Thread-Apartment-STA_Thread-Windows):
fdoraybacba4a22017-05-10 21:10:00146 A variant of single threaded with COM initialized.
147
Gabriel Charette39db4c62019-04-29 19:52:38148### Prefer Sequences to Physical Threads
gab2a4576052017-06-07 23:36:12149
Gabriel Charette39db4c62019-04-29 19:52:38150Sequenced execution (on virtual threads) is strongly preferred to
151single-threaded execution (on physical threads). Except for types/methods bound
152to the main thread (UI) or IO threads: thread-safety is better achieved via
153`base::SequencedTaskRunner` than through managing your own physical threads
154(ref. [Posting a Sequenced Task](#posting-a-sequenced-task) below).
gab2a4576052017-06-07 23:36:12155
Gabriel Charette39db4c62019-04-29 19:52:38156All APIs which are exposed for "current physical thread" have an equivalent for
157"current sequence"
158([mapping](threading_and_tasks_faq.md#How-to-migrate-from-SingleThreadTaskRunner-to-SequencedTaskRunner)).
gab2a4576052017-06-07 23:36:12159
Gabriel Charette39db4c62019-04-29 19:52:38160If you find yourself writing a sequence-friendly type and it fails
161thread-affinity checks (e.g., `THREAD_CHECKER`) in a leaf dependency: consider
162making that dependency sequence-friendly as well. Most core APIs in Chrome are
163sequence-friendly, but some legacy types may still over-zealously use
164ThreadChecker/ThreadTaskRunnerHandle/SingleThreadTaskRunner when they could
165instead rely on the "current sequence" and no longer be thread-affine.
fdoraybacba4a22017-05-10 21:10:00166
167## Posting a Parallel Task
168
Gabriel Charette52fa3ae2019-04-15 21:44:37169### Direct Posting to the Thread Pool
fdoraybacba4a22017-05-10 21:10:00170
171A task that can run on any thread and doesn’t have ordering or mutual exclusion
172requirements with other tasks should be posted using one of the
173`base::PostTask*()` functions defined in
Gabriel Charette04b138f2018-08-06 00:03:22174[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h).
fdoraybacba4a22017-05-10 21:10:00175
176```cpp
177base::PostTask(FROM_HERE, base::BindOnce(&Task));
178```
179
180This posts tasks with default traits.
181
Sami Kyostila831c60b2019-07-31 13:31:23182The `base::PostTask*()` functions allow the caller to provide additional details
183about the task via TaskTraits (ref. [Annotating Tasks with TaskTraits](#Annotating-Tasks-with-TaskTraits)).
fdoraybacba4a22017-05-10 21:10:00184
185```cpp
Sami Kyostila831c60b2019-07-31 13:31:23186base::PostTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00187 FROM_HERE, {base::TaskPriority::BEST_EFFORT, MayBlock()},
fdoraybacba4a22017-05-10 21:10:00188 base::BindOnce(&Task));
189```
190
fdoray52bf5552017-05-11 12:43:59191### Posting via a TaskRunner
fdoraybacba4a22017-05-10 21:10:00192
193A parallel
Gabriel Charette39db4c62019-04-29 19:52:38194[`base::TaskRunner`](https://cs.chromium.org/chromium/src/base/task_runner.h) is
195an alternative to calling `base::PostTask*()` directly. This is mainly useful
196when it isn’t known in advance whether tasks will be posted in parallel, in
197sequence, or to a single-thread (ref. [Posting a Sequenced
198Task](#Posting-a-Sequenced-Task), [Posting Multiple Tasks to the Same
199Thread](#Posting-Multiple-Tasks-to-the-Same-Thread)). Since `base::TaskRunner`
200is the base class of `base::SequencedTaskRunner` and
201`base::SingleThreadTaskRunner`, a `scoped_refptr<TaskRunner>` member can hold a
202`base::TaskRunner`, a `base::SequencedTaskRunner` or a
203`base::SingleThreadTaskRunner`.
fdoraybacba4a22017-05-10 21:10:00204
205```cpp
206class A {
207 public:
208 A() = default;
209
fdoraybacba4a22017-05-10 21:10:00210 void DoSomething() {
fdoraybacba4a22017-05-10 21:10:00211 task_runner_->PostTask(FROM_HERE, base::BindOnce(&A));
212 }
213
214 private:
215 scoped_refptr<base::TaskRunner> task_runner_ =
Sami Kyostila831c60b2019-07-31 13:31:23216 base::CreateTaskRunner({base::TaskPriority::USER_VISIBLE});
fdoraybacba4a22017-05-10 21:10:00217};
218```
219
220Unless a test needs to control precisely how tasks are executed, it is preferred
221to call `base::PostTask*()` directly (ref. [Testing](#Testing) for less invasive
222ways of controlling tasks in tests).
223
224## Posting a Sequenced Task
225
226A sequence is a set of tasks that run one at a time in posting order (not
227necessarily on the same thread). To post tasks as part of a sequence, use a
Gabriel Charette39db4c62019-04-29 19:52:38228[`base::SequencedTaskRunner`](https://cs.chromium.org/chromium/src/base/sequenced_task_runner.h).
fdoraybacba4a22017-05-10 21:10:00229
230### Posting to a New Sequence
231
Gabriel Charette39db4c62019-04-29 19:52:38232A `base::SequencedTaskRunner` can be created by
Sami Kyostila831c60b2019-07-31 13:31:23233`base::CreateSequencedTaskRunner()`.
fdoraybacba4a22017-05-10 21:10:00234
235```cpp
236scoped_refptr<SequencedTaskRunner> sequenced_task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23237 base::CreateSequencedTaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00238
239// TaskB runs after TaskA completes.
240sequenced_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskA));
241sequenced_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskB));
242```
243
244### Posting to the Current Sequence
245
Gabriel Charette39db4c62019-04-29 19:52:38246The `base::SequencedTaskRunner` to which the current task was posted can be
247obtained via
248[`base::SequencedTaskRunnerHandle::Get()`](https://cs.chromium.org/chromium/src/base/threading/sequenced_task_runner_handle.h).
fdoraybacba4a22017-05-10 21:10:00249
250*** note
Gabriel Charette39db4c62019-04-29 19:52:38251**NOTE:** it is invalid to call `base::SequencedTaskRunnerHandle::Get()` from a
fdoraybacba4a22017-05-10 21:10:00252parallel task, but it is valid from a single-threaded task (a
Gabriel Charette39db4c62019-04-29 19:52:38253`base::SingleThreadTaskRunner` is a `base::SequencedTaskRunner`).
fdoraybacba4a22017-05-10 21:10:00254***
255
256```cpp
257// The task will run after any task that has already been posted
258// to the SequencedTaskRunner to which the current task was posted
259// (in particular, it will run after the current task completes).
260// It is also guaranteed that it won’t run concurrently with any
261// task posted to that SequencedTaskRunner.
262base::SequencedTaskRunnerHandle::Get()->
263 PostTask(FROM_HERE, base::BindOnce(&Task));
264```
265
266## Using Sequences Instead of Locks
267
268Usage of locks is discouraged in Chrome. Sequences inherently provide
Gabriel Charettea3ccc972018-11-13 14:43:12269thread-safety. Prefer classes that are always accessed from the same
270sequence to managing your own thread-safety with locks.
271
272**Thread-safe but not thread-affine; how so?** Tasks posted to the same sequence
273will run in sequential order. After a sequenced task completes, the next task
274may be picked up by a different worker thread, but that task is guaranteed to
275see any side-effects caused by the previous one(s) on its sequence.
fdoraybacba4a22017-05-10 21:10:00276
277```cpp
278class A {
279 public:
280 A() {
281 // Do not require accesses to be on the creation sequence.
isherman8c33b8a2017-06-27 19:18:30282 DETACH_FROM_SEQUENCE(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00283 }
284
285 void AddValue(int v) {
286 // Check that all accesses are on the same sequence.
isherman8c33b8a2017-06-27 19:18:30287 DCHECK_CALLED_ON_VALID_SEQUENCE(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00288 values_.push_back(v);
289}
290
291 private:
isherman8c33b8a2017-06-27 19:18:30292 SEQUENCE_CHECKER(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00293
294 // No lock required, because all accesses are on the
295 // same sequence.
296 std::vector<int> values_;
297};
298
299A a;
300scoped_refptr<SequencedTaskRunner> task_runner_for_a = ...;
Mike Bjorged3a09842018-05-15 18:37:28301task_runner_for_a->PostTask(FROM_HERE,
302 base::BindOnce(&A::AddValue, base::Unretained(&a), 42));
303task_runner_for_a->PostTask(FROM_HERE,
304 base::BindOnce(&A::AddValue, base::Unretained(&a), 27));
fdoraybacba4a22017-05-10 21:10:00305
306// Access from a different sequence causes a DCHECK failure.
307scoped_refptr<SequencedTaskRunner> other_task_runner = ...;
308other_task_runner->PostTask(FROM_HERE,
Mike Bjorged3a09842018-05-15 18:37:28309 base::BindOnce(&A::AddValue, base::Unretained(&a), 1));
fdoraybacba4a22017-05-10 21:10:00310```
311
Gabriel Charette90480312018-02-16 15:10:05312Locks should only be used to swap in a shared data structure that can be
313accessed on multiple threads. If one thread updates it based on expensive
314computation or through disk access, then that slow work should be done without
Gabriel Charette39db4c62019-04-29 19:52:38315holding the lock. Only when the result is available should the lock be used to
316swap in the new data. An example of this is in PluginList::LoadPlugins
317([`content/browser/plugin_list.cc`](https://cs.chromium.org/chromium/src/content/browser/plugin_list.cc).
318If you must use locks,
Gabriel Charette90480312018-02-16 15:10:05319[here](https://www.chromium.org/developers/lock-and-condition-variable) are some
320best practices and pitfalls to avoid.
321
Gabriel Charette39db4c62019-04-29 19:52:38322In order to write non-blocking code, many APIs in Chrome are asynchronous.
Gabriel Charette90480312018-02-16 15:10:05323Usually this means that they either need to be executed on a particular
324thread/sequence and will return results via a custom delegate interface, or they
325take a `base::Callback<>` object that is called when the requested operation is
326completed. Executing work on a specific thread/sequence is covered in the
327PostTask sections above.
328
fdoraybacba4a22017-05-10 21:10:00329## Posting Multiple Tasks to the Same Thread
330
331If multiple tasks need to run on the same thread, post them to a
Gabriel Charette39db4c62019-04-29 19:52:38332[`base::SingleThreadTaskRunner`](https://cs.chromium.org/chromium/src/base/single_thread_task_runner.h).
333All tasks posted to the same `base::SingleThreadTaskRunner` run on the same thread in
fdoraybacba4a22017-05-10 21:10:00334posting order.
335
336### Posting to the Main Thread or to the IO Thread in the Browser Process
337
Eric Seckler6cf08db82018-08-30 12:01:55338To post tasks to the main thread or to the IO thread, use
Sami Kyostila831c60b2019-07-31 13:31:23339`base::PostTask()` or get the appropriate SingleThreadTaskRunner using
340`base::CreateSingleThreadTaskRunner`, supplying a `BrowserThread::ID`
Eric Seckler6cf08db82018-08-30 12:01:55341as trait. For this, you'll also need to include
342[`content/public/browser/browser_task_traits.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_task_traits.h).
fdoraybacba4a22017-05-10 21:10:00343
344```cpp
Sami Kyostila831c60b2019-07-31 13:31:23345base::PostTask(FROM_HERE, {content::BrowserThread::UI}, ...);
fdoraybacba4a22017-05-10 21:10:00346
Sami Kyostila831c60b2019-07-31 13:31:23347base::CreateSingleThreadTaskRunner({content::BrowserThread::IO})
fdoraybacba4a22017-05-10 21:10:00348 ->PostTask(FROM_HERE, ...);
349```
350
351The main thread and the IO thread are already super busy. Therefore, prefer
fdoray52bf5552017-05-11 12:43:59352posting to a general purpose thread when possible (ref.
353[Posting a Parallel Task](#Posting-a-Parallel-Task),
354[Posting a Sequenced task](#Posting-a-Sequenced-Task)).
355Good reasons to post to the main thread are to update the UI or access objects
356that are bound to it (e.g. `Profile`). A good reason to post to the IO thread is
357to access the internals of components that are bound to it (e.g. IPCs, network).
358Note: It is not necessary to have an explicit post task to the IO thread to
359send/receive an IPC or send/receive data on the network.
fdoraybacba4a22017-05-10 21:10:00360
361### Posting to the Main Thread in a Renderer Process
362TODO
363
364### Posting to a Custom SingleThreadTaskRunner
365
366If multiple tasks need to run on the same thread and that thread doesn’t have to
Gabriel Charette39db4c62019-04-29 19:52:38367be the main thread or the IO thread, post them to a `base::SingleThreadTaskRunner`
Sami Kyostila831c60b2019-07-31 13:31:23368created by `base::CreateSingleThreadTaskRunner`.
fdoraybacba4a22017-05-10 21:10:00369
370```cpp
Dominic Farolinodbe9769b2019-05-31 04:06:03371scoped_refptr<SingleThreadTaskRunner> single_thread_task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23372 base::CreateSingleThreadTaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00373
374// TaskB runs after TaskA completes. Both tasks run on the same thread.
375single_thread_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskA));
376single_thread_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskB));
377```
378
Gabriel Charette39db4c62019-04-29 19:52:38379Remember that we [prefer sequences to physical
380threads](#prefer-sequences-to-physical-threads) and that this thus should rarely
381be necessary.
fdoraybacba4a22017-05-10 21:10:00382
383### Posting to the Current Thread
384
385*** note
386**IMPORTANT:** To post a task that needs mutual exclusion with the current
387sequence of tasks but doesn’t absolutely need to run on the current thread, use
Gabriel Charette39db4c62019-04-29 19:52:38388`base::SequencedTaskRunnerHandle::Get()` instead of
389`base::ThreadTaskRunnerHandle::Get()` (ref. [Posting to the Current
390Sequence](#Posting-to-the-Current-Sequence)). That will better document the
391requirements of the posted task and will avoid unnecessarily making your API
392thread-affine. In a single-thread task, `base::SequencedTaskRunnerHandle::Get()`
393is equivalent to `base::ThreadTaskRunnerHandle::Get()`.
fdoraybacba4a22017-05-10 21:10:00394***
395
Gabriel Charette39db4c62019-04-29 19:52:38396To post a task to the current thread, use
397[`base::ThreadTaskRunnerHandle`](https://cs.chromium.org/chromium/src/base/threading/thread_task_runner_handle.h).
fdoraybacba4a22017-05-10 21:10:00398
399```cpp
400// The task will run on the current thread in the future.
401base::ThreadTaskRunnerHandle::Get()->PostTask(
402 FROM_HERE, base::BindOnce(&Task));
403```
404
405*** note
Gabriel Charette39db4c62019-04-29 19:52:38406**NOTE:** It is invalid to call `base::ThreadTaskRunnerHandle::Get()` from a parallel
fdoraybacba4a22017-05-10 21:10:00407or a sequenced task.
408***
409
410## Posting Tasks to a COM Single-Thread Apartment (STA) Thread (Windows)
411
412Tasks that need to run on a COM Single-Thread Apartment (STA) thread must be
Gabriel Charette39db4c62019-04-29 19:52:38413posted to a `base::SingleThreadTaskRunner` returned by
Sami Kyostila831c60b2019-07-31 13:31:23414`base::CreateCOMSTATaskRunner()`. As mentioned in [Posting Multiple Tasks to the
415Same Thread](#Posting-Multiple-Tasks-to-the-Same-Thread), all tasks posted to
416the same `base::SingleThreadTaskRunner` run on the same thread in posting order.
fdoraybacba4a22017-05-10 21:10:00417
418```cpp
419// Task(A|B|C)UsingCOMSTA will run on the same COM STA thread.
420
421void TaskAUsingCOMSTA() {
422 // [ This runs on a COM STA thread. ]
423
424 // Make COM STA calls.
425 // ...
426
427 // Post another task to the current COM STA thread.
428 base::ThreadTaskRunnerHandle::Get()->PostTask(
429 FROM_HERE, base::BindOnce(&TaskCUsingCOMSTA));
430}
431void TaskBUsingCOMSTA() { }
432void TaskCUsingCOMSTA() { }
433
Sami Kyostila831c60b2019-07-31 13:31:23434auto com_sta_task_runner = base::CreateCOMSTATaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00435com_sta_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskAUsingCOMSTA));
436com_sta_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskBUsingCOMSTA));
437```
438
439## Annotating Tasks with TaskTraits
440
Gabriel Charette39db4c62019-04-29 19:52:38441[`base::TaskTraits`](https://cs.chromium.org/chromium/src/base/task/task_traits.h)
Gabriel Charette52fa3ae2019-04-15 21:44:37442encapsulate information about a task that helps the thread pool make better
fdoraybacba4a22017-05-10 21:10:00443scheduling decisions.
444
Gabriel Charette39db4c62019-04-29 19:52:38445All `base::PostTask*()` functions in
Gabriel Charette04b138f2018-08-06 00:03:22446[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette39db4c62019-04-29 19:52:38447have an overload that takes `base::TaskTraits` as argument and one that doesn’t.
448The overload that doesn’t take `base::TaskTraits` as argument is appropriate for
449tasks that:
fdoraybacba4a22017-05-10 21:10:00450- Don’t block (ref. MayBlock and WithBaseSyncPrimitives).
451- Prefer inheriting the current priority to specifying their own.
Gabriel Charette52fa3ae2019-04-15 21:44:37452- Can either block shutdown or be skipped on shutdown (thread pool is free to
453 choose a fitting default).
fdoraybacba4a22017-05-10 21:10:00454Tasks that don’t match this description must be posted with explicit TaskTraits.
455
Gabriel Charette04b138f2018-08-06 00:03:22456[`base/task/task_traits.h`](https://cs.chromium.org/chromium/src/base/task/task_traits.h)
Eric Seckler6cf08db82018-08-30 12:01:55457provides exhaustive documentation of available traits. The content layer also
458provides additional traits in
459[`content/public/browser/browser_task_traits.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_task_traits.h)
460to facilitate posting a task onto a BrowserThread.
461
Gabriel Charette39db4c62019-04-29 19:52:38462Below are some examples of how to specify `base::TaskTraits`.
fdoraybacba4a22017-05-10 21:10:00463
464```cpp
465// This task has no explicit TaskTraits. It cannot block. Its priority
466// is inherited from the calling context (e.g. if it is posted from
Gabriel Charette141a442582018-07-27 21:23:25467// a BEST_EFFORT task, it will have a BEST_EFFORT priority). It will either
fdoraybacba4a22017-05-10 21:10:00468// block shutdown or be skipped on shutdown.
469base::PostTask(FROM_HERE, base::BindOnce(...));
470
Gabriel Charette52fa3ae2019-04-15 21:44:37471// This task has the highest priority. The thread pool will try to
Gabriel Charette141a442582018-07-27 21:23:25472// run it before USER_VISIBLE and BEST_EFFORT tasks.
Sami Kyostila831c60b2019-07-31 13:31:23473base::PostTask(
fdoraybacba4a22017-05-10 21:10:00474 FROM_HERE, {base::TaskPriority::USER_BLOCKING},
475 base::BindOnce(...));
476
477// This task has the lowest priority and is allowed to block (e.g. it
478// can read a file from disk).
Sami Kyostila831c60b2019-07-31 13:31:23479base::PostTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00480 FROM_HERE, {base::TaskPriority::BEST_EFFORT, base::MayBlock()},
fdoraybacba4a22017-05-10 21:10:00481 base::BindOnce(...));
482
483// This task blocks shutdown. The process won't exit before its
484// execution is complete.
Sami Kyostila831c60b2019-07-31 13:31:23485base::PostTask(
fdoraybacba4a22017-05-10 21:10:00486 FROM_HERE, {base::TaskShutdownBehavior::BLOCK_SHUTDOWN},
487 base::BindOnce(...));
Eric Seckler6cf08db82018-08-30 12:01:55488
489// This task will run on the Browser UI thread.
Sami Kyostila831c60b2019-07-31 13:31:23490base::PostTask(
Eric Seckler6cf08db82018-08-30 12:01:55491 FROM_HERE, {content::BrowserThread::UI},
492 base::BindOnce(...));
fdoraybacba4a22017-05-10 21:10:00493```
494
495## Keeping the Browser Responsive
496
497Do not perform expensive work on the main thread, the IO thread or any sequence
498that is expected to run tasks with a low latency. Instead, perform expensive
499work asynchronously using `base::PostTaskAndReply*()` or
Gabriel Charette39db4c62019-04-29 19:52:38500`base::SequencedTaskRunner::PostTaskAndReply()`. Note that
501asynchronous/overlapped I/O on the IO thread are fine.
fdoraybacba4a22017-05-10 21:10:00502
503Example: Running the code below on the main thread will prevent the browser from
504responding to user input for a long time.
505
506```cpp
507// GetHistoryItemsFromDisk() may block for a long time.
508// AddHistoryItemsToOmniboxDropDown() updates the UI and therefore must
509// be called on the main thread.
510AddHistoryItemsToOmniboxDropdown(GetHistoryItemsFromDisk("keyword"));
511```
512
513The code below solves the problem by scheduling a call to
514`GetHistoryItemsFromDisk()` in a thread pool followed by a call to
515`AddHistoryItemsToOmniboxDropdown()` on the origin sequence (the main thread in
516this case). The return value of the first call is automatically provided as
517argument to the second call.
518
519```cpp
Sami Kyostila831c60b2019-07-31 13:31:23520base::PostTaskAndReplyWithResult(
fdoraybacba4a22017-05-10 21:10:00521 FROM_HERE, {base::MayBlock()},
522 base::BindOnce(&GetHistoryItemsFromDisk, "keyword"),
523 base::BindOnce(&AddHistoryItemsToOmniboxDropdown));
524```
525
526## Posting a Task with a Delay
527
528### Posting a One-Off Task with a Delay
529
530To post a task that must run once after a delay expires, use
Gabriel Charette39db4c62019-04-29 19:52:38531`base::PostDelayedTask*()` or `base::TaskRunner::PostDelayedTask()`.
fdoraybacba4a22017-05-10 21:10:00532
533```cpp
Sami Kyostila831c60b2019-07-31 13:31:23534base::PostDelayedTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00535 FROM_HERE, {base::TaskPriority::BEST_EFFORT}, base::BindOnce(&Task),
fdoraybacba4a22017-05-10 21:10:00536 base::TimeDelta::FromHours(1));
537
538scoped_refptr<base::SequencedTaskRunner> task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23539 base::CreateSequencedTaskRunner({base::TaskPriority::BEST_EFFORT});
fdoraybacba4a22017-05-10 21:10:00540task_runner->PostDelayedTask(
541 FROM_HERE, base::BindOnce(&Task), base::TimeDelta::FromHours(1));
542```
543
544*** note
545**NOTE:** A task that has a 1-hour delay probably doesn’t have to run right away
Gabriel Charetteb10aeeb2018-07-26 20:15:00546when its delay expires. Specify `base::TaskPriority::BEST_EFFORT` to prevent it
fdoraybacba4a22017-05-10 21:10:00547from slowing down the browser when its delay expires.
548***
549
550### Posting a Repeating Task with a Delay
551To post a task that must run at regular intervals,
552use [`base::RepeatingTimer`](https://cs.chromium.org/chromium/src/base/timer/timer.h).
553
554```cpp
555class A {
556 public:
557 ~A() {
558 // The timer is stopped automatically when it is deleted.
559 }
560 void StartDoingStuff() {
561 timer_.Start(FROM_HERE, TimeDelta::FromSeconds(1),
562 this, &MyClass::DoStuff);
563 }
564 void StopDoingStuff() {
565 timer_.Stop();
566 }
567 private:
568 void DoStuff() {
569 // This method is called every second on the sequence that invoked
570 // StartDoingStuff().
571 }
572 base::RepeatingTimer timer_;
573};
574```
575
576## Cancelling a Task
577
578### Using base::WeakPtr
579
580[`base::WeakPtr`](https://cs.chromium.org/chromium/src/base/memory/weak_ptr.h)
581can be used to ensure that any callback bound to an object is canceled when that
582object is destroyed.
583
584```cpp
585int Compute() { … }
586
587class A {
588 public:
fdoraybacba4a22017-05-10 21:10:00589 void ComputeAndStore() {
590 // Schedule a call to Compute() in a thread pool followed by
591 // a call to A::Store() on the current sequence. The call to
592 // A::Store() is canceled when |weak_ptr_factory_| is destroyed.
593 // (guarantees that |this| will not be used-after-free).
594 base::PostTaskAndReplyWithResult(
595 FROM_HERE, base::BindOnce(&Compute),
596 base::BindOnce(&A::Store, weak_ptr_factory_.GetWeakPtr()));
597 }
598
599 private:
600 void Store(int value) { value_ = value; }
601
602 int value_;
Jeremy Roman0dd0b2f2019-07-16 21:00:43603 base::WeakPtrFactory<A> weak_ptr_factory_{this};
fdoraybacba4a22017-05-10 21:10:00604};
605```
606
607Note: `WeakPtr` is not thread-safe: `GetWeakPtr()`, `~WeakPtrFactory()`, and
608`Compute()` (bound to a `WeakPtr`) must all run on the same sequence.
609
610### Using base::CancelableTaskTracker
611
612[`base::CancelableTaskTracker`](https://cs.chromium.org/chromium/src/base/task/cancelable_task_tracker.h)
613allows cancellation to happen on a different sequence than the one on which
614tasks run. Keep in mind that `CancelableTaskTracker` cannot cancel tasks that
615have already started to run.
616
617```cpp
Sami Kyostila831c60b2019-07-31 13:31:23618auto task_runner = base::CreateTaskRunner({base::ThreadPool()});
fdoraybacba4a22017-05-10 21:10:00619base::CancelableTaskTracker cancelable_task_tracker;
620cancelable_task_tracker.PostTask(task_runner.get(), FROM_HERE,
Peter Kasting341e1fb2018-02-24 00:03:01621 base::DoNothing());
fdoraybacba4a22017-05-10 21:10:00622// Cancels Task(), only if it hasn't already started running.
623cancelable_task_tracker.TryCancelAll();
624```
625
626## Testing
627
628To test code that uses `base::ThreadTaskRunnerHandle`,
629`base::SequencedTaskRunnerHandle` or a function in
Gabriel Charette39db4c62019-04-29 19:52:38630[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h),
631instantiate a
fdoraybacba4a22017-05-10 21:10:00632[`base::test::ScopedTaskEnvironment`](https://cs.chromium.org/chromium/src/base/test/scoped_task_environment.h)
Gabriel Charette39db4c62019-04-29 19:52:38633for the scope of the test. If you need BrowserThreads, use
634`content::TestBrowserThreadBundle` instead of
635`base::test::ScopedTaskEnvironment`.
fdoraybacba4a22017-05-10 21:10:00636
Gabriel Charette39db4c62019-04-29 19:52:38637Tests can run the `base::test::ScopedTaskEnvironment`'s message pump using a
638`base::RunLoop`, which can be made to run until `Quit()` (explicitly or via
639`RunLoop::QuitClosure()`), or to `RunUntilIdle()` ready-to-run tasks and
640immediately return.
Wezd9e4cb772019-01-09 03:07:03641
642ScopedTaskEnvironment configures RunLoop::Run() to LOG(FATAL) if it hasn't been
643explicitly quit after TestTimeouts::action_timeout(). This is preferable to
644having the test hang if the code under test fails to trigger the RunLoop to
645quit. The timeout can be overridden with ScopedRunTimeoutForTest.
646
fdoraybacba4a22017-05-10 21:10:00647```cpp
648class MyTest : public testing::Test {
649 public:
650 // ...
651 protected:
652 base::test::ScopedTaskEnvironment scoped_task_environment_;
653};
654
655TEST(MyTest, MyTest) {
656 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&A));
657 base::SequencedTaskRunnerHandle::Get()->PostTask(FROM_HERE,
658 base::BindOnce(&B));
659 base::ThreadTaskRunnerHandle::Get()->PostDelayedTask(
660 FROM_HERE, base::BindOnce(&C), base::TimeDelta::Max());
661
662 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until it is empty.
663 // Delayed tasks are not added to the queue until they are ripe for execution.
664 base::RunLoop().RunUntilIdle();
665 // A and B have been executed. C is not ripe for execution yet.
666
667 base::RunLoop run_loop;
668 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&D));
669 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, run_loop.QuitClosure());
670 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&E));
671
672 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until QuitClosure is
673 // invoked.
674 run_loop.Run();
675 // D and run_loop.QuitClosure() have been executed. E is still in the queue.
676
Gabriel Charette52fa3ae2019-04-15 21:44:37677 // Tasks posted to thread pool run asynchronously as they are posted.
Sami Kyostila831c60b2019-07-31 13:31:23678 base::PostTask(FROM_HERE, {base::ThreadPool()}, base::BindOnce(&F));
fdoraybacba4a22017-05-10 21:10:00679 auto task_runner =
Sami Kyostila831c60b2019-07-31 13:31:23680 base::CreateSequencedTaskRunner({base::ThreadPool()});
fdoraybacba4a22017-05-10 21:10:00681 task_runner->PostTask(FROM_HERE, base::BindOnce(&G));
682
Gabriel Charette52fa3ae2019-04-15 21:44:37683 // To block until all tasks posted to thread pool are done running:
Gabriel Charette43fd3702019-05-29 16:36:51684 base::ThreadPoolInstance::Get()->FlushForTesting();
fdoraybacba4a22017-05-10 21:10:00685 // F and G have been executed.
686
Sami Kyostila831c60b2019-07-31 13:31:23687 base::PostTaskAndReplyWithResult(
fdoraybacba4a22017-05-10 21:10:00688 FROM_HERE, base::TaskTrait(),
689 base::BindOnce(&H), base::BindOnce(&I));
690
691 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until both the
692 // (Thread|Sequenced)TaskRunnerHandle queue and the TaskSchedule queue are
693 // empty:
694 scoped_task_environment_.RunUntilIdle();
695 // E, H, I have been executed.
696}
697```
698
Gabriel Charette52fa3ae2019-04-15 21:44:37699## Using ThreadPool in a New Process
fdoraybacba4a22017-05-10 21:10:00700
Gabriel Charette43fd3702019-05-29 16:36:51701ThreadPoolInstance needs to be initialized in a process before the functions in
Gabriel Charette04b138f2018-08-06 00:03:22702[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette43fd3702019-05-29 16:36:51703can be used. Initialization of ThreadPoolInstance in the Chrome browser process
704and child processes (renderer, GPU, utility) has already been taken care of. To
705use ThreadPoolInstance in another process, initialize ThreadPoolInstance early
706in the main function:
fdoraybacba4a22017-05-10 21:10:00707
708```cpp
Gabriel Charette43fd3702019-05-29 16:36:51709// This initializes and starts ThreadPoolInstance with default params.
710base::ThreadPoolInstance::CreateAndStartWithDefaultParams(“process_name”);
711// The base/task/post_task.h API can now be used with base::ThreadPool trait.
712// Tasks will be // scheduled as they are posted.
fdoraybacba4a22017-05-10 21:10:00713
Gabriel Charette43fd3702019-05-29 16:36:51714// This initializes ThreadPoolInstance.
715base::ThreadPoolInstance::Create(“process_name”);
716// The base/task/post_task.h API can now be used with base::ThreadPool trait. No
717// threads will be created and no tasks will be scheduled until after Start() is
718// called.
719base::ThreadPoolInstance::Get()->Start(params);
Gabriel Charette52fa3ae2019-04-15 21:44:37720// ThreadPool can now create threads and schedule tasks.
fdoraybacba4a22017-05-10 21:10:00721```
722
Gabriel Charette43fd3702019-05-29 16:36:51723And shutdown ThreadPoolInstance late in the main function:
fdoraybacba4a22017-05-10 21:10:00724
725```cpp
Gabriel Charette43fd3702019-05-29 16:36:51726base::ThreadPoolInstance::Get()->Shutdown();
fdoraybacba4a22017-05-10 21:10:00727// Tasks posted with TaskShutdownBehavior::BLOCK_SHUTDOWN and
728// tasks posted with TaskShutdownBehavior::SKIP_ON_SHUTDOWN that
729// have started to run before the Shutdown() call have now completed their
730// execution. Tasks posted with
731// TaskShutdownBehavior::CONTINUE_ON_SHUTDOWN may still be
732// running.
733```
Gabriel Charetteb86e5fe62017-06-08 19:39:28734## TaskRunner ownership (encourage no dependency injection)
Sebastien Marchandc95489b2017-05-25 16:39:34735
736TaskRunners shouldn't be passed through several components. Instead, the
737components that uses a TaskRunner should be the one that creates it.
738
739See [this example](https://codereview.chromium.org/2885173002/) of a
740refactoring where a TaskRunner was passed through a lot of components only to be
741used in an eventual leaf. The leaf can and should now obtain its TaskRunner
742directly from
Gabriel Charette04b138f2018-08-06 00:03:22743[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h).
Gabriel Charetteb86e5fe62017-06-08 19:39:28744
Gabriel Charette39db4c62019-04-29 19:52:38745As mentioned above, `base::test::ScopedTaskEnvironment` allows unit tests to
746control tasks posted from underlying TaskRunners. In rare cases where a test
747needs to more precisely control task ordering: dependency injection of
748TaskRunners can be useful. For such cases the preferred approach is the
749following:
Gabriel Charetteb86e5fe62017-06-08 19:39:28750
751```cpp
Gabriel Charette39db4c62019-04-29 19:52:38752class Foo {
Gabriel Charetteb86e5fe62017-06-08 19:39:28753 public:
754
Gabriel Charette39db4c62019-04-29 19:52:38755 // Overrides |background_task_runner_| in tests.
Gabriel Charetteb86e5fe62017-06-08 19:39:28756 void SetBackgroundTaskRunnerForTesting(
Gabriel Charette39db4c62019-04-29 19:52:38757 scoped_refptr<base::SequencedTaskRunner> background_task_runner) {
758 background_task_runner_ = std::move(background_task_runner);
759 }
Gabriel Charetteb86e5fe62017-06-08 19:39:28760
761 private:
michaelpg12c04572017-06-26 23:25:06762 scoped_refptr<base::SequencedTaskRunner> background_task_runner_ =
Sami Kyostila831c60b2019-07-31 13:31:23763 base::CreateSequencedTaskRunner(
Gabriel Charetteb10aeeb2018-07-26 20:15:00764 {base::MayBlock(), base::TaskPriority::BEST_EFFORT});
Gabriel Charetteb86e5fe62017-06-08 19:39:28765}
766```
767
768Note that this still allows removing all layers of plumbing between //chrome and
769that component since unit tests will use the leaf layer directly.
Gabriel Charette8917f4c2018-11-22 15:50:28770
771## FAQ
772See [Threading and Tasks FAQ](threading_and_tasks_faq.md) for more examples.