blob: 0da7216c63a54be8d2f9d98b5ddcfb92f27d727f [file] [log] [blame] [view]
fdoraybacba4a22017-05-10 21:10:001# Threading and Tasks in Chrome
2
3[TOC]
4
Gabriel Charette8917f4c2018-11-22 15:50:285Note: See [Threading and Tasks FAQ](threading_and_tasks_faq.md) for more
6examples.
7
fdoraybacba4a22017-05-10 21:10:008## Overview
9
Gabriel Charette39db4c62019-04-29 19:52:3810Chrome has a [multi-process
11architecture](https://www.chromium.org/developers/design-documents/multi-process-architecture)
12and each process is heavily multi-threaded. In this document we will go over the
Charlie Harrisonbda54652023-11-17 21:20:0613basic threading system shared by each process. Our primary goal is to keep the
14browser highly responsive. Absent external requirements about latency or
15workload, Chrome attempts to be a [highly concurrent, but not necessarily
Matt Falkenhagen72a2dfc2021-08-05 22:36:1316parallel](https://stackoverflow.com/questions/1050222/what-is-the-difference-between-concurrency-and-parallelism#:~:text=Concurrency%20is%20when%20two%20or,e.g.%2C%20on%20a%20multicore%20processor.),
Jared Saulea867ab2021-07-15 17:39:0117system.
Gabriel Charette39db4c62019-04-29 19:52:3818
cfredricff6d86c2022-02-15 16:26:1119A basic intro to the way Chromium does concurrency (especially Sequences) can be
20found
21[here](https://docs.google.com/presentation/d/1ujV8LjIUyPBmULzdT2aT9Izte8PDwbJi).
22
Gabriel Charette39db4c62019-04-29 19:52:3823This documentation assumes familiarity with computer science
24[threading concepts](https://en.wikipedia.org/wiki/Thread_(computing)).
Gabriel Charette90480312018-02-16 15:10:0525
Charlie Harrisonbda54652023-11-17 21:20:0626### Quick start guide
27
28 * Do not perform expensive computation or blocking IO on the main thread
29 (a.k.a. “UI” thread in the browser process) or IO thread (each
30 process's thread for receiving IPC). A busy UI / IO thread can cause
31 user-visible latency, so prefer running that work on the
32 [thread pool](#direct-posting-to-the-thread-pool).
33 * Always avoid reading/writing to the same place in memory from separate
34 threads or sequences. This will lead to
35 [data races](https://en.wikipedia.org/wiki/Race_condition#Data_race)!
36 Prefer passing messages across sequences instead. Alternatives to message
37 passing like using locks is discouraged.
38 * To prevent accidental data races, prefer for most classes to be used
39 exclusively on a single sequence. You should use utilities like
40 [SEQUENCE_CHECKER](https://source.chromium.org/chromium/chromium/src/+/main:base/sequence_checker.h)
41 or [base::SequenceBound](https://source.chromium.org/chromium/chromium/src/+/main:base/threading/sequence_bound.h)
42 to help enforce this constraint.
43 * If you need to orchestrate multiple objects that live on different
44 sequences, be careful about object lifetimes. For example,
45 using [base::Unretained](https://source.chromium.org/chromium/chromium/src/+/main:base/functional/bind.h;l=169;drc=ef1375f2c9fffa0d9cd664b43b0035c09fb70e99)
46 in posted tasks can often lead to use-after-free bugs without careful
47 analysis of object lifetimes. Consider whether you need to use
48 [weak pointers](https://source.chromium.org/chromium/chromium/src/+/main:base/memory/weak_ptr.h)
49 or [scoped refptrs](https://source.chromium.org/chromium/chromium/src/+/main:base/memory/scoped_refptr.h)
50 instead.
51
Gabriel Charette364a16a2019-02-06 21:12:1552### Nomenclature
Gabriel Charette39db4c62019-04-29 19:52:3853
54## Core Concepts
55 * **Task**: A unit of work to be processed. Effectively a function pointer with
Alex St-Onge490a97a2021-02-04 02:47:1956 optionally associated state. In Chrome this is `base::OnceCallback` and
57 `base::RepeatingCallback` created via `base::BindOnce` and
58 `base::BindRepeating`, respectively.
Gabriel Charette39db4c62019-04-29 19:52:3859 ([documentation](https://chromium.googlesource.com/chromium/src/+/HEAD/docs/callback.md)).
60 * **Task queue**: A queue of tasks to be processed.
61 * **Physical thread**: An operating system provided thread (e.g. pthread on
62 POSIX or CreateThread() on Windows). The Chrome cross-platform abstraction
63 is `base::PlatformThread`. You should pretty much never use this directly.
64 * **`base::Thread`**: A physical thread forever processing messages from a
65 dedicated task queue until Quit(). You should pretty much never be creating
66 your own `base::Thread`'s.
67 * **Thread pool**: A pool of physical threads with a shared task queue. In
Gabriel Charette0b20ee62019-09-18 14:06:1268 Chrome, this is `base::ThreadPoolInstance`. There's exactly one instance per
69 Chrome process, it serves tasks posted through
Gabriel Charette9b6c04072022-04-01 23:22:4670 [`base/task/thread_pool.h`](https://cs.chromium.org/chromium/src/base/task/thread_pool.h)
Gabriel Charette43fd3702019-05-29 16:36:5171 and as such you should rarely need to use the `base::ThreadPoolInstance` API
Gabriel Charette39db4c62019-04-29 19:52:3872 directly (more on posting tasks later).
73 * **Sequence** or **Virtual thread**: A chrome-managed thread of execution.
74 Like a physical thread, only one task can run on a given sequence / virtual
75 thread at any given moment and each task sees the side-effects of the
76 preceding tasks. Tasks are executed sequentially but may hop physical
77 threads between each one.
78 * **Task runner**: An interface through which tasks can be posted. In Chrome
79 this is `base::TaskRunner`.
80 * **Sequenced task runner**: A task runner which guarantees that tasks posted
81 to it will run sequentially, in posted order. Each such task is guaranteed to
82 see the side-effects of the task preceding it. Tasks posted to a sequenced
83 task runner are typically processed by a single thread (virtual or physical).
84 In Chrome this is `base::SequencedTaskRunner` which is-a
85 `base::TaskRunner`.
86 * **Single-thread task runner**: A sequenced task runner which guarantees that
87 all tasks will be processed by the same physical thread. In Chrome this is
88 `base::SingleThreadTaskRunner` which is-a `base::SequencedTaskRunner`. We
89 [prefer sequences to threads](#prefer-sequences-to-physical-threads) whenever
90 possible.
91
92## Threading Lexicon
93Note to the reader: the following terms are an attempt to bridge the gap between
94common threading nomenclature and the way we use them in Chrome. It might be a
95bit heavy if you're just getting started. Should this be hard to parse, consider
96skipping to the more detailed sections below and referring back to this as
97necessary.
98
99 * **Thread-unsafe**: The vast majority of types in Chrome are thread-unsafe
100 (by design). Access to such types/methods must be externally synchronized.
101 Typically thread-unsafe types require that all tasks accessing their state be
102 posted to the same `base::SequencedTaskRunner` and they verify this in debug
103 builds with a `SEQUENCE_CHECKER` member. Locks are also an option to
104 synchronize access but in Chrome we strongly
105 [prefer sequences to locks](#Using-Sequences-Instead-of-Locks).
Gabriel Charette364a16a2019-02-06 21:12:15106 * **Thread-affine**: Such types/methods need to be always accessed from the
Gabriel Charetteb984d672019-02-12 21:53:27107 same physical thread (i.e. from the same `base::SingleThreadTaskRunner`) and
Gabriel Charette39db4c62019-04-29 19:52:38108 typically have a `THREAD_CHECKER` member to verify that they are. Short of
109 using a third-party API or having a leaf dependency which is thread-affine:
110 there's pretty much no reason for a type to be thread-affine in Chrome.
111 Note that `base::SingleThreadTaskRunner` is-a `base::SequencedTaskRunner` so
Gabriel Charetteb984d672019-02-12 21:53:27112 thread-affine is a subset of thread-unsafe. Thread-affine is also sometimes
113 referred to as **thread-hostile**.
Albert J. Wongf06ff5002021-07-08 20:37:00114 * **Thread-safe**: Such types/methods can be safely accessed in parallel.
115 * **Thread-compatible**: Such types provide safe parallel access to const
Gabriel Charetteb984d672019-02-12 21:53:27116 methods but require synchronization for non-const (or mixed const/non-const
Gabriel Charette39db4c62019-04-29 19:52:38117 access). Chrome doesn't expose reader-writer locks; as such, the only use
Gabriel Charetteb984d672019-02-12 21:53:27118 case for this is objects (typically globals) which are initialized once in a
Gabriel Charette364a16a2019-02-06 21:12:15119 thread-safe manner (either in the single-threaded phase of startup or lazily
120 through a thread-safe static-local-initialization paradigm a la
Gabriel Charetteb984d672019-02-12 21:53:27121 `base::NoDestructor`) and forever after immutable.
122 * **Immutable**: A subset of thread-compatible types which cannot be modified
123 after construction.
Gabriel Charette364a16a2019-02-06 21:12:15124 * **Sequence-friendly**: Such types/methods are thread-unsafe types which
125 support being invoked from a `base::SequencedTaskRunner`. Ideally this would
126 be the case for all thread-unsafe types but legacy code sometimes has
127 overzealous checks that enforce thread-affinity in mere thread-unsafe
Gabriel Charette39db4c62019-04-29 19:52:38128 scenarios. See [Prefer Sequences to
129 Threads](#prefer-sequences-to-physical-threads) below for more details.
Gabriel Charette364a16a2019-02-06 21:12:15130
fdoraybacba4a22017-05-10 21:10:00131### Threads
132
133Every Chrome process has
134
135* a main thread
Gabriel Charette39db4c62019-04-29 19:52:38136 * in the browser process (BrowserThread::UI): updates the UI
137 * in renderer processes (Blink main thread): runs most of Blink
fdoraybacba4a22017-05-10 21:10:00138* an IO thread
Matt Falkenhagen72a2dfc2021-08-05 22:36:13139 * in all processes: all IPC messages arrive on this thread. The application
140 logic to handle the message may be in a different thread (i.e., the IO
141 thread may route the message to a [Mojo
142 interface](/docs/README.md#Mojo-Services) which is bound to a
143 different thread).
144 * more generally most async I/O happens on this thread (e.g., through
145 base::FileDescriptorWatcher).
146 * in the browser process: this is called BrowserThread::IO.
fdoraybacba4a22017-05-10 21:10:00147* a few more special-purpose threads
148* and a pool of general-purpose threads
149
150Most threads have a loop that gets tasks from a queue and runs them (the queue
151may be shared between multiple threads).
152
153### Tasks
154
155A task is a `base::OnceClosure` added to a queue for asynchronous execution.
156
157A `base::OnceClosure` stores a function pointer and arguments. It has a `Run()`
158method that invokes the function pointer using the bound arguments. It is
159created using `base::BindOnce`. (ref. [Callback<> and Bind()
160documentation](callback.md)).
161
162```
163void TaskA() {}
164void TaskB(int v) {}
165
166auto task_a = base::BindOnce(&TaskA);
167auto task_b = base::BindOnce(&TaskB, 42);
168```
169
170A group of tasks can be executed in one of the following ways:
171
172* [Parallel](#Posting-a-Parallel-Task): No task execution ordering, possibly all
173 at once on any thread
174* [Sequenced](#Posting-a-Sequenced-Task): Tasks executed in posting order, one
175 at a time on any thread.
176* [Single Threaded](#Posting-Multiple-Tasks-to-the-Same-Thread): Tasks executed
177 in posting order, one at a time on a single thread.
Drew Stonebraker653a3ba2019-07-02 19:24:23178 * [COM Single Threaded](#Posting-Tasks-to-a-COM-Single_Thread-Apartment-STA_Thread-Windows):
fdoraybacba4a22017-05-10 21:10:00179 A variant of single threaded with COM initialized.
180
Gabriel Charette39db4c62019-04-29 19:52:38181### Prefer Sequences to Physical Threads
gab2a4576052017-06-07 23:36:12182
Gabriel Charette39db4c62019-04-29 19:52:38183Sequenced execution (on virtual threads) is strongly preferred to
184single-threaded execution (on physical threads). Except for types/methods bound
185to the main thread (UI) or IO threads: thread-safety is better achieved via
186`base::SequencedTaskRunner` than through managing your own physical threads
187(ref. [Posting a Sequenced Task](#posting-a-sequenced-task) below).
gab2a4576052017-06-07 23:36:12188
Gabriel Charette39db4c62019-04-29 19:52:38189All APIs which are exposed for "current physical thread" have an equivalent for
190"current sequence"
191([mapping](threading_and_tasks_faq.md#How-to-migrate-from-SingleThreadTaskRunner-to-SequencedTaskRunner)).
gab2a4576052017-06-07 23:36:12192
Gabriel Charette39db4c62019-04-29 19:52:38193If you find yourself writing a sequence-friendly type and it fails
194thread-affinity checks (e.g., `THREAD_CHECKER`) in a leaf dependency: consider
195making that dependency sequence-friendly as well. Most core APIs in Chrome are
196sequence-friendly, but some legacy types may still over-zealously use
Sean Maher03efef12022-09-23 22:43:13197ThreadChecker/SingleThreadTaskRunner when they could instead rely on the
198"current sequence" and no longer be thread-affine.
fdoraybacba4a22017-05-10 21:10:00199
200## Posting a Parallel Task
201
Gabriel Charette52fa3ae2019-04-15 21:44:37202### Direct Posting to the Thread Pool
fdoraybacba4a22017-05-10 21:10:00203
204A task that can run on any thread and doesn’t have ordering or mutual exclusion
205requirements with other tasks should be posted using one of the
Gabriel Charette43de5c42020-01-27 22:44:45206`base::ThreadPool::PostTask*()` functions defined in
207[`base/task/thread_pool.h`](https://cs.chromium.org/chromium/src/base/task/thread_pool.h).
fdoraybacba4a22017-05-10 21:10:00208
209```cpp
Gabriel Charette43de5c42020-01-27 22:44:45210base::ThreadPool::PostTask(FROM_HERE, base::BindOnce(&Task));
fdoraybacba4a22017-05-10 21:10:00211```
212
213This posts tasks with default traits.
214
Gabriel Charette43de5c42020-01-27 22:44:45215The `base::ThreadPool::PostTask*()` functions allow the caller to provide
216additional details about the task via TaskTraits (ref. [Annotating Tasks with
217TaskTraits](#Annotating-Tasks-with-TaskTraits)).
fdoraybacba4a22017-05-10 21:10:00218
219```cpp
Gabriel Charette43de5c42020-01-27 22:44:45220base::ThreadPool::PostTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00221 FROM_HERE, {base::TaskPriority::BEST_EFFORT, MayBlock()},
fdoraybacba4a22017-05-10 21:10:00222 base::BindOnce(&Task));
223```
224
fdoray52bf5552017-05-11 12:43:59225### Posting via a TaskRunner
fdoraybacba4a22017-05-10 21:10:00226
227A parallel
Patrick Monette2d93ad902021-11-01 19:20:22228[`base::TaskRunner`](https://cs.chromium.org/chromium/src/base/task/task_runner.h) is
Gabriel Charette43de5c42020-01-27 22:44:45229an alternative to calling `base::ThreadPool::PostTask*()` directly. This is
230mainly useful when it isn’t known in advance whether tasks will be posted in
231parallel, in sequence, or to a single-thread (ref. [Posting a Sequenced
Gabriel Charette39db4c62019-04-29 19:52:38232Task](#Posting-a-Sequenced-Task), [Posting Multiple Tasks to the Same
233Thread](#Posting-Multiple-Tasks-to-the-Same-Thread)). Since `base::TaskRunner`
234is the base class of `base::SequencedTaskRunner` and
235`base::SingleThreadTaskRunner`, a `scoped_refptr<TaskRunner>` member can hold a
236`base::TaskRunner`, a `base::SequencedTaskRunner` or a
237`base::SingleThreadTaskRunner`.
fdoraybacba4a22017-05-10 21:10:00238
239```cpp
240class A {
241 public:
242 A() = default;
243
Gabriel Charette43de5c42020-01-27 22:44:45244 void PostSomething() {
245 task_runner_->PostTask(FROM_HERE, base::BindOnce(&A, &DoSomething));
246 }
247
fdoraybacba4a22017-05-10 21:10:00248 void DoSomething() {
fdoraybacba4a22017-05-10 21:10:00249 }
250
251 private:
252 scoped_refptr<base::TaskRunner> task_runner_ =
Gabriel Charette43de5c42020-01-27 22:44:45253 base::ThreadPool::CreateTaskRunner({base::TaskPriority::USER_VISIBLE});
fdoraybacba4a22017-05-10 21:10:00254};
255```
256
257Unless a test needs to control precisely how tasks are executed, it is preferred
Gabriel Charette49e3cd02020-01-28 03:45:27258to call `base::ThreadPool::PostTask*()` directly (ref. [Testing](#Testing) for
259less invasive ways of controlling tasks in tests).
fdoraybacba4a22017-05-10 21:10:00260
261## Posting a Sequenced Task
262
263A sequence is a set of tasks that run one at a time in posting order (not
264necessarily on the same thread). To post tasks as part of a sequence, use a
Patrick Monette2d93ad902021-11-01 19:20:22265[`base::SequencedTaskRunner`](https://cs.chromium.org/chromium/src/base/task/sequenced_task_runner.h).
fdoraybacba4a22017-05-10 21:10:00266
267### Posting to a New Sequence
268
Gabriel Charette39db4c62019-04-29 19:52:38269A `base::SequencedTaskRunner` can be created by
Gabriel Charette43de5c42020-01-27 22:44:45270`base::ThreadPool::CreateSequencedTaskRunner()`.
fdoraybacba4a22017-05-10 21:10:00271
272```cpp
273scoped_refptr<SequencedTaskRunner> sequenced_task_runner =
Gabriel Charette43de5c42020-01-27 22:44:45274 base::ThreadPool::CreateSequencedTaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00275
276// TaskB runs after TaskA completes.
277sequenced_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskA));
278sequenced_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskB));
279```
280
Alex Clarke0dd499562019-10-18 19:45:09281### Posting to the Current (Virtual) Thread
282
Gabriel Charettefee55662019-11-20 21:06:28283The preferred way of posting to the current (virtual) thread is via
Sean Maher03efef12022-09-23 22:43:13284`base::SequencedTaskRunner::GetCurrentDefault()`.
Alex Clarke0dd499562019-10-18 19:45:09285
286```cpp
287// The task will run on the current (virtual) thread's default task queue.
Sean Maher03efef12022-09-23 22:43:13288base::SequencedTaskRunner::GetCurrentDefault()->PostTask(
Gabriel Charettefee55662019-11-20 21:06:28289 FROM_HERE, base::BindOnce(&Task);
Alex Clarke0dd499562019-10-18 19:45:09290```
291
Sean Maher03efef12022-09-23 22:43:13292Note that `SequencedTaskRunner::GetCurrentDefault()` returns the default queue for the
Gabriel Charettefee55662019-11-20 21:06:28293current virtual thread. On threads with multiple task queues (e.g.
294BrowserThread::UI) this can be a different queue than the one the current task
295belongs to. The "current" task runner is intentionally not exposed via a static
296getter. Either you know it already and can post to it directly or you don't and
Francois Doraya06ee172022-11-24 21:09:18297the only sensible destination is the default queue. See https://bit.ly/3JvCLsX
Sean Maher03efef12022-09-23 22:43:13298for detailed discussion.
Alex Clarke0dd499562019-10-18 19:45:09299
fdoraybacba4a22017-05-10 21:10:00300## Using Sequences Instead of Locks
301
302Usage of locks is discouraged in Chrome. Sequences inherently provide
Gabriel Charettea3ccc972018-11-13 14:43:12303thread-safety. Prefer classes that are always accessed from the same
304sequence to managing your own thread-safety with locks.
305
306**Thread-safe but not thread-affine; how so?** Tasks posted to the same sequence
307will run in sequential order. After a sequenced task completes, the next task
308may be picked up by a different worker thread, but that task is guaranteed to
309see any side-effects caused by the previous one(s) on its sequence.
fdoraybacba4a22017-05-10 21:10:00310
311```cpp
312class A {
313 public:
314 A() {
315 // Do not require accesses to be on the creation sequence.
isherman8c33b8a2017-06-27 19:18:30316 DETACH_FROM_SEQUENCE(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00317 }
318
319 void AddValue(int v) {
320 // Check that all accesses are on the same sequence.
isherman8c33b8a2017-06-27 19:18:30321 DCHECK_CALLED_ON_VALID_SEQUENCE(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00322 values_.push_back(v);
323}
324
325 private:
isherman8c33b8a2017-06-27 19:18:30326 SEQUENCE_CHECKER(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00327
328 // No lock required, because all accesses are on the
329 // same sequence.
330 std::vector<int> values_;
331};
332
333A a;
334scoped_refptr<SequencedTaskRunner> task_runner_for_a = ...;
Mike Bjorged3a09842018-05-15 18:37:28335task_runner_for_a->PostTask(FROM_HERE,
336 base::BindOnce(&A::AddValue, base::Unretained(&a), 42));
337task_runner_for_a->PostTask(FROM_HERE,
338 base::BindOnce(&A::AddValue, base::Unretained(&a), 27));
fdoraybacba4a22017-05-10 21:10:00339
340// Access from a different sequence causes a DCHECK failure.
341scoped_refptr<SequencedTaskRunner> other_task_runner = ...;
342other_task_runner->PostTask(FROM_HERE,
Mike Bjorged3a09842018-05-15 18:37:28343 base::BindOnce(&A::AddValue, base::Unretained(&a), 1));
fdoraybacba4a22017-05-10 21:10:00344```
345
Gabriel Charette90480312018-02-16 15:10:05346Locks should only be used to swap in a shared data structure that can be
347accessed on multiple threads. If one thread updates it based on expensive
348computation or through disk access, then that slow work should be done without
Gabriel Charette39db4c62019-04-29 19:52:38349holding the lock. Only when the result is available should the lock be used to
350swap in the new data. An example of this is in PluginList::LoadPlugins
351([`content/browser/plugin_list.cc`](https://cs.chromium.org/chromium/src/content/browser/plugin_list.cc).
352If you must use locks,
Gabriel Charette90480312018-02-16 15:10:05353[here](https://www.chromium.org/developers/lock-and-condition-variable) are some
354best practices and pitfalls to avoid.
355
Gabriel Charette39db4c62019-04-29 19:52:38356In order to write non-blocking code, many APIs in Chrome are asynchronous.
Gabriel Charette90480312018-02-16 15:10:05357Usually this means that they either need to be executed on a particular
358thread/sequence and will return results via a custom delegate interface, or they
Alex St-Onge490a97a2021-02-04 02:47:19359take a `base::OnceCallback<>` (or `base::RepeatingCallback<>`) object that is
360called when the requested operation is completed. Executing work on a specific
361thread/sequence is covered in the PostTask sections above.
Gabriel Charette90480312018-02-16 15:10:05362
fdoraybacba4a22017-05-10 21:10:00363## Posting Multiple Tasks to the Same Thread
364
365If multiple tasks need to run on the same thread, post them to a
Patrick Monette2d93ad902021-11-01 19:20:22366[`base::SingleThreadTaskRunner`](https://cs.chromium.org/chromium/src/base/task/single_thread_task_runner.h).
Gabriel Charette39db4c62019-04-29 19:52:38367All tasks posted to the same `base::SingleThreadTaskRunner` run on the same thread in
fdoraybacba4a22017-05-10 21:10:00368posting order.
369
370### Posting to the Main Thread or to the IO Thread in the Browser Process
371
Eric Seckler6cf08db82018-08-30 12:01:55372To post tasks to the main thread or to the IO thread, use
Olivier Li56b99d4e2020-02-11 13:51:41373`content::GetUIThreadTaskRunner({})` or `content::GetIOThreadTaskRunner({})`
Gabriel Charette49e3cd02020-01-28 03:45:27374from
375[`content/public/browser/browser_thread.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_thread.h)
376
377You may provide additional BrowserTaskTraits as a parameter to those methods
378though this is generally still uncommon in BrowserThreads and should be reserved
379for advanced use cases.
380
381There's an ongoing migration ([task APIs v3]) away from the previous
382base-API-with-traits which you may still find throughout the codebase (it's
383equivalent):
fdoraybacba4a22017-05-10 21:10:00384
385```cpp
Sami Kyostila831c60b2019-07-31 13:31:23386base::PostTask(FROM_HERE, {content::BrowserThread::UI}, ...);
fdoraybacba4a22017-05-10 21:10:00387
Sami Kyostila831c60b2019-07-31 13:31:23388base::CreateSingleThreadTaskRunner({content::BrowserThread::IO})
fdoraybacba4a22017-05-10 21:10:00389 ->PostTask(FROM_HERE, ...);
390```
391
Gabriel Charette49e3cd02020-01-28 03:45:27392Note: For the duration of the migration, you'll unfortunately need to continue
393manually including
394[`content/public/browser/browser_task_traits.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_task_traits.h).
395to use the browser_thread.h API.
Gabriel Charette43de5c42020-01-27 22:44:45396
fdoraybacba4a22017-05-10 21:10:00397The main thread and the IO thread are already super busy. Therefore, prefer
fdoray52bf5552017-05-11 12:43:59398posting to a general purpose thread when possible (ref.
399[Posting a Parallel Task](#Posting-a-Parallel-Task),
400[Posting a Sequenced task](#Posting-a-Sequenced-Task)).
401Good reasons to post to the main thread are to update the UI or access objects
402that are bound to it (e.g. `Profile`). A good reason to post to the IO thread is
403to access the internals of components that are bound to it (e.g. IPCs, network).
404Note: It is not necessary to have an explicit post task to the IO thread to
405send/receive an IPC or send/receive data on the network.
fdoraybacba4a22017-05-10 21:10:00406
407### Posting to the Main Thread in a Renderer Process
Gabriel Charette49e3cd02020-01-28 03:45:27408TODO(blink-dev)
fdoraybacba4a22017-05-10 21:10:00409
410### Posting to a Custom SingleThreadTaskRunner
411
412If multiple tasks need to run on the same thread and that thread doesn’t have to
Gabriel Charette43de5c42020-01-27 22:44:45413be the main thread or the IO thread, post them to a
Gabriel Charette49e3cd02020-01-28 03:45:27414`base::SingleThreadTaskRunner` created by
415`base::Threadpool::CreateSingleThreadTaskRunner`.
fdoraybacba4a22017-05-10 21:10:00416
417```cpp
Dominic Farolinodbe9769b2019-05-31 04:06:03418scoped_refptr<SingleThreadTaskRunner> single_thread_task_runner =
Gabriel Charette43de5c42020-01-27 22:44:45419 base::Threadpool::CreateSingleThreadTaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00420
421// TaskB runs after TaskA completes. Both tasks run on the same thread.
422single_thread_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskA));
423single_thread_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskB));
424```
425
Gabriel Charette39db4c62019-04-29 19:52:38426Remember that we [prefer sequences to physical
427threads](#prefer-sequences-to-physical-threads) and that this thus should rarely
428be necessary.
fdoraybacba4a22017-05-10 21:10:00429
Alexander Timine653dfc2020-01-07 17:55:06430### Posting to the Current Thread
431
432*** note
433**IMPORTANT:** To post a task that needs mutual exclusion with the current
Gabriel Charette49e3cd02020-01-28 03:45:27434sequence of tasks but doesn’t absolutely need to run on the current physical
Sean Maher03efef12022-09-23 22:43:13435thread, use `base::SequencedTaskRunner::GetCurrentDefault()` instead of
436`base::SingleThreadTaskRunner::GetCurrentDefault()` (ref. [Posting to the Current
Gabriel Charette49e3cd02020-01-28 03:45:27437Sequence](#Posting-to-the-Current-Virtual_Thread)). That will better document
438the requirements of the posted task and will avoid unnecessarily making your API
439physical thread-affine. In a single-thread task,
Sean Maher03efef12022-09-23 22:43:13440`base::SequencedTaskRunner::GetCurrentDefault()` is equivalent to
441`base::SingleThreadTaskRunner::GetCurrentDefault()`.
Alexander Timine653dfc2020-01-07 17:55:06442***
443
444If you must post a task to the current physical thread nonetheless, use
Sean Maher03efef12022-09-23 22:43:13445[`base::SingleThreadTaskRunner::CurrentDefaultHandle`](https://source.chromium.org/chromium/chromium/src/+/main:base/task/single_thread_task_runner.h).
Alexander Timine653dfc2020-01-07 17:55:06446
447```cpp
448// The task will run on the current thread in the future.
Sean Maher03efef12022-09-23 22:43:13449base::SingleThreadTaskRunner::GetCurrentDefault()->PostTask(
Alexander Timine653dfc2020-01-07 17:55:06450 FROM_HERE, base::BindOnce(&Task));
451```
452
fdoraybacba4a22017-05-10 21:10:00453## Posting Tasks to a COM Single-Thread Apartment (STA) Thread (Windows)
454
455Tasks that need to run on a COM Single-Thread Apartment (STA) thread must be
Gabriel Charette39db4c62019-04-29 19:52:38456posted to a `base::SingleThreadTaskRunner` returned by
Gabriel Charette43de5c42020-01-27 22:44:45457`base::ThreadPool::CreateCOMSTATaskRunner()`. As mentioned in [Posting Multiple
458Tasks to the Same Thread](#Posting-Multiple-Tasks-to-the-Same-Thread), all tasks
459posted to the same `base::SingleThreadTaskRunner` run on the same thread in
460posting order.
fdoraybacba4a22017-05-10 21:10:00461
462```cpp
463// Task(A|B|C)UsingCOMSTA will run on the same COM STA thread.
464
465void TaskAUsingCOMSTA() {
466 // [ This runs on a COM STA thread. ]
467
468 // Make COM STA calls.
469 // ...
470
471 // Post another task to the current COM STA thread.
Sean Maher03efef12022-09-23 22:43:13472 base::SingleThreadTaskRunner::GetCurrentDefault()->PostTask(
fdoraybacba4a22017-05-10 21:10:00473 FROM_HERE, base::BindOnce(&TaskCUsingCOMSTA));
474}
475void TaskBUsingCOMSTA() { }
476void TaskCUsingCOMSTA() { }
477
Gabriel Charette43de5c42020-01-27 22:44:45478auto com_sta_task_runner = base::ThreadPool::CreateCOMSTATaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00479com_sta_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskAUsingCOMSTA));
480com_sta_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskBUsingCOMSTA));
481```
482
Egor Pasko7f58c33b2023-02-17 13:19:56483## Memory ordering guarantees for posted Tasks
484
485This task system guarantees that all the memory effects of sequential execution
Egor Pasko049e8d352023-02-23 17:09:50486before posting a task are _visible_ to the task when it starts running. More
487formally, a call to `PostTask()` and the execution of the posted task are in the
488[happens-before
Egor Pasko7f58c33b2023-02-17 13:19:56489relationship](https://preshing.com/20130702/the-happens-before-relation/) with
Egor Pasko049e8d352023-02-23 17:09:50490each other. This is true for all variants of posting a task in `::base`,
491including `PostTaskAndReply()`. Similarly the happens-before relationship is
492present for tasks running in a sequence as part of the same SequencedTaskRunner.
Egor Pasko7f58c33b2023-02-17 13:19:56493
Egor Pasko049e8d352023-02-23 17:09:50494This guarantee is important to know about because Chrome tasks commonly access
495memory beyond the immediate data copied into the `base::OnceCallback`, and this
496happens-before relationship allows to avoid additional synchronization within
497the tasks themselves. As a very specific example, consider a callback that binds
498a pointer to memory which was just initialized in the thread posting the task.
Egor Pasko7f58c33b2023-02-17 13:19:56499
Egor Pasko049e8d352023-02-23 17:09:50500A more constrained model is also worth noting. Execution can be split into tasks
501running on different task runners, where each task _exclusively_ accesses
502certain objects in memory without explicit synchronization. Posting another task
503transfers this 'ownership' (of the objects) to the next task. With this the
504notion of object ownership can often be extended to the level of task runners,
505which provides useful invariants to reason about. This model allows to avoid
506race conditions while also avoiding locks and atomic operations. Because of its
507simplicity this model is commonly used in Chrome.
Egor Pasko7f58c33b2023-02-17 13:19:56508
fdoraybacba4a22017-05-10 21:10:00509## Annotating Tasks with TaskTraits
510
Gabriel Charette39db4c62019-04-29 19:52:38511[`base::TaskTraits`](https://cs.chromium.org/chromium/src/base/task/task_traits.h)
Gabriel Charette52fa3ae2019-04-15 21:44:37512encapsulate information about a task that helps the thread pool make better
fdoraybacba4a22017-05-10 21:10:00513scheduling decisions.
514
Gabriel Charette43de5c42020-01-27 22:44:45515Methods that take `base::TaskTraits` can be be passed `{}` when default traits
516are sufficient. Default traits are appropriate for tasks that:
Nigel Tao26ad1852023-03-23 01:14:56517
Gabriel Charettede41cad2020-03-03 18:05:06518- Don’t block (ref. MayBlock and WithBaseSyncPrimitives);
519- Pertain to user-blocking activity;
520 (explicitly or implicitly by having an ordering dependency with a component
521 that does)
Gabriel Charette52fa3ae2019-04-15 21:44:37522- Can either block shutdown or be skipped on shutdown (thread pool is free to
523 choose a fitting default).
Nigel Tao26ad1852023-03-23 01:14:56524
fdoraybacba4a22017-05-10 21:10:00525Tasks that don’t match this description must be posted with explicit TaskTraits.
526
Gabriel Charette04b138f2018-08-06 00:03:22527[`base/task/task_traits.h`](https://cs.chromium.org/chromium/src/base/task/task_traits.h)
Eric Seckler6cf08db82018-08-30 12:01:55528provides exhaustive documentation of available traits. The content layer also
529provides additional traits in
530[`content/public/browser/browser_task_traits.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_task_traits.h)
531to facilitate posting a task onto a BrowserThread.
532
Gabriel Charette39db4c62019-04-29 19:52:38533Below are some examples of how to specify `base::TaskTraits`.
fdoraybacba4a22017-05-10 21:10:00534
535```cpp
Gabriel Charettede41cad2020-03-03 18:05:06536// This task has no explicit TaskTraits. It cannot block. Its priority is
537// USER_BLOCKING. It will either block shutdown or be skipped on shutdown.
Gabriel Charette43de5c42020-01-27 22:44:45538base::ThreadPool::PostTask(FROM_HERE, base::BindOnce(...));
fdoraybacba4a22017-05-10 21:10:00539
Gabriel Charettede41cad2020-03-03 18:05:06540// This task has the highest priority. The thread pool will schedule it before
541// USER_VISIBLE and BEST_EFFORT tasks.
Gabriel Charette43de5c42020-01-27 22:44:45542base::ThreadPool::PostTask(
fdoraybacba4a22017-05-10 21:10:00543 FROM_HERE, {base::TaskPriority::USER_BLOCKING},
544 base::BindOnce(...));
545
546// This task has the lowest priority and is allowed to block (e.g. it
547// can read a file from disk).
Gabriel Charette43de5c42020-01-27 22:44:45548base::ThreadPool::PostTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00549 FROM_HERE, {base::TaskPriority::BEST_EFFORT, base::MayBlock()},
fdoraybacba4a22017-05-10 21:10:00550 base::BindOnce(...));
551
552// This task blocks shutdown. The process won't exit before its
553// execution is complete.
Gabriel Charette43de5c42020-01-27 22:44:45554base::ThreadPool::PostTask(
fdoraybacba4a22017-05-10 21:10:00555 FROM_HERE, {base::TaskShutdownBehavior::BLOCK_SHUTDOWN},
556 base::BindOnce(...));
557```
558
559## Keeping the Browser Responsive
560
561Do not perform expensive work on the main thread, the IO thread or any sequence
562that is expected to run tasks with a low latency. Instead, perform expensive
Gabriel Charette43de5c42020-01-27 22:44:45563work asynchronously using `base::ThreadPool::PostTaskAndReply*()` or
Gabriel Charette39db4c62019-04-29 19:52:38564`base::SequencedTaskRunner::PostTaskAndReply()`. Note that
565asynchronous/overlapped I/O on the IO thread are fine.
fdoraybacba4a22017-05-10 21:10:00566
567Example: Running the code below on the main thread will prevent the browser from
568responding to user input for a long time.
569
570```cpp
571// GetHistoryItemsFromDisk() may block for a long time.
572// AddHistoryItemsToOmniboxDropDown() updates the UI and therefore must
573// be called on the main thread.
574AddHistoryItemsToOmniboxDropdown(GetHistoryItemsFromDisk("keyword"));
575```
576
577The code below solves the problem by scheduling a call to
578`GetHistoryItemsFromDisk()` in a thread pool followed by a call to
579`AddHistoryItemsToOmniboxDropdown()` on the origin sequence (the main thread in
580this case). The return value of the first call is automatically provided as
581argument to the second call.
582
583```cpp
Gabriel Charette43de5c42020-01-27 22:44:45584base::ThreadPool::PostTaskAndReplyWithResult(
fdoraybacba4a22017-05-10 21:10:00585 FROM_HERE, {base::MayBlock()},
586 base::BindOnce(&GetHistoryItemsFromDisk, "keyword"),
587 base::BindOnce(&AddHistoryItemsToOmniboxDropdown));
588```
589
590## Posting a Task with a Delay
591
592### Posting a One-Off Task with a Delay
593
594To post a task that must run once after a delay expires, use
Gabriel Charette43de5c42020-01-27 22:44:45595`base::ThreadPool::PostDelayedTask*()` or `base::TaskRunner::PostDelayedTask()`.
fdoraybacba4a22017-05-10 21:10:00596
597```cpp
Gabriel Charette43de5c42020-01-27 22:44:45598base::ThreadPool::PostDelayedTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00599 FROM_HERE, {base::TaskPriority::BEST_EFFORT}, base::BindOnce(&Task),
Peter Kastinge5a38ed2021-10-02 03:06:35600 base::Hours(1));
fdoraybacba4a22017-05-10 21:10:00601
602scoped_refptr<base::SequencedTaskRunner> task_runner =
Gabriel Charette43de5c42020-01-27 22:44:45603 base::ThreadPool::CreateSequencedTaskRunner(
604 {base::TaskPriority::BEST_EFFORT});
fdoraybacba4a22017-05-10 21:10:00605task_runner->PostDelayedTask(
Peter Kastinge5a38ed2021-10-02 03:06:35606 FROM_HERE, base::BindOnce(&Task), base::Hours(1));
fdoraybacba4a22017-05-10 21:10:00607```
608
609*** note
610**NOTE:** A task that has a 1-hour delay probably doesn’t have to run right away
Gabriel Charetteb10aeeb2018-07-26 20:15:00611when its delay expires. Specify `base::TaskPriority::BEST_EFFORT` to prevent it
fdoraybacba4a22017-05-10 21:10:00612from slowing down the browser when its delay expires.
613***
614
615### Posting a Repeating Task with a Delay
616To post a task that must run at regular intervals,
617use [`base::RepeatingTimer`](https://cs.chromium.org/chromium/src/base/timer/timer.h).
618
619```cpp
620class A {
621 public:
622 ~A() {
623 // The timer is stopped automatically when it is deleted.
624 }
625 void StartDoingStuff() {
Peter Kasting53fd6ee2021-10-05 20:40:48626 timer_.Start(FROM_HERE, Seconds(1),
Erik Chen0ee26a32021-07-14 20:04:47627 this, &A::DoStuff);
fdoraybacba4a22017-05-10 21:10:00628 }
629 void StopDoingStuff() {
630 timer_.Stop();
631 }
632 private:
633 void DoStuff() {
634 // This method is called every second on the sequence that invoked
635 // StartDoingStuff().
636 }
637 base::RepeatingTimer timer_;
638};
639```
640
641## Cancelling a Task
642
643### Using base::WeakPtr
644
645[`base::WeakPtr`](https://cs.chromium.org/chromium/src/base/memory/weak_ptr.h)
646can be used to ensure that any callback bound to an object is canceled when that
647object is destroyed.
648
649```cpp
650int Compute() { … }
651
652class A {
653 public:
fdoraybacba4a22017-05-10 21:10:00654 void ComputeAndStore() {
655 // Schedule a call to Compute() in a thread pool followed by
656 // a call to A::Store() on the current sequence. The call to
657 // A::Store() is canceled when |weak_ptr_factory_| is destroyed.
658 // (guarantees that |this| will not be used-after-free).
Gabriel Charette43de5c42020-01-27 22:44:45659 base::ThreadPool::PostTaskAndReplyWithResult(
fdoraybacba4a22017-05-10 21:10:00660 FROM_HERE, base::BindOnce(&Compute),
661 base::BindOnce(&A::Store, weak_ptr_factory_.GetWeakPtr()));
662 }
663
664 private:
665 void Store(int value) { value_ = value; }
666
667 int value_;
Jeremy Roman0dd0b2f2019-07-16 21:00:43668 base::WeakPtrFactory<A> weak_ptr_factory_{this};
fdoraybacba4a22017-05-10 21:10:00669};
670```
671
Eugene Zemtsov48b30d32022-03-18 23:56:11672Note: `WeakPtr` is not thread-safe: `~WeakPtrFactory()` and
Francois Dorayf652a9d02021-07-06 13:07:52673`Store()` (bound to a `WeakPtr`) must all run on the same sequence.
fdoraybacba4a22017-05-10 21:10:00674
675### Using base::CancelableTaskTracker
676
677[`base::CancelableTaskTracker`](https://cs.chromium.org/chromium/src/base/task/cancelable_task_tracker.h)
678allows cancellation to happen on a different sequence than the one on which
679tasks run. Keep in mind that `CancelableTaskTracker` cannot cancel tasks that
680have already started to run.
681
682```cpp
Gabriel Charette43de5c42020-01-27 22:44:45683auto task_runner = base::ThreadPool::CreateTaskRunner({});
fdoraybacba4a22017-05-10 21:10:00684base::CancelableTaskTracker cancelable_task_tracker;
685cancelable_task_tracker.PostTask(task_runner.get(), FROM_HERE,
Peter Kasting341e1fb2018-02-24 00:03:01686 base::DoNothing());
fdoraybacba4a22017-05-10 21:10:00687// Cancels Task(), only if it hasn't already started running.
688cancelable_task_tracker.TryCancelAll();
689```
690
Etienne Pierre-dorayd3882992020-01-14 20:34:11691## Posting a Job to run in parallel
692
693The [`base::PostJob`](https://cs.chromium.org/chromium/src/base/task/post_job.h)
694is a power user API to be able to schedule a single base::RepeatingCallback
Albert J. Wongf06ff5002021-07-08 20:37:00695worker task and request that ThreadPool workers invoke it in parallel.
Etienne Pierre-dorayd3882992020-01-14 20:34:11696This avoids degenerate cases:
697* Calling `PostTask()` for each work item, causing significant overhead.
698* Fixed number of `PostTask()` calls that split the work and might run for a
699 long time. This is problematic when many components post “num cores” tasks and
700 all expect to use all the cores. In these cases, the scheduler lacks context
701 to be fair to multiple same-priority requests and/or ability to request lower
702 priority work to yield when high priority work comes in.
703
Etienne Pierre-doray6d3cd9192020-04-06 21:10:37704See [`base/task/job_perftest.cc`](https://cs.chromium.org/chromium/src/base/task/job_perftest.cc)
705for a complete example.
706
Etienne Pierre-dorayd3882992020-01-14 20:34:11707```cpp
708// A canonical implementation of |worker_task|.
709void WorkerTask(base::JobDelegate* job_delegate) {
710 while (!job_delegate->ShouldYield()) {
711 auto work_item = TakeWorkItem(); // Smallest unit of work.
712 if (!work_item)
713 return:
714 ProcessWork(work_item);
715 }
716}
717
718// Returns the latest thread-safe number of incomplete work items.
Etienne Pierre-Dorayf91d7a02020-09-11 15:53:27719void NumIncompleteWorkItems(size_t worker_count) {
720 // NumIncompleteWorkItems() may use |worker_count| if it needs to account for
721 // local work lists, which is easier than doing its own accounting, keeping in
722 // mind that the actual number of items may be racily overestimated and thus
723 // WorkerTask() may be called when there's no available work.
724 return GlobalQueueSize() + worker_count;
725}
Etienne Pierre-dorayd3882992020-01-14 20:34:11726
Gabriel Charette1138d602020-01-29 08:51:52727base::PostJob(FROM_HERE, {},
Etienne Pierre-dorayd3882992020-01-14 20:34:11728 base::BindRepeating(&WorkerTask),
729 base::BindRepeating(&NumIncompleteWorkItems));
730```
731
732By doing as much work as possible in a loop when invoked, the worker task avoids
733scheduling overhead. Meanwhile `base::JobDelegate::ShouldYield()` is
734periodically invoked to conditionally exit and let the scheduler prioritize
735other work. This yield-semantic allows, for example, a user-visible job to use
736all cores but get out of the way when a user-blocking task comes in.
737
Jared Saulea867ab2021-07-15 17:39:01738### Adding additional work to a running job
Etienne Pierre-dorayd3882992020-01-14 20:34:11739
740When new work items are added and the API user wants additional threads to
Albert J. Wongf06ff5002021-07-08 20:37:00741invoke the worker task in parallel,
Etienne Pierre-dorayd3882992020-01-14 20:34:11742`JobHandle/JobDelegate::NotifyConcurrencyIncrease()` *must* be invoked shortly
743after max concurrency increases.
744
fdoraybacba4a22017-05-10 21:10:00745## Testing
746
Gabriel Charette0b20ee62019-09-18 14:06:12747For more details see [Testing Components Which Post
748Tasks](threading_and_tasks_testing.md).
749
Sean Maher03efef12022-09-23 22:43:13750To test code that uses `base::SingleThreadTaskRunner::CurrentDefaultHandle`,
751`base::SequencedTaskRunner::CurrentDefaultHandle` or a function in
Gabriel Charette9b6c04072022-04-01 23:22:46752[`base/task/thread_pool.h`](https://cs.chromium.org/chromium/src/base/task/thread_pool.h),
Gabriel Charette39db4c62019-04-29 19:52:38753instantiate a
Gabriel Charette0b20ee62019-09-18 14:06:12754[`base::test::TaskEnvironment`](https://cs.chromium.org/chromium/src/base/test/task_environment.h)
Gabriel Charette39db4c62019-04-29 19:52:38755for the scope of the test. If you need BrowserThreads, use
Gabriel Charette798fde72019-08-20 22:24:04756`content::BrowserTaskEnvironment` instead of
Gabriel Charette694c3c332019-08-19 14:53:05757`base::test::TaskEnvironment`.
fdoraybacba4a22017-05-10 21:10:00758
Gabriel Charette694c3c332019-08-19 14:53:05759Tests can run the `base::test::TaskEnvironment`'s message pump using a
Gabriel Charette39db4c62019-04-29 19:52:38760`base::RunLoop`, which can be made to run until `Quit()` (explicitly or via
761`RunLoop::QuitClosure()`), or to `RunUntilIdle()` ready-to-run tasks and
762immediately return.
Wezd9e4cb772019-01-09 03:07:03763
Wez9d5dd282020-02-10 17:21:22764TaskEnvironment configures RunLoop::Run() to GTEST_FAIL() if it hasn't been
Wezd9e4cb772019-01-09 03:07:03765explicitly quit after TestTimeouts::action_timeout(). This is preferable to
766having the test hang if the code under test fails to trigger the RunLoop to
Wez9d5dd282020-02-10 17:21:22767quit. The timeout can be overridden with base::test::ScopedRunLoopTimeout.
Wezd9e4cb772019-01-09 03:07:03768
fdoraybacba4a22017-05-10 21:10:00769```cpp
770class MyTest : public testing::Test {
771 public:
772 // ...
773 protected:
Gabriel Charette694c3c332019-08-19 14:53:05774 base::test::TaskEnvironment task_environment_;
fdoraybacba4a22017-05-10 21:10:00775};
776
Xiaohan Wang5279ee02022-10-19 22:21:06777TEST_F(MyTest, FirstTest) {
Sean Maher03efef12022-09-23 22:43:13778 base::SingleThreadTaskRunner::GetCurrentDefault()->PostTask(FROM_HERE, base::BindOnce(&A));
779 base::SequencedTaskRunner::GetCurrentDefault()->PostTask(FROM_HERE,
fdoraybacba4a22017-05-10 21:10:00780 base::BindOnce(&B));
Sean Maher03efef12022-09-23 22:43:13781 base::SingleThreadTaskRunner::GetCurrentDefault()->PostDelayedTask(
fdoraybacba4a22017-05-10 21:10:00782 FROM_HERE, base::BindOnce(&C), base::TimeDelta::Max());
783
Sean Maher03efef12022-09-23 22:43:13784 // This runs the (SingleThread|Sequenced)TaskRunner::CurrentDefaultHandle queue until it is empty.
fdoraybacba4a22017-05-10 21:10:00785 // Delayed tasks are not added to the queue until they are ripe for execution.
Gabriel Charettebd126bc32022-02-01 18:19:19786 // Prefer explicit exit conditions to RunUntilIdle when possible:
787 // bit.ly/run-until-idle-with-care2.
fdoraybacba4a22017-05-10 21:10:00788 base::RunLoop().RunUntilIdle();
789 // A and B have been executed. C is not ripe for execution yet.
790
791 base::RunLoop run_loop;
Sean Maher03efef12022-09-23 22:43:13792 base::SingleThreadTaskRunner::GetCurrentDefault()->PostTask(FROM_HERE, base::BindOnce(&D));
793 base::SingleThreadTaskRunner::GetCurrentDefault()->PostTask(FROM_HERE, run_loop.QuitClosure());
794 base::SingleThreadTaskRunner::GetCurrentDefault()->PostTask(FROM_HERE, base::BindOnce(&E));
fdoraybacba4a22017-05-10 21:10:00795
Sean Maher03efef12022-09-23 22:43:13796 // This runs the (SingleThread|Sequenced)TaskRunner::CurrentDefaultHandle queue until QuitClosure is
fdoraybacba4a22017-05-10 21:10:00797 // invoked.
798 run_loop.Run();
799 // D and run_loop.QuitClosure() have been executed. E is still in the queue.
800
Gabriel Charette52fa3ae2019-04-15 21:44:37801 // Tasks posted to thread pool run asynchronously as they are posted.
Gabriel Charette43de5c42020-01-27 22:44:45802 base::ThreadPool::PostTask(FROM_HERE, {}, base::BindOnce(&F));
fdoraybacba4a22017-05-10 21:10:00803 auto task_runner =
Gabriel Charette43de5c42020-01-27 22:44:45804 base::ThreadPool::CreateSequencedTaskRunner({});
fdoraybacba4a22017-05-10 21:10:00805 task_runner->PostTask(FROM_HERE, base::BindOnce(&G));
806
Gabriel Charette52fa3ae2019-04-15 21:44:37807 // To block until all tasks posted to thread pool are done running:
Gabriel Charette43fd3702019-05-29 16:36:51808 base::ThreadPoolInstance::Get()->FlushForTesting();
fdoraybacba4a22017-05-10 21:10:00809 // F and G have been executed.
810
Gabriel Charette43de5c42020-01-27 22:44:45811 base::ThreadPool::PostTaskAndReplyWithResult(
812 FROM_HERE, {}, base::BindOnce(&H), base::BindOnce(&I));
fdoraybacba4a22017-05-10 21:10:00813
Sean Maher03efef12022-09-23 22:43:13814 // This runs the (SingleThread|Sequenced)TaskRunner::CurrentDefaultHandle queue until both the
815 // (SingleThread|Sequenced)TaskRunner::CurrentDefaultHandle queue and the ThreadPool queue are
Gabriel Charettebd126bc32022-02-01 18:19:19816 // empty. Prefer explicit exit conditions to RunUntilIdle when possible:
817 // bit.ly/run-until-idle-with-care2.
Gabriel Charette694c3c332019-08-19 14:53:05818 task_environment_.RunUntilIdle();
fdoraybacba4a22017-05-10 21:10:00819 // E, H, I have been executed.
820}
821```
822
Gabriel Charette52fa3ae2019-04-15 21:44:37823## Using ThreadPool in a New Process
fdoraybacba4a22017-05-10 21:10:00824
Gabriel Charette43fd3702019-05-29 16:36:51825ThreadPoolInstance needs to be initialized in a process before the functions in
Gabriel Charette9b6c04072022-04-01 23:22:46826[`base/task/thread_pool.h`](https://cs.chromium.org/chromium/src/base/task/thread_pool.h)
Gabriel Charette43fd3702019-05-29 16:36:51827can be used. Initialization of ThreadPoolInstance in the Chrome browser process
828and child processes (renderer, GPU, utility) has already been taken care of. To
829use ThreadPoolInstance in another process, initialize ThreadPoolInstance early
830in the main function:
fdoraybacba4a22017-05-10 21:10:00831
832```cpp
Gabriel Charette43fd3702019-05-29 16:36:51833// This initializes and starts ThreadPoolInstance with default params.
834base::ThreadPoolInstance::CreateAndStartWithDefaultParams(“process_name”);
Gabriel Charette9b6c04072022-04-01 23:22:46835// The base/task/thread_pool.h API can now be used with base::ThreadPool trait.
Jared Saulea867ab2021-07-15 17:39:01836// Tasks will be scheduled as they are posted.
fdoraybacba4a22017-05-10 21:10:00837
Gabriel Charette43fd3702019-05-29 16:36:51838// This initializes ThreadPoolInstance.
839base::ThreadPoolInstance::Create(“process_name”);
Gabriel Charette9b6c04072022-04-01 23:22:46840// The base/task/thread_pool.h API can now be used with base::ThreadPool trait. No
Gabriel Charette43fd3702019-05-29 16:36:51841// threads will be created and no tasks will be scheduled until after Start() is
842// called.
843base::ThreadPoolInstance::Get()->Start(params);
Gabriel Charette52fa3ae2019-04-15 21:44:37844// ThreadPool can now create threads and schedule tasks.
fdoraybacba4a22017-05-10 21:10:00845```
846
Gabriel Charette43fd3702019-05-29 16:36:51847And shutdown ThreadPoolInstance late in the main function:
fdoraybacba4a22017-05-10 21:10:00848
849```cpp
Gabriel Charette43fd3702019-05-29 16:36:51850base::ThreadPoolInstance::Get()->Shutdown();
fdoraybacba4a22017-05-10 21:10:00851// Tasks posted with TaskShutdownBehavior::BLOCK_SHUTDOWN and
852// tasks posted with TaskShutdownBehavior::SKIP_ON_SHUTDOWN that
853// have started to run before the Shutdown() call have now completed their
854// execution. Tasks posted with
855// TaskShutdownBehavior::CONTINUE_ON_SHUTDOWN may still be
856// running.
857```
Gabriel Charetteb86e5fe62017-06-08 19:39:28858## TaskRunner ownership (encourage no dependency injection)
Sebastien Marchandc95489b2017-05-25 16:39:34859
860TaskRunners shouldn't be passed through several components. Instead, the
Jared Saulea867ab2021-07-15 17:39:01861component that uses a TaskRunner should be the one that creates it.
Sebastien Marchandc95489b2017-05-25 16:39:34862
863See [this example](https://codereview.chromium.org/2885173002/) of a
864refactoring where a TaskRunner was passed through a lot of components only to be
865used in an eventual leaf. The leaf can and should now obtain its TaskRunner
866directly from
Gabriel Charette9b6c04072022-04-01 23:22:46867[`base/task/thread_pool.h`](https://cs.chromium.org/chromium/src/base/task/thread_pool.h).
Gabriel Charetteb86e5fe62017-06-08 19:39:28868
Gabriel Charette694c3c332019-08-19 14:53:05869As mentioned above, `base::test::TaskEnvironment` allows unit tests to
Gabriel Charette39db4c62019-04-29 19:52:38870control tasks posted from underlying TaskRunners. In rare cases where a test
871needs to more precisely control task ordering: dependency injection of
872TaskRunners can be useful. For such cases the preferred approach is the
873following:
Gabriel Charetteb86e5fe62017-06-08 19:39:28874
875```cpp
Gabriel Charette39db4c62019-04-29 19:52:38876class Foo {
Gabriel Charetteb86e5fe62017-06-08 19:39:28877 public:
878
Gabriel Charette39db4c62019-04-29 19:52:38879 // Overrides |background_task_runner_| in tests.
Gabriel Charetteb86e5fe62017-06-08 19:39:28880 void SetBackgroundTaskRunnerForTesting(
Gabriel Charette39db4c62019-04-29 19:52:38881 scoped_refptr<base::SequencedTaskRunner> background_task_runner) {
882 background_task_runner_ = std::move(background_task_runner);
883 }
Gabriel Charetteb86e5fe62017-06-08 19:39:28884
885 private:
michaelpg12c04572017-06-26 23:25:06886 scoped_refptr<base::SequencedTaskRunner> background_task_runner_ =
Gabriel Charette43de5c42020-01-27 22:44:45887 base::ThreadPool::CreateSequencedTaskRunner(
Gabriel Charetteb10aeeb2018-07-26 20:15:00888 {base::MayBlock(), base::TaskPriority::BEST_EFFORT});
Gabriel Charetteb86e5fe62017-06-08 19:39:28889}
890```
891
892Note that this still allows removing all layers of plumbing between //chrome and
893that component since unit tests will use the leaf layer directly.
Gabriel Charette8917f4c2018-11-22 15:50:28894
895## FAQ
896See [Threading and Tasks FAQ](threading_and_tasks_faq.md) for more examples.
Gabriel Charette43de5c42020-01-27 22:44:45897
898[task APIs v3]: https://docs.google.com/document/d/1tssusPykvx3g0gvbvU4HxGyn3MjJlIylnsH13-Tv6s4/edit?ts=5de99a52#heading=h.ss4tw38hvh3s
Carlos Caballero40b6d042020-06-16 06:50:25899
900## Internals
901
902### SequenceManager
903
904[SequenceManager](https://cs.chromium.org/chromium/src/base/task/sequence_manager/sequence_manager.h)
905manages TaskQueues which have different properties (e.g. priority, common task
906type) multiplexing all posted tasks into a single backing sequence. This will
907usually be a MessagePump. Depending on the type of message pump used other
908events such as UI messages may be processed as well. On Windows APC calls (as
909time permits) and signals sent to a registered set of HANDLEs may also be
910processed.
911
Carlos Caballero4a050922020-07-02 11:43:38912### MessagePump
Carlos Caballero40b6d042020-06-16 06:50:25913
914[MessagePumps](https://cs.chromium.org/chromium/src/base/message_loop/message_pump.h)
915are responsible for processing native messages as well as for giving cycles to
916their delegate (SequenceManager) periodically. MessagePumps take care to mixing
917delegate callbacks with native message processing so neither type of event
918starves the other of cycles.
919
920There are different [MessagePumpTypes](https://cs.chromium.org/chromium/src/base/message_loop/message_pump_type.h),
921most common are:
922
923* DEFAULT: Supports tasks and timers only
924
925* UI: Supports native UI events (e.g. Windows messages)
926
927* IO: Supports asynchronous IO (not file I/O!)
928
929* CUSTOM: User provided implementation of MessagePump interface
930
Carlos Caballero4a050922020-07-02 11:43:38931### RunLoop
Carlos Caballero40b6d042020-06-16 06:50:25932
Jared Saulea867ab2021-07-15 17:39:01933RunLoop is a helper class to run the RunLoop::Delegate associated with the
Carlos Caballero40b6d042020-06-16 06:50:25934current thread (usually a SequenceManager). Create a RunLoop on the stack and
935call Run/Quit to run a nested RunLoop but please avoid nested loops in
936production code!
937
Carlos Caballero4a050922020-07-02 11:43:38938### Task Reentrancy
Carlos Caballero40b6d042020-06-16 06:50:25939
940SequenceManager has task reentrancy protection. This means that if a
941task is being processed, a second task cannot start until the first task is
942finished. Reentrancy can happen when processing a task, and an inner
943message pump is created. That inner pump then processes native messages
944which could implicitly start an inner task. Inner message pumps are created
945with dialogs (DialogBox), common dialogs (GetOpenFileName), OLE functions
946(DoDragDrop), printer functions (StartDoc) and *many* others.
947
948```cpp
949Sample workaround when inner task processing is needed:
950 HRESULT hr;
951 {
Francois Doraya06ee172022-11-24 21:09:18952 CurrentThread::ScopedAllowApplicationTasksInNativeNestedLoop allow;
Carlos Caballero40b6d042020-06-16 06:50:25953 hr = DoDragDrop(...); // Implicitly runs a modal message loop.
954 }
955 // Process |hr| (the result returned by DoDragDrop()).
956```
957
958Please be SURE your task is reentrant (nestable) and all global variables
959are stable and accessible before before using
Francois Doraya06ee172022-11-24 21:09:18960CurrentThread::ScopedAllowApplicationTasksInNativeNestedLoop.
Carlos Caballero40b6d042020-06-16 06:50:25961
962## APIs for general use
963
964User code should hardly ever need to access SequenceManager APIs directly as
965these are meant for code that deals with scheduling. Instead you should use the
966following:
967
968* base::RunLoop: Drive the SequenceManager from the thread it's bound to.
969
Sean Maher03efef12022-09-23 22:43:13970* base::Thread/SequencedTaskRunner::CurrentDefaultHandle: Post back to the SequenceManager TaskQueues from a task running on it.
Carlos Caballero40b6d042020-06-16 06:50:25971
972* SequenceLocalStorageSlot : Bind external state to a sequence.
973
Carlos Caballero4a050922020-07-02 11:43:38974* base::CurrentThread : Proxy to a subset of Task related APIs bound to the current thread
Carlos Caballero40b6d042020-06-16 06:50:25975
976* Embedders may provide their own static accessors to post tasks on specific loops (e.g. content::BrowserThreads).
977
978### SingleThreadTaskExecutor and TaskEnvironment
979
980Instead of having to deal with SequenceManager and TaskQueues code that needs a
981simple task posting environment (one default task queue) can use a
982[SingleThreadTaskExecutor](https://cs.chromium.org/chromium/src/base/task/single_thread_task_executor.h).
983
984Unit tests can use [TaskEnvironment](https://cs.chromium.org/chromium/src/base/test/task_environment.h)
985which is highly configurable.
Carlos Caballero4a050922020-07-02 11:43:38986
Wen Fane09439ca2021-03-09 16:50:41987## MessageLoop and MessageLoopCurrent
Carlos Caballero4a050922020-07-02 11:43:38988
Wen Fane09439ca2021-03-09 16:50:41989You might come across references to MessageLoop or MessageLoopCurrent in the
Carlos Caballero4a050922020-07-02 11:43:38990code or documentation. These classes no longer exist and we are in the process
Jared Saulea867ab2021-07-15 17:39:01991or getting rid of all references to them. `base::MessageLoopCurrent` was
992replaced by `base::CurrentThread` and the drop in replacements for
993`base::MessageLoop` are `base::SingleThreadTaskExecutor` and
994`base::Test::TaskEnvironment`.