blob: e51f5619d2af8c0e046b131ecf87e7d8371feaa9 [file] [log] [blame] [view]
fdoraybacba4a22017-05-10 21:10:001# Threading and Tasks in Chrome
2
3[TOC]
4
Gabriel Charette8917f4c2018-11-22 15:50:285Note: See [Threading and Tasks FAQ](threading_and_tasks_faq.md) for more
6examples.
7
fdoraybacba4a22017-05-10 21:10:008## Overview
9
Gabriel Charette39db4c62019-04-29 19:52:3810Chrome has a [multi-process
11architecture](https://www.chromium.org/developers/design-documents/multi-process-architecture)
12and each process is heavily multi-threaded. In this document we will go over the
13basic threading system shared by each process. The main goal is to keep the main
Matt Falkenhagen72a2dfc2021-08-05 22:36:1314thread (a.k.a. "UI" thread in the browser process) and IO thread (each process's
15thread for receiving
16[IPC](https://en.wikipedia.org/wiki/Inter-process_communication))
17responsive. This means offloading any blocking I/O or other expensive
18operations to other threads. Our approach is to use message passing as the way
19of communicating between threads. We discourage locking and thread-safe objects.
20Instead, objects live on only one (often virtual -- we'll get to that later!)
21thread and we pass messages between those threads for communication. Absent
22external requirements about latency or workload, Chrome attempts to be a [highly
23concurrent, but not necessarily
24parallel](https://stackoverflow.com/questions/1050222/what-is-the-difference-between-concurrency-and-parallelism#:~:text=Concurrency%20is%20when%20two%20or,e.g.%2C%20on%20a%20multicore%20processor.),
Jared Saulea867ab2021-07-15 17:39:0125system.
Gabriel Charette39db4c62019-04-29 19:52:3826
cfredricff6d86c2022-02-15 16:26:1127A basic intro to the way Chromium does concurrency (especially Sequences) can be
28found
29[here](https://docs.google.com/presentation/d/1ujV8LjIUyPBmULzdT2aT9Izte8PDwbJi).
30
Gabriel Charette39db4c62019-04-29 19:52:3831This documentation assumes familiarity with computer science
32[threading concepts](https://en.wikipedia.org/wiki/Thread_(computing)).
Gabriel Charette90480312018-02-16 15:10:0533
Gabriel Charette364a16a2019-02-06 21:12:1534### Nomenclature
Gabriel Charette39db4c62019-04-29 19:52:3835
36## Core Concepts
37 * **Task**: A unit of work to be processed. Effectively a function pointer with
Alex St-Onge490a97a2021-02-04 02:47:1938 optionally associated state. In Chrome this is `base::OnceCallback` and
39 `base::RepeatingCallback` created via `base::BindOnce` and
40 `base::BindRepeating`, respectively.
Gabriel Charette39db4c62019-04-29 19:52:3841 ([documentation](https://chromium.googlesource.com/chromium/src/+/HEAD/docs/callback.md)).
42 * **Task queue**: A queue of tasks to be processed.
43 * **Physical thread**: An operating system provided thread (e.g. pthread on
44 POSIX or CreateThread() on Windows). The Chrome cross-platform abstraction
45 is `base::PlatformThread`. You should pretty much never use this directly.
46 * **`base::Thread`**: A physical thread forever processing messages from a
47 dedicated task queue until Quit(). You should pretty much never be creating
48 your own `base::Thread`'s.
49 * **Thread pool**: A pool of physical threads with a shared task queue. In
Gabriel Charette0b20ee62019-09-18 14:06:1250 Chrome, this is `base::ThreadPoolInstance`. There's exactly one instance per
51 Chrome process, it serves tasks posted through
Gabriel Charette39db4c62019-04-29 19:52:3852 [`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette43fd3702019-05-29 16:36:5153 and as such you should rarely need to use the `base::ThreadPoolInstance` API
Gabriel Charette39db4c62019-04-29 19:52:3854 directly (more on posting tasks later).
55 * **Sequence** or **Virtual thread**: A chrome-managed thread of execution.
56 Like a physical thread, only one task can run on a given sequence / virtual
57 thread at any given moment and each task sees the side-effects of the
58 preceding tasks. Tasks are executed sequentially but may hop physical
59 threads between each one.
60 * **Task runner**: An interface through which tasks can be posted. In Chrome
61 this is `base::TaskRunner`.
62 * **Sequenced task runner**: A task runner which guarantees that tasks posted
63 to it will run sequentially, in posted order. Each such task is guaranteed to
64 see the side-effects of the task preceding it. Tasks posted to a sequenced
65 task runner are typically processed by a single thread (virtual or physical).
66 In Chrome this is `base::SequencedTaskRunner` which is-a
67 `base::TaskRunner`.
68 * **Single-thread task runner**: A sequenced task runner which guarantees that
69 all tasks will be processed by the same physical thread. In Chrome this is
70 `base::SingleThreadTaskRunner` which is-a `base::SequencedTaskRunner`. We
71 [prefer sequences to threads](#prefer-sequences-to-physical-threads) whenever
72 possible.
73
74## Threading Lexicon
75Note to the reader: the following terms are an attempt to bridge the gap between
76common threading nomenclature and the way we use them in Chrome. It might be a
77bit heavy if you're just getting started. Should this be hard to parse, consider
78skipping to the more detailed sections below and referring back to this as
79necessary.
80
81 * **Thread-unsafe**: The vast majority of types in Chrome are thread-unsafe
82 (by design). Access to such types/methods must be externally synchronized.
83 Typically thread-unsafe types require that all tasks accessing their state be
84 posted to the same `base::SequencedTaskRunner` and they verify this in debug
85 builds with a `SEQUENCE_CHECKER` member. Locks are also an option to
86 synchronize access but in Chrome we strongly
87 [prefer sequences to locks](#Using-Sequences-Instead-of-Locks).
Gabriel Charette364a16a2019-02-06 21:12:1588 * **Thread-affine**: Such types/methods need to be always accessed from the
Gabriel Charetteb984d672019-02-12 21:53:2789 same physical thread (i.e. from the same `base::SingleThreadTaskRunner`) and
Gabriel Charette39db4c62019-04-29 19:52:3890 typically have a `THREAD_CHECKER` member to verify that they are. Short of
91 using a third-party API or having a leaf dependency which is thread-affine:
92 there's pretty much no reason for a type to be thread-affine in Chrome.
93 Note that `base::SingleThreadTaskRunner` is-a `base::SequencedTaskRunner` so
Gabriel Charetteb984d672019-02-12 21:53:2794 thread-affine is a subset of thread-unsafe. Thread-affine is also sometimes
95 referred to as **thread-hostile**.
Albert J. Wongf06ff5002021-07-08 20:37:0096 * **Thread-safe**: Such types/methods can be safely accessed in parallel.
97 * **Thread-compatible**: Such types provide safe parallel access to const
Gabriel Charetteb984d672019-02-12 21:53:2798 methods but require synchronization for non-const (or mixed const/non-const
Gabriel Charette39db4c62019-04-29 19:52:3899 access). Chrome doesn't expose reader-writer locks; as such, the only use
Gabriel Charetteb984d672019-02-12 21:53:27100 case for this is objects (typically globals) which are initialized once in a
Gabriel Charette364a16a2019-02-06 21:12:15101 thread-safe manner (either in the single-threaded phase of startup or lazily
102 through a thread-safe static-local-initialization paradigm a la
Gabriel Charetteb984d672019-02-12 21:53:27103 `base::NoDestructor`) and forever after immutable.
104 * **Immutable**: A subset of thread-compatible types which cannot be modified
105 after construction.
Gabriel Charette364a16a2019-02-06 21:12:15106 * **Sequence-friendly**: Such types/methods are thread-unsafe types which
107 support being invoked from a `base::SequencedTaskRunner`. Ideally this would
108 be the case for all thread-unsafe types but legacy code sometimes has
109 overzealous checks that enforce thread-affinity in mere thread-unsafe
Gabriel Charette39db4c62019-04-29 19:52:38110 scenarios. See [Prefer Sequences to
111 Threads](#prefer-sequences-to-physical-threads) below for more details.
Gabriel Charette364a16a2019-02-06 21:12:15112
fdoraybacba4a22017-05-10 21:10:00113### Threads
114
115Every Chrome process has
116
117* a main thread
Gabriel Charette39db4c62019-04-29 19:52:38118 * in the browser process (BrowserThread::UI): updates the UI
119 * in renderer processes (Blink main thread): runs most of Blink
fdoraybacba4a22017-05-10 21:10:00120* an IO thread
Matt Falkenhagen72a2dfc2021-08-05 22:36:13121 * in all processes: all IPC messages arrive on this thread. The application
122 logic to handle the message may be in a different thread (i.e., the IO
123 thread may route the message to a [Mojo
124 interface](/docs/README.md#Mojo-Services) which is bound to a
125 different thread).
126 * more generally most async I/O happens on this thread (e.g., through
127 base::FileDescriptorWatcher).
128 * in the browser process: this is called BrowserThread::IO.
fdoraybacba4a22017-05-10 21:10:00129* a few more special-purpose threads
130* and a pool of general-purpose threads
131
132Most threads have a loop that gets tasks from a queue and runs them (the queue
133may be shared between multiple threads).
134
135### Tasks
136
137A task is a `base::OnceClosure` added to a queue for asynchronous execution.
138
139A `base::OnceClosure` stores a function pointer and arguments. It has a `Run()`
140method that invokes the function pointer using the bound arguments. It is
141created using `base::BindOnce`. (ref. [Callback<> and Bind()
142documentation](callback.md)).
143
144```
145void TaskA() {}
146void TaskB(int v) {}
147
148auto task_a = base::BindOnce(&TaskA);
149auto task_b = base::BindOnce(&TaskB, 42);
150```
151
152A group of tasks can be executed in one of the following ways:
153
154* [Parallel](#Posting-a-Parallel-Task): No task execution ordering, possibly all
155 at once on any thread
156* [Sequenced](#Posting-a-Sequenced-Task): Tasks executed in posting order, one
157 at a time on any thread.
158* [Single Threaded](#Posting-Multiple-Tasks-to-the-Same-Thread): Tasks executed
159 in posting order, one at a time on a single thread.
Drew Stonebraker653a3ba2019-07-02 19:24:23160 * [COM Single Threaded](#Posting-Tasks-to-a-COM-Single_Thread-Apartment-STA_Thread-Windows):
fdoraybacba4a22017-05-10 21:10:00161 A variant of single threaded with COM initialized.
162
Gabriel Charette39db4c62019-04-29 19:52:38163### Prefer Sequences to Physical Threads
gab2a4576052017-06-07 23:36:12164
Gabriel Charette39db4c62019-04-29 19:52:38165Sequenced execution (on virtual threads) is strongly preferred to
166single-threaded execution (on physical threads). Except for types/methods bound
167to the main thread (UI) or IO threads: thread-safety is better achieved via
168`base::SequencedTaskRunner` than through managing your own physical threads
169(ref. [Posting a Sequenced Task](#posting-a-sequenced-task) below).
gab2a4576052017-06-07 23:36:12170
Gabriel Charette39db4c62019-04-29 19:52:38171All APIs which are exposed for "current physical thread" have an equivalent for
172"current sequence"
173([mapping](threading_and_tasks_faq.md#How-to-migrate-from-SingleThreadTaskRunner-to-SequencedTaskRunner)).
gab2a4576052017-06-07 23:36:12174
Gabriel Charette39db4c62019-04-29 19:52:38175If you find yourself writing a sequence-friendly type and it fails
176thread-affinity checks (e.g., `THREAD_CHECKER`) in a leaf dependency: consider
177making that dependency sequence-friendly as well. Most core APIs in Chrome are
178sequence-friendly, but some legacy types may still over-zealously use
179ThreadChecker/ThreadTaskRunnerHandle/SingleThreadTaskRunner when they could
180instead rely on the "current sequence" and no longer be thread-affine.
fdoraybacba4a22017-05-10 21:10:00181
182## Posting a Parallel Task
183
Gabriel Charette52fa3ae2019-04-15 21:44:37184### Direct Posting to the Thread Pool
fdoraybacba4a22017-05-10 21:10:00185
186A task that can run on any thread and doesn’t have ordering or mutual exclusion
187requirements with other tasks should be posted using one of the
Gabriel Charette43de5c42020-01-27 22:44:45188`base::ThreadPool::PostTask*()` functions defined in
189[`base/task/thread_pool.h`](https://cs.chromium.org/chromium/src/base/task/thread_pool.h).
fdoraybacba4a22017-05-10 21:10:00190
191```cpp
Gabriel Charette43de5c42020-01-27 22:44:45192base::ThreadPool::PostTask(FROM_HERE, base::BindOnce(&Task));
fdoraybacba4a22017-05-10 21:10:00193```
194
195This posts tasks with default traits.
196
Gabriel Charette43de5c42020-01-27 22:44:45197The `base::ThreadPool::PostTask*()` functions allow the caller to provide
198additional details about the task via TaskTraits (ref. [Annotating Tasks with
199TaskTraits](#Annotating-Tasks-with-TaskTraits)).
fdoraybacba4a22017-05-10 21:10:00200
201```cpp
Gabriel Charette43de5c42020-01-27 22:44:45202base::ThreadPool::PostTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00203 FROM_HERE, {base::TaskPriority::BEST_EFFORT, MayBlock()},
fdoraybacba4a22017-05-10 21:10:00204 base::BindOnce(&Task));
205```
206
fdoray52bf5552017-05-11 12:43:59207### Posting via a TaskRunner
fdoraybacba4a22017-05-10 21:10:00208
209A parallel
Patrick Monette2d93ad902021-11-01 19:20:22210[`base::TaskRunner`](https://cs.chromium.org/chromium/src/base/task/task_runner.h) is
Gabriel Charette43de5c42020-01-27 22:44:45211an alternative to calling `base::ThreadPool::PostTask*()` directly. This is
212mainly useful when it isn’t known in advance whether tasks will be posted in
213parallel, in sequence, or to a single-thread (ref. [Posting a Sequenced
Gabriel Charette39db4c62019-04-29 19:52:38214Task](#Posting-a-Sequenced-Task), [Posting Multiple Tasks to the Same
215Thread](#Posting-Multiple-Tasks-to-the-Same-Thread)). Since `base::TaskRunner`
216is the base class of `base::SequencedTaskRunner` and
217`base::SingleThreadTaskRunner`, a `scoped_refptr<TaskRunner>` member can hold a
218`base::TaskRunner`, a `base::SequencedTaskRunner` or a
219`base::SingleThreadTaskRunner`.
fdoraybacba4a22017-05-10 21:10:00220
221```cpp
222class A {
223 public:
224 A() = default;
225
Gabriel Charette43de5c42020-01-27 22:44:45226 void PostSomething() {
227 task_runner_->PostTask(FROM_HERE, base::BindOnce(&A, &DoSomething));
228 }
229
fdoraybacba4a22017-05-10 21:10:00230 void DoSomething() {
fdoraybacba4a22017-05-10 21:10:00231 }
232
233 private:
234 scoped_refptr<base::TaskRunner> task_runner_ =
Gabriel Charette43de5c42020-01-27 22:44:45235 base::ThreadPool::CreateTaskRunner({base::TaskPriority::USER_VISIBLE});
fdoraybacba4a22017-05-10 21:10:00236};
237```
238
239Unless a test needs to control precisely how tasks are executed, it is preferred
Gabriel Charette49e3cd02020-01-28 03:45:27240to call `base::ThreadPool::PostTask*()` directly (ref. [Testing](#Testing) for
241less invasive ways of controlling tasks in tests).
fdoraybacba4a22017-05-10 21:10:00242
243## Posting a Sequenced Task
244
245A sequence is a set of tasks that run one at a time in posting order (not
246necessarily on the same thread). To post tasks as part of a sequence, use a
Patrick Monette2d93ad902021-11-01 19:20:22247[`base::SequencedTaskRunner`](https://cs.chromium.org/chromium/src/base/task/sequenced_task_runner.h).
fdoraybacba4a22017-05-10 21:10:00248
249### Posting to a New Sequence
250
Gabriel Charette39db4c62019-04-29 19:52:38251A `base::SequencedTaskRunner` can be created by
Gabriel Charette43de5c42020-01-27 22:44:45252`base::ThreadPool::CreateSequencedTaskRunner()`.
fdoraybacba4a22017-05-10 21:10:00253
254```cpp
255scoped_refptr<SequencedTaskRunner> sequenced_task_runner =
Gabriel Charette43de5c42020-01-27 22:44:45256 base::ThreadPool::CreateSequencedTaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00257
258// TaskB runs after TaskA completes.
259sequenced_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskA));
260sequenced_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskB));
261```
262
Alex Clarke0dd499562019-10-18 19:45:09263### Posting to the Current (Virtual) Thread
264
Gabriel Charettefee55662019-11-20 21:06:28265The preferred way of posting to the current (virtual) thread is via
266`base::SequencedTaskRunnerHandle::Get()`.
Alex Clarke0dd499562019-10-18 19:45:09267
268```cpp
269// The task will run on the current (virtual) thread's default task queue.
Gabriel Charettefee55662019-11-20 21:06:28270base::SequencedTaskRunnerHandle::Get()->PostTask(
271 FROM_HERE, base::BindOnce(&Task);
Alex Clarke0dd499562019-10-18 19:45:09272```
273
Jared Saulea867ab2021-07-15 17:39:01274Note that `SequencedTaskRunnerHandle::Get()` returns the default queue for the
Gabriel Charettefee55662019-11-20 21:06:28275current virtual thread. On threads with multiple task queues (e.g.
276BrowserThread::UI) this can be a different queue than the one the current task
277belongs to. The "current" task runner is intentionally not exposed via a static
278getter. Either you know it already and can post to it directly or you don't and
279the only sensible destination is the default queue.
Alex Clarke0dd499562019-10-18 19:45:09280
fdoraybacba4a22017-05-10 21:10:00281## Using Sequences Instead of Locks
282
283Usage of locks is discouraged in Chrome. Sequences inherently provide
Gabriel Charettea3ccc972018-11-13 14:43:12284thread-safety. Prefer classes that are always accessed from the same
285sequence to managing your own thread-safety with locks.
286
287**Thread-safe but not thread-affine; how so?** Tasks posted to the same sequence
288will run in sequential order. After a sequenced task completes, the next task
289may be picked up by a different worker thread, but that task is guaranteed to
290see any side-effects caused by the previous one(s) on its sequence.
fdoraybacba4a22017-05-10 21:10:00291
292```cpp
293class A {
294 public:
295 A() {
296 // Do not require accesses to be on the creation sequence.
isherman8c33b8a2017-06-27 19:18:30297 DETACH_FROM_SEQUENCE(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00298 }
299
300 void AddValue(int v) {
301 // Check that all accesses are on the same sequence.
isherman8c33b8a2017-06-27 19:18:30302 DCHECK_CALLED_ON_VALID_SEQUENCE(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00303 values_.push_back(v);
304}
305
306 private:
isherman8c33b8a2017-06-27 19:18:30307 SEQUENCE_CHECKER(sequence_checker_);
fdoraybacba4a22017-05-10 21:10:00308
309 // No lock required, because all accesses are on the
310 // same sequence.
311 std::vector<int> values_;
312};
313
314A a;
315scoped_refptr<SequencedTaskRunner> task_runner_for_a = ...;
Mike Bjorged3a09842018-05-15 18:37:28316task_runner_for_a->PostTask(FROM_HERE,
317 base::BindOnce(&A::AddValue, base::Unretained(&a), 42));
318task_runner_for_a->PostTask(FROM_HERE,
319 base::BindOnce(&A::AddValue, base::Unretained(&a), 27));
fdoraybacba4a22017-05-10 21:10:00320
321// Access from a different sequence causes a DCHECK failure.
322scoped_refptr<SequencedTaskRunner> other_task_runner = ...;
323other_task_runner->PostTask(FROM_HERE,
Mike Bjorged3a09842018-05-15 18:37:28324 base::BindOnce(&A::AddValue, base::Unretained(&a), 1));
fdoraybacba4a22017-05-10 21:10:00325```
326
Gabriel Charette90480312018-02-16 15:10:05327Locks should only be used to swap in a shared data structure that can be
328accessed on multiple threads. If one thread updates it based on expensive
329computation or through disk access, then that slow work should be done without
Gabriel Charette39db4c62019-04-29 19:52:38330holding the lock. Only when the result is available should the lock be used to
331swap in the new data. An example of this is in PluginList::LoadPlugins
332([`content/browser/plugin_list.cc`](https://cs.chromium.org/chromium/src/content/browser/plugin_list.cc).
333If you must use locks,
Gabriel Charette90480312018-02-16 15:10:05334[here](https://www.chromium.org/developers/lock-and-condition-variable) are some
335best practices and pitfalls to avoid.
336
Gabriel Charette39db4c62019-04-29 19:52:38337In order to write non-blocking code, many APIs in Chrome are asynchronous.
Gabriel Charette90480312018-02-16 15:10:05338Usually this means that they either need to be executed on a particular
339thread/sequence and will return results via a custom delegate interface, or they
Alex St-Onge490a97a2021-02-04 02:47:19340take a `base::OnceCallback<>` (or `base::RepeatingCallback<>`) object that is
341called when the requested operation is completed. Executing work on a specific
342thread/sequence is covered in the PostTask sections above.
Gabriel Charette90480312018-02-16 15:10:05343
fdoraybacba4a22017-05-10 21:10:00344## Posting Multiple Tasks to the Same Thread
345
346If multiple tasks need to run on the same thread, post them to a
Patrick Monette2d93ad902021-11-01 19:20:22347[`base::SingleThreadTaskRunner`](https://cs.chromium.org/chromium/src/base/task/single_thread_task_runner.h).
Gabriel Charette39db4c62019-04-29 19:52:38348All tasks posted to the same `base::SingleThreadTaskRunner` run on the same thread in
fdoraybacba4a22017-05-10 21:10:00349posting order.
350
351### Posting to the Main Thread or to the IO Thread in the Browser Process
352
Eric Seckler6cf08db82018-08-30 12:01:55353To post tasks to the main thread or to the IO thread, use
Olivier Li56b99d4e2020-02-11 13:51:41354`content::GetUIThreadTaskRunner({})` or `content::GetIOThreadTaskRunner({})`
Gabriel Charette49e3cd02020-01-28 03:45:27355from
356[`content/public/browser/browser_thread.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_thread.h)
357
358You may provide additional BrowserTaskTraits as a parameter to those methods
359though this is generally still uncommon in BrowserThreads and should be reserved
360for advanced use cases.
361
362There's an ongoing migration ([task APIs v3]) away from the previous
363base-API-with-traits which you may still find throughout the codebase (it's
364equivalent):
fdoraybacba4a22017-05-10 21:10:00365
366```cpp
Sami Kyostila831c60b2019-07-31 13:31:23367base::PostTask(FROM_HERE, {content::BrowserThread::UI}, ...);
fdoraybacba4a22017-05-10 21:10:00368
Sami Kyostila831c60b2019-07-31 13:31:23369base::CreateSingleThreadTaskRunner({content::BrowserThread::IO})
fdoraybacba4a22017-05-10 21:10:00370 ->PostTask(FROM_HERE, ...);
371```
372
Gabriel Charette49e3cd02020-01-28 03:45:27373Note: For the duration of the migration, you'll unfortunately need to continue
374manually including
375[`content/public/browser/browser_task_traits.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_task_traits.h).
376to use the browser_thread.h API.
Gabriel Charette43de5c42020-01-27 22:44:45377
fdoraybacba4a22017-05-10 21:10:00378The main thread and the IO thread are already super busy. Therefore, prefer
fdoray52bf5552017-05-11 12:43:59379posting to a general purpose thread when possible (ref.
380[Posting a Parallel Task](#Posting-a-Parallel-Task),
381[Posting a Sequenced task](#Posting-a-Sequenced-Task)).
382Good reasons to post to the main thread are to update the UI or access objects
383that are bound to it (e.g. `Profile`). A good reason to post to the IO thread is
384to access the internals of components that are bound to it (e.g. IPCs, network).
385Note: It is not necessary to have an explicit post task to the IO thread to
386send/receive an IPC or send/receive data on the network.
fdoraybacba4a22017-05-10 21:10:00387
388### Posting to the Main Thread in a Renderer Process
Gabriel Charette49e3cd02020-01-28 03:45:27389TODO(blink-dev)
fdoraybacba4a22017-05-10 21:10:00390
391### Posting to a Custom SingleThreadTaskRunner
392
393If multiple tasks need to run on the same thread and that thread doesn’t have to
Gabriel Charette43de5c42020-01-27 22:44:45394be the main thread or the IO thread, post them to a
Gabriel Charette49e3cd02020-01-28 03:45:27395`base::SingleThreadTaskRunner` created by
396`base::Threadpool::CreateSingleThreadTaskRunner`.
fdoraybacba4a22017-05-10 21:10:00397
398```cpp
Dominic Farolinodbe9769b2019-05-31 04:06:03399scoped_refptr<SingleThreadTaskRunner> single_thread_task_runner =
Gabriel Charette43de5c42020-01-27 22:44:45400 base::Threadpool::CreateSingleThreadTaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00401
402// TaskB runs after TaskA completes. Both tasks run on the same thread.
403single_thread_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskA));
404single_thread_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskB));
405```
406
Gabriel Charette39db4c62019-04-29 19:52:38407Remember that we [prefer sequences to physical
408threads](#prefer-sequences-to-physical-threads) and that this thus should rarely
409be necessary.
fdoraybacba4a22017-05-10 21:10:00410
Alexander Timine653dfc2020-01-07 17:55:06411### Posting to the Current Thread
412
413*** note
414**IMPORTANT:** To post a task that needs mutual exclusion with the current
Gabriel Charette49e3cd02020-01-28 03:45:27415sequence of tasks but doesn’t absolutely need to run on the current physical
416thread, use `base::SequencedTaskRunnerHandle::Get()` instead of
Alexander Timine653dfc2020-01-07 17:55:06417`base::ThreadTaskRunnerHandle::Get()` (ref. [Posting to the Current
Gabriel Charette49e3cd02020-01-28 03:45:27418Sequence](#Posting-to-the-Current-Virtual_Thread)). That will better document
419the requirements of the posted task and will avoid unnecessarily making your API
420physical thread-affine. In a single-thread task,
421`base::SequencedTaskRunnerHandle::Get()` is equivalent to
422`base::ThreadTaskRunnerHandle::Get()`.
Alexander Timine653dfc2020-01-07 17:55:06423***
424
425If you must post a task to the current physical thread nonetheless, use
426[`base::ThreadTaskRunnerHandle`](https://cs.chromium.org/chromium/src/base/threading/thread_task_runner_handle.h).
427
428```cpp
429// The task will run on the current thread in the future.
430base::ThreadTaskRunnerHandle::Get()->PostTask(
431 FROM_HERE, base::BindOnce(&Task));
432```
433
fdoraybacba4a22017-05-10 21:10:00434## Posting Tasks to a COM Single-Thread Apartment (STA) Thread (Windows)
435
436Tasks that need to run on a COM Single-Thread Apartment (STA) thread must be
Gabriel Charette39db4c62019-04-29 19:52:38437posted to a `base::SingleThreadTaskRunner` returned by
Gabriel Charette43de5c42020-01-27 22:44:45438`base::ThreadPool::CreateCOMSTATaskRunner()`. As mentioned in [Posting Multiple
439Tasks to the Same Thread](#Posting-Multiple-Tasks-to-the-Same-Thread), all tasks
440posted to the same `base::SingleThreadTaskRunner` run on the same thread in
441posting order.
fdoraybacba4a22017-05-10 21:10:00442
443```cpp
444// Task(A|B|C)UsingCOMSTA will run on the same COM STA thread.
445
446void TaskAUsingCOMSTA() {
447 // [ This runs on a COM STA thread. ]
448
449 // Make COM STA calls.
450 // ...
451
452 // Post another task to the current COM STA thread.
453 base::ThreadTaskRunnerHandle::Get()->PostTask(
454 FROM_HERE, base::BindOnce(&TaskCUsingCOMSTA));
455}
456void TaskBUsingCOMSTA() { }
457void TaskCUsingCOMSTA() { }
458
Gabriel Charette43de5c42020-01-27 22:44:45459auto com_sta_task_runner = base::ThreadPool::CreateCOMSTATaskRunner(...);
fdoraybacba4a22017-05-10 21:10:00460com_sta_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskAUsingCOMSTA));
461com_sta_task_runner->PostTask(FROM_HERE, base::BindOnce(&TaskBUsingCOMSTA));
462```
463
464## Annotating Tasks with TaskTraits
465
Gabriel Charette39db4c62019-04-29 19:52:38466[`base::TaskTraits`](https://cs.chromium.org/chromium/src/base/task/task_traits.h)
Gabriel Charette52fa3ae2019-04-15 21:44:37467encapsulate information about a task that helps the thread pool make better
fdoraybacba4a22017-05-10 21:10:00468scheduling decisions.
469
Gabriel Charette43de5c42020-01-27 22:44:45470Methods that take `base::TaskTraits` can be be passed `{}` when default traits
471are sufficient. Default traits are appropriate for tasks that:
Gabriel Charettede41cad2020-03-03 18:05:06472- Don’t block (ref. MayBlock and WithBaseSyncPrimitives);
473- Pertain to user-blocking activity;
474 (explicitly or implicitly by having an ordering dependency with a component
475 that does)
Gabriel Charette52fa3ae2019-04-15 21:44:37476- Can either block shutdown or be skipped on shutdown (thread pool is free to
477 choose a fitting default).
fdoraybacba4a22017-05-10 21:10:00478Tasks that don’t match this description must be posted with explicit TaskTraits.
479
Gabriel Charette04b138f2018-08-06 00:03:22480[`base/task/task_traits.h`](https://cs.chromium.org/chromium/src/base/task/task_traits.h)
Eric Seckler6cf08db82018-08-30 12:01:55481provides exhaustive documentation of available traits. The content layer also
482provides additional traits in
483[`content/public/browser/browser_task_traits.h`](https://cs.chromium.org/chromium/src/content/public/browser/browser_task_traits.h)
484to facilitate posting a task onto a BrowserThread.
485
Gabriel Charette39db4c62019-04-29 19:52:38486Below are some examples of how to specify `base::TaskTraits`.
fdoraybacba4a22017-05-10 21:10:00487
488```cpp
Gabriel Charettede41cad2020-03-03 18:05:06489// This task has no explicit TaskTraits. It cannot block. Its priority is
490// USER_BLOCKING. It will either block shutdown or be skipped on shutdown.
Gabriel Charette43de5c42020-01-27 22:44:45491base::ThreadPool::PostTask(FROM_HERE, base::BindOnce(...));
fdoraybacba4a22017-05-10 21:10:00492
Gabriel Charettede41cad2020-03-03 18:05:06493// This task has the highest priority. The thread pool will schedule it before
494// USER_VISIBLE and BEST_EFFORT tasks.
Gabriel Charette43de5c42020-01-27 22:44:45495base::ThreadPool::PostTask(
fdoraybacba4a22017-05-10 21:10:00496 FROM_HERE, {base::TaskPriority::USER_BLOCKING},
497 base::BindOnce(...));
498
499// This task has the lowest priority and is allowed to block (e.g. it
500// can read a file from disk).
Gabriel Charette43de5c42020-01-27 22:44:45501base::ThreadPool::PostTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00502 FROM_HERE, {base::TaskPriority::BEST_EFFORT, base::MayBlock()},
fdoraybacba4a22017-05-10 21:10:00503 base::BindOnce(...));
504
505// This task blocks shutdown. The process won't exit before its
506// execution is complete.
Gabriel Charette43de5c42020-01-27 22:44:45507base::ThreadPool::PostTask(
fdoraybacba4a22017-05-10 21:10:00508 FROM_HERE, {base::TaskShutdownBehavior::BLOCK_SHUTDOWN},
509 base::BindOnce(...));
510```
511
512## Keeping the Browser Responsive
513
514Do not perform expensive work on the main thread, the IO thread or any sequence
515that is expected to run tasks with a low latency. Instead, perform expensive
Gabriel Charette43de5c42020-01-27 22:44:45516work asynchronously using `base::ThreadPool::PostTaskAndReply*()` or
Gabriel Charette39db4c62019-04-29 19:52:38517`base::SequencedTaskRunner::PostTaskAndReply()`. Note that
518asynchronous/overlapped I/O on the IO thread are fine.
fdoraybacba4a22017-05-10 21:10:00519
520Example: Running the code below on the main thread will prevent the browser from
521responding to user input for a long time.
522
523```cpp
524// GetHistoryItemsFromDisk() may block for a long time.
525// AddHistoryItemsToOmniboxDropDown() updates the UI and therefore must
526// be called on the main thread.
527AddHistoryItemsToOmniboxDropdown(GetHistoryItemsFromDisk("keyword"));
528```
529
530The code below solves the problem by scheduling a call to
531`GetHistoryItemsFromDisk()` in a thread pool followed by a call to
532`AddHistoryItemsToOmniboxDropdown()` on the origin sequence (the main thread in
533this case). The return value of the first call is automatically provided as
534argument to the second call.
535
536```cpp
Gabriel Charette43de5c42020-01-27 22:44:45537base::ThreadPool::PostTaskAndReplyWithResult(
fdoraybacba4a22017-05-10 21:10:00538 FROM_HERE, {base::MayBlock()},
539 base::BindOnce(&GetHistoryItemsFromDisk, "keyword"),
540 base::BindOnce(&AddHistoryItemsToOmniboxDropdown));
541```
542
543## Posting a Task with a Delay
544
545### Posting a One-Off Task with a Delay
546
547To post a task that must run once after a delay expires, use
Gabriel Charette43de5c42020-01-27 22:44:45548`base::ThreadPool::PostDelayedTask*()` or `base::TaskRunner::PostDelayedTask()`.
fdoraybacba4a22017-05-10 21:10:00549
550```cpp
Gabriel Charette43de5c42020-01-27 22:44:45551base::ThreadPool::PostDelayedTask(
Gabriel Charetteb10aeeb2018-07-26 20:15:00552 FROM_HERE, {base::TaskPriority::BEST_EFFORT}, base::BindOnce(&Task),
Peter Kastinge5a38ed2021-10-02 03:06:35553 base::Hours(1));
fdoraybacba4a22017-05-10 21:10:00554
555scoped_refptr<base::SequencedTaskRunner> task_runner =
Gabriel Charette43de5c42020-01-27 22:44:45556 base::ThreadPool::CreateSequencedTaskRunner(
557 {base::TaskPriority::BEST_EFFORT});
fdoraybacba4a22017-05-10 21:10:00558task_runner->PostDelayedTask(
Peter Kastinge5a38ed2021-10-02 03:06:35559 FROM_HERE, base::BindOnce(&Task), base::Hours(1));
fdoraybacba4a22017-05-10 21:10:00560```
561
562*** note
563**NOTE:** A task that has a 1-hour delay probably doesn’t have to run right away
Gabriel Charetteb10aeeb2018-07-26 20:15:00564when its delay expires. Specify `base::TaskPriority::BEST_EFFORT` to prevent it
fdoraybacba4a22017-05-10 21:10:00565from slowing down the browser when its delay expires.
566***
567
568### Posting a Repeating Task with a Delay
569To post a task that must run at regular intervals,
570use [`base::RepeatingTimer`](https://cs.chromium.org/chromium/src/base/timer/timer.h).
571
572```cpp
573class A {
574 public:
575 ~A() {
576 // The timer is stopped automatically when it is deleted.
577 }
578 void StartDoingStuff() {
Peter Kasting53fd6ee2021-10-05 20:40:48579 timer_.Start(FROM_HERE, Seconds(1),
Erik Chen0ee26a32021-07-14 20:04:47580 this, &A::DoStuff);
fdoraybacba4a22017-05-10 21:10:00581 }
582 void StopDoingStuff() {
583 timer_.Stop();
584 }
585 private:
586 void DoStuff() {
587 // This method is called every second on the sequence that invoked
588 // StartDoingStuff().
589 }
590 base::RepeatingTimer timer_;
591};
592```
593
594## Cancelling a Task
595
596### Using base::WeakPtr
597
598[`base::WeakPtr`](https://cs.chromium.org/chromium/src/base/memory/weak_ptr.h)
599can be used to ensure that any callback bound to an object is canceled when that
600object is destroyed.
601
602```cpp
603int Compute() { … }
604
605class A {
606 public:
fdoraybacba4a22017-05-10 21:10:00607 void ComputeAndStore() {
608 // Schedule a call to Compute() in a thread pool followed by
609 // a call to A::Store() on the current sequence. The call to
610 // A::Store() is canceled when |weak_ptr_factory_| is destroyed.
611 // (guarantees that |this| will not be used-after-free).
Gabriel Charette43de5c42020-01-27 22:44:45612 base::ThreadPool::PostTaskAndReplyWithResult(
fdoraybacba4a22017-05-10 21:10:00613 FROM_HERE, base::BindOnce(&Compute),
614 base::BindOnce(&A::Store, weak_ptr_factory_.GetWeakPtr()));
615 }
616
617 private:
618 void Store(int value) { value_ = value; }
619
620 int value_;
Jeremy Roman0dd0b2f2019-07-16 21:00:43621 base::WeakPtrFactory<A> weak_ptr_factory_{this};
fdoraybacba4a22017-05-10 21:10:00622};
623```
624
625Note: `WeakPtr` is not thread-safe: `GetWeakPtr()`, `~WeakPtrFactory()`, and
Francois Dorayf652a9d02021-07-06 13:07:52626`Store()` (bound to a `WeakPtr`) must all run on the same sequence.
fdoraybacba4a22017-05-10 21:10:00627
628### Using base::CancelableTaskTracker
629
630[`base::CancelableTaskTracker`](https://cs.chromium.org/chromium/src/base/task/cancelable_task_tracker.h)
631allows cancellation to happen on a different sequence than the one on which
632tasks run. Keep in mind that `CancelableTaskTracker` cannot cancel tasks that
633have already started to run.
634
635```cpp
Gabriel Charette43de5c42020-01-27 22:44:45636auto task_runner = base::ThreadPool::CreateTaskRunner({});
fdoraybacba4a22017-05-10 21:10:00637base::CancelableTaskTracker cancelable_task_tracker;
638cancelable_task_tracker.PostTask(task_runner.get(), FROM_HERE,
Peter Kasting341e1fb2018-02-24 00:03:01639 base::DoNothing());
fdoraybacba4a22017-05-10 21:10:00640// Cancels Task(), only if it hasn't already started running.
641cancelable_task_tracker.TryCancelAll();
642```
643
Etienne Pierre-dorayd3882992020-01-14 20:34:11644## Posting a Job to run in parallel
645
646The [`base::PostJob`](https://cs.chromium.org/chromium/src/base/task/post_job.h)
647is a power user API to be able to schedule a single base::RepeatingCallback
Albert J. Wongf06ff5002021-07-08 20:37:00648worker task and request that ThreadPool workers invoke it in parallel.
Etienne Pierre-dorayd3882992020-01-14 20:34:11649This avoids degenerate cases:
650* Calling `PostTask()` for each work item, causing significant overhead.
651* Fixed number of `PostTask()` calls that split the work and might run for a
652 long time. This is problematic when many components post “num cores” tasks and
653 all expect to use all the cores. In these cases, the scheduler lacks context
654 to be fair to multiple same-priority requests and/or ability to request lower
655 priority work to yield when high priority work comes in.
656
Etienne Pierre-doray6d3cd9192020-04-06 21:10:37657See [`base/task/job_perftest.cc`](https://cs.chromium.org/chromium/src/base/task/job_perftest.cc)
658for a complete example.
659
Etienne Pierre-dorayd3882992020-01-14 20:34:11660```cpp
661// A canonical implementation of |worker_task|.
662void WorkerTask(base::JobDelegate* job_delegate) {
663 while (!job_delegate->ShouldYield()) {
664 auto work_item = TakeWorkItem(); // Smallest unit of work.
665 if (!work_item)
666 return:
667 ProcessWork(work_item);
668 }
669}
670
671// Returns the latest thread-safe number of incomplete work items.
Etienne Pierre-Dorayf91d7a02020-09-11 15:53:27672void NumIncompleteWorkItems(size_t worker_count) {
673 // NumIncompleteWorkItems() may use |worker_count| if it needs to account for
674 // local work lists, which is easier than doing its own accounting, keeping in
675 // mind that the actual number of items may be racily overestimated and thus
676 // WorkerTask() may be called when there's no available work.
677 return GlobalQueueSize() + worker_count;
678}
Etienne Pierre-dorayd3882992020-01-14 20:34:11679
Gabriel Charette1138d602020-01-29 08:51:52680base::PostJob(FROM_HERE, {},
Etienne Pierre-dorayd3882992020-01-14 20:34:11681 base::BindRepeating(&WorkerTask),
682 base::BindRepeating(&NumIncompleteWorkItems));
683```
684
685By doing as much work as possible in a loop when invoked, the worker task avoids
686scheduling overhead. Meanwhile `base::JobDelegate::ShouldYield()` is
687periodically invoked to conditionally exit and let the scheduler prioritize
688other work. This yield-semantic allows, for example, a user-visible job to use
689all cores but get out of the way when a user-blocking task comes in.
690
Jared Saulea867ab2021-07-15 17:39:01691### Adding additional work to a running job
Etienne Pierre-dorayd3882992020-01-14 20:34:11692
693When new work items are added and the API user wants additional threads to
Albert J. Wongf06ff5002021-07-08 20:37:00694invoke the worker task in parallel,
Etienne Pierre-dorayd3882992020-01-14 20:34:11695`JobHandle/JobDelegate::NotifyConcurrencyIncrease()` *must* be invoked shortly
696after max concurrency increases.
697
fdoraybacba4a22017-05-10 21:10:00698## Testing
699
Gabriel Charette0b20ee62019-09-18 14:06:12700For more details see [Testing Components Which Post
701Tasks](threading_and_tasks_testing.md).
702
fdoraybacba4a22017-05-10 21:10:00703To test code that uses `base::ThreadTaskRunnerHandle`,
704`base::SequencedTaskRunnerHandle` or a function in
Gabriel Charette39db4c62019-04-29 19:52:38705[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h),
706instantiate a
Gabriel Charette0b20ee62019-09-18 14:06:12707[`base::test::TaskEnvironment`](https://cs.chromium.org/chromium/src/base/test/task_environment.h)
Gabriel Charette39db4c62019-04-29 19:52:38708for the scope of the test. If you need BrowserThreads, use
Gabriel Charette798fde72019-08-20 22:24:04709`content::BrowserTaskEnvironment` instead of
Gabriel Charette694c3c332019-08-19 14:53:05710`base::test::TaskEnvironment`.
fdoraybacba4a22017-05-10 21:10:00711
Gabriel Charette694c3c332019-08-19 14:53:05712Tests can run the `base::test::TaskEnvironment`'s message pump using a
Gabriel Charette39db4c62019-04-29 19:52:38713`base::RunLoop`, which can be made to run until `Quit()` (explicitly or via
714`RunLoop::QuitClosure()`), or to `RunUntilIdle()` ready-to-run tasks and
715immediately return.
Wezd9e4cb772019-01-09 03:07:03716
Wez9d5dd282020-02-10 17:21:22717TaskEnvironment configures RunLoop::Run() to GTEST_FAIL() if it hasn't been
Wezd9e4cb772019-01-09 03:07:03718explicitly quit after TestTimeouts::action_timeout(). This is preferable to
719having the test hang if the code under test fails to trigger the RunLoop to
Wez9d5dd282020-02-10 17:21:22720quit. The timeout can be overridden with base::test::ScopedRunLoopTimeout.
Wezd9e4cb772019-01-09 03:07:03721
fdoraybacba4a22017-05-10 21:10:00722```cpp
723class MyTest : public testing::Test {
724 public:
725 // ...
726 protected:
Gabriel Charette694c3c332019-08-19 14:53:05727 base::test::TaskEnvironment task_environment_;
fdoraybacba4a22017-05-10 21:10:00728};
729
730TEST(MyTest, MyTest) {
731 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&A));
732 base::SequencedTaskRunnerHandle::Get()->PostTask(FROM_HERE,
733 base::BindOnce(&B));
734 base::ThreadTaskRunnerHandle::Get()->PostDelayedTask(
735 FROM_HERE, base::BindOnce(&C), base::TimeDelta::Max());
736
737 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until it is empty.
738 // Delayed tasks are not added to the queue until they are ripe for execution.
Gabriel Charettebd126bc32022-02-01 18:19:19739 // Prefer explicit exit conditions to RunUntilIdle when possible:
740 // bit.ly/run-until-idle-with-care2.
fdoraybacba4a22017-05-10 21:10:00741 base::RunLoop().RunUntilIdle();
742 // A and B have been executed. C is not ripe for execution yet.
743
744 base::RunLoop run_loop;
745 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&D));
746 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, run_loop.QuitClosure());
747 base::ThreadTaskRunnerHandle::Get()->PostTask(FROM_HERE, base::BindOnce(&E));
748
749 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until QuitClosure is
750 // invoked.
751 run_loop.Run();
752 // D and run_loop.QuitClosure() have been executed. E is still in the queue.
753
Gabriel Charette52fa3ae2019-04-15 21:44:37754 // Tasks posted to thread pool run asynchronously as they are posted.
Gabriel Charette43de5c42020-01-27 22:44:45755 base::ThreadPool::PostTask(FROM_HERE, {}, base::BindOnce(&F));
fdoraybacba4a22017-05-10 21:10:00756 auto task_runner =
Gabriel Charette43de5c42020-01-27 22:44:45757 base::ThreadPool::CreateSequencedTaskRunner({});
fdoraybacba4a22017-05-10 21:10:00758 task_runner->PostTask(FROM_HERE, base::BindOnce(&G));
759
Gabriel Charette52fa3ae2019-04-15 21:44:37760 // To block until all tasks posted to thread pool are done running:
Gabriel Charette43fd3702019-05-29 16:36:51761 base::ThreadPoolInstance::Get()->FlushForTesting();
fdoraybacba4a22017-05-10 21:10:00762 // F and G have been executed.
763
Gabriel Charette43de5c42020-01-27 22:44:45764 base::ThreadPool::PostTaskAndReplyWithResult(
765 FROM_HERE, {}, base::BindOnce(&H), base::BindOnce(&I));
fdoraybacba4a22017-05-10 21:10:00766
767 // This runs the (Thread|Sequenced)TaskRunnerHandle queue until both the
Gabriel Charettebd126bc32022-02-01 18:19:19768 // (Thread|Sequenced)TaskRunnerHandle queue and the ThreadPool queue are
769 // empty. Prefer explicit exit conditions to RunUntilIdle when possible:
770 // bit.ly/run-until-idle-with-care2.
Gabriel Charette694c3c332019-08-19 14:53:05771 task_environment_.RunUntilIdle();
fdoraybacba4a22017-05-10 21:10:00772 // E, H, I have been executed.
773}
774```
775
Gabriel Charette52fa3ae2019-04-15 21:44:37776## Using ThreadPool in a New Process
fdoraybacba4a22017-05-10 21:10:00777
Gabriel Charette43fd3702019-05-29 16:36:51778ThreadPoolInstance needs to be initialized in a process before the functions in
Gabriel Charette04b138f2018-08-06 00:03:22779[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h)
Gabriel Charette43fd3702019-05-29 16:36:51780can be used. Initialization of ThreadPoolInstance in the Chrome browser process
781and child processes (renderer, GPU, utility) has already been taken care of. To
782use ThreadPoolInstance in another process, initialize ThreadPoolInstance early
783in the main function:
fdoraybacba4a22017-05-10 21:10:00784
785```cpp
Gabriel Charette43fd3702019-05-29 16:36:51786// This initializes and starts ThreadPoolInstance with default params.
787base::ThreadPoolInstance::CreateAndStartWithDefaultParams(“process_name”);
788// The base/task/post_task.h API can now be used with base::ThreadPool trait.
Jared Saulea867ab2021-07-15 17:39:01789// Tasks will be scheduled as they are posted.
fdoraybacba4a22017-05-10 21:10:00790
Gabriel Charette43fd3702019-05-29 16:36:51791// This initializes ThreadPoolInstance.
792base::ThreadPoolInstance::Create(“process_name”);
793// The base/task/post_task.h API can now be used with base::ThreadPool trait. No
794// threads will be created and no tasks will be scheduled until after Start() is
795// called.
796base::ThreadPoolInstance::Get()->Start(params);
Gabriel Charette52fa3ae2019-04-15 21:44:37797// ThreadPool can now create threads and schedule tasks.
fdoraybacba4a22017-05-10 21:10:00798```
799
Gabriel Charette43fd3702019-05-29 16:36:51800And shutdown ThreadPoolInstance late in the main function:
fdoraybacba4a22017-05-10 21:10:00801
802```cpp
Gabriel Charette43fd3702019-05-29 16:36:51803base::ThreadPoolInstance::Get()->Shutdown();
fdoraybacba4a22017-05-10 21:10:00804// Tasks posted with TaskShutdownBehavior::BLOCK_SHUTDOWN and
805// tasks posted with TaskShutdownBehavior::SKIP_ON_SHUTDOWN that
806// have started to run before the Shutdown() call have now completed their
807// execution. Tasks posted with
808// TaskShutdownBehavior::CONTINUE_ON_SHUTDOWN may still be
809// running.
810```
Gabriel Charetteb86e5fe62017-06-08 19:39:28811## TaskRunner ownership (encourage no dependency injection)
Sebastien Marchandc95489b2017-05-25 16:39:34812
813TaskRunners shouldn't be passed through several components. Instead, the
Jared Saulea867ab2021-07-15 17:39:01814component that uses a TaskRunner should be the one that creates it.
Sebastien Marchandc95489b2017-05-25 16:39:34815
816See [this example](https://codereview.chromium.org/2885173002/) of a
817refactoring where a TaskRunner was passed through a lot of components only to be
818used in an eventual leaf. The leaf can and should now obtain its TaskRunner
819directly from
Gabriel Charette04b138f2018-08-06 00:03:22820[`base/task/post_task.h`](https://cs.chromium.org/chromium/src/base/task/post_task.h).
Gabriel Charetteb86e5fe62017-06-08 19:39:28821
Gabriel Charette694c3c332019-08-19 14:53:05822As mentioned above, `base::test::TaskEnvironment` allows unit tests to
Gabriel Charette39db4c62019-04-29 19:52:38823control tasks posted from underlying TaskRunners. In rare cases where a test
824needs to more precisely control task ordering: dependency injection of
825TaskRunners can be useful. For such cases the preferred approach is the
826following:
Gabriel Charetteb86e5fe62017-06-08 19:39:28827
828```cpp
Gabriel Charette39db4c62019-04-29 19:52:38829class Foo {
Gabriel Charetteb86e5fe62017-06-08 19:39:28830 public:
831
Gabriel Charette39db4c62019-04-29 19:52:38832 // Overrides |background_task_runner_| in tests.
Gabriel Charetteb86e5fe62017-06-08 19:39:28833 void SetBackgroundTaskRunnerForTesting(
Gabriel Charette39db4c62019-04-29 19:52:38834 scoped_refptr<base::SequencedTaskRunner> background_task_runner) {
835 background_task_runner_ = std::move(background_task_runner);
836 }
Gabriel Charetteb86e5fe62017-06-08 19:39:28837
838 private:
michaelpg12c04572017-06-26 23:25:06839 scoped_refptr<base::SequencedTaskRunner> background_task_runner_ =
Gabriel Charette43de5c42020-01-27 22:44:45840 base::ThreadPool::CreateSequencedTaskRunner(
Gabriel Charetteb10aeeb2018-07-26 20:15:00841 {base::MayBlock(), base::TaskPriority::BEST_EFFORT});
Gabriel Charetteb86e5fe62017-06-08 19:39:28842}
843```
844
845Note that this still allows removing all layers of plumbing between //chrome and
846that component since unit tests will use the leaf layer directly.
Gabriel Charette8917f4c2018-11-22 15:50:28847
848## FAQ
849See [Threading and Tasks FAQ](threading_and_tasks_faq.md) for more examples.
Gabriel Charette43de5c42020-01-27 22:44:45850
851[task APIs v3]: https://docs.google.com/document/d/1tssusPykvx3g0gvbvU4HxGyn3MjJlIylnsH13-Tv6s4/edit?ts=5de99a52#heading=h.ss4tw38hvh3s
Carlos Caballero40b6d042020-06-16 06:50:25852
853## Internals
854
855### SequenceManager
856
857[SequenceManager](https://cs.chromium.org/chromium/src/base/task/sequence_manager/sequence_manager.h)
858manages TaskQueues which have different properties (e.g. priority, common task
859type) multiplexing all posted tasks into a single backing sequence. This will
860usually be a MessagePump. Depending on the type of message pump used other
861events such as UI messages may be processed as well. On Windows APC calls (as
862time permits) and signals sent to a registered set of HANDLEs may also be
863processed.
864
Carlos Caballero4a050922020-07-02 11:43:38865### MessagePump
Carlos Caballero40b6d042020-06-16 06:50:25866
867[MessagePumps](https://cs.chromium.org/chromium/src/base/message_loop/message_pump.h)
868are responsible for processing native messages as well as for giving cycles to
869their delegate (SequenceManager) periodically. MessagePumps take care to mixing
870delegate callbacks with native message processing so neither type of event
871starves the other of cycles.
872
873There are different [MessagePumpTypes](https://cs.chromium.org/chromium/src/base/message_loop/message_pump_type.h),
874most common are:
875
876* DEFAULT: Supports tasks and timers only
877
878* UI: Supports native UI events (e.g. Windows messages)
879
880* IO: Supports asynchronous IO (not file I/O!)
881
882* CUSTOM: User provided implementation of MessagePump interface
883
Carlos Caballero4a050922020-07-02 11:43:38884### RunLoop
Carlos Caballero40b6d042020-06-16 06:50:25885
Jared Saulea867ab2021-07-15 17:39:01886RunLoop is a helper class to run the RunLoop::Delegate associated with the
Carlos Caballero40b6d042020-06-16 06:50:25887current thread (usually a SequenceManager). Create a RunLoop on the stack and
888call Run/Quit to run a nested RunLoop but please avoid nested loops in
889production code!
890
Carlos Caballero4a050922020-07-02 11:43:38891### Task Reentrancy
Carlos Caballero40b6d042020-06-16 06:50:25892
893SequenceManager has task reentrancy protection. This means that if a
894task is being processed, a second task cannot start until the first task is
895finished. Reentrancy can happen when processing a task, and an inner
896message pump is created. That inner pump then processes native messages
897which could implicitly start an inner task. Inner message pumps are created
898with dialogs (DialogBox), common dialogs (GetOpenFileName), OLE functions
899(DoDragDrop), printer functions (StartDoc) and *many* others.
900
901```cpp
902Sample workaround when inner task processing is needed:
903 HRESULT hr;
904 {
Carlos Caballerob25fe8472020-07-17 10:27:17905 CurrentThread::ScopedNestableTaskAllower allow;
Carlos Caballero40b6d042020-06-16 06:50:25906 hr = DoDragDrop(...); // Implicitly runs a modal message loop.
907 }
908 // Process |hr| (the result returned by DoDragDrop()).
909```
910
911Please be SURE your task is reentrant (nestable) and all global variables
912are stable and accessible before before using
Carlos Caballerob25fe8472020-07-17 10:27:17913CurrentThread::ScopedNestableTaskAllower.
Carlos Caballero40b6d042020-06-16 06:50:25914
915## APIs for general use
916
917User code should hardly ever need to access SequenceManager APIs directly as
918these are meant for code that deals with scheduling. Instead you should use the
919following:
920
921* base::RunLoop: Drive the SequenceManager from the thread it's bound to.
922
923* base::Thread/SequencedTaskRunnerHandle: Post back to the SequenceManager TaskQueues from a task running on it.
924
925* SequenceLocalStorageSlot : Bind external state to a sequence.
926
Carlos Caballero4a050922020-07-02 11:43:38927* base::CurrentThread : Proxy to a subset of Task related APIs bound to the current thread
Carlos Caballero40b6d042020-06-16 06:50:25928
929* Embedders may provide their own static accessors to post tasks on specific loops (e.g. content::BrowserThreads).
930
931### SingleThreadTaskExecutor and TaskEnvironment
932
933Instead of having to deal with SequenceManager and TaskQueues code that needs a
934simple task posting environment (one default task queue) can use a
935[SingleThreadTaskExecutor](https://cs.chromium.org/chromium/src/base/task/single_thread_task_executor.h).
936
937Unit tests can use [TaskEnvironment](https://cs.chromium.org/chromium/src/base/test/task_environment.h)
938which is highly configurable.
Carlos Caballero4a050922020-07-02 11:43:38939
Wen Fane09439ca2021-03-09 16:50:41940## MessageLoop and MessageLoopCurrent
Carlos Caballero4a050922020-07-02 11:43:38941
Wen Fane09439ca2021-03-09 16:50:41942You might come across references to MessageLoop or MessageLoopCurrent in the
Carlos Caballero4a050922020-07-02 11:43:38943code or documentation. These classes no longer exist and we are in the process
Jared Saulea867ab2021-07-15 17:39:01944or getting rid of all references to them. `base::MessageLoopCurrent` was
945replaced by `base::CurrentThread` and the drop in replacements for
946`base::MessageLoop` are `base::SingleThreadTaskExecutor` and
947`base::Test::TaskEnvironment`.