zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 1 | # Adding third_party Libraries |
| 2 | |
| 3 | [TOC] |
| 4 | |
| 5 | Using third party code can save time and is consistent with our values - no need |
| 6 | to reinvent the wheel! We put all code that isn't written by Chromium developers |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 7 | into `//third_party` (even if you end up modifying just a few functions). We do |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 8 | this to make it easy to track license compliance, security patches, and supply |
| 9 | the right credit and attributions. It also makes it a lot easier for other |
| 10 | projects that embed our code to track what is Chromium licensed and what is |
| 11 | covered by other licenses. |
| 12 | |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 13 | ## Put the code in //third_party |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 14 | |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 15 | By default, all code should be checked into [//third_party](../third_party/), |
| 16 | for the reasons given above. Other locations are only appropriate in a few |
| 17 | situations and need explicit approval; don't assume that because there's some |
| 18 | other directory with third_party in the name it's okay to put new things |
| 19 | there. |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 20 | |
Tim van der Lippe | 5870ac3 | 2019-10-18 11:46:54 | [diff] [blame] | 21 | ## Before you start |
| 22 | |
| 23 | To make sure the inclusion of a new third_party project makes sense for the |
| 24 | Chromium project, you should first obtain Chrome Eng Review approval. |
| 25 | Googlers should see go/chrome-eng-review and review existing topics in |
| 26 | g/chrome-eng-review. Please include information about the additional checkout |
John Abd-El-Malek | 988e2c0 | 2020-08-18 04:49:24 | [diff] [blame] | 27 | size, build times, and binary size increase of |
| 28 | [official](https://www.chromium.org/developers/gn-build-configuration) builds |
| 29 | on Android and one desktop platform. Please also make sure that the motivation |
Tim van der Lippe | 5870ac3 | 2019-10-18 11:46:54 | [diff] [blame] | 30 | for your project is clear, e.g., a design doc has been circulated. |
| 31 | |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 32 | ## Get the code |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 33 | |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 34 | There are two common ways to depend on third-party code: you can reference a |
| 35 | Git repo directly (via entries in the DEPS file), or you can check in a |
| 36 | snapshot. The former is preferable if you are actively developing in it or need |
| 37 | access to the history; the latter is better if you don't need the full history |
| 38 | of the repo or don't need to pick up every single change. And, of course, if |
| 39 | the code you need isn't in a Git repo, you have to do the latter. |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 40 | |
Tim van der Lippe | 5870ac3 | 2019-10-18 11:46:54 | [diff] [blame] | 41 | ### Node packages |
| 42 | |
| 43 | To include a Node package, add the dependency to the |
| 44 | [Node package.json](../third_party/node/package.json). Make sure to update |
| 45 | the corresponding [`npm_exclude.txt`](../third_party/node/npm_exclude.txt) |
| 46 | and [`npm_include.txt`](../third_party/node/npm_include.txt) to make the code |
| 47 | available during checkout. |
| 48 | |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 49 | ### Pulling the code via DEPS |
| 50 | |
| 51 | If the code is in a Git repo that you want to mirror, please file an [infra git |
| 52 | ticket](https://bugs.chromium.org/p/chromium/issues/entry?template=Infra-Git) |
| 53 | to get the repo mirrored onto chromium.googlesource.com; we don't allow direct |
| 54 | dependencies on non-Google-hosted repositories, so that we can still build |
| 55 | if an external repository goes down.. |
| 56 | |
| 57 | Once the mirror is set up, add an entry to [//DEPS](../DEPS) so that gclient |
| 58 | will pull it in. If the code is only needed on some platforms, add a condition |
| 59 | to the deps entry so that developers on other platforms don't pull in things |
| 60 | they don't need. |
| 61 | |
| 62 | As for specifying the path where the library is fetched, a path like |
| 63 | `//third_party/<project_name>/src` is highly recommended so that you can put |
| 64 | the file like OWNERS or README.chromium at `//third_party/<project_name>`. If |
| 65 | you have a wrong path in DEPS and want to change the path of the existing |
| 66 | library in DEPS, please ask the infrastructure team before committing the |
| 67 | change. |
| 68 | |
David Dorwin | 7fde299b | 2020-09-25 02:10:34 | [diff] [blame^] | 69 | Lastly, add the new directory to Chromium's `//third_party/.gitignore`, so that |
| 70 | it won't show up as untracked files when you run `git status` on the main |
| 71 | repository. |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 72 | |
| 73 | ### Checking in the code directly |
| 74 | |
| 75 | If you are checking in a snapshot, please describe the source in the |
| 76 | README.chromium file, described below. For security reasons, please retrieve |
| 77 | the code as securely as you can, using HTTPS and GPG signatures if available. |
| 78 | If retrieving a tarball, please do not check the tarball itself into the tree, |
| 79 | but do list the source and the SHA-512 hash (for verification) in the |
| 80 | README.chromium and Change List. The SHA-512 hash can be computed via |
| 81 | `sha512sum` or `openssl dgst -sha512`. If retrieving from a git |
| 82 | repository, please list the revision that the code was pulled from. |
| 83 | |
| 84 | If you are checking the files in directly, you do not need an entry in DEPS |
David Dorwin | 7fde299b | 2020-09-25 02:10:34 | [diff] [blame^] | 85 | and do not need to modify `//third_party/.gitignore`. |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 86 | |
| 87 | ### Checking in large files |
| 88 | |
| 89 | _Accessible to Googlers only. Non-Googlers can email one of the people in |
| 90 | third_party/OWNERS for help. |
| 91 | |
| 92 | See [Moving large files to Google Storage](https://goto.google.com/checking-in-large-files) |
| 93 | |
| 94 | ## Document the code's context |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 95 | |
| 96 | ### Add OWNERS |
| 97 | |
Forrest Fleming | 80f7021 | 2020-07-01 00:13:50 | [diff] [blame] | 98 | Your OWNERS file must either list two Chromium developer accounts as the first |
| 99 | two lines or include a `file:` directive to an OWNERS file within the |
| 100 | `third_party` directory that itself conforms to this criterion. This will ensure |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 101 | accountability for maintenance of the code over time. While there isn't always |
| 102 | an ideal or obvious set of people that should go in OWNERS, this is critical for |
| 103 | first-line triage of any issues that crop up in the code. |
| 104 | |
| 105 | As an OWNER, you're expected to: |
| 106 | |
| 107 | * Remove the dependency when/if it is no longer needed |
| 108 | * Update the dependency when a security or stability bug is fixed upstream |
| 109 | * Help ensure the Chrome feature that uses the dependency continues to use the |
| 110 | dependency in the best way, as the feature and the dependency change over |
| 111 | time. |
| 112 | |
| 113 | ### Add a README.chromium |
| 114 | |
| 115 | You need a README.chromium file with information about the project from which |
| 116 | you're re-using code. See |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 117 | [//third_party/README.chromium.template](../third_party/README.chromium.template) |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 118 | for a list of fields to include. A presubmit check will check this has the right |
| 119 | format. |
| 120 | |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 121 | README.chromium files contain a field indicating whether the package is |
| 122 | security-critical or not. A package is security-critical if it is compiled |
| 123 | into the product and does any of the following: |
| 124 | |
| 125 | * Accepts untrustworthy inputs from the internet |
| 126 | * Parses or interprets complex input formats |
| 127 | * Sends data to internet servers |
| 128 | * Collects new data |
| 129 | * Influences or sets security-related policy (including the user experience) |
| 130 | |
Adrian Taylor | 0a06ec3 | 2020-03-03 05:00:07 | [diff] [blame] | 131 | One of the fields is CPEPrefix. This is used by Chromium and Google systems to |
| 132 | spot known upstream security vulnerabilities, and ensure we merge the fixes |
| 133 | into our third-party copy. These systems are not foolproof, so as the OWNER, |
| 134 | it's up to you to keep an eye out rather than solely relying on these |
| 135 | automated systems. But, adding CPEs decreases the chances of us missing |
| 136 | vulnerabilities, so they should always be added if possible. |
| 137 | |
| 138 | The CPE is a common format shared across the industry; you can look up the CPE |
| 139 | for your package [here](https://nvd.nist.gov/products/cpe/search). Please use |
| 140 | CPE format 2.2. When searching for a CPE, you may find that there is not yet |
| 141 | a CPE for the specific upstream version you're using. This is normal, as CPEs |
| 142 | are typically allocated only when a vulnerability is found. You should follow |
| 143 | the version number convention such that, when that does occur in future, we'll |
| 144 | be notified. If no CPE is available, please specify "unknown". |
| 145 | |
Adrian Taylor | 8e0d3fd | 2020-04-17 20:14:25 | [diff] [blame] | 146 | If you're using a patched or modified version which is halfway between two |
| 147 | public versions, please "round downwards" to the lower of the public versions |
| 148 | (it's better for us to be notified of false-positive vulnerabilities than |
| 149 | false-negatives). |
Adrian Taylor | 0a06ec3 | 2020-03-03 05:00:07 | [diff] [blame] | 150 | |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 151 | ### Add a LICENSE file and run related checks |
| 152 | |
| 153 | You need a LICENSE file. Example: |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 154 | [//third_party/libjpeg/LICENSE](../third_party/libjpeg/LICENSE). |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 155 | |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 156 | Run `//tools/licenses.py scan`; this will complain about incomplete or missing |
| 157 | data for third_party checkins. We use `licenses.py credits` to generate the |
| 158 | about:credits page in Google Chrome builds. |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 159 | |
| 160 | If the library will never be shipped as a part of Chrome (e.g. build-time tools, |
| 161 | testing tools), make sure to set "License File" as "NOT_SHIPPED" so that the |
Dirk Pranke | bf4136b | 2018-09-20 22:48:43 | [diff] [blame] | 162 | license is not included in about:credits page ([more on this below](#credits)). |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 163 | |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 164 | ## Get a review |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 165 | |
Aaron Gable | fc8cdad | 2018-01-16 21:02:40 | [diff] [blame] | 166 | All third party additions and substantive changes like re-licensing need the |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 167 | following sign-offs. Some of these are accessible to Googlers only. |
| 168 | Non-Googlers can email one of the people in |
| 169 | [//third_party/OWNERS](../third_party/OWNERS) for help. |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 170 | |
Tim van der Lippe | 8c749839 | 2019-10-28 12:21:04 | [diff] [blame] | 171 | * Make sure you have the approval from Chrome Eng Review as mentioned |
| 172 | [above](#before-you-start). |
Aaron Gable | fc8cdad | 2018-01-16 21:02:40 | [diff] [blame] | 173 | * Get security@chromium.org approval. Email the list with relevant details and |
| 174 | a link to the CL. Third party code is a hot spot for security vulnerabilities. |
| 175 | When adding a new package that could potentially carry security risk, make |
| 176 | sure to highlight risk to security@chromium.org. You may be asked to add |
| 177 | a README.security or, in dangerous cases, README.SECURITY.URGENTLY file. |
Dirk Pranke | 6fb90c0 | 2018-10-17 02:02:20 | [diff] [blame] | 178 | * Add chromium-third-party@google.com as a reviewer on your change. This |
Adam Langley | 88658b3 | 2018-11-20 22:12:47 | [diff] [blame] | 179 | will trigger an automatic round-robin assignment to a reviewer who will check |
| 180 | licensing matters. These reviewers may not be able to +1 a change so look for |
| 181 | verbal approval in the comments. (This list does not receive or deliver |
| 182 | email, so only use it as a reviewer, not for other communication. Internally, |
Dirk Pranke | f743281 | 2020-06-10 22:38:20 | [diff] [blame] | 183 | see [cl/221704656](https://cl/221704656) for details about how |
| 184 | this is configured.). If you have questions about the third-party process, |
| 185 | ask one of the [//third_party/OWNERS](../third_party/OWNERS) instead. |
Adam Langley | 88658b3 | 2018-11-20 22:12:47 | [diff] [blame] | 186 | * Lastly, if all other steps are complete, get a positive code review from a |
| 187 | member of [//third_party/OWNERS](../third_party/OWNERS) to land the change. |
zpeng | 8d6f584a | 2016-12-16 20:50:28 | [diff] [blame] | 188 | |
Dirk Pranke | 6fb90c0 | 2018-10-17 02:02:20 | [diff] [blame] | 189 | Please send separate emails to the eng review and security lists. |
jochen | 893d518 | 2017-01-31 22:01:49 | [diff] [blame] | 190 | |
Dirk Pranke | 568e95c | 2018-11-01 23:41:50 | [diff] [blame] | 191 | Subsequent changes don't normally require third-party-owners or security |
| 192 | approval; you can modify the code as much as you want. When you update code, be |
| 193 | mindful of security-related mailing lists for the project and relevant CVE to |
| 194 | update your package. |
Dirk Pranke | bf4136b | 2018-09-20 22:48:43 | [diff] [blame] | 195 | |
| 196 | ## How we ensure that the right credits are displayed {#credits} |
| 197 | |
| 198 | As we said at the beginning, it is important that Chrome displays the |
| 199 | right credit and attributions for all of the third_party code we use. |
| 200 | |
| 201 | To view this in chrome, you can open chrome://credits. |
| 202 | |
| 203 | That page displays a resource embedded in the browser as part of the |
| 204 | [//components/resources/components_resources.grd](../components/resources/components_resource.grd) |
| 205 | GRIT file; the actual HTML text is generated in the |
| 206 | [//components/resources:about_credits](../components/resources/BUILD.gn) |
| 207 | build target using a template from the output of the |
| 208 | [//tools/licenses.py](../tools/licenses.py) script. Assuming you've followed |
| 209 | the rules above to ensure that you have the proper LICENSE file and it passes |
| 210 | the checks, it'll be included automatically. |