blob: 2f5d235a33280fae5aca7cf6e246eb0970aa5ed2 [file] [log] [blame] [view]
zpeng8d6f584a2016-12-16 20:50:281# Adding third_party Libraries
2
3[TOC]
4
5Using third party code can save time and is consistent with our values - no need
6to reinvent the wheel! We put all code that isn't written by Chromium developers
7into src/third_party (even if you end up modifying just a few functions). We do
8this to make it easy to track license compliance, security patches, and supply
9the right credit and attributions. It also makes it a lot easier for other
10projects that embed our code to track what is Chromium licensed and what is
11covered by other licenses.
12
13## Get the Code
14
15When you find code you want to use, get it. This often means downloading: from
16Sourceforge, from the hosting feature of Google Code, or from somewhere else.
17Sometimes it can mean negotiating a license with another company and receiving
18the code another way. Please describe the source in the README.chromium file,
19described below. For security reasons, please retrieve the code as securely as
20you can, using HTTPS and GPG signatures if available. If retrieving a tarball,
21please do not check the tarball itself into the tree, but do list the source and
22the SHA-512 hash (for verification) in the README.chromium and Change List. The
23SHA-512 hash can be computed via the `shasum (sha512sum)` or `openssl`
24utilities. If retrieving from a git repository, please list the SHA-512 hash.
25
26## Put the Code in (the right) third_party
27
28By default, all code should be checked into
29[src/third_party](http://src.chromium.org/viewvc/chrome/trunk/src/third_party/).
30It is OK to have third_party subdirectories that are not top-level (e.g.
31src/net/third_party), but don't add more third_party directories than necessary.
32
33## Document the Code's Context
34
35### Add OWNERS
36
37Your OWNERS file must include 2 Chromium developer accounts. This will ensure
38accountability for maintenance of the code over time. While there isn't always
39an ideal or obvious set of people that should go in OWNERS, this is critical for
40first-line triage of any issues that crop up in the code.
41
42As an OWNER, you're expected to:
43
44* Remove the dependency when/if it is no longer needed
45* Update the dependency when a security or stability bug is fixed upstream
46* Help ensure the Chrome feature that uses the dependency continues to use the
47 dependency in the best way, as the feature and the dependency change over
48 time.
49
50### Add a README.chromium
51
52You need a README.chromium file with information about the project from which
53you're re-using code. See
54[README.chromium.template](http://src.chromium.org/viewvc/chrome/trunk/src/third_party/README.chromium.template)
55for a list of fields to include. A presubmit check will check this has the right
56format.
57
58### Add a LICENSE file and run related checks
59
60You need a LICENSE file. Example:
61[third_party/libjpeg/LICENSE](http://src.chromium.org/viewvc/chrome/trunk/src/third_party/libjpeg/LICENSE?revision=42288&view=markup).
62
63Run the following scripts:
64
65* `src/tools/licenses.py scan` - This will complain about incomplete or missing
66 data for third_party checkins. We use 'licenses.py credits' to generate the
67 about:credits page in Google Chrome builds.
boushley76393b22017-04-19 17:24:3868* `src/tools/checklicenses/checklicenses.py` - See below for info on how to
69 handle possible failures.
zpeng8d6f584a2016-12-16 20:50:2870
71See the ["Odds n' Ends"](adding_to_third_party.md#Odds-n_Ends) Section below if
72you run into any failures running these.
73
74If the library will never be shipped as a part of Chrome (e.g. build-time tools,
75testing tools), make sure to set "License File" as "NOT_SHIPPED" so that the
76license is not included in about:credits page.
77
78### Modify DEPS
79
80If the code is applicable and will be compiled on all supported Chromium
derat817105082017-02-22 17:57:5581platforms (Windows, Mac, Linux, Chrome OS, iOS, Android), check it in to
zpeng8d6f584a2016-12-16 20:50:2882[src/third_party](http://src.chromium.org/viewvc/chrome/trunk/src/third_party/).
83
84If the code is only applicable to certain platforms, check it in to
85[src/third_party](http://src.chromium.org/viewvc/chrome/trunk/src/third_party/)
86and add an entry to the
87[DEPS](http://src.chromium.org/viewvc/chrome/trunk/src/DEPS) file that causes
88the code to be checked out from src/third_party into src/third_party by gclient.
89
90_Explanation: Checking it into src/third_party causes all developers to need to
91check out your code. This wastes disk space cause syncing to take longer for
92developers that don't need your code. When all platforms really do need the
93code, checking it in to src/third_party allows some slight improvements over
94DEPS._
95
96As for specifying the path where the library is fetched, a path like
97`src/third_party/<project_name>/src` is highly recommended so that you can put
98the file like OWNERS or README.chromium at `third_party/<project_name>`. If you
99have a wrong path in DEPS and want to change the path of the existing library in
100DEPS, please ask the infrastructure team before committing the change.
101
zpeng2d0d3d82016-12-16 21:48:21102### Checking in large files
103_Accessible to Googlers only. Non-Googlers can email one of the people in
104third_party/OWNERS for help._
105
106See [Moving large files to Google Storage](https://goto.google.com/checking-in-large-files)
107
zpeng8d6f584a2016-12-16 20:50:28108## Setting up ignore
109
110If your code is synced via DEPS, you should add the new directory to Chromium's
111`.gitignore`. This is necessary because Chromium's main git repository already
112contains
113[src/third_party](http://src.chromium.org/viewvc/chrome/trunk/src/third_party/)
114and the project synced via DEPS is nested inside of it and its files regarded as
115untracked. That is, anyone running `git status` from `src/` would see a clutter.
116Your project's files are tracked by your repository, not Chromium's, so make
117sure the directory is listed in Chromium's `.gitignore`.
118
119## Get a Review
120
121All third party additions and substantive changes like re-licensing need the
122following sign-offs. Some of these are accessible to Googlers only. Non-Googlers
123can email one of the people in third_party/OWNERS for help.
124
jochen893d5182017-01-31 22:01:49125* Chrome Eng Review. Googlers should see go/chrome-eng-review (please include information about the additional checkout size, build times, and binary sizes. Please also make sure that the motivation for your project is clear, e.g., a design doc has been circulated).
zpeng8d6f584a2016-12-16 20:50:28126* [email protected] (ping the list with relevant
127 details and a link to the CL).
128* [email protected] (ping the list with relevant details and a link to the
129 CL).
130
jochen893d5182017-01-31 22:01:49131Please send separate emails to the three lists.
132
zpeng8d6f584a2016-12-16 20:50:28133Third party code is a hot spot for security vulnerabilities. When adding a new
134package that could potentially carry security risk, make sure to highlight risk
135to [email protected]. You may be asked to add a README.security or, in
136dangerous cases, README.SECURITY.URGENTLY file. When you update your code, be
137mindful of security-related mailing lists for the project and relevant CVE to
138update your package.
139
140Subsequent changes don't require third-party-owners approval; you can modify the
141code as much as you want.
142
143## Ask the infrastructure team to add a git mirror for the dependency (or
144configure the git repo, if using googlesource.com)
145
146Before committing the DEPS, you need to ask the infra team to create a git
147mirror for your dependency. [Create a
148ticket](https://bugs.chromium.org/p/chromium/issues/entry?template=Infra-Git)
149for infra and ask the infra team.
150
151If you are using a git repo from googlesource.com then you must ensure that the
152repository is configured to give the build bots unlimited quota, or else the
153builders will fail to checkout with an "Over Quota" error. [Create a
154ticket](https://bugs.chromium.org/p/chromium/issues/entry?template=Infra-Git)
155for infra and ask the infra team what needs to be done. Note that you'll need
156unlimited quota for at least two role accounts. See the quota status of
157`boringssl` as an example.
158
159## Odds n' Ends
160
161### Handling `licenses_check (checklicenses.py)` failures
162
163This is needed for [Issue
16428291](http://code.google.com/p/chromium/issues/detail?id=28291): Pass the
165Ubuntu license check script:
166
167__If the failure looks like ... ... the right action is to ... __
168
169* 'filename' has non-whitelisted license 'UNKNOWN'
170 * Ideally make the licensecheck.pl script recognize the license of that
171 file. Often this requires __adding a license header__. Does it have
172 license header? If it's third party code, ask the upstream project to make
173 sure all their files have license headers. If the license header is there
174 but is not recognized, we should try to patch licensecheck.pl. If in
175 doubt please contact [email protected]
176* 'filename' has non-whitelisted license 'X' and X is BSD-compatible
177 * Add the license X to WHITELISTED_LICENSES in checklicenses.py . Make sure
178 to respect the OWNERS of that file. You must get an approval before
179 landing. CLs violating this requirement may be reverted.
180* 'filename' has non-whitelisted license 'X' and X is not BSD-compatible (i.e.
181 GPL)
182 * Do you really need to add those files? Chromium is BSD-licensed so the
183 resulting binaries can't use GPL code. Ideally we just shouldn't have
184 those files at all in the tree. If in doubt, please ask [email protected]
185