blob: 4289c29d7c5a2c6a2e9736660f6454b01fdeffbf [file] [log] [blame]
Eric Biggersf4f864c2017-10-29 06:30:14 -04001=====================================
2Filesystem-level encryption (fscrypt)
3=====================================
4
5Introduction
6============
7
8fscrypt is a library which filesystems can hook into to support
9transparent encryption of files and directories.
10
11Note: "fscrypt" in this document refers to the kernel-level portion,
12implemented in ``fs/crypto/``, as opposed to the userspace tool
13`fscrypt <https://github.com/google/fscrypt>`_. This document only
14covers the kernel-level portion. For command-line examples of how to
15use encryption, see the documentation for the userspace tool `fscrypt
16<https://github.com/google/fscrypt>`_. Also, it is recommended to use
17the fscrypt userspace tool, or other existing userspace tools such as
18`fscryptctl <https://github.com/google/fscryptctl>`_ or `Android's key
19management system
20<https://source.android.com/security/encryption/file-based>`_, over
21using the kernel's API directly. Using existing tools reduces the
22chance of introducing your own security bugs. (Nevertheless, for
23completeness this documentation covers the kernel's API anyway.)
24
25Unlike dm-crypt, fscrypt operates at the filesystem level rather than
26at the block device level. This allows it to encrypt different files
27with different keys and to have unencrypted files on the same
28filesystem. This is useful for multi-user systems where each user's
29data-at-rest needs to be cryptographically isolated from the others.
30However, except for filenames, fscrypt does not encrypt filesystem
31metadata.
32
33Unlike eCryptfs, which is a stacked filesystem, fscrypt is integrated
34directly into supported filesystems --- currently ext4, F2FS, and
35UBIFS. This allows encrypted files to be read and written without
36caching both the decrypted and encrypted pages in the pagecache,
37thereby nearly halving the memory used and bringing it in line with
38unencrypted files. Similarly, half as many dentries and inodes are
39needed. eCryptfs also limits encrypted filenames to 143 bytes,
40causing application compatibility issues; fscrypt allows the full 255
41bytes (NAME_MAX). Finally, unlike eCryptfs, the fscrypt API can be
42used by unprivileged users, with no need to mount anything.
43
44fscrypt does not support encrypting files in-place. Instead, it
45supports marking an empty directory as encrypted. Then, after
46userspace provides the key, all regular files, directories, and
47symbolic links created in that directory tree are transparently
48encrypted.
49
50Threat model
51============
52
53Offline attacks
54---------------
55
56Provided that userspace chooses a strong encryption key, fscrypt
57protects the confidentiality of file contents and filenames in the
58event of a single point-in-time permanent offline compromise of the
59block device content. fscrypt does not protect the confidentiality of
60non-filename metadata, e.g. file sizes, file permissions, file
61timestamps, and extended attributes. Also, the existence and location
62of holes (unallocated blocks which logically contain all zeroes) in
63files is not protected.
64
65fscrypt is not guaranteed to protect confidentiality or authenticity
66if an attacker is able to manipulate the filesystem offline prior to
67an authorized user later accessing the filesystem.
68
69Online attacks
70--------------
71
72fscrypt (and storage encryption in general) can only provide limited
73protection, if any at all, against online attacks. In detail:
74
Eric Biggersba13f2c2019-08-04 19:35:49 -070075Side-channel attacks
76~~~~~~~~~~~~~~~~~~~~
77
Eric Biggersf4f864c2017-10-29 06:30:14 -040078fscrypt is only resistant to side-channel attacks, such as timing or
79electromagnetic attacks, to the extent that the underlying Linux
80Cryptographic API algorithms are. If a vulnerable algorithm is used,
81such as a table-based implementation of AES, it may be possible for an
82attacker to mount a side channel attack against the online system.
83Side channel attacks may also be mounted against applications
84consuming decrypted data.
85
Eric Biggersba13f2c2019-08-04 19:35:49 -070086Unauthorized file access
87~~~~~~~~~~~~~~~~~~~~~~~~
Eric Biggersf4f864c2017-10-29 06:30:14 -040088
Eric Biggersba13f2c2019-08-04 19:35:49 -070089After an encryption key has been added, fscrypt does not hide the
90plaintext file contents or filenames from other users on the same
91system. Instead, existing access control mechanisms such as file mode
92bits, POSIX ACLs, LSMs, or namespaces should be used for this purpose.
Eric Biggersf4f864c2017-10-29 06:30:14 -040093
Eric Biggersba13f2c2019-08-04 19:35:49 -070094(For the reasoning behind this, understand that while the key is
95added, the confidentiality of the data, from the perspective of the
96system itself, is *not* protected by the mathematical properties of
97encryption but rather only by the correctness of the kernel.
98Therefore, any encryption-specific access control checks would merely
99be enforced by kernel *code* and therefore would be largely redundant
100with the wide variety of access control mechanisms already available.)
101
102Kernel memory compromise
103~~~~~~~~~~~~~~~~~~~~~~~~
104
105An attacker who compromises the system enough to read from arbitrary
106memory, e.g. by mounting a physical attack or by exploiting a kernel
107security vulnerability, can compromise all encryption keys that are
108currently in use.
109
110However, fscrypt allows encryption keys to be removed from the kernel,
111which may protect them from later compromise.
112
113In more detail, the FS_IOC_REMOVE_ENCRYPTION_KEY ioctl (or the
114FS_IOC_REMOVE_ENCRYPTION_KEY_ALL_USERS ioctl) can wipe a master
115encryption key from kernel memory. If it does so, it will also try to
116evict all cached inodes which had been "unlocked" using the key,
117thereby wiping their per-file keys and making them once again appear
118"locked", i.e. in ciphertext or encrypted form.
119
120However, these ioctls have some limitations:
121
122- Per-file keys for in-use files will *not* be removed or wiped.
123 Therefore, for maximum effect, userspace should close the relevant
124 encrypted files and directories before removing a master key, as
125 well as kill any processes whose working directory is in an affected
126 encrypted directory.
127
128- The kernel cannot magically wipe copies of the master key(s) that
129 userspace might have as well. Therefore, userspace must wipe all
130 copies of the master key(s) it makes as well; normally this should
131 be done immediately after FS_IOC_ADD_ENCRYPTION_KEY, without waiting
132 for FS_IOC_REMOVE_ENCRYPTION_KEY. Naturally, the same also applies
133 to all higher levels in the key hierarchy. Userspace should also
134 follow other security precautions such as mlock()ing memory
135 containing keys to prevent it from being swapped out.
136
137- In general, decrypted contents and filenames in the kernel VFS
138 caches are freed but not wiped. Therefore, portions thereof may be
139 recoverable from freed memory, even after the corresponding key(s)
140 were wiped. To partially solve this, you can set
141 CONFIG_PAGE_POISONING=y in your kernel config and add page_poison=1
142 to your kernel command line. However, this has a performance cost.
143
144- Secret keys might still exist in CPU registers, in crypto
145 accelerator hardware (if used by the crypto API to implement any of
146 the algorithms), or in other places not explicitly considered here.
147
148Limitations of v1 policies
149~~~~~~~~~~~~~~~~~~~~~~~~~~
150
151v1 encryption policies have some weaknesses with respect to online
152attacks:
153
154- There is no verification that the provided master key is correct.
155 Therefore, a malicious user can temporarily associate the wrong key
156 with another user's encrypted files to which they have read-only
157 access. Because of filesystem caching, the wrong key will then be
158 used by the other user's accesses to those files, even if the other
159 user has the correct key in their own keyring. This violates the
160 meaning of "read-only access".
161
162- A compromise of a per-file key also compromises the master key from
163 which it was derived.
164
165- Non-root users cannot securely remove encryption keys.
166
167All the above problems are fixed with v2 encryption policies. For
168this reason among others, it is recommended to use v2 encryption
169policies on all new encrypted directories.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400170
171Key hierarchy
172=============
173
174Master Keys
175-----------
176
177Each encrypted directory tree is protected by a *master key*. Master
178keys can be up to 64 bytes long, and must be at least as long as the
179greater of the key length needed by the contents and filenames
180encryption modes being used. For example, if AES-256-XTS is used for
181contents encryption, the master key must be 64 bytes (512 bits). Note
182that the XTS mode is defined to require a key twice as long as that
183required by the underlying block cipher.
184
185To "unlock" an encrypted directory tree, userspace must provide the
186appropriate master key. There can be any number of master keys, each
187of which protects any number of directory trees on any number of
188filesystems.
189
Eric Biggersba13f2c2019-08-04 19:35:49 -0700190Master keys must be real cryptographic keys, i.e. indistinguishable
191from random bytestrings of the same length. This implies that users
192**must not** directly use a password as a master key, zero-pad a
193shorter key, or repeat a shorter key. Security cannot be guaranteed
194if userspace makes any such error, as the cryptographic proofs and
195analysis would no longer apply.
196
197Instead, users should generate master keys either using a
198cryptographically secure random number generator, or by using a KDF
199(Key Derivation Function). The kernel does not do any key stretching;
200therefore, if userspace derives the key from a low-entropy secret such
201as a passphrase, it is critical that a KDF designed for this purpose
202be used, such as scrypt, PBKDF2, or Argon2.
203
204Key derivation function
205-----------------------
206
207With one exception, fscrypt never uses the master key(s) for
208encryption directly. Instead, they are only used as input to a KDF
209(Key Derivation Function) to derive the actual keys.
210
211The KDF used for a particular master key differs depending on whether
212the key is used for v1 encryption policies or for v2 encryption
213policies. Users **must not** use the same key for both v1 and v2
214encryption policies. (No real-world attack is currently known on this
215specific case of key reuse, but its security cannot be guaranteed
216since the cryptographic proofs and analysis would no longer apply.)
217
218For v1 encryption policies, the KDF only supports deriving per-file
219encryption keys. It works by encrypting the master key with
220AES-128-ECB, using the file's 16-byte nonce as the AES key. The
221resulting ciphertext is used as the derived key. If the ciphertext is
222longer than needed, then it is truncated to the needed length.
223
224For v2 encryption policies, the KDF is HKDF-SHA512. The master key is
225passed as the "input keying material", no salt is used, and a distinct
226"application-specific information string" is used for each distinct
227key to be derived. For example, when a per-file encryption key is
228derived, the application-specific information string is the file's
229nonce prefixed with "fscrypt\\0" and a context byte. Different
230context bytes are used for other types of derived keys.
231
232HKDF-SHA512 is preferred to the original AES-128-ECB based KDF because
233HKDF is more flexible, is nonreversible, and evenly distributes
234entropy from the master key. HKDF is also standardized and widely
235used by other software, whereas the AES-128-ECB based KDF is ad-hoc.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400236
237Per-file keys
238-------------
239
Eric Biggers8094c3c2019-01-06 08:36:21 -0500240Since each master key can protect many files, it is necessary to
241"tweak" the encryption of each file so that the same plaintext in two
242files doesn't map to the same ciphertext, or vice versa. In most
243cases, fscrypt does this by deriving per-file keys. When a new
244encrypted inode (regular file, directory, or symlink) is created,
245fscrypt randomly generates a 16-byte nonce and stores it in the
Eric Biggersba13f2c2019-08-04 19:35:49 -0700246inode's encryption xattr. Then, it uses a KDF (as described in `Key
247derivation function`_) to derive the file's key from the master key
248and nonce.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400249
Eric Biggers8094c3c2019-01-06 08:36:21 -0500250Key derivation was chosen over key wrapping because wrapped keys would
251require larger xattrs which would be less likely to fit in-line in the
252filesystem's inode table, and there didn't appear to be any
253significant advantages to key wrapping. In particular, currently
254there is no requirement to support unlocking a file with multiple
255alternative master keys or to support rotating master keys. Instead,
256the master keys may be wrapped in userspace, e.g. as is done by the
257`fscrypt <https://github.com/google/fscrypt>`_ tool.
258
259Including the inode number in the IVs was considered. However, it was
260rejected as it would have prevented ext4 filesystems from being
261resized, and by itself still wouldn't have been sufficient to prevent
262the same key from being directly reused for both XTS and CTS-CBC.
263
Eric Biggersba13f2c2019-08-04 19:35:49 -0700264DIRECT_KEY and per-mode keys
265----------------------------
266
267The Adiantum encryption mode (see `Encryption modes and usage`_) is
268suitable for both contents and filenames encryption, and it accepts
269long IVs --- long enough to hold both an 8-byte logical block number
270and a 16-byte per-file nonce. Also, the overhead of each Adiantum key
271is greater than that of an AES-256-XTS key.
272
273Therefore, to improve performance and save memory, for Adiantum a
274"direct key" configuration is supported. When the user has enabled
275this by setting FSCRYPT_POLICY_FLAG_DIRECT_KEY in the fscrypt policy,
276per-file keys are not used. Instead, whenever any data (contents or
277filenames) is encrypted, the file's 16-byte nonce is included in the
278IV. Moreover:
279
280- For v1 encryption policies, the encryption is done directly with the
281 master key. Because of this, users **must not** use the same master
282 key for any other purpose, even for other v1 policies.
283
284- For v2 encryption policies, the encryption is done with a per-mode
285 key derived using the KDF. Users may use the same master key for
286 other v2 encryption policies.
287
288Key identifiers
289---------------
290
291For master keys used for v2 encryption policies, a unique 16-byte "key
292identifier" is also derived using the KDF. This value is stored in
293the clear, since it is needed to reliably identify the key itself.
294
Eric Biggersf4f864c2017-10-29 06:30:14 -0400295Encryption modes and usage
296==========================
297
298fscrypt allows one encryption mode to be specified for file contents
299and one encryption mode to be specified for filenames. Different
300directory trees are permitted to use different encryption modes.
301Currently, the following pairs of encryption modes are supported:
302
303- AES-256-XTS for contents and AES-256-CTS-CBC for filenames
304- AES-128-CBC for contents and AES-128-CTS-CBC for filenames
Eric Biggers8094c3c2019-01-06 08:36:21 -0500305- Adiantum for both contents and filenames
Eric Biggersf4f864c2017-10-29 06:30:14 -0400306
Eric Biggers8094c3c2019-01-06 08:36:21 -0500307If unsure, you should use the (AES-256-XTS, AES-256-CTS-CBC) pair.
308
Eric Biggersf4f864c2017-10-29 06:30:14 -0400309AES-128-CBC was added only for low-powered embedded devices with
Eric Biggersadbd9b42019-06-20 11:15:05 -0700310crypto accelerators such as CAAM or CESA that do not support XTS. To
311use AES-128-CBC, CONFIG_CRYPTO_SHA256 (or another SHA-256
312implementation) must be enabled so that ESSIV can be used.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400313
Eric Biggers8094c3c2019-01-06 08:36:21 -0500314Adiantum is a (primarily) stream cipher-based mode that is fast even
315on CPUs without dedicated crypto instructions. It's also a true
316wide-block mode, unlike XTS. It can also eliminate the need to derive
317per-file keys. However, it depends on the security of two primitives,
318XChaCha12 and AES-256, rather than just one. See the paper
319"Adiantum: length-preserving encryption for entry-level processors"
320(https://eprint.iacr.org/2018/720.pdf) for more details. To use
321Adiantum, CONFIG_CRYPTO_ADIANTUM must be enabled. Also, fast
322implementations of ChaCha and NHPoly1305 should be enabled, e.g.
323CONFIG_CRYPTO_CHACHA20_NEON and CONFIG_CRYPTO_NHPOLY1305_NEON for ARM.
324
Eric Biggersf4f864c2017-10-29 06:30:14 -0400325New encryption modes can be added relatively easily, without changes
326to individual filesystems. However, authenticated encryption (AE)
327modes are not currently supported because of the difficulty of dealing
328with ciphertext expansion.
329
Eric Biggers8094c3c2019-01-06 08:36:21 -0500330Contents encryption
331-------------------
332
Eric Biggersf4f864c2017-10-29 06:30:14 -0400333For file contents, each filesystem block is encrypted independently.
334Currently, only the case where the filesystem block size is equal to
Eric Biggers8094c3c2019-01-06 08:36:21 -0500335the system's page size (usually 4096 bytes) is supported.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400336
Eric Biggers8094c3c2019-01-06 08:36:21 -0500337Each block's IV is set to the logical block number within the file as
338a little endian number, except that:
Eric Biggersf4f864c2017-10-29 06:30:14 -0400339
Eric Biggers8094c3c2019-01-06 08:36:21 -0500340- With CBC mode encryption, ESSIV is also used. Specifically, each IV
341 is encrypted with AES-256 where the AES-256 key is the SHA-256 hash
342 of the file's data encryption key.
343
Eric Biggers2336d0d2019-08-04 19:35:44 -0700344- In the "direct key" configuration (FSCRYPT_POLICY_FLAG_DIRECT_KEY
345 set in the fscrypt_policy), the file's nonce is also appended to the
346 IV. Currently this is only allowed with the Adiantum encryption
347 mode.
Eric Biggers8094c3c2019-01-06 08:36:21 -0500348
349Filenames encryption
350--------------------
351
352For filenames, each full filename is encrypted at once. Because of
353the requirements to retain support for efficient directory lookups and
354filenames of up to 255 bytes, the same IV is used for every filename
355in a directory.
356
357However, each encrypted directory still uses a unique key; or
358alternatively (for the "direct key" configuration) has the file's
359nonce included in the IVs. Thus, IV reuse is limited to within a
360single directory.
361
362With CTS-CBC, the IV reuse means that when the plaintext filenames
363share a common prefix at least as long as the cipher block size (16
364bytes for AES), the corresponding encrypted filenames will also share
365a common prefix. This is undesirable. Adiantum does not have this
366weakness, as it is a wide-block encryption mode.
367
368All supported filenames encryption modes accept any plaintext length
369>= 16 bytes; cipher block alignment is not required. However,
370filenames shorter than 16 bytes are NUL-padded to 16 bytes before
371being encrypted. In addition, to reduce leakage of filename lengths
372via their ciphertexts, all filenames are NUL-padded to the next 4, 8,
37316, or 32-byte boundary (configurable). 32 is recommended since this
374provides the best confidentiality, at the cost of making directory
375entries consume slightly more space. Note that since NUL (``\0``) is
376not otherwise a valid character in filenames, the padding will never
377produce duplicate plaintexts.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400378
379Symbolic link targets are considered a type of filename and are
Eric Biggers8094c3c2019-01-06 08:36:21 -0500380encrypted in the same way as filenames in directory entries, except
381that IV reuse is not a problem as each symlink has its own inode.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400382
383User API
384========
385
386Setting an encryption policy
387----------------------------
388
Eric Biggersba13f2c2019-08-04 19:35:49 -0700389FS_IOC_SET_ENCRYPTION_POLICY
390~~~~~~~~~~~~~~~~~~~~~~~~~~~~
391
Eric Biggersf4f864c2017-10-29 06:30:14 -0400392The FS_IOC_SET_ENCRYPTION_POLICY ioctl sets an encryption policy on an
393empty directory or verifies that a directory or regular file already
394has the specified encryption policy. It takes in a pointer to a
Eric Biggersba13f2c2019-08-04 19:35:49 -0700395:c:type:`struct fscrypt_policy_v1` or a :c:type:`struct
396fscrypt_policy_v2`, defined as follows::
Eric Biggersf4f864c2017-10-29 06:30:14 -0400397
Eric Biggersba13f2c2019-08-04 19:35:49 -0700398 #define FSCRYPT_POLICY_V1 0
399 #define FSCRYPT_KEY_DESCRIPTOR_SIZE 8
400 struct fscrypt_policy_v1 {
Eric Biggersf4f864c2017-10-29 06:30:14 -0400401 __u8 version;
402 __u8 contents_encryption_mode;
403 __u8 filenames_encryption_mode;
404 __u8 flags;
Eric Biggers2336d0d2019-08-04 19:35:44 -0700405 __u8 master_key_descriptor[FSCRYPT_KEY_DESCRIPTOR_SIZE];
Eric Biggersf4f864c2017-10-29 06:30:14 -0400406 };
Eric Biggersba13f2c2019-08-04 19:35:49 -0700407 #define fscrypt_policy fscrypt_policy_v1
408
409 #define FSCRYPT_POLICY_V2 2
410 #define FSCRYPT_KEY_IDENTIFIER_SIZE 16
411 struct fscrypt_policy_v2 {
412 __u8 version;
413 __u8 contents_encryption_mode;
414 __u8 filenames_encryption_mode;
415 __u8 flags;
416 __u8 __reserved[4];
417 __u8 master_key_identifier[FSCRYPT_KEY_IDENTIFIER_SIZE];
418 };
Eric Biggersf4f864c2017-10-29 06:30:14 -0400419
420This structure must be initialized as follows:
421
Eric Biggersba13f2c2019-08-04 19:35:49 -0700422- ``version`` must be FSCRYPT_POLICY_V1 (0) if the struct is
423 :c:type:`fscrypt_policy_v1` or FSCRYPT_POLICY_V2 (2) if the struct
424 is :c:type:`fscrypt_policy_v2`. (Note: we refer to the original
425 policy version as "v1", though its version code is really 0.) For
426 new encrypted directories, use v2 policies.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400427
428- ``contents_encryption_mode`` and ``filenames_encryption_mode`` must
Eric Biggers2336d0d2019-08-04 19:35:44 -0700429 be set to constants from ``<linux/fscrypt.h>`` which identify the
430 encryption modes to use. If unsure, use FSCRYPT_MODE_AES_256_XTS
431 (1) for ``contents_encryption_mode`` and FSCRYPT_MODE_AES_256_CTS
432 (4) for ``filenames_encryption_mode``.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400433
Eric Biggers2336d0d2019-08-04 19:35:44 -0700434- ``flags`` must contain a value from ``<linux/fscrypt.h>`` which
Eric Biggersf4f864c2017-10-29 06:30:14 -0400435 identifies the amount of NUL-padding to use when encrypting
Eric Biggersba13f2c2019-08-04 19:35:49 -0700436 filenames. If unsure, use FSCRYPT_POLICY_FLAGS_PAD_32 (0x3).
437 Additionally, if the encryption modes are both
Eric Biggers2336d0d2019-08-04 19:35:44 -0700438 FSCRYPT_MODE_ADIANTUM, this can contain
Eric Biggersba13f2c2019-08-04 19:35:49 -0700439 FSCRYPT_POLICY_FLAG_DIRECT_KEY; see `DIRECT_KEY and per-mode keys`_.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400440
Eric Biggersba13f2c2019-08-04 19:35:49 -0700441- For v2 encryption policies, ``__reserved`` must be zeroed.
442
443- For v1 encryption policies, ``master_key_descriptor`` specifies how
444 to find the master key in a keyring; see `Adding keys`_. It is up
445 to userspace to choose a unique ``master_key_descriptor`` for each
446 master key. The e4crypt and fscrypt tools use the first 8 bytes of
Eric Biggersf4f864c2017-10-29 06:30:14 -0400447 ``SHA-512(SHA-512(master_key))``, but this particular scheme is not
448 required. Also, the master key need not be in the keyring yet when
449 FS_IOC_SET_ENCRYPTION_POLICY is executed. However, it must be added
450 before any files can be created in the encrypted directory.
451
Eric Biggersba13f2c2019-08-04 19:35:49 -0700452 For v2 encryption policies, ``master_key_descriptor`` has been
453 replaced with ``master_key_identifier``, which is longer and cannot
454 be arbitrarily chosen. Instead, the key must first be added using
455 `FS_IOC_ADD_ENCRYPTION_KEY`_. Then, the ``key_spec.u.identifier``
456 the kernel returned in the :c:type:`struct fscrypt_add_key_arg` must
457 be used as the ``master_key_identifier`` in the :c:type:`struct
458 fscrypt_policy_v2`.
459
Eric Biggersf4f864c2017-10-29 06:30:14 -0400460If the file is not yet encrypted, then FS_IOC_SET_ENCRYPTION_POLICY
461verifies that the file is an empty directory. If so, the specified
462encryption policy is assigned to the directory, turning it into an
463encrypted directory. After that, and after providing the
464corresponding master key as described in `Adding keys`_, all regular
465files, directories (recursively), and symlinks created in the
466directory will be encrypted, inheriting the same encryption policy.
467The filenames in the directory's entries will be encrypted as well.
468
469Alternatively, if the file is already encrypted, then
470FS_IOC_SET_ENCRYPTION_POLICY validates that the specified encryption
471policy exactly matches the actual one. If they match, then the ioctl
472returns 0. Otherwise, it fails with EEXIST. This works on both
473regular files and directories, including nonempty directories.
474
Eric Biggersba13f2c2019-08-04 19:35:49 -0700475When a v2 encryption policy is assigned to a directory, it is also
476required that either the specified key has been added by the current
477user or that the caller has CAP_FOWNER in the initial user namespace.
478(This is needed to prevent a user from encrypting their data with
479another user's key.) The key must remain added while
480FS_IOC_SET_ENCRYPTION_POLICY is executing. However, if the new
481encrypted directory does not need to be accessed immediately, then the
482key can be removed right away afterwards.
483
Eric Biggersf4f864c2017-10-29 06:30:14 -0400484Note that the ext4 filesystem does not allow the root directory to be
485encrypted, even if it is empty. Users who want to encrypt an entire
486filesystem with one key should consider using dm-crypt instead.
487
488FS_IOC_SET_ENCRYPTION_POLICY can fail with the following errors:
489
490- ``EACCES``: the file is not owned by the process's uid, nor does the
491 process have the CAP_FOWNER capability in a namespace with the file
492 owner's uid mapped
493- ``EEXIST``: the file is already encrypted with an encryption policy
494 different from the one specified
495- ``EINVAL``: an invalid encryption policy was specified (invalid
Eric Biggersba13f2c2019-08-04 19:35:49 -0700496 version, mode(s), or flags; or reserved bits were set)
497- ``ENOKEY``: a v2 encryption policy was specified, but the key with
498 the specified ``master_key_identifier`` has not been added, nor does
499 the process have the CAP_FOWNER capability in the initial user
500 namespace
Eric Biggersf4f864c2017-10-29 06:30:14 -0400501- ``ENOTDIR``: the file is unencrypted and is a regular file, not a
502 directory
503- ``ENOTEMPTY``: the file is unencrypted and is a nonempty directory
504- ``ENOTTY``: this type of filesystem does not implement encryption
505- ``EOPNOTSUPP``: the kernel was not configured with encryption
Chandan Rajendra643fa9612018-12-12 15:20:12 +0530506 support for filesystems, or the filesystem superblock has not
Eric Biggersf4f864c2017-10-29 06:30:14 -0400507 had encryption enabled on it. (For example, to use encryption on an
Chandan Rajendra643fa9612018-12-12 15:20:12 +0530508 ext4 filesystem, CONFIG_FS_ENCRYPTION must be enabled in the
Eric Biggersf4f864c2017-10-29 06:30:14 -0400509 kernel config, and the superblock must have had the "encrypt"
510 feature flag enabled using ``tune2fs -O encrypt`` or ``mkfs.ext4 -O
511 encrypt``.)
512- ``EPERM``: this directory may not be encrypted, e.g. because it is
513 the root directory of an ext4 filesystem
514- ``EROFS``: the filesystem is readonly
515
516Getting an encryption policy
517----------------------------
518
Eric Biggersba13f2c2019-08-04 19:35:49 -0700519Two ioctls are available to get a file's encryption policy:
Eric Biggersf4f864c2017-10-29 06:30:14 -0400520
Eric Biggersba13f2c2019-08-04 19:35:49 -0700521- `FS_IOC_GET_ENCRYPTION_POLICY_EX`_
522- `FS_IOC_GET_ENCRYPTION_POLICY`_
523
524The extended (_EX) version of the ioctl is more general and is
525recommended to use when possible. However, on older kernels only the
526original ioctl is available. Applications should try the extended
527version, and if it fails with ENOTTY fall back to the original
528version.
529
530FS_IOC_GET_ENCRYPTION_POLICY_EX
531~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
532
533The FS_IOC_GET_ENCRYPTION_POLICY_EX ioctl retrieves the encryption
534policy, if any, for a directory or regular file. No additional
535permissions are required beyond the ability to open the file. It
536takes in a pointer to a :c:type:`struct fscrypt_get_policy_ex_arg`,
537defined as follows::
538
539 struct fscrypt_get_policy_ex_arg {
540 __u64 policy_size; /* input/output */
541 union {
542 __u8 version;
543 struct fscrypt_policy_v1 v1;
544 struct fscrypt_policy_v2 v2;
545 } policy; /* output */
546 };
547
548The caller must initialize ``policy_size`` to the size available for
549the policy struct, i.e. ``sizeof(arg.policy)``.
550
551On success, the policy struct is returned in ``policy``, and its
552actual size is returned in ``policy_size``. ``policy.version`` should
553be checked to determine the version of policy returned. Note that the
554version code for the "v1" policy is actually 0 (FSCRYPT_POLICY_V1).
555
556FS_IOC_GET_ENCRYPTION_POLICY_EX can fail with the following errors:
Eric Biggersf4f864c2017-10-29 06:30:14 -0400557
558- ``EINVAL``: the file is encrypted, but it uses an unrecognized
Eric Biggersba13f2c2019-08-04 19:35:49 -0700559 encryption policy version
Eric Biggersf4f864c2017-10-29 06:30:14 -0400560- ``ENODATA``: the file is not encrypted
Eric Biggersba13f2c2019-08-04 19:35:49 -0700561- ``ENOTTY``: this type of filesystem does not implement encryption,
562 or this kernel is too old to support FS_IOC_GET_ENCRYPTION_POLICY_EX
563 (try FS_IOC_GET_ENCRYPTION_POLICY instead)
Eric Biggersf4f864c2017-10-29 06:30:14 -0400564- ``EOPNOTSUPP``: the kernel was not configured with encryption
565 support for this filesystem
Eric Biggersba13f2c2019-08-04 19:35:49 -0700566- ``EOVERFLOW``: the file is encrypted and uses a recognized
567 encryption policy version, but the policy struct does not fit into
568 the provided buffer
Eric Biggersf4f864c2017-10-29 06:30:14 -0400569
570Note: if you only need to know whether a file is encrypted or not, on
571most filesystems it is also possible to use the FS_IOC_GETFLAGS ioctl
572and check for FS_ENCRYPT_FL, or to use the statx() system call and
573check for STATX_ATTR_ENCRYPTED in stx_attributes.
574
Eric Biggersba13f2c2019-08-04 19:35:49 -0700575FS_IOC_GET_ENCRYPTION_POLICY
576~~~~~~~~~~~~~~~~~~~~~~~~~~~~
577
578The FS_IOC_GET_ENCRYPTION_POLICY ioctl can also retrieve the
579encryption policy, if any, for a directory or regular file. However,
580unlike `FS_IOC_GET_ENCRYPTION_POLICY_EX`_,
581FS_IOC_GET_ENCRYPTION_POLICY only supports the original policy
582version. It takes in a pointer directly to a :c:type:`struct
583fscrypt_policy_v1` rather than a :c:type:`struct
584fscrypt_get_policy_ex_arg`.
585
586The error codes for FS_IOC_GET_ENCRYPTION_POLICY are the same as those
587for FS_IOC_GET_ENCRYPTION_POLICY_EX, except that
588FS_IOC_GET_ENCRYPTION_POLICY also returns ``EINVAL`` if the file is
589encrypted using a newer encryption policy version.
590
Eric Biggersf4f864c2017-10-29 06:30:14 -0400591Getting the per-filesystem salt
592-------------------------------
593
594Some filesystems, such as ext4 and F2FS, also support the deprecated
595ioctl FS_IOC_GET_ENCRYPTION_PWSALT. This ioctl retrieves a randomly
596generated 16-byte value stored in the filesystem superblock. This
597value is intended to used as a salt when deriving an encryption key
598from a passphrase or other low-entropy user credential.
599
600FS_IOC_GET_ENCRYPTION_PWSALT is deprecated. Instead, prefer to
601generate and manage any needed salt(s) in userspace.
602
603Adding keys
604-----------
605
Eric Biggersba13f2c2019-08-04 19:35:49 -0700606FS_IOC_ADD_ENCRYPTION_KEY
607~~~~~~~~~~~~~~~~~~~~~~~~~
608
609The FS_IOC_ADD_ENCRYPTION_KEY ioctl adds a master encryption key to
610the filesystem, making all files on the filesystem which were
611encrypted using that key appear "unlocked", i.e. in plaintext form.
612It can be executed on any file or directory on the target filesystem,
613but using the filesystem's root directory is recommended. It takes in
614a pointer to a :c:type:`struct fscrypt_add_key_arg`, defined as
615follows::
616
617 struct fscrypt_add_key_arg {
618 struct fscrypt_key_specifier key_spec;
619 __u32 raw_size;
620 __u32 __reserved[9];
621 __u8 raw[];
622 };
623
624 #define FSCRYPT_KEY_SPEC_TYPE_DESCRIPTOR 1
625 #define FSCRYPT_KEY_SPEC_TYPE_IDENTIFIER 2
626
627 struct fscrypt_key_specifier {
628 __u32 type; /* one of FSCRYPT_KEY_SPEC_TYPE_* */
629 __u32 __reserved;
630 union {
631 __u8 __reserved[32]; /* reserve some extra space */
632 __u8 descriptor[FSCRYPT_KEY_DESCRIPTOR_SIZE];
633 __u8 identifier[FSCRYPT_KEY_IDENTIFIER_SIZE];
634 } u;
635 };
636
637:c:type:`struct fscrypt_add_key_arg` must be zeroed, then initialized
638as follows:
639
640- If the key is being added for use by v1 encryption policies, then
641 ``key_spec.type`` must contain FSCRYPT_KEY_SPEC_TYPE_DESCRIPTOR, and
642 ``key_spec.u.descriptor`` must contain the descriptor of the key
643 being added, corresponding to the value in the
644 ``master_key_descriptor`` field of :c:type:`struct
645 fscrypt_policy_v1`. To add this type of key, the calling process
646 must have the CAP_SYS_ADMIN capability in the initial user
647 namespace.
648
649 Alternatively, if the key is being added for use by v2 encryption
650 policies, then ``key_spec.type`` must contain
651 FSCRYPT_KEY_SPEC_TYPE_IDENTIFIER, and ``key_spec.u.identifier`` is
652 an *output* field which the kernel fills in with a cryptographic
653 hash of the key. To add this type of key, the calling process does
654 not need any privileges. However, the number of keys that can be
655 added is limited by the user's quota for the keyrings service (see
656 ``Documentation/security/keys/core.rst``).
657
658- ``raw_size`` must be the size of the ``raw`` key provided, in bytes.
659
660- ``raw`` is a variable-length field which must contain the actual
661 key, ``raw_size`` bytes long.
662
663For v2 policy keys, the kernel keeps track of which user (identified
664by effective user ID) added the key, and only allows the key to be
665removed by that user --- or by "root", if they use
666`FS_IOC_REMOVE_ENCRYPTION_KEY_ALL_USERS`_.
667
668However, if another user has added the key, it may be desirable to
669prevent that other user from unexpectedly removing it. Therefore,
670FS_IOC_ADD_ENCRYPTION_KEY may also be used to add a v2 policy key
671*again*, even if it's already added by other user(s). In this case,
672FS_IOC_ADD_ENCRYPTION_KEY will just install a claim to the key for the
673current user, rather than actually add the key again (but the raw key
674must still be provided, as a proof of knowledge).
675
676FS_IOC_ADD_ENCRYPTION_KEY returns 0 if either the key or a claim to
677the key was either added or already exists.
678
679FS_IOC_ADD_ENCRYPTION_KEY can fail with the following errors:
680
681- ``EACCES``: FSCRYPT_KEY_SPEC_TYPE_DESCRIPTOR was specified, but the
682 caller does not have the CAP_SYS_ADMIN capability in the initial
683 user namespace
684- ``EDQUOT``: the key quota for this user would be exceeded by adding
685 the key
686- ``EINVAL``: invalid key size or key specifier type, or reserved bits
687 were set
688- ``ENOTTY``: this type of filesystem does not implement encryption
689- ``EOPNOTSUPP``: the kernel was not configured with encryption
690 support for this filesystem, or the filesystem superblock has not
691 had encryption enabled on it
692
693Legacy method
694~~~~~~~~~~~~~
695
696For v1 encryption policies, a master encryption key can also be
697provided by adding it to a process-subscribed keyring, e.g. to a
698session keyring, or to a user keyring if the user keyring is linked
699into the session keyring.
700
701This method is deprecated (and not supported for v2 encryption
702policies) for several reasons. First, it cannot be used in
703combination with FS_IOC_REMOVE_ENCRYPTION_KEY (see `Removing keys`_),
704so for removing a key a workaround such as keyctl_unlink() in
705combination with ``sync; echo 2 > /proc/sys/vm/drop_caches`` would
706have to be used. Second, it doesn't match the fact that the
707locked/unlocked status of encrypted files (i.e. whether they appear to
708be in plaintext form or in ciphertext form) is global. This mismatch
709has caused much confusion as well as real problems when processes
710running under different UIDs, such as a ``sudo`` command, need to
711access encrypted files.
712
713Nevertheless, to add a key to one of the process-subscribed keyrings,
714the add_key() system call can be used (see:
Eric Biggersf4f864c2017-10-29 06:30:14 -0400715``Documentation/security/keys/core.rst``). The key type must be
716"logon"; keys of this type are kept in kernel memory and cannot be
717read back by userspace. The key description must be "fscrypt:"
718followed by the 16-character lower case hex representation of the
719``master_key_descriptor`` that was set in the encryption policy. The
720key payload must conform to the following structure::
721
Eric Biggersba13f2c2019-08-04 19:35:49 -0700722 #define FSCRYPT_MAX_KEY_SIZE 64
Eric Biggersf4f864c2017-10-29 06:30:14 -0400723
724 struct fscrypt_key {
Eric Biggersba13f2c2019-08-04 19:35:49 -0700725 __u32 mode;
726 __u8 raw[FSCRYPT_MAX_KEY_SIZE];
727 __u32 size;
Eric Biggersf4f864c2017-10-29 06:30:14 -0400728 };
729
730``mode`` is ignored; just set it to 0. The actual key is provided in
731``raw`` with ``size`` indicating its size in bytes. That is, the
732bytes ``raw[0..size-1]`` (inclusive) are the actual key.
733
734The key description prefix "fscrypt:" may alternatively be replaced
735with a filesystem-specific prefix such as "ext4:". However, the
736filesystem-specific prefixes are deprecated and should not be used in
737new programs.
738
Eric Biggersba13f2c2019-08-04 19:35:49 -0700739Removing keys
740-------------
Eric Biggersf4f864c2017-10-29 06:30:14 -0400741
Eric Biggersba13f2c2019-08-04 19:35:49 -0700742Two ioctls are available for removing a key that was added by
743`FS_IOC_ADD_ENCRYPTION_KEY`_:
744
745- `FS_IOC_REMOVE_ENCRYPTION_KEY`_
746- `FS_IOC_REMOVE_ENCRYPTION_KEY_ALL_USERS`_
747
748These two ioctls differ only in cases where v2 policy keys are added
749or removed by non-root users.
750
751These ioctls don't work on keys that were added via the legacy
752process-subscribed keyrings mechanism.
753
754Before using these ioctls, read the `Kernel memory compromise`_
755section for a discussion of the security goals and limitations of
756these ioctls.
757
758FS_IOC_REMOVE_ENCRYPTION_KEY
759~~~~~~~~~~~~~~~~~~~~~~~~~~~~
760
761The FS_IOC_REMOVE_ENCRYPTION_KEY ioctl removes a claim to a master
762encryption key from the filesystem, and possibly removes the key
763itself. It can be executed on any file or directory on the target
764filesystem, but using the filesystem's root directory is recommended.
765It takes in a pointer to a :c:type:`struct fscrypt_remove_key_arg`,
766defined as follows::
767
768 struct fscrypt_remove_key_arg {
769 struct fscrypt_key_specifier key_spec;
770 #define FSCRYPT_KEY_REMOVAL_STATUS_FLAG_FILES_BUSY 0x00000001
771 #define FSCRYPT_KEY_REMOVAL_STATUS_FLAG_OTHER_USERS 0x00000002
772 __u32 removal_status_flags; /* output */
773 __u32 __reserved[5];
774 };
775
776This structure must be zeroed, then initialized as follows:
777
778- The key to remove is specified by ``key_spec``:
779
780 - To remove a key used by v1 encryption policies, set
781 ``key_spec.type`` to FSCRYPT_KEY_SPEC_TYPE_DESCRIPTOR and fill
782 in ``key_spec.u.descriptor``. To remove this type of key, the
783 calling process must have the CAP_SYS_ADMIN capability in the
784 initial user namespace.
785
786 - To remove a key used by v2 encryption policies, set
787 ``key_spec.type`` to FSCRYPT_KEY_SPEC_TYPE_IDENTIFIER and fill
788 in ``key_spec.u.identifier``.
789
790For v2 policy keys, this ioctl is usable by non-root users. However,
791to make this possible, it actually just removes the current user's
792claim to the key, undoing a single call to FS_IOC_ADD_ENCRYPTION_KEY.
793Only after all claims are removed is the key really removed.
794
795For example, if FS_IOC_ADD_ENCRYPTION_KEY was called with uid 1000,
796then the key will be "claimed" by uid 1000, and
797FS_IOC_REMOVE_ENCRYPTION_KEY will only succeed as uid 1000. Or, if
798both uids 1000 and 2000 added the key, then for each uid
799FS_IOC_REMOVE_ENCRYPTION_KEY will only remove their own claim. Only
800once *both* are removed is the key really removed. (Think of it like
801unlinking a file that may have hard links.)
802
803If FS_IOC_REMOVE_ENCRYPTION_KEY really removes the key, it will also
804try to "lock" all files that had been unlocked with the key. It won't
805lock files that are still in-use, so this ioctl is expected to be used
806in cooperation with userspace ensuring that none of the files are
807still open. However, if necessary, this ioctl can be executed again
808later to retry locking any remaining files.
809
810FS_IOC_REMOVE_ENCRYPTION_KEY returns 0 if either the key was removed
811(but may still have files remaining to be locked), the user's claim to
812the key was removed, or the key was already removed but had files
813remaining to be the locked so the ioctl retried locking them. In any
814of these cases, ``removal_status_flags`` is filled in with the
815following informational status flags:
816
817- ``FSCRYPT_KEY_REMOVAL_STATUS_FLAG_FILES_BUSY``: set if some file(s)
818 are still in-use. Not guaranteed to be set in the case where only
819 the user's claim to the key was removed.
820- ``FSCRYPT_KEY_REMOVAL_STATUS_FLAG_OTHER_USERS``: set if only the
821 user's claim to the key was removed, not the key itself
822
823FS_IOC_REMOVE_ENCRYPTION_KEY can fail with the following errors:
824
825- ``EACCES``: The FSCRYPT_KEY_SPEC_TYPE_DESCRIPTOR key specifier type
826 was specified, but the caller does not have the CAP_SYS_ADMIN
827 capability in the initial user namespace
828- ``EINVAL``: invalid key specifier type, or reserved bits were set
829- ``ENOKEY``: the key object was not found at all, i.e. it was never
830 added in the first place or was already fully removed including all
831 files locked; or, the user does not have a claim to the key (but
832 someone else does).
833- ``ENOTTY``: this type of filesystem does not implement encryption
834- ``EOPNOTSUPP``: the kernel was not configured with encryption
835 support for this filesystem, or the filesystem superblock has not
836 had encryption enabled on it
837
838FS_IOC_REMOVE_ENCRYPTION_KEY_ALL_USERS
839~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
840
841FS_IOC_REMOVE_ENCRYPTION_KEY_ALL_USERS is exactly the same as
842`FS_IOC_REMOVE_ENCRYPTION_KEY`_, except that for v2 policy keys, the
843ALL_USERS version of the ioctl will remove all users' claims to the
844key, not just the current user's. I.e., the key itself will always be
845removed, no matter how many users have added it. This difference is
846only meaningful if non-root users are adding and removing keys.
847
848Because of this, FS_IOC_REMOVE_ENCRYPTION_KEY_ALL_USERS also requires
849"root", namely the CAP_SYS_ADMIN capability in the initial user
850namespace. Otherwise it will fail with EACCES.
851
852Getting key status
853------------------
854
855FS_IOC_GET_ENCRYPTION_KEY_STATUS
856~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
857
858The FS_IOC_GET_ENCRYPTION_KEY_STATUS ioctl retrieves the status of a
859master encryption key. It can be executed on any file or directory on
860the target filesystem, but using the filesystem's root directory is
861recommended. It takes in a pointer to a :c:type:`struct
862fscrypt_get_key_status_arg`, defined as follows::
863
864 struct fscrypt_get_key_status_arg {
865 /* input */
866 struct fscrypt_key_specifier key_spec;
867 __u32 __reserved[6];
868
869 /* output */
870 #define FSCRYPT_KEY_STATUS_ABSENT 1
871 #define FSCRYPT_KEY_STATUS_PRESENT 2
872 #define FSCRYPT_KEY_STATUS_INCOMPLETELY_REMOVED 3
873 __u32 status;
874 #define FSCRYPT_KEY_STATUS_FLAG_ADDED_BY_SELF 0x00000001
875 __u32 status_flags;
876 __u32 user_count;
877 __u32 __out_reserved[13];
878 };
879
880The caller must zero all input fields, then fill in ``key_spec``:
881
882 - To get the status of a key for v1 encryption policies, set
883 ``key_spec.type`` to FSCRYPT_KEY_SPEC_TYPE_DESCRIPTOR and fill
884 in ``key_spec.u.descriptor``.
885
886 - To get the status of a key for v2 encryption policies, set
887 ``key_spec.type`` to FSCRYPT_KEY_SPEC_TYPE_IDENTIFIER and fill
888 in ``key_spec.u.identifier``.
889
890On success, 0 is returned and the kernel fills in the output fields:
891
892- ``status`` indicates whether the key is absent, present, or
893 incompletely removed. Incompletely removed means that the master
894 secret has been removed, but some files are still in use; i.e.,
895 `FS_IOC_REMOVE_ENCRYPTION_KEY`_ returned 0 but set the informational
896 status flag FSCRYPT_KEY_REMOVAL_STATUS_FLAG_FILES_BUSY.
897
898- ``status_flags`` can contain the following flags:
899
900 - ``FSCRYPT_KEY_STATUS_FLAG_ADDED_BY_SELF`` indicates that the key
901 has added by the current user. This is only set for keys
902 identified by ``identifier`` rather than by ``descriptor``.
903
904- ``user_count`` specifies the number of users who have added the key.
905 This is only set for keys identified by ``identifier`` rather than
906 by ``descriptor``.
907
908FS_IOC_GET_ENCRYPTION_KEY_STATUS can fail with the following errors:
909
910- ``EINVAL``: invalid key specifier type, or reserved bits were set
911- ``ENOTTY``: this type of filesystem does not implement encryption
912- ``EOPNOTSUPP``: the kernel was not configured with encryption
913 support for this filesystem, or the filesystem superblock has not
914 had encryption enabled on it
915
916Among other use cases, FS_IOC_GET_ENCRYPTION_KEY_STATUS can be useful
917for determining whether the key for a given encrypted directory needs
918to be added before prompting the user for the passphrase needed to
919derive the key.
920
921FS_IOC_GET_ENCRYPTION_KEY_STATUS can only get the status of keys in
922the filesystem-level keyring, i.e. the keyring managed by
923`FS_IOC_ADD_ENCRYPTION_KEY`_ and `FS_IOC_REMOVE_ENCRYPTION_KEY`_. It
924cannot get the status of a key that has only been added for use by v1
925encryption policies using the legacy mechanism involving
926process-subscribed keyrings.
Eric Biggersf4f864c2017-10-29 06:30:14 -0400927
928Access semantics
929================
930
931With the key
932------------
933
934With the encryption key, encrypted regular files, directories, and
935symlinks behave very similarly to their unencrypted counterparts ---
936after all, the encryption is intended to be transparent. However,
937astute users may notice some differences in behavior:
938
939- Unencrypted files, or files encrypted with a different encryption
940 policy (i.e. different key, modes, or flags), cannot be renamed or
941 linked into an encrypted directory; see `Encryption policy
Eric Biggersf5e55e72019-01-22 16:20:21 -0800942 enforcement`_. Attempts to do so will fail with EXDEV. However,
Eric Biggersf4f864c2017-10-29 06:30:14 -0400943 encrypted files can be renamed within an encrypted directory, or
944 into an unencrypted directory.
945
Eric Biggersf5e55e72019-01-22 16:20:21 -0800946 Note: "moving" an unencrypted file into an encrypted directory, e.g.
947 with the `mv` program, is implemented in userspace by a copy
948 followed by a delete. Be aware that the original unencrypted data
949 may remain recoverable from free space on the disk; prefer to keep
950 all files encrypted from the very beginning. The `shred` program
951 may be used to overwrite the source files but isn't guaranteed to be
952 effective on all filesystems and storage devices.
953
Eric Biggersf4f864c2017-10-29 06:30:14 -0400954- Direct I/O is not supported on encrypted files. Attempts to use
955 direct I/O on such files will fall back to buffered I/O.
956
957- The fallocate operations FALLOC_FL_COLLAPSE_RANGE,
958 FALLOC_FL_INSERT_RANGE, and FALLOC_FL_ZERO_RANGE are not supported
959 on encrypted files and will fail with EOPNOTSUPP.
960
961- Online defragmentation of encrypted files is not supported. The
962 EXT4_IOC_MOVE_EXT and F2FS_IOC_MOVE_RANGE ioctls will fail with
963 EOPNOTSUPP.
964
965- The ext4 filesystem does not support data journaling with encrypted
966 regular files. It will fall back to ordered data mode instead.
967
968- DAX (Direct Access) is not supported on encrypted files.
969
970- The st_size of an encrypted symlink will not necessarily give the
971 length of the symlink target as required by POSIX. It will actually
Eric Biggers2f46a2b2018-01-11 23:30:09 -0500972 give the length of the ciphertext, which will be slightly longer
973 than the plaintext due to NUL-padding and an extra 2-byte overhead.
974
975- The maximum length of an encrypted symlink is 2 bytes shorter than
976 the maximum length of an unencrypted symlink. For example, on an
977 EXT4 filesystem with a 4K block size, unencrypted symlinks can be up
978 to 4095 bytes long, while encrypted symlinks can only be up to 4093
979 bytes long (both lengths excluding the terminating null).
Eric Biggersf4f864c2017-10-29 06:30:14 -0400980
981Note that mmap *is* supported. This is possible because the pagecache
982for an encrypted file contains the plaintext, not the ciphertext.
983
984Without the key
985---------------
986
987Some filesystem operations may be performed on encrypted regular
988files, directories, and symlinks even before their encryption key has
Eric Biggersba13f2c2019-08-04 19:35:49 -0700989been added, or after their encryption key has been removed:
Eric Biggersf4f864c2017-10-29 06:30:14 -0400990
991- File metadata may be read, e.g. using stat().
992
993- Directories may be listed, in which case the filenames will be
994 listed in an encoded form derived from their ciphertext. The
995 current encoding algorithm is described in `Filename hashing and
996 encoding`_. The algorithm is subject to change, but it is
997 guaranteed that the presented filenames will be no longer than
998 NAME_MAX bytes, will not contain the ``/`` or ``\0`` characters, and
999 will uniquely identify directory entries.
1000
1001 The ``.`` and ``..`` directory entries are special. They are always
1002 present and are not encrypted or encoded.
1003
1004- Files may be deleted. That is, nondirectory files may be deleted
1005 with unlink() as usual, and empty directories may be deleted with
1006 rmdir() as usual. Therefore, ``rm`` and ``rm -r`` will work as
1007 expected.
1008
1009- Symlink targets may be read and followed, but they will be presented
1010 in encrypted form, similar to filenames in directories. Hence, they
1011 are unlikely to point to anywhere useful.
1012
1013Without the key, regular files cannot be opened or truncated.
1014Attempts to do so will fail with ENOKEY. This implies that any
1015regular file operations that require a file descriptor, such as
1016read(), write(), mmap(), fallocate(), and ioctl(), are also forbidden.
1017
1018Also without the key, files of any type (including directories) cannot
1019be created or linked into an encrypted directory, nor can a name in an
1020encrypted directory be the source or target of a rename, nor can an
1021O_TMPFILE temporary file be created in an encrypted directory. All
1022such operations will fail with ENOKEY.
1023
1024It is not currently possible to backup and restore encrypted files
1025without the encryption key. This would require special APIs which
1026have not yet been implemented.
1027
1028Encryption policy enforcement
1029=============================
1030
1031After an encryption policy has been set on a directory, all regular
1032files, directories, and symbolic links created in that directory
1033(recursively) will inherit that encryption policy. Special files ---
1034that is, named pipes, device nodes, and UNIX domain sockets --- will
1035not be encrypted.
1036
1037Except for those special files, it is forbidden to have unencrypted
1038files, or files encrypted with a different encryption policy, in an
1039encrypted directory tree. Attempts to link or rename such a file into
Eric Biggersf5e55e72019-01-22 16:20:21 -08001040an encrypted directory will fail with EXDEV. This is also enforced
Eric Biggersf4f864c2017-10-29 06:30:14 -04001041during ->lookup() to provide limited protection against offline
1042attacks that try to disable or downgrade encryption in known locations
1043where applications may later write sensitive data. It is recommended
1044that systems implementing a form of "verified boot" take advantage of
1045this by validating all top-level encryption policies prior to access.
1046
1047Implementation details
1048======================
1049
1050Encryption context
1051------------------
1052
1053An encryption policy is represented on-disk by a :c:type:`struct
Eric Biggersba13f2c2019-08-04 19:35:49 -07001054fscrypt_context_v1` or a :c:type:`struct fscrypt_context_v2`. It is
1055up to individual filesystems to decide where to store it, but normally
1056it would be stored in a hidden extended attribute. It should *not* be
1057exposed by the xattr-related system calls such as getxattr() and
1058setxattr() because of the special semantics of the encryption xattr.
1059(In particular, there would be much confusion if an encryption policy
1060were to be added to or removed from anything other than an empty
1061directory.) These structs are defined as follows::
Eric Biggersf4f864c2017-10-29 06:30:14 -04001062
Eric Biggersf4f864c2017-10-29 06:30:14 -04001063 #define FS_KEY_DERIVATION_NONCE_SIZE 16
1064
Eric Biggersba13f2c2019-08-04 19:35:49 -07001065 #define FSCRYPT_KEY_DESCRIPTOR_SIZE 8
1066 struct fscrypt_context_v1 {
1067 u8 version;
Eric Biggersf4f864c2017-10-29 06:30:14 -04001068 u8 contents_encryption_mode;
1069 u8 filenames_encryption_mode;
1070 u8 flags;
Eric Biggers2336d0d2019-08-04 19:35:44 -07001071 u8 master_key_descriptor[FSCRYPT_KEY_DESCRIPTOR_SIZE];
Eric Biggersf4f864c2017-10-29 06:30:14 -04001072 u8 nonce[FS_KEY_DERIVATION_NONCE_SIZE];
1073 };
1074
Eric Biggersba13f2c2019-08-04 19:35:49 -07001075 #define FSCRYPT_KEY_IDENTIFIER_SIZE 16
1076 struct fscrypt_context_v2 {
1077 u8 version;
1078 u8 contents_encryption_mode;
1079 u8 filenames_encryption_mode;
1080 u8 flags;
1081 u8 __reserved[4];
1082 u8 master_key_identifier[FSCRYPT_KEY_IDENTIFIER_SIZE];
1083 u8 nonce[FS_KEY_DERIVATION_NONCE_SIZE];
1084 };
1085
1086The context structs contain the same information as the corresponding
1087policy structs (see `Setting an encryption policy`_), except that the
1088context structs also contain a nonce. The nonce is randomly generated
1089by the kernel and is used as KDF input or as a tweak to cause
1090different files to be encrypted differently; see `Per-file keys`_ and
1091`DIRECT_KEY and per-mode keys`_.
Eric Biggersf4f864c2017-10-29 06:30:14 -04001092
1093Data path changes
1094-----------------
1095
1096For the read path (->readpage()) of regular files, filesystems can
1097read the ciphertext into the page cache and decrypt it in-place. The
1098page lock must be held until decryption has finished, to prevent the
1099page from becoming visible to userspace prematurely.
1100
1101For the write path (->writepage()) of regular files, filesystems
1102cannot encrypt data in-place in the page cache, since the cached
1103plaintext must be preserved. Instead, filesystems must encrypt into a
1104temporary buffer or "bounce page", then write out the temporary
1105buffer. Some filesystems, such as UBIFS, already use temporary
1106buffers regardless of encryption. Other filesystems, such as ext4 and
1107F2FS, have to allocate bounce pages specially for encryption.
1108
1109Filename hashing and encoding
1110-----------------------------
1111
1112Modern filesystems accelerate directory lookups by using indexed
1113directories. An indexed directory is organized as a tree keyed by
1114filename hashes. When a ->lookup() is requested, the filesystem
1115normally hashes the filename being looked up so that it can quickly
1116find the corresponding directory entry, if any.
1117
1118With encryption, lookups must be supported and efficient both with and
1119without the encryption key. Clearly, it would not work to hash the
1120plaintext filenames, since the plaintext filenames are unavailable
1121without the key. (Hashing the plaintext filenames would also make it
1122impossible for the filesystem's fsck tool to optimize encrypted
1123directories.) Instead, filesystems hash the ciphertext filenames,
1124i.e. the bytes actually stored on-disk in the directory entries. When
1125asked to do a ->lookup() with the key, the filesystem just encrypts
1126the user-supplied name to get the ciphertext.
1127
1128Lookups without the key are more complicated. The raw ciphertext may
1129contain the ``\0`` and ``/`` characters, which are illegal in
1130filenames. Therefore, readdir() must base64-encode the ciphertext for
1131presentation. For most filenames, this works fine; on ->lookup(), the
1132filesystem just base64-decodes the user-supplied name to get back to
1133the raw ciphertext.
1134
1135However, for very long filenames, base64 encoding would cause the
1136filename length to exceed NAME_MAX. To prevent this, readdir()
1137actually presents long filenames in an abbreviated form which encodes
1138a strong "hash" of the ciphertext filename, along with the optional
1139filesystem-specific hash(es) needed for directory lookups. This
1140allows the filesystem to still, with a high degree of confidence, map
1141the filename given in ->lookup() back to a particular directory entry
1142that was previously listed by readdir(). See :c:type:`struct
1143fscrypt_digested_name` in the source for more details.
1144
1145Note that the precise way that filenames are presented to userspace
1146without the key is subject to change in the future. It is only meant
1147as a way to temporarily present valid filenames so that commands like
1148``rm -r`` work as expected on encrypted directories.
Eric Biggers05643362019-06-20 11:16:58 -07001149
1150Tests
1151=====
1152
1153To test fscrypt, use xfstests, which is Linux's de facto standard
1154filesystem test suite. First, run all the tests in the "encrypt"
1155group on the relevant filesystem(s). For example, to test ext4 and
1156f2fs encryption using `kvm-xfstests
1157<https://github.com/tytso/xfstests-bld/blob/master/Documentation/kvm-quickstart.md>`_::
1158
1159 kvm-xfstests -c ext4,f2fs -g encrypt
1160
1161UBIFS encryption can also be tested this way, but it should be done in
1162a separate command, and it takes some time for kvm-xfstests to set up
1163emulated UBI volumes::
1164
1165 kvm-xfstests -c ubifs -g encrypt
1166
1167No tests should fail. However, tests that use non-default encryption
1168modes (e.g. generic/549 and generic/550) will be skipped if the needed
1169algorithms were not built into the kernel's crypto API. Also, tests
1170that access the raw block device (e.g. generic/399, generic/548,
1171generic/549, generic/550) will be skipped on UBIFS.
1172
1173Besides running the "encrypt" group tests, for ext4 and f2fs it's also
1174possible to run most xfstests with the "test_dummy_encryption" mount
1175option. This option causes all new files to be automatically
1176encrypted with a dummy key, without having to make any API calls.
1177This tests the encrypted I/O paths more thoroughly. To do this with
1178kvm-xfstests, use the "encrypt" filesystem configuration::
1179
1180 kvm-xfstests -c ext4/encrypt,f2fs/encrypt -g auto
1181
1182Because this runs many more tests than "-g encrypt" does, it takes
1183much longer to run; so also consider using `gce-xfstests
1184<https://github.com/tytso/xfstests-bld/blob/master/Documentation/gce-xfstests.md>`_
1185instead of kvm-xfstests::
1186
1187 gce-xfstests -c ext4/encrypt,f2fs/encrypt -g auto