blob: b7c25d393e3697ecf1ef3f4800e1a221d922d4b6 [file] [log] [blame]
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +02001API
2===
3
4.. module:: jinja2
5 :synopsis: public Jinja2 API
6
7This document describes the API to Jinja2 and not the template language. It
8will be most useful as reference to those implementing the template interface
9to the application and not those who are creating Jinja2 templates.
10
11Basics
12------
13
14Jinja2 uses a central object called the template :class:`Environment`.
Carl A Dunhamd5463582014-01-18 15:26:10 -060015Instances of this class are used to store the configuration and global objects,
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +020016and are used to load templates from the file system or other locations.
Armin Ronacher0aa0f582009-03-18 01:01:36 +010017Even if you are creating templates from strings by using the constructor of
Armin Ronacher61a5a242008-05-26 12:07:44 +020018:class:`Template` class, an environment is created automatically for you,
19albeit a shared one.
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +020020
21Most applications will create one :class:`Environment` object on application
Kojo Idrissad48cb212016-04-10 14:04:46 -050022initialization and use that to load templates. In some cases however, it's
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +020023useful to have multiple environments side by side, if different configurations
24are in use.
25
26The simplest way to configure Jinja2 to load templates for your application
27looks roughly like this::
28
29 from jinja2 import Environment, PackageLoader
30 env = Environment(loader=PackageLoader('yourapplication', 'templates'))
31
32This will create a template environment with the default settings and a
33loader that looks up the templates in the `templates` folder inside the
34`yourapplication` python package. Different loaders are available
35and you can also write your own if you want to load templates from a
36database or other resources.
37
38To load a template from this environment you just have to call the
39:meth:`get_template` method which then returns the loaded :class:`Template`::
40
41 template = env.get_template('mytemplate.html')
42
43To render it with some variables, just call the :meth:`render` method::
44
45 print template.render(the='variables', go='here')
46
Éric Araujof6b654d2015-05-29 16:57:10 -040047Using a template loader rather than passing strings to :class:`Template`
Armin Ronacher61a5a242008-05-26 12:07:44 +020048or :meth:`Environment.from_string` has multiple advantages. Besides being
49a lot easier to use it also enables template inheritance.
50
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +020051
Armin Ronacherf3c35c42008-05-23 23:18:14 +020052Unicode
53-------
54
Armin Ronacher656d5e72010-02-09 01:31:47 +010055Jinja2 is using Unicode internally which means that you have to pass Unicode
Armin Ronacherf3c35c42008-05-23 23:18:14 +020056objects to the render function or bytestrings that only consist of ASCII
57characters. Additionally newlines are normalized to one end of line
58sequence which is per default UNIX style (``\n``).
59
Armin Ronacher61a5a242008-05-26 12:07:44 +020060Python 2.x supports two ways of representing string objects. One is the
61`str` type and the other is the `unicode` type, both of which extend a type
62called `basestring`. Unfortunately the default is `str` which should not
63be used to store text based information unless only ASCII characters are
Armin Ronacher0aa0f582009-03-18 01:01:36 +010064used. With Python 2.6 it is possible to make `unicode` the default on a per
Armin Ronacher61a5a242008-05-26 12:07:44 +020065module level and with Python 3 it will be the default.
66
Armin Ronacher656d5e72010-02-09 01:31:47 +010067To explicitly use a Unicode string you have to prefix the string literal
Armin Ronacher61a5a242008-05-26 12:07:44 +020068with a `u`: ``u'Hänsel und Gretel sagen Hallo'``. That way Python will
Armin Ronacher656d5e72010-02-09 01:31:47 +010069store the string as Unicode by decoding the string with the character
Armin Ronacher61a5a242008-05-26 12:07:44 +020070encoding from the current Python module. If no encoding is specified this
71defaults to 'ASCII' which means that you can't use any non ASCII identifier.
72
73To set a better module encoding add the following comment to the first or
Armin Ronacher656d5e72010-02-09 01:31:47 +010074second line of the Python module using the Unicode literal::
Armin Ronacher61a5a242008-05-26 12:07:44 +020075
76 # -*- coding: utf-8 -*-
77
78We recommend utf-8 as Encoding for Python modules and templates as it's
79possible to represent every Unicode character in utf-8 and because it's
80backwards compatible to ASCII. For Jinja2 the default encoding of templates
81is assumed to be utf-8.
82
Armin Ronacher656d5e72010-02-09 01:31:47 +010083It is not possible to use Jinja2 to process non-Unicode data. The reason
Armin Ronacher61a5a242008-05-26 12:07:44 +020084for this is that Jinja2 uses Unicode already on the language level. For
85example Jinja2 treats the non-breaking space as valid whitespace inside
86expressions which requires knowledge of the encoding or operating on an
Armin Ronacher656d5e72010-02-09 01:31:47 +010087Unicode string.
Armin Ronacher61a5a242008-05-26 12:07:44 +020088
Armin Ronacher656d5e72010-02-09 01:31:47 +010089For more details about Unicode in Python have a look at the excellent
Armin Ronacher61a5a242008-05-26 12:07:44 +020090`Unicode documentation`_.
91
Armin Ronacher58f351d2008-05-28 21:30:14 +020092Another important thing is how Jinja2 is handling string literals in
Armin Ronacher656d5e72010-02-09 01:31:47 +010093templates. A naive implementation would be using Unicode strings for
Armin Ronacher58f351d2008-05-28 21:30:14 +020094all string literals but it turned out in the past that this is problematic
95as some libraries are typechecking against `str` explicitly. For example
Armin Ronacher656d5e72010-02-09 01:31:47 +010096`datetime.strftime` does not accept Unicode arguments. To not break it
Armin Ronacher58f351d2008-05-28 21:30:14 +020097completely Jinja2 is returning `str` for strings that fit into ASCII and
98for everything else `unicode`:
99
100>>> m = Template(u"{% set a, b = 'foo', 'föö' %}").module
101>>> m.a
102'foo'
103>>> m.b
104u'f\xf6\xf6'
105
Armin Ronacher61a5a242008-05-26 12:07:44 +0200106
107.. _Unicode documentation: http://docs.python.org/dev/howto/unicode.html
Armin Ronacherf3c35c42008-05-23 23:18:14 +0200108
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200109High Level API
110--------------
111
Armin Ronacher9bb7e472008-05-28 11:26:59 +0200112The high-level API is the API you will use in the application to load and
113render Jinja2 templates. The :ref:`low-level-api` on the other side is only
114useful if you want to dig deeper into Jinja2 or :ref:`develop extensions
115<jinja-extensions>`.
116
Armin Ronacher5411ce72008-05-25 11:36:22 +0200117.. autoclass:: Environment([options])
Armin Ronacher31bbd9e2010-01-14 00:41:30 +0100118 :members: from_string, get_template, select_template,
Armin Ronacher46844982011-01-29 20:19:58 +0100119 get_or_select_template, join_path, extend, compile_expression,
Armin Ronacher94638502011-09-26 00:41:25 +0200120 compile_templates, list_templates, add_extension
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200121
122 .. attribute:: shared
123
124 If a template was created by using the :class:`Template` constructor
125 an environment is created automatically. These environments are
126 created as shared environments which means that multiple templates
127 may have the same anonymous environment. For all shared environments
128 this attribute is `True`, else `False`.
129
130 .. attribute:: sandboxed
131
132 If the environment is sandboxed this attribute is `True`. For the
133 sandbox mode have a look at the documentation for the
134 :class:`~jinja2.sandbox.SandboxedEnvironment`.
135
136 .. attribute:: filters
137
138 A dict of filters for this environment. As long as no template was
Armin Ronacher7259c762008-04-30 13:03:59 +0200139 loaded it's safe to add new filters or remove old. For custom filters
Armin Ronacherd1ff8582008-05-11 00:30:43 +0200140 see :ref:`writing-filters`. For valid filter names have a look at
141 :ref:`identifier-naming`.
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200142
143 .. attribute:: tests
144
Lukas Meuserad48a2e2008-05-01 18:19:57 +0200145 A dict of test functions for this environment. As long as no
146 template was loaded it's safe to modify this dict. For custom tests
Armin Ronacherd1ff8582008-05-11 00:30:43 +0200147 see :ref:`writing-tests`. For valid test names have a look at
148 :ref:`identifier-naming`.
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200149
150 .. attribute:: globals
151
152 A dict of global variables. These variables are always available
Armin Ronacher981cbf62008-05-13 09:12:27 +0200153 in a template. As long as no template was loaded it's safe
Armin Ronacher7259c762008-04-30 13:03:59 +0200154 to modify this dict. For more details see :ref:`global-namespace`.
Armin Ronacherd1ff8582008-05-11 00:30:43 +0200155 For valid object names have a look at :ref:`identifier-naming`.
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200156
Armin Ronachere2535202016-12-31 00:43:50 +0100157 .. attribute:: policies
158
159 A dictionary with :ref:`policies`. These can be reconfigured to
160 change the runtime behavior or certain template features. Usually
161 these are security related.
162
ThiefMaster14936312015-04-06 13:54:14 +0200163 .. attribute:: code_generator_class
164
165 The class used for code generation. This should not be changed
166 in most cases, unless you need to modify the Python code a
167 template compiles to.
168
ThiefMasterf22fdd52015-04-06 14:08:46 +0200169 .. attribute:: context_class
170
171 The context used for templates. This should not be changed
172 in most cases, unless you need to modify internals of how
173 template variables are handled. For details, see
174 :class:`~jinja2.runtime.Context`.
175
Armin Ronachered98cac2008-05-07 08:42:11 +0200176 .. automethod:: overlay([options])
177
Armin Ronacher58f351d2008-05-28 21:30:14 +0200178 .. method:: undefined([hint, obj, name, exc])
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200179
Armin Ronacher5411ce72008-05-25 11:36:22 +0200180 Creates a new :class:`Undefined` object for `name`. This is useful
181 for filters or functions that may return undefined objects for
182 some operations. All parameters except of `hint` should be provided
183 as keyword parameters for better readability. The `hint` is used as
184 error message for the exception if provided, otherwise the error
Armin Ronacher0aa0f582009-03-18 01:01:36 +0100185 message will be generated from `obj` and `name` automatically. The exception
Armin Ronacher5411ce72008-05-25 11:36:22 +0200186 provided as `exc` is raised if something with the generated undefined
187 object is done that the undefined object does not allow. The default
188 exception is :exc:`UndefinedError`. If a `hint` is provided the
Alex Chan972c0302015-04-05 22:42:34 +0100189 `name` may be omitted.
Armin Ronacher5411ce72008-05-25 11:36:22 +0200190
191 The most common way to create an undefined object is by providing
192 a name only::
193
194 return environment.undefined(name='some_name')
195
196 This means that the name `some_name` is not defined. If the name
197 was from an attribute of an object it makes sense to tell the
198 undefined object the holder object to improve the error message::
199
200 if not hasattr(obj, 'attr'):
201 return environment.undefined(obj=obj, name='attr')
202
203 For a more complex example you can provide a hint. For example
204 the :func:`first` filter creates an undefined object that way::
205
206 return environment.undefined('no first item, sequence was empty')
207
208 If it the `name` or `obj` is known (for example because an attribute
Alex Chan972c0302015-04-05 22:42:34 +0100209 was accessed) it should be passed to the undefined object, even if
Armin Ronacher5411ce72008-05-25 11:36:22 +0200210 a custom `hint` is provided. This gives undefined objects the
211 possibility to enhance the error message.
212
213.. autoclass:: Template
Armin Ronacher9bb7e472008-05-28 11:26:59 +0200214 :members: module, make_module
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200215
Armin Ronacher7259c762008-04-30 13:03:59 +0200216 .. attribute:: globals
217
Armin Ronachered98cac2008-05-07 08:42:11 +0200218 The dict with the globals of that template. It's unsafe to modify
219 this dict as it may be shared with other templates or the environment
220 that loaded the template.
Armin Ronacher7259c762008-04-30 13:03:59 +0200221
222 .. attribute:: name
223
Armin Ronachered98cac2008-05-07 08:42:11 +0200224 The loading name of the template. If the template was loaded from a
225 string this is `None`.
226
Armin Ronacher5411ce72008-05-25 11:36:22 +0200227 .. attribute:: filename
228
229 The filename of the template on the file system if it was loaded from
230 there. Otherwise this is `None`.
231
Armin Ronachered98cac2008-05-07 08:42:11 +0200232 .. automethod:: render([context])
233
234 .. automethod:: generate([context])
235
236 .. automethod:: stream([context])
Armin Ronacher7259c762008-04-30 13:03:59 +0200237
Armin Ronacherd8326d92016-12-28 22:51:46 +0100238 .. automethod:: render_async([context])
239
240 .. automethod:: generate_async([context])
241
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200242
Armin Ronacher6df604e2008-05-23 22:18:38 +0200243.. autoclass:: jinja2.environment.TemplateStream()
Armin Ronacher74b51062008-06-17 11:28:59 +0200244 :members: disable_buffering, enable_buffering, dump
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200245
246
Armin Ronacher1da23d12010-04-05 18:11:18 +0200247Autoescaping
248------------
249
Armin Ronachera27a5032017-01-07 15:55:20 +0100250.. versionchanged:: 2.4
Armin Ronacher1da23d12010-04-05 18:11:18 +0200251
Armin Ronachera27a5032017-01-07 15:55:20 +0100252Jinja2 now comes with autoescaping support. As of Jinja 2.9 the
253autoescape extension is removed and built-in. However autoescaping is
254not yet enabled by default though this might change in the future.
255It's recommended to configure a sensible default for autoescaping. This
256makes it possible to enable and disable autoescaping on a per-template
257basis (HTML versus text for instance).
Armin Ronacher1da23d12010-04-05 18:11:18 +0200258
259Here a recommended setup that enables autoescaping for templates ending
260in ``'.html'``, ``'.htm'`` and ``'.xml'`` and disabling it by default
261for all other extensions::
262
263 def guess_autoescape(template_name):
264 if template_name is None or '.' not in template_name:
265 return False
266 ext = template_name.rsplit('.', 1)[1]
267 return ext in ('html', 'htm', 'xml')
268
269 env = Environment(autoescape=guess_autoescape,
Armin Ronachera27a5032017-01-07 15:55:20 +0100270 loader=PackageLoader('mypackage'))
Armin Ronacher1da23d12010-04-05 18:11:18 +0200271
272When implementing a guessing autoescape function, make sure you also
273accept `None` as valid template name. This will be passed when generating
274templates from strings.
275
276Inside the templates the behaviour can be temporarily changed by using
277the `autoescape` block (see :ref:`autoescape-overrides`).
278
279
Armin Ronacherd1ff8582008-05-11 00:30:43 +0200280.. _identifier-naming:
281
282Notes on Identifiers
Armin Ronacher5411ce72008-05-25 11:36:22 +0200283--------------------
Armin Ronacherd1ff8582008-05-11 00:30:43 +0200284
285Jinja2 uses the regular Python 2.x naming rules. Valid identifiers have to
286match ``[a-zA-Z_][a-zA-Z0-9_]*``. As a matter of fact non ASCII characters
287are currently not allowed. This limitation will probably go away as soon as
288unicode identifiers are fully specified for Python 3.
289
290Filters and tests are looked up in separate namespaces and have slightly
291modified identifier syntax. Filters and tests may contain dots to group
292filters and tests by topic. For example it's perfectly valid to add a
293function into the filter dict and call it `to.unicode`. The regular
294expression for filter and test identifiers is
295``[a-zA-Z_][a-zA-Z0-9_]*(\.[a-zA-Z_][a-zA-Z0-9_]*)*```.
296
297
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200298Undefined Types
299---------------
300
301These classes can be used as undefined types. The :class:`Environment`
302constructor takes an `undefined` parameter that can be one of those classes
303or a custom subclass of :class:`Undefined`. Whenever the template engine is
304unable to look up a name or access an attribute one of those objects is
305created and returned. Some operations on undefined values are then allowed,
306others fail.
307
308The closest to regular Python behavior is the `StrictUndefined` which
309disallows all operations beside testing if it's an undefined object.
310
Armin Ronachera816bf42008-09-17 21:28:01 +0200311.. autoclass:: jinja2.Undefined()
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200312
Armin Ronacher9bb7e472008-05-28 11:26:59 +0200313 .. attribute:: _undefined_hint
314
315 Either `None` or an unicode string with the error message for
316 the undefined object.
317
318 .. attribute:: _undefined_obj
319
320 Either `None` or the owner object that caused the undefined object
321 to be created (for example because an attribute does not exist).
322
323 .. attribute:: _undefined_name
324
325 The name for the undefined variable / attribute or just `None`
326 if no such information exists.
327
328 .. attribute:: _undefined_exception
329
330 The exception that the undefined object wants to raise. This
331 is usually one of :exc:`UndefinedError` or :exc:`SecurityError`.
332
333 .. method:: _fail_with_undefined_error(\*args, \**kwargs)
334
335 When called with any arguments this method raises
336 :attr:`_undefined_exception` with an error message generated
337 from the undefined hints stored on the undefined object.
338
Armin Ronachera816bf42008-09-17 21:28:01 +0200339.. autoclass:: jinja2.DebugUndefined()
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200340
Armin Ronachera816bf42008-09-17 21:28:01 +0200341.. autoclass:: jinja2.StrictUndefined()
Armin Ronacher5411ce72008-05-25 11:36:22 +0200342
Armin Ronacher6e9dfbf2014-06-06 22:14:45 +0600343There is also a factory function that can decorate undefined objects to
344implement logging on failures:
345
346.. autofunction:: jinja2.make_logging_undefined
347
Armin Ronacher5411ce72008-05-25 11:36:22 +0200348Undefined objects are created by calling :attr:`undefined`.
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200349
Armin Ronacher9bb7e472008-05-28 11:26:59 +0200350.. admonition:: Implementation
351
352 :class:`Undefined` objects are implemented by overriding the special
353 `__underscore__` methods. For example the default :class:`Undefined`
354 class implements `__unicode__` in a way that it returns an empty
355 string, however `__int__` and others still fail with an exception. To
356 allow conversion to int by returning ``0`` you can implement your own::
357
358 class NullUndefined(Undefined):
359 def __int__(self):
360 return 0
361 def __float__(self):
362 return 0.0
363
364 To disallow a method, just override it and raise
Armin Ronacher58f351d2008-05-28 21:30:14 +0200365 :attr:`~Undefined._undefined_exception`. Because this is a very common
366 idom in undefined objects there is the helper method
367 :meth:`~Undefined._fail_with_undefined_error` that does the error raising
368 automatically. Here a class that works like the regular :class:`Undefined`
369 but chokes on iteration::
Armin Ronacher9bb7e472008-05-28 11:26:59 +0200370
371 class NonIterableUndefined(Undefined):
372 __iter__ = Undefined._fail_with_undefined_error
373
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200374
Armin Ronacher7259c762008-04-30 13:03:59 +0200375The Context
376-----------
377
Armin Ronacher6df604e2008-05-23 22:18:38 +0200378.. autoclass:: jinja2.runtime.Context()
Armin Ronacherf35e2812008-05-06 16:04:10 +0200379 :members: resolve, get_exported, get_all
Armin Ronacher7259c762008-04-30 13:03:59 +0200380
381 .. attribute:: parent
382
383 A dict of read only, global variables the template looks up. These
Armin Ronacher19cf9c22008-05-01 12:49:53 +0200384 can either come from another :class:`Context`, from the
Armin Ronacher5411ce72008-05-25 11:36:22 +0200385 :attr:`Environment.globals` or :attr:`Template.globals` or points
386 to a dict created by combining the globals with the variables
387 passed to the render function. It must not be altered.
Armin Ronacher7259c762008-04-30 13:03:59 +0200388
389 .. attribute:: vars
390
391 The template local variables. This list contains environment and
392 context functions from the :attr:`parent` scope as well as local
393 modifications and exported variables from the template. The template
394 will modify this dict during template evaluation but filters and
395 context functions are not allowed to modify it.
396
397 .. attribute:: environment
398
399 The environment that loaded the template.
400
401 .. attribute:: exported_vars
402
403 This set contains all the names the template exports. The values for
404 the names are in the :attr:`vars` dict. In order to get a copy of the
405 exported variables as dict, :meth:`get_exported` can be used.
406
407 .. attribute:: name
408
409 The load name of the template owning this context.
410
411 .. attribute:: blocks
412
413 A dict with the current mapping of blocks in the template. The keys
414 in this dict are the names of the blocks, and the values a list of
415 blocks registered. The last item in each list is the current active
416 block (latest in the inheritance chain).
417
Armin Ronacherfe150f32010-03-15 02:42:41 +0100418 .. attribute:: eval_ctx
419
420 The current :ref:`eval-context`.
421
Armin Ronacher9bb7e472008-05-28 11:26:59 +0200422 .. automethod:: jinja2.runtime.Context.call(callable, \*args, \**kwargs)
423
424
425.. admonition:: Implementation
426
427 Context is immutable for the same reason Python's frame locals are
428 immutable inside functions. Both Jinja2 and Python are not using the
429 context / frame locals as data storage for variables but only as primary
430 data source.
431
432 When a template accesses a variable the template does not define, Jinja2
433 looks up the variable in the context, after that the variable is treated
434 as if it was defined in the template.
435
Armin Ronacher7259c762008-04-30 13:03:59 +0200436
Armin Ronacher5cdc1ac2008-05-07 12:17:18 +0200437.. _loaders:
438
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200439Loaders
440-------
441
442Loaders are responsible for loading templates from a resource such as the
Armin Ronacher7259c762008-04-30 13:03:59 +0200443file system. The environment will keep the compiled modules in memory like
444Python's `sys.modules`. Unlike `sys.modules` however this cache is limited in
445size by default and templates are automatically reloaded.
Armin Ronachercda43df2008-05-03 17:10:05 +0200446All loaders are subclasses of :class:`BaseLoader`. If you want to create your
Armin Ronachercda43df2008-05-03 17:10:05 +0200447own loader, subclass :class:`BaseLoader` and override `get_source`.
448
Armin Ronachera816bf42008-09-17 21:28:01 +0200449.. autoclass:: jinja2.BaseLoader
Armin Ronachercda43df2008-05-03 17:10:05 +0200450 :members: get_source, load
451
452Here a list of the builtin loaders Jinja2 provides:
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200453
Armin Ronachera816bf42008-09-17 21:28:01 +0200454.. autoclass:: jinja2.FileSystemLoader
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200455
Armin Ronachera816bf42008-09-17 21:28:01 +0200456.. autoclass:: jinja2.PackageLoader
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200457
Armin Ronachera816bf42008-09-17 21:28:01 +0200458.. autoclass:: jinja2.DictLoader
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200459
Armin Ronachera816bf42008-09-17 21:28:01 +0200460.. autoclass:: jinja2.FunctionLoader
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200461
Armin Ronachera816bf42008-09-17 21:28:01 +0200462.. autoclass:: jinja2.PrefixLoader
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200463
Armin Ronachera816bf42008-09-17 21:28:01 +0200464.. autoclass:: jinja2.ChoiceLoader
465
Armin Ronacher46844982011-01-29 20:19:58 +0100466.. autoclass:: jinja2.ModuleLoader
467
Armin Ronachera816bf42008-09-17 21:28:01 +0200468
469.. _bytecode-cache:
470
471Bytecode Cache
472--------------
473
474Jinja 2.1 and higher support external bytecode caching. Bytecode caches make
475it possible to store the generated bytecode on the file system or a different
476location to avoid parsing the templates on first use.
477
478This is especially useful if you have a web application that is initialized on
479the first request and Jinja compiles many templates at once which slows down
480the application.
481
Jakub Wilk3fc008b2013-05-25 23:37:34 +0200482To use a bytecode cache, instantiate it and pass it to the :class:`Environment`.
Armin Ronachera816bf42008-09-17 21:28:01 +0200483
484.. autoclass:: jinja2.BytecodeCache
485 :members: load_bytecode, dump_bytecode, clear
486
487.. autoclass:: jinja2.bccache.Bucket
488 :members: write_bytecode, load_bytecode, bytecode_from_string,
489 bytecode_to_string, reset
490
491 .. attribute:: environment
492
493 The :class:`Environment` that created the bucket.
494
495 .. attribute:: key
496
497 The unique cache key for this bucket
498
499 .. attribute:: code
500
501 The bytecode if it's loaded, otherwise `None`.
502
503
504Builtin bytecode caches:
505
506.. autoclass:: jinja2.FileSystemBytecodeCache
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200507
Armin Ronacheraa1d17d2008-09-18 18:09:06 +0200508.. autoclass:: jinja2.MemcachedBytecodeCache
509
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200510
Armin Ronacherd8326d92016-12-28 22:51:46 +0100511Async Support
512-------------
513
514Starting with version 2.9, Jinja2 also supports the Python `async` and
515`await` constructs. As far as template designers go this feature is
516entirely opaque to them however as a developer you should be aware of how
517it's implemented as it influences what type of APIs you can safely expose
518to the template environment.
519
520First you need to be aware that by default async support is disabled as
521enabling it will generate different template code behind the scenes which
522passes everything through the asyncio event loop. This is important to
523understand because it has some impact to what you are doing:
524
525* template rendering will require an event loop to be set for the
526 current thread (``asyncio.get_event_loop`` needs to return one)
527* all template generation code internally runs async generators which
528 means that you will pay a performance penalty even if the non sync
529 methods are used!
530* The sync methods are based on async methods if the async mode is
531 enabled which means that `render` for instance will internally invoke
532 `render_async` and run it as part of the current event loop until the
533 execution finished.
534
535Awaitable objects can be returned from functions in templates and any
536function call in a template will automatically await the result. This
537means that you can let provide a method that asynchronously loads data
538from a database if you so desire and from the template designer's point of
539view this is just another function they can call. This means that the
540``await`` you would normally issue in Python is implied. However this
541only applies to function calls. If an attribute for instance would be an
542avaitable object then this would not result in the expected behavior.
543
544Likewise iterations with a `for` loop support async iterators.
545
Armin Ronachere2535202016-12-31 00:43:50 +0100546.. _policies:
547
548Policies
549--------
550
551Starting with Jinja 2.9 policies can be configured on the environment
552which can slightly influence how filters and other template constructs
553behave. They can be configured with the
554:attr:`~jinja2.Environment.policies` attribute.
555
556Example::
557
558 env.policies['urlize.rel'] = 'nofollow noopener'
559
Armin Ronacher028f0582017-01-07 14:57:44 +0100560``compiler.ascii_str``:
561 This boolean controls on Python 2 if Jinja2 should store ASCII only
562 literals as bytestring instead of unicode strings. This used to be
563 always enabled for Jinja versions below 2.9 and now can be changed.
564 Traditionally it was done this way since some APIs in Python 2 failed
565 badly for unicode strings (for instance the datetime strftime API).
566 Now however sometimes the inverse is true (for instance str.format).
567 If this is set to False then all strings are stored as unicode
568 internally.
569
Armin Ronachere2535202016-12-31 00:43:50 +0100570``urlize.rel``:
571 A string that defines the items for the `rel` attribute of generated
572 links with the `urlize` filter. These items are always added. The
573 default is `noopener`.
574
575``urlize.target``:
576 The default target that is issued for links from the `urlize` filter
577 if no other target is defined by the call explicitly.
578
Armin Ronachere71a1302017-01-06 21:33:51 +0100579``json.dumps_function``:
580 If this is set to a value other than `None` then the `tojson` filter
581 will dump with this function instead of the default one. Note that
582 this function should accept arbitrary extra arguments which might be
583 passed in the future from the filter. Currently the only argument
584 that might be passed is `indent`. The default dump function is
585 ``json.dumps``.
586
587``json.dumps_kwargs``:
588 Keyword arguments to be passed to the dump function. The default is
589 ``{'sort_keys': True}``.
590
Armin Ronacherd8326d92016-12-28 22:51:46 +0100591
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200592Utilities
593---------
594
595These helper functions and classes are useful if you add custom filters or
596functions to a Jinja2 environment.
597
Armin Ronachera816bf42008-09-17 21:28:01 +0200598.. autofunction:: jinja2.environmentfilter
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200599
Armin Ronachera816bf42008-09-17 21:28:01 +0200600.. autofunction:: jinja2.contextfilter
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200601
Armin Ronacherfe150f32010-03-15 02:42:41 +0100602.. autofunction:: jinja2.evalcontextfilter
603
Armin Ronachera816bf42008-09-17 21:28:01 +0200604.. autofunction:: jinja2.environmentfunction
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200605
Armin Ronachera816bf42008-09-17 21:28:01 +0200606.. autofunction:: jinja2.contextfunction
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200607
Armin Ronacherfe150f32010-03-15 02:42:41 +0100608.. autofunction:: jinja2.evalcontextfunction
609
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200610.. function:: escape(s)
611
Armin Ronacher9bb7e472008-05-28 11:26:59 +0200612 Convert the characters ``&``, ``<``, ``>``, ``'``, and ``"`` in string `s`
613 to HTML-safe sequences. Use this if you need to display text that might
614 contain such characters in HTML. This function will not escaped objects
615 that do have an HTML representation such as already escaped data.
616
617 The return value is a :class:`Markup` string.
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200618
Armin Ronachera816bf42008-09-17 21:28:01 +0200619.. autofunction:: jinja2.clear_caches
Armin Ronacher187bde12008-05-01 18:19:16 +0200620
Armin Ronachera816bf42008-09-17 21:28:01 +0200621.. autofunction:: jinja2.is_undefined
Armin Ronacher9bb7e472008-05-28 11:26:59 +0200622
Armin Ronachera816bf42008-09-17 21:28:01 +0200623.. autoclass:: jinja2.Markup([string])
Armin Ronacher58f351d2008-05-28 21:30:14 +0200624 :members: escape, unescape, striptags
625
626.. admonition:: Note
627
628 The Jinja2 :class:`Markup` class is compatible with at least Pylons and
629 Genshi. It's expected that more template engines and framework will pick
630 up the `__html__` concept soon.
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200631
632
633Exceptions
634----------
635
Armin Ronachera816bf42008-09-17 21:28:01 +0200636.. autoexception:: jinja2.TemplateError
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200637
Armin Ronachera816bf42008-09-17 21:28:01 +0200638.. autoexception:: jinja2.UndefinedError
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200639
Armin Ronachera816bf42008-09-17 21:28:01 +0200640.. autoexception:: jinja2.TemplateNotFound
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200641
Armin Ronacher31bbd9e2010-01-14 00:41:30 +0100642.. autoexception:: jinja2.TemplatesNotFound
643
Armin Ronachera816bf42008-09-17 21:28:01 +0200644.. autoexception:: jinja2.TemplateSyntaxError
Armin Ronacher3c8b7ad2008-04-28 13:52:21 +0200645
Armin Ronacherf3c35c42008-05-23 23:18:14 +0200646 .. attribute:: message
647
648 The error message as utf-8 bytestring.
649
650 .. attribute:: lineno
651
652 The line number where the error occurred
653
654 .. attribute:: name
655
656 The load name for the template as unicode string.
657
658 .. attribute:: filename
659
660 The filename that loaded the template as bytestring in the encoding
661 of the file system (most likely utf-8 or mbcs on Windows systems).
662
663 The reason why the filename and error message are bytestrings and not
664 unicode strings is that Python 2.x is not using unicode for exceptions
665 and tracebacks as well as the compiler. This will change with Python 3.
666
Armin Ronachera816bf42008-09-17 21:28:01 +0200667.. autoexception:: jinja2.TemplateAssertionError
Armin Ronacher7259c762008-04-30 13:03:59 +0200668
669
670.. _writing-filters:
671
672Custom Filters
673--------------
674
675Custom filters are just regular Python functions that take the left side of
Guillaume Paumier345e0ba2016-04-10 08:58:06 -0700676the filter as first argument and the arguments passed to the filter as
Armin Ronacher7259c762008-04-30 13:03:59 +0200677extra arguments or keyword arguments.
678
679For example in the filter ``{{ 42|myfilter(23) }}`` the function would be
680called with ``myfilter(42, 23)``. Here for example a simple filter that can
681be applied to datetime objects to format them::
682
683 def datetimeformat(value, format='%H:%M / %d-%m-%Y'):
684 return value.strftime(format)
685
686You can register it on the template environment by updating the
687:attr:`~Environment.filters` dict on the environment::
688
689 environment.filters['datetimeformat'] = datetimeformat
690
691Inside the template it can then be used as follows:
692
693.. sourcecode:: jinja
694
695 written on: {{ article.pub_date|datetimeformat }}
696 publication date: {{ article.pub_date|datetimeformat('%d-%m-%Y') }}
697
698Filters can also be passed the current template context or environment. This
Armin Ronacher0aa0f582009-03-18 01:01:36 +0100699is useful if a filter wants to return an undefined value or check the current
Armin Ronacher2e3c9c72010-04-10 13:03:46 +0200700:attr:`~Environment.autoescape` setting. For this purpose three decorators
Armin Ronacherfe150f32010-03-15 02:42:41 +0100701exist: :func:`environmentfilter`, :func:`contextfilter` and
702:func:`evalcontextfilter`.
Armin Ronacher7259c762008-04-30 13:03:59 +0200703
704Here a small example filter that breaks a text into HTML line breaks and
705paragraphs and marks the return value as safe HTML string if autoescaping is
706enabled::
707
708 import re
Jeffrey Finkelstein449ef022011-07-01 15:46:54 -0700709 from jinja2 import evalcontextfilter, Markup, escape
Armin Ronacher7259c762008-04-30 13:03:59 +0200710
711 _paragraph_re = re.compile(r'(?:\r\n|\r|\n){2,}')
712
Armin Ronacherfe150f32010-03-15 02:42:41 +0100713 @evalcontextfilter
714 def nl2br(eval_ctx, value):
Jörn Hees17024512014-06-15 18:31:16 +0200715 result = u'\n\n'.join(u'<p>%s</p>' % p.replace('\n', Markup('<br>\n'))
Armin Ronacher7259c762008-04-30 13:03:59 +0200716 for p in _paragraph_re.split(escape(value)))
Armin Ronacherfe150f32010-03-15 02:42:41 +0100717 if eval_ctx.autoescape:
Armin Ronacher7259c762008-04-30 13:03:59 +0200718 result = Markup(result)
719 return result
720
721Context filters work the same just that the first argument is the current
Armin Ronacher19cf9c22008-05-01 12:49:53 +0200722active :class:`Context` rather then the environment.
Armin Ronacher7259c762008-04-30 13:03:59 +0200723
724
Armin Ronacherfe150f32010-03-15 02:42:41 +0100725.. _eval-context:
726
727Evaluation Context
728------------------
729
730The evaluation context (short eval context or eval ctx) is a new object
Jakub Wilk3fc008b2013-05-25 23:37:34 +0200731introduced in Jinja 2.4 that makes it possible to activate and deactivate
Armin Ronacherfe150f32010-03-15 02:42:41 +0100732compiled features at runtime.
733
734Currently it is only used to enable and disable the automatic escaping but
735can be used for extensions as well.
736
737In previous Jinja versions filters and functions were marked as
738environment callables in order to check for the autoescape status from the
739environment. In new versions it's encouraged to check the setting from the
740evaluation context instead.
741
742Previous versions::
743
744 @environmentfilter
745 def filter(env, value):
746 result = do_something(value)
747 if env.autoescape:
748 result = Markup(result)
749 return result
750
751In new versions you can either use a :func:`contextfilter` and access the
752evaluation context from the actual context, or use a
753:func:`evalcontextfilter` which directly passes the evaluation context to
754the function::
755
756 @contextfilter
757 def filter(context, value):
758 result = do_something(value)
759 if context.eval_ctx.autoescape:
760 result = Markup(result)
761 return result
762
763 @evalcontextfilter
764 def filter(eval_ctx, value):
765 result = do_something(value)
766 if eval_ctx.autoescape:
767 result = Markup(result)
768 return result
769
770The evaluation context must not be modified at runtime. Modifications
771must only happen with a :class:`nodes.EvalContextModifier` and
772:class:`nodes.ScopedEvalContextModifier` from an extension, not on the
773eval context object itself.
774
Armin Ronacher76ae15e2010-03-15 09:36:47 +0100775.. autoclass:: jinja2.nodes.EvalContext
Armin Ronacher30fda272010-03-15 03:06:04 +0100776
777 .. attribute:: autoescape
778
779 `True` or `False` depending on if autoescaping is active or not.
780
781 .. attribute:: volatile
782
783 `True` if the compiler cannot evaluate some expressions at compile
784 time. At runtime this should always be `False`.
785
786
Armin Ronacher7259c762008-04-30 13:03:59 +0200787.. _writing-tests:
788
789Custom Tests
790------------
791
Armin Ronachera5d8f552008-09-11 20:46:34 +0200792Tests work like filters just that there is no way for a test to get access
Armin Ronacher7259c762008-04-30 13:03:59 +0200793to the environment or context and that they can't be chained. The return
Armin Ronachera5d8f552008-09-11 20:46:34 +0200794value of a test should be `True` or `False`. The purpose of a test is to
Armin Ronacher7259c762008-04-30 13:03:59 +0200795give the template designers the possibility to perform type and conformability
796checks.
797
Armin Ronachera5d8f552008-09-11 20:46:34 +0200798Here a simple test that checks if a variable is a prime number::
Armin Ronacher7259c762008-04-30 13:03:59 +0200799
800 import math
801
802 def is_prime(n):
803 if n == 2:
804 return True
805 for i in xrange(2, int(math.ceil(math.sqrt(n))) + 1):
806 if n % i == 0:
807 return False
808 return True
809
810
811You can register it on the template environment by updating the
812:attr:`~Environment.tests` dict on the environment::
813
814 environment.tests['prime'] = is_prime
815
816A template designer can then use the test like this:
817
818.. sourcecode:: jinja
819
820 {% if 42 is prime %}
821 42 is a prime number
822 {% else %}
823 42 is not a prime number
824 {% endif %}
825
826
827.. _global-namespace:
828
829The Global Namespace
830--------------------
831
Armin Ronacher981cbf62008-05-13 09:12:27 +0200832Variables stored in the :attr:`Environment.globals` dict are special as they
833are available for imported templates too, even if they are imported without
834context. This is the place where you can put variables and functions
835that should be available all the time. Additionally :attr:`Template.globals`
836exist that are variables available to a specific template that are available
837to all :meth:`~Template.render` calls.
Armin Ronacher5411ce72008-05-25 11:36:22 +0200838
839
Armin Ronacher9bb7e472008-05-28 11:26:59 +0200840.. _low-level-api:
841
Armin Ronacher5411ce72008-05-25 11:36:22 +0200842Low Level API
843-------------
844
845The low level API exposes functionality that can be useful to understand some
846implementation details, debugging purposes or advanced :ref:`extension
Armin Ronacher61a5a242008-05-26 12:07:44 +0200847<jinja-extensions>` techniques. Unless you know exactly what you are doing we
848don't recommend using any of those.
Armin Ronacher5411ce72008-05-25 11:36:22 +0200849
850.. automethod:: Environment.lex
851
852.. automethod:: Environment.parse
853
Armin Ronacher9ad96e72008-06-13 22:44:01 +0200854.. automethod:: Environment.preprocess
855
Armin Ronacher5411ce72008-05-25 11:36:22 +0200856.. automethod:: Template.new_context
857
858.. method:: Template.root_render_func(context)
859
860 This is the low level render function. It's passed a :class:`Context`
861 that has to be created by :meth:`new_context` of the same template or
862 a compatible template. This render function is generated by the
863 compiler from the template code and returns a generator that yields
864 unicode strings.
865
866 If an exception in the template code happens the template engine will
867 not rewrite the exception but pass through the original one. As a
868 matter of fact this function should only be called from within a
869 :meth:`render` / :meth:`generate` / :meth:`stream` call.
870
871.. attribute:: Template.blocks
872
873 A dict of block render functions. Each of these functions works exactly
874 like the :meth:`root_render_func` with the same limitations.
875
876.. attribute:: Template.is_up_to_date
877
878 This attribute is `False` if there is a newer version of the template
879 available, otherwise `True`.
Armin Ronacher9bb7e472008-05-28 11:26:59 +0200880
881.. admonition:: Note
882
Armin Ronacher58f351d2008-05-28 21:30:14 +0200883 The low-level API is fragile. Future Jinja2 versions will try not to
884 change it in a backwards incompatible way but modifications in the Jinja2
885 core may shine through. For example if Jinja2 introduces a new AST node
886 in later versions that may be returned by :meth:`~Environment.parse`.
Armin Ronacher63cf9b82009-07-26 10:33:36 +0200887
888The Meta API
889------------
890
891.. versionadded:: 2.2
892
893The meta API returns some information about abstract syntax trees that
894could help applications to implement more advanced template concepts. All
895the functions of the meta API operate on an abstract syntax tree as
896returned by the :meth:`Environment.parse` method.
897
898.. autofunction:: jinja2.meta.find_undeclared_variables
899
900.. autofunction:: jinja2.meta.find_referenced_templates