123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214 |
- JMESPath
- ========
- .. image:: https://badges.gitter.im/Join Chat.svg
- :target: https://gitter.im/jmespath/chat
- JMESPath (pronounced "james path") allows you to declaratively specify how to
- extract elements from a JSON document.
- For example, given this document::
- {"foo": {"bar": "baz"}}
- The jmespath expression ``foo.bar`` will return "baz".
- JMESPath also supports:
- Referencing elements in a list. Given the data::
- {"foo": {"bar": ["one", "two"]}}
- The expression: ``foo.bar[0]`` will return "one".
- You can also reference all the items in a list using the ``*``
- syntax::
- {"foo": {"bar": [{"name": "one"}, {"name": "two"}]}}
- The expression: ``foo.bar[*].name`` will return ["one", "two"].
- Negative indexing is also supported (-1 refers to the last element
- in the list). Given the data above, the expression
- ``foo.bar[-1].name`` will return "two".
- The ``*`` can also be used for hash types::
- {"foo": {"bar": {"name": "one"}, "baz": {"name": "two"}}}
- The expression: ``foo.*.name`` will return ["one", "two"].
- Installation
- ============
- You can install JMESPath from pypi with:
- .. code:: bash
- pip install jmespath
- API
- ===
- The ``jmespath.py`` library has two functions
- that operate on python data structures. You can use ``search``
- and give it the jmespath expression and the data:
- .. code:: python
- >>> import jmespath
- >>> path = jmespath.search('foo.bar', {'foo': {'bar': 'baz'}})
- 'baz'
- Similar to the ``re`` module, you can use the ``compile`` function
- to compile the JMESPath expression and use this parsed expression
- to perform repeated searches:
- .. code:: python
- >>> import jmespath
- >>> expression = jmespath.compile('foo.bar')
- >>> expression.search({'foo': {'bar': 'baz'}})
- 'baz'
- >>> expression.search({'foo': {'bar': 'other'}})
- 'other'
- This is useful if you're going to use the same jmespath expression to
- search multiple documents. This avoids having to reparse the
- JMESPath expression each time you search a new document.
- Options
- -------
- You can provide an instance of ``jmespath.Options`` to control how
- a JMESPath expression is evaluated. The most common scenario for
- using an ``Options`` instance is if you want to have ordered output
- of your dict keys. To do this you can use either of these options:
- .. code:: python
- >>> import jmespath
- >>> jmespath.search('{a: a, b: b}',
- ... mydata,
- ... jmespath.Options(dict_cls=collections.OrderedDict))
- >>> import jmespath
- >>> parsed = jmespath.compile('{a: a, b: b}')
- >>> parsed.search(mydata,
- ... jmespath.Options(dict_cls=collections.OrderedDict))
- Custom Functions
- ~~~~~~~~~~~~~~~~
- The JMESPath language has numerous
- `built-in functions
- <http://jmespath.org/specification.html#built-in-functions>`__, but it is
- also possible to add your own custom functions. Keep in mind that
- custom function support in jmespath.py is experimental and the API may
- change based on feedback.
- **If you have a custom function that you've found useful, consider submitting
- it to jmespath.site and propose that it be added to the JMESPath language.**
- You can submit proposals
- `here <https://github.com/jmespath/jmespath.site/issues>`__.
- To create custom functions:
- * Create a subclass of ``jmespath.functions.Functions``.
- * Create a method with the name ``_func_<your function name>``.
- * Apply the ``jmespath.functions.signature`` decorator that indicates
- the expected types of the function arguments.
- * Provide an instance of your subclass in a ``jmespath.Options`` object.
- Below are a few examples:
- .. code:: python
- import jmespath
- from jmespath import functions
- # 1. Create a subclass of functions.Functions.
- # The function.Functions base class has logic
- # that introspects all of its methods and automatically
- # registers your custom functions in its function table.
- class CustomFunctions(functions.Functions):
- # 2 and 3. Create a function that starts with _func_
- # and decorate it with @signature which indicates its
- # expected types.
- # In this example, we're creating a jmespath function
- # called "unique_letters" that accepts a single argument
- # with an expected type "string".
- @functions.signature({'types': ['string']})
- def _func_unique_letters(self, s):
- # Given a string s, return a sorted
- # string of unique letters: 'ccbbadd' -> 'abcd'
- return ''.join(sorted(set(s)))
- # Here's another example. This is creating
- # a jmespath function called "my_add" that expects
- # two arguments, both of which should be of type number.
- @functions.signature({'types': ['number']}, {'types': ['number']})
- def _func_my_add(self, x, y):
- return x + y
- # 4. Provide an instance of your subclass in a Options object.
- options = jmespath.Options(custom_functions=CustomFunctions())
- # Provide this value to jmespath.search:
- # This will print 3
- print(
- jmespath.search(
- 'my_add(`1`, `2`)', {}, options=options)
- )
- # This will print "abcd"
- print(
- jmespath.search(
- 'foo.bar | unique_letters(@)',
- {'foo': {'bar': 'ccbbadd'}},
- options=options)
- )
- Again, if you come up with useful functions that you think make
- sense in the JMESPath language (and make sense to implement in all
- JMESPath libraries, not just python), please let us know at
- `jmespath.site <https://github.com/jmespath/jmespath.site/issues>`__.
- Specification
- =============
- If you'd like to learn more about the JMESPath language, you can check out
- the `JMESPath tutorial <http://jmespath.org/tutorial.html>`__. Also check
- out the `JMESPath examples page <http://jmespath.org/examples.html>`__ for
- examples of more complex jmespath queries.
- The grammar is specified using ABNF, as described in
- `RFC4234 <http://www.ietf.org/rfc/rfc4234.txt>`_.
- You can find the most up to date
- `grammar for JMESPath here <http://jmespath.org/specification.html#grammar>`__.
- You can read the full
- `JMESPath specification here <http://jmespath.org/specification.html>`__.
- Testing
- =======
- In addition to the unit tests for the jmespath modules,
- there is a ``tests/compliance`` directory that contains
- .json files with test cases. This allows other implementations
- to verify they are producing the correct output. Each json
- file is grouped by feature.
- Discuss
- =======
- Join us on our `Gitter channel <https://gitter.im/jmespath/chat>`__
- if you want to chat or if you have any questions.
|