METADATA 15 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410
  1. Metadata-Version: 2.1
  2. Name: wcwidth
  3. Version: 0.2.13
  4. Summary: Measures the displayed width of unicode strings in a terminal
  5. Home-page: https://github.com/jquast/wcwidth
  6. Author: Jeff Quast
  7. Author-email: contact@jeffquast.com
  8. License: MIT
  9. Keywords: cjk,combining,console,eastasian,emoji,emulator,terminal,unicode,wcswidth,wcwidth,xterm
  10. Classifier: Intended Audience :: Developers
  11. Classifier: Natural Language :: English
  12. Classifier: Development Status :: 5 - Production/Stable
  13. Classifier: Environment :: Console
  14. Classifier: License :: OSI Approved :: MIT License
  15. Classifier: Operating System :: POSIX
  16. Classifier: Programming Language :: Python :: 2.7
  17. Classifier: Programming Language :: Python :: 3.5
  18. Classifier: Programming Language :: Python :: 3.6
  19. Classifier: Programming Language :: Python :: 3.7
  20. Classifier: Programming Language :: Python :: 3.8
  21. Classifier: Programming Language :: Python :: 3.9
  22. Classifier: Programming Language :: Python :: 3.10
  23. Classifier: Programming Language :: Python :: 3.11
  24. Classifier: Programming Language :: Python :: 3.12
  25. Classifier: Topic :: Software Development :: Libraries
  26. Classifier: Topic :: Software Development :: Localization
  27. Classifier: Topic :: Software Development :: Internationalization
  28. Classifier: Topic :: Terminals
  29. License-File: LICENSE
  30. Requires-Dist: backports.functools-lru-cache >=1.2.1 ; python_version < "3.2"
  31. |pypi_downloads| |codecov| |license|
  32. ============
  33. Introduction
  34. ============
  35. This library is mainly for CLI programs that carefully produce output for
  36. Terminals, or make pretend to be an emulator.
  37. **Problem Statement**: The printable length of *most* strings are equal to the
  38. number of cells they occupy on the screen ``1 character : 1 cell``. However,
  39. there are categories of characters that *occupy 2 cells* (full-wide), and
  40. others that *occupy 0* cells (zero-width).
  41. **Solution**: POSIX.1-2001 and POSIX.1-2008 conforming systems provide
  42. `wcwidth(3)`_ and `wcswidth(3)`_ C functions of which this python module's
  43. functions precisely copy. *These functions return the number of cells a
  44. unicode string is expected to occupy.*
  45. Installation
  46. ------------
  47. The stable version of this package is maintained on pypi, install using pip::
  48. pip install wcwidth
  49. Example
  50. -------
  51. **Problem**: given the following phrase (Japanese),
  52. >>> text = u'コンニチハ'
  53. Python **incorrectly** uses the *string length* of 5 codepoints rather than the
  54. *printable length* of 10 cells, so that when using the `rjust` function, the
  55. output length is wrong::
  56. >>> print(len('コンニチハ'))
  57. 5
  58. >>> print('コンニチハ'.rjust(20, '_'))
  59. _______________コンニチハ
  60. By defining our own "rjust" function that uses wcwidth, we can correct this::
  61. >>> def wc_rjust(text, length, padding=' '):
  62. ... from wcwidth import wcswidth
  63. ... return padding * max(0, (length - wcswidth(text))) + text
  64. ...
  65. Our **Solution** uses wcswidth to determine the string length correctly::
  66. >>> from wcwidth import wcswidth
  67. >>> print(wcswidth('コンニチハ'))
  68. 10
  69. >>> print(wc_rjust('コンニチハ', 20, '_'))
  70. __________コンニチハ
  71. Choosing a Version
  72. ------------------
  73. Export an environment variable, ``UNICODE_VERSION``. This should be done by
  74. *terminal emulators* or those developers experimenting with authoring one of
  75. their own, from shell::
  76. $ export UNICODE_VERSION=13.0
  77. If unspecified, the latest version is used. If your Terminal Emulator does not
  78. export this variable, you can use the `jquast/ucs-detect`_ utility to
  79. automatically detect and export it to your shell.
  80. wcwidth, wcswidth
  81. -----------------
  82. Use function ``wcwidth()`` to determine the length of a *single unicode
  83. character*, and ``wcswidth()`` to determine the length of many, a *string
  84. of unicode characters*.
  85. Briefly, return values of function ``wcwidth()`` are:
  86. ``-1``
  87. Indeterminate (not printable).
  88. ``0``
  89. Does not advance the cursor, such as NULL or Combining.
  90. ``2``
  91. Characters of category East Asian Wide (W) or East Asian
  92. Full-width (F) which are displayed using two terminal cells.
  93. ``1``
  94. All others.
  95. Function ``wcswidth()`` simply returns the sum of all values for each character
  96. along a string, or ``-1`` when it occurs anywhere along a string.
  97. Full API Documentation at https://wcwidth.readthedocs.org
  98. ==========
  99. Developing
  100. ==========
  101. Install wcwidth in editable mode::
  102. pip install -e .
  103. Execute unit tests using tox_::
  104. tox -e py27,py35,py36,py37,py38,py39,py310,py311,py312
  105. Updating Unicode Version
  106. ------------------------
  107. Regenerate python code tables from latest Unicode Specification data files::
  108. tox -e update
  109. The script is located at ``bin/update-tables.py``, requires Python 3.9 or
  110. later. It is recommended but not necessary to run this script with the newest
  111. Python, because the newest Python has the latest ``unicodedata`` for generating
  112. comments.
  113. Building Documentation
  114. ----------------------
  115. This project is using `sphinx`_ 4.5 to build documentation::
  116. tox -e sphinx
  117. The output will be in ``docs/_build/html/``.
  118. Updating Requirements
  119. ---------------------
  120. This project is using `pip-tools`_ to manage requirements.
  121. To upgrade requirements for updating unicode version, run::
  122. tox -e update_requirements_update
  123. To upgrade requirements for testing, run::
  124. tox -e update_requirements37,update_requirements39
  125. To upgrade requirements for building documentation, run::
  126. tox -e update_requirements_docs
  127. Utilities
  128. ---------
  129. Supplementary tools for browsing and testing terminals for wide unicode
  130. characters are found in the `bin/`_ of this project's source code. Just ensure
  131. to first ``pip install -r requirements-develop.txt`` from this projects main
  132. folder. For example, an interactive browser for testing::
  133. python ./bin/wcwidth-browser.py
  134. ====
  135. Uses
  136. ====
  137. This library is used in:
  138. - `jquast/blessed`_: a thin, practical wrapper around terminal capabilities in
  139. Python.
  140. - `prompt-toolkit/python-prompt-toolkit`_: a Library for building powerful
  141. interactive command lines in Python.
  142. - `dbcli/pgcli`_: Postgres CLI with autocompletion and syntax highlighting.
  143. - `thomasballinger/curtsies`_: a Curses-like terminal wrapper with a display
  144. based on compositing 2d arrays of text.
  145. - `selectel/pyte`_: Simple VTXXX-compatible linux terminal emulator.
  146. - `astanin/python-tabulate`_: Pretty-print tabular data in Python, a library
  147. and a command-line utility.
  148. - `rspeer/python-ftfy`_: Fixes mojibake and other glitches in Unicode
  149. text.
  150. - `nbedos/termtosvg`_: Terminal recorder that renders sessions as SVG
  151. animations.
  152. - `peterbrittain/asciimatics`_: Package to help people create full-screen text
  153. UIs.
  154. - `python-cmd2/cmd2`_: A tool for building interactive command line apps
  155. - `stratis-storage/stratis-cli`_: CLI for the Stratis project
  156. - `ihabunek/toot`_: A Mastodon CLI/TUI client
  157. - `saulpw/visidata`_: Terminal spreadsheet multitool for discovering and
  158. arranging data
  159. ===============
  160. Other Languages
  161. ===============
  162. - `timoxley/wcwidth`_: JavaScript
  163. - `janlelis/unicode-display_width`_: Ruby
  164. - `alecrabbit/php-wcwidth`_: PHP
  165. - `Text::CharWidth`_: Perl
  166. - `bluebear94/Terminal-WCWidth`_: Perl 6
  167. - `mattn/go-runewidth`_: Go
  168. - `grepsuzette/wcwidth`_: Haxe
  169. - `aperezdc/lua-wcwidth`_: Lua
  170. - `joachimschmidt557/zig-wcwidth`_: Zig
  171. - `fumiyas/wcwidth-cjk`_: `LD_PRELOAD` override
  172. - `joshuarubin/wcwidth9`_: Unicode version 9 in C
  173. =======
  174. History
  175. =======
  176. 0.2.13 *2024-01-06*
  177. * **Bugfix** zero-width support for Hangul Jamo (Korean)
  178. 0.2.12 *2023-11-21*
  179. * re-release to remove .pyi file misplaced in wheel files `Issue #101`_.
  180. 0.2.11 *2023-11-20*
  181. * Include tests files in the source distribution (`PR #98`_, `PR #100`_).
  182. 0.2.10 *2023-11-13*
  183. * **Bugfix** accounting of some kinds of emoji sequences using U+FE0F
  184. Variation Selector 16 (`PR #97`_).
  185. * **Updated** `Specification <Specification_from_pypi_>`_.
  186. 0.2.9 *2023-10-30*
  187. * **Bugfix** zero-width characters used in Emoji ZWJ sequences, Balinese,
  188. Jamo, Devanagari, Tamil, Kannada and others (`PR #91`_).
  189. * **Updated** to include `Specification <Specification_from_pypi_>`_ of
  190. character measurements.
  191. 0.2.8 *2023-09-30*
  192. * Include requirements files in the source distribution (`PR #82`_).
  193. 0.2.7 *2023-09-28*
  194. * **Updated** tables to include Unicode Specification 15.1.0.
  195. * Include ``bin``, ``docs``, and ``tox.ini`` in the source distribution
  196. 0.2.6 *2023-01-14*
  197. * **Updated** tables to include Unicode Specification 14.0.0 and 15.0.0.
  198. * **Changed** developer tools to use pip-compile, and to use jinja2 templates
  199. for code generation in `bin/update-tables.py` to prepare for possible
  200. compiler optimization release.
  201. 0.2.1 .. 0.2.5 *2020-06-23*
  202. * **Repository** changes to update tests and packaging issues, and
  203. begin tagging repository with matching release versions.
  204. 0.2.0 *2020-06-01*
  205. * **Enhancement**: Unicode version may be selected by exporting the
  206. Environment variable ``UNICODE_VERSION``, such as ``13.0``, or ``6.3.0``.
  207. See the `jquast/ucs-detect`_ CLI utility for automatic detection.
  208. * **Enhancement**:
  209. API Documentation is published to readthedocs.org.
  210. * **Updated** tables for *all* Unicode Specifications with files
  211. published in a programmatically consumable format, versions 4.1.0
  212. through 13.0
  213. 0.1.9 *2020-03-22*
  214. * **Performance** optimization by `Avram Lubkin`_, `PR #35`_.
  215. * **Updated** tables to Unicode Specification 13.0.0.
  216. 0.1.8 *2020-01-01*
  217. * **Updated** tables to Unicode Specification 12.0.0. (`PR #30`_).
  218. 0.1.7 *2016-07-01*
  219. * **Updated** tables to Unicode Specification 9.0.0. (`PR #18`_).
  220. 0.1.6 *2016-01-08 Production/Stable*
  221. * ``LICENSE`` file now included with distribution.
  222. 0.1.5 *2015-09-13 Alpha*
  223. * **Bugfix**:
  224. Resolution of "combining_ character width" issue, most especially
  225. those that previously returned -1 now often (correctly) return 0.
  226. resolved by `Philip Craig`_ via `PR #11`_.
  227. * **Deprecated**:
  228. The module path ``wcwidth.table_comb`` is no longer available,
  229. it has been superseded by module path ``wcwidth.table_zero``.
  230. 0.1.4 *2014-11-20 Pre-Alpha*
  231. * **Feature**: ``wcswidth()`` now determines printable length
  232. for (most) combining_ characters. The developer's tool
  233. `bin/wcwidth-browser.py`_ is improved to display combining_
  234. characters when provided the ``--combining`` option
  235. (`Thomas Ballinger`_ and `Leta Montopoli`_ `PR #5`_).
  236. * **Feature**: added static analysis (prospector_) to testing
  237. framework.
  238. 0.1.3 *2014-10-29 Pre-Alpha*
  239. * **Bugfix**: 2nd parameter of wcswidth was not honored.
  240. (`Thomas Ballinger`_, `PR #4`_).
  241. 0.1.2 *2014-10-28 Pre-Alpha*
  242. * **Updated** tables to Unicode Specification 7.0.0.
  243. (`Thomas Ballinger`_, `PR #3`_).
  244. 0.1.1 *2014-05-14 Pre-Alpha*
  245. * Initial release to pypi, Based on Unicode Specification 6.3.0
  246. This code was originally derived directly from C code of the same name,
  247. whose latest version is available at
  248. https://www.cl.cam.ac.uk/~mgk25/ucs/wcwidth.c::
  249. * Markus Kuhn -- 2007-05-26 (Unicode 5.0)
  250. *
  251. * Permission to use, copy, modify, and distribute this software
  252. * for any purpose and without fee is hereby granted. The author
  253. * disclaims all warranties with regard to this software.
  254. .. _`Specification_from_pypi`: https://wcwidth.readthedocs.io/en/latest/specs.html
  255. .. _`tox`: https://tox.wiki/en/latest/
  256. .. _`prospector`: https://github.com/landscapeio/prospector
  257. .. _`combining`: https://en.wikipedia.org/wiki/Combining_character
  258. .. _`bin/`: https://github.com/jquast/wcwidth/tree/master/bin
  259. .. _`bin/wcwidth-browser.py`: https://github.com/jquast/wcwidth/blob/master/bin/wcwidth-browser.py
  260. .. _`Thomas Ballinger`: https://github.com/thomasballinger
  261. .. _`Leta Montopoli`: https://github.com/lmontopo
  262. .. _`Philip Craig`: https://github.com/philipc
  263. .. _`PR #3`: https://github.com/jquast/wcwidth/pull/3
  264. .. _`PR #4`: https://github.com/jquast/wcwidth/pull/4
  265. .. _`PR #5`: https://github.com/jquast/wcwidth/pull/5
  266. .. _`PR #11`: https://github.com/jquast/wcwidth/pull/11
  267. .. _`PR #18`: https://github.com/jquast/wcwidth/pull/18
  268. .. _`PR #30`: https://github.com/jquast/wcwidth/pull/30
  269. .. _`PR #35`: https://github.com/jquast/wcwidth/pull/35
  270. .. _`PR #82`: https://github.com/jquast/wcwidth/pull/82
  271. .. _`PR #91`: https://github.com/jquast/wcwidth/pull/91
  272. .. _`PR #97`: https://github.com/jquast/wcwidth/pull/97
  273. .. _`PR #98`: https://github.com/jquast/wcwidth/pull/98
  274. .. _`PR #100`: https://github.com/jquast/wcwidth/pull/100
  275. .. _`Issue #101`: https://github.com/jquast/wcwidth/issues/101
  276. .. _`jquast/blessed`: https://github.com/jquast/blessed
  277. .. _`selectel/pyte`: https://github.com/selectel/pyte
  278. .. _`thomasballinger/curtsies`: https://github.com/thomasballinger/curtsies
  279. .. _`dbcli/pgcli`: https://github.com/dbcli/pgcli
  280. .. _`prompt-toolkit/python-prompt-toolkit`: https://github.com/prompt-toolkit/python-prompt-toolkit
  281. .. _`timoxley/wcwidth`: https://github.com/timoxley/wcwidth
  282. .. _`wcwidth(3)`: https://man7.org/linux/man-pages/man3/wcwidth.3.html
  283. .. _`wcswidth(3)`: https://man7.org/linux/man-pages/man3/wcswidth.3.html
  284. .. _`astanin/python-tabulate`: https://github.com/astanin/python-tabulate
  285. .. _`janlelis/unicode-display_width`: https://github.com/janlelis/unicode-display_width
  286. .. _`rspeer/python-ftfy`: https://github.com/rspeer/python-ftfy
  287. .. _`alecrabbit/php-wcwidth`: https://github.com/alecrabbit/php-wcwidth
  288. .. _`Text::CharWidth`: https://metacpan.org/pod/Text::CharWidth
  289. .. _`bluebear94/Terminal-WCWidth`: https://github.com/bluebear94/Terminal-WCWidth
  290. .. _`mattn/go-runewidth`: https://github.com/mattn/go-runewidth
  291. .. _`grepsuzette/wcwidth`: https://github.com/grepsuzette/wcwidth
  292. .. _`jquast/ucs-detect`: https://github.com/jquast/ucs-detect
  293. .. _`Avram Lubkin`: https://github.com/avylove
  294. .. _`nbedos/termtosvg`: https://github.com/nbedos/termtosvg
  295. .. _`peterbrittain/asciimatics`: https://github.com/peterbrittain/asciimatics
  296. .. _`aperezdc/lua-wcwidth`: https://github.com/aperezdc/lua-wcwidth
  297. .. _`joachimschmidt557/zig-wcwidth`: https://github.com/joachimschmidt557/zig-wcwidth
  298. .. _`fumiyas/wcwidth-cjk`: https://github.com/fumiyas/wcwidth-cjk
  299. .. _`joshuarubin/wcwidth9`: https://github.com/joshuarubin/wcwidth9
  300. .. _`python-cmd2/cmd2`: https://github.com/python-cmd2/cmd2
  301. .. _`stratis-storage/stratis-cli`: https://github.com/stratis-storage/stratis-cli
  302. .. _`ihabunek/toot`: https://github.com/ihabunek/toot
  303. .. _`saulpw/visidata`: https://github.com/saulpw/visidata
  304. .. _`pip-tools`: https://pip-tools.readthedocs.io/
  305. .. _`sphinx`: https://www.sphinx-doc.org/
  306. .. |pypi_downloads| image:: https://img.shields.io/pypi/dm/wcwidth.svg?logo=pypi
  307. :alt: Downloads
  308. :target: https://pypi.org/project/wcwidth/
  309. .. |codecov| image:: https://codecov.io/gh/jquast/wcwidth/branch/master/graph/badge.svg
  310. :alt: codecov.io Code Coverage
  311. :target: https://app.codecov.io/gh/jquast/wcwidth/
  312. .. |license| image:: https://img.shields.io/pypi/l/wcwidth.svg
  313. :target: https://pypi.org/project/wcwidth/
  314. :alt: MIT License