Fonts in X11R7.7

Juliusz Chroboczek

X Version 11, Release 7.7

16 March 2012


Table of Contents

Introduction
Two font systems
Installing fonts
Configuring Xft
Configuring the core X11 fonts system
Fonts included with X11R7.7
Standard bitmap fonts
The ClearlyU Unicode font family
Standard scalable fonts
The Bigelow & Holmes Luxi family
More about core fonts
Core fonts and internationalisation
Additional notes about scalable core fonts
Appendix: background and terminology
Characters and glyphs
Font files, fonts, and XLFD
Unicode
References

Introduction

This document describes the support for fonts in X11R7.7. Installing fonts is aimed at the casual user wishing to install fonts in X11R7.7 the rest of the document describes the font support in more detail.

We assume some familiarity with digital fonts. If anything is not clear to you, please consult Appendix: background and terminology at the end of this document for background information.

Two font systems

X11 includes two font systems: the original core X11 fonts system, which is present in all implementations of X11, and the Xft fonts system, which may not yet be distributed with implementations of X11 that are not based on either XFree86 or X11R6.8 or later.

The core X11 fonts system is directly derived from the fonts system included with X11R1 in 1987, which could only use monochrome bitmap fonts. Over the years, it has been more or less happily coerced into dealing with scalable fonts and rotated glyphs.

Xft was designed from the start to provide good support for scalable fonts, and to do so efficiently. Unlike the core fonts system, it supports features such as anti-aliasing and sub-pixel rasterisation. Perhaps more importantly, it gives applications full control over the way glyphs are rendered, making fine typesetting and WYSIWIG display possible. Finally, it allows applications to use fonts that are not installed system-wide for displaying documents with embedded fonts.

Xft is not compatible with the core fonts system: usage of Xft requires fairly extensive changes to toolkits (user-interface libraries). While X.Org will continue to maintain the core fonts system, toolkit authors are encouraged to switch to Xft as soon as possible.

Installing fonts

This section explains how to configure both Xft and the core fonts system to access newly-installed fonts.

Configuring Xft

Xft has no configuration mechanism itself, it relies upon the fontconfig library to configure and customise fonts. That library is not specific to the X Window system, and does not rely on any particular font output mechanism.

Installing fonts in Xft

Fontconfig looks for fonts in a set of well-known directories that include all of X11R7.7's standard font directories (/usr/share/fonts/X11/*) by default) as well as a directory called .fonts/ in the user's home directory. Installing a font for use by Xft applications is as simple as copying a font file into one of these directories.

$ cp lucbr.ttf ~/.fonts/

Fontconfig will notice the new font at the next opportunity and rebuild its list of fonts. If you want to trigger this update from the command line, you may run the command fc-cache.

$ fc-cache

In order to globally update the system-wide Fontconfig information on Unix systems, you will typically need to run this command as root:

$ su -c fc-cache

Fine-tuning Xft

Fontconfig's behaviour is controlled by a set of configuration files: a standard configuration file, /etc/fonts/fonts.conf, the files in a standard configuration directory, /etc/fonts/conf.d/, a host-specific configuration file, /etc/fonts/local.conf, and a user-specific file called .fonts.conf in the user's home directory (this can be overridden with the FONTCONFIG_FILE environment variable).

Every Fontconfig configuration file must start with the following boilerplate:

<?xml version="1.0"?>
<!DOCTYPE fontconfig SYSTEM "fonts.dtd">
<fontconfig>

In addition, every Fontconfig configuration file must end with the following line:

</fontconfig>

The default Fontconfig configuration file includes the directory ˜/.fonts/ in the list of directories searched for font files, and this is where user-specific font files should be installed. In the unlikely case that a new font directory needs to be added, this can be done with the following syntax:

<dir>/usr/local/share/fonts/</dir>

Another useful option is the ability to disable anti-aliasing (font smoothing) for selected fonts. This can be done with the following syntax:

<match target="font">
    <test qual="any" name="family">
        <string>Lucida Console</string>
    </test>
    <edit name="antialias" mode="assign">
        <bool>false</bool>
    </edit>
</match>

Anti-aliasing can be disabled for all fonts by the following incantation:

<match target="font">
    <edit name="antialias" mode="assign">
        <bool>false</bool>
    </edit>
</match>

Xft supports sub-pixel rasterisation on LCD displays. X11R7.7 should automatically enable this feature on laptops and when using an LCD monitor connected with a DVI cable; you can check whether this was done by typing

$ xdpyinfo -ext RENDER | grep sub-pixel

If this doesn't print anything, you will need to configure Render for your particular LCD hardware manually; this is done with the following syntax:

<match target="font">
    <edit name="rgba" mode="assign">
        <const>rgb</const>
    </edit>
</match>

The string rgb within the <const>...</const> specifies the order of pixel components on your display, and should be changed to match your hardware; it can be one of rgb (normal LCD screen), bgr (backwards LCD screen), vrgb (LCD screen rotated clockwise) or vbgr (LCD screen rotated counterclockwise).

Configuring applications

A growing number of applications use Xft in preference to the core fonts system. Some applications, however, need to be explicitly configured to use Xft.

A case in point is XTerm, which can be set to use Xft by using the -fa command line option or by setting the XTerm*faceName resource:

XTerm*faceName: Courier

or

$ xterm -fa "Courier"

For KDE applications, you should select Anti-alias fonts in the Fonts panel of KDE's Control Center. Note that this option is misnamed: it switches KDE to using Xft but doesn't enable anti-aliasing in case it was disabled by your Xft configuration file.

Gnome applications and Mozilla Firefox will use Xft by default.

Configuring the core X11 fonts system

Installing fonts in the core system is a two step process. First, you need to create a font directory that contains all the relevant font files as well as some index files. You then need to inform the X server of the existence of this new directory by including it in the font path.

Installing bitmap fonts

The X11R7.7 server can use bitmap fonts in both the cross-platform BDF format and the somewhat more efficient binary PCF format. (X11R7.7 also supports the obsolete SNF format.)

Bitmap fonts are normally distributed in the BDF format. Before installing such fonts, it is desirable (but not absolutely necessary) to convert the font files to the PCF format. This is done by using the command bdftopcf, e.g.

$ bdftopcf courier12.bdf

You may then want to compress the resulting PCF font files:

$ gzip courier12.pcf

After the fonts have been converted, you should copy all the font files that you wish to make available into a arbitrary directory, say /usr/local/share/fonts/bitmap/. You should then create the index file fonts.dir by running the command mkfontdir (please see the mkfontdir(1) manual page for more information):

$ mkdir /usr/local/share/fonts/bitmap/
$ cp *.pcf.gz /usr/local/share/fonts/bitmap/
$ mkfontdir /usr/local/share/fonts/bitmap/

All that remains is to tell the X server about the existence of the new font directory; see Setting the server's font path below.

Installing scalable fonts

The X11R7.7 server supports scalable fonts in multiple formats, including Type 1, TrueType, and OpenType/CFF. (Earlier versions of X11 also included support for the Speedo and CID scalable font formats, but that is not included in current releases.)

Installing scalable fonts is very similar to installing bitmap fonts: you create a directory with the font files, and run mkfontdir to create an index file called fonts.dir.

There is, however, a big difference: mkfontdir cannot automatically recognise scalable font files. For that reason, you must first index all the font files in a file called fonts.scale. While this can be done by hand, it is best done by using the mkfontscale utility.

$ mkfontscale /usr/local/share/fonts/Type1/
$ mkfontdir /usr/local/share/fonts/Type1/

Under some circumstances, it may be necessary to modify the fonts.scale file generated by mkfontscale; for more information, please see the mkfontdir(1) and mkfontscale(1) manual pages and Core fonts and internationalisation later in this document.

CID-keyed fonts

The CID-keyed font format was designed by Adobe Systems for fonts with large character sets. The CID-keyed format is obsolete, as it has been superseded by other formats such as OpenType/CFF and support for CID-keyed fonts has been removed from X11.

Setting the server's font path

The list of directories where the server looks for fonts is known as the font path. Informing the server of the existence of a new font directory consists of putting it on the font path.

The font path is an ordered list; if a client's request matches multiple fonts, the first one in the font path is the one that gets used. When matching fonts, the server makes two passes over the font path: during the first pass, it searches for an exact match; during the second, it searches for fonts suitable for scaling.

For best results, scalable fonts should appear in the font path before the bitmap fonts; this way, the server will prefer bitmap fonts to scalable fonts when an exact match is possible, but will avoid scaling bitmap fonts when a scalable font can be used. (The :unscaled hack, while still supported, should no longer be necessary in X11R7.7.)

You may check the font path of the running server by typing the command

$ xset q

Font path catalogue directories

You can specify a special kind of font path directory in the form catalogue:<dir>. The directory specified after the catalogue: prefix will be scanned for symlinks and each symlink destination will be added as a local font path entry.

The symlink can be suffixed by attributes such as 'unscaled', which will be passed through to the underlying font path entry. The only exception is the newly introduced 'pri' attribute, which will be used for ordering the font paths specified by the symlinks.

An example configuration:

         75dpi:unscaled:pri=20 -> /usr/share/X11/fonts/75dpi
         ghostscript:pri=60 -> /usr/share/fonts/default/ghostscript
         misc:unscaled:pri=10 -> /usr/share/X11/fonts/misc
         type1:pri=40 -> /usr/share/X11/fonts/Type1
         type1:pri=50 -> /usr/share/fonts/default/Type1

This will add /usr/share/X11/fonts/misc as the first font path entry with the attribute unscaled. This is functionally equivalent to setting the following font path:

         /usr/share/X11/fonts/misc:unscaled,
         /usr/share/X11/fonts/75dpi:unscaled,
         /usr/share/X11/fonts/Type1,
         /usr/share/fonts/default/Type1,
         /usr/share/fonts/default/ghostscript

Temporary modification of the font path

The xset utility may be used to modify the font path for the current session. The font path is set with the command xset fp; a new element is added to the front with xset +fp, and added to the end with xset fp+. For example,

$ xset +fp /usr/local/fonts/Type1
$ xset fp+ /usr/local/fonts/bitmap

Conversely, an element may be removed from the front of the font path with xset -fp, and removed from the end with xset fp-. You may reset the font path to its default value with xset fp default.

For more information, please consult the xset(1) manual page.

Permanent modification of the font path

The default font path (the one used just after server startup or after xset fp default) may be specified in the X server's xorg.conf file. It is computed by appending all the directories mentioned in the FontPath entries of the Files section in the order in which they appear. If no font path is specified in a config file, the server uses a default value specified when it was built.

FontPath "/usr/local/fonts/Type1"
...
FontPath "/usr/local/fonts/bitmap"

For more information, please consult the xorg.conf(5) manual page.

Troubleshooting

If you seem to be unable to use some of the fonts you have installed, the first thing to check is that the fonts.dir files are correct and that they are readable by the server (the X server usually runs as root, beware of NFS-mounted font directories). If this doesn't help, it is quite possible that you are trying to use a font in a format that is not supported by your server.

X11R7.7 supports the BDF, PCF, SNF, Type 1, TrueType, and OpenType font formats. However, not all X11R7.7 servers come with all the font backends configured in.

On most platforms, the X11R7.7 servers no longer uses font backends from modules that are loaded at runtime. The built in font support corresponds to the functionality formerly provided by these modules:

  • "bitmap": bitmap fonts (*.bdf, *.pcf and *.snf);

  • "freetype": TrueType fonts (*.ttf and *.ttc), OpenType fonts (*.otf and *.otc) and Type 1 fonts (*.pfa and *.pfb).

Fonts included with X11R7.7

Standard bitmap fonts

The Sample Implementation of X11 (SI) comes with a large number of bitmap fonts, including the fixed family, and bitmap versions of Courier, Times, Helvetica and some members of the Lucida family.

In X11R7.7, a number of these fonts are provided in Unicode-encoded font files now. At build time, these fonts are split into font files encoded according to legacy encodings, a process which allows us to provide the standard fonts in a number of regional encodings with no duplication of work.

For example, the font file

/usr/share/fonts/X11/misc/6x13.bdf

with XLFD

-misc-fixed-medium-r-semicondensed--13-120-75-75-c-60-iso10646-1

is a Unicode-encoded version of the standard fixed font with added support for the Latin, Greek, Cyrillic, Georgian, Armenian, IPA and other scripts plus numerous technical symbols. It contains over 2800 glyphs, covering all characters of ISO 8859 parts 1-5, 7-10, 13-15, as well as all European IBM and Microsoft code pages, KOI8, WGL4, and the repertoires of many other character sets.

This font is used at build time for generating the font files

6x13-ISO8859-1.bdf
6x13-ISO8859-2.bdf
...
6x13-ISO8859-15.bdf
6x13-KOI8-R.bdf

with respective XLFDs

-misc-fixed-medium-r-normal--13-120-75-75-c-60-iso8859-1
...
-misc-fixed-medium-r-normal--13-120-75-75-c-60-iso8859-15
-misc-fixed-medium-r-normal--13-120-75-75-c-60-koi8-r

The standard short name fixed is normally an alias for

-misc-fixed-medium-r-normal--13-120-75-75-c-60-iso8859-1

The ClearlyU Unicode font family

The ClearlyU family of fonts provides a set of 12 pt, 100 dpi proportional fonts with many of the glyphs needed for Unicode text. Together, the fonts contain approximately 7500 glyphs.

The main ClearlyU font has the XLFD

-mutt-clearlyu-medium-r-normal--17-120-100-100-p-101-iso10646-1

and resides in the font file

/usr/share/fonts/X11/misc/cu12.pcf.gz

Additional ClearlyU fonts include

-mutt-clearlyu alternate glyphs-medium-r-normal--17-120-100-100-p-91-iso10646-1
-mutt-clearlyu pua-medium-r-normal--17-120-100-100-p-111-iso10646-1
-mutt-clearlyu arabic extra-medium-r-normal--17-120-100-100-p-103-fontspecific-0
-mutt-clearlyu ligature-medium-r-normal--17-120-100-100-p-141-fontspecific-0

The Alternate Glyphs font contains additional glyph shapes that are needed for certain languages. A second alternate glyph font will be provided later for cases where a character has more than one commonly used alternate shape (e.g. the Urdu heh).

The PUA font contains extra glyphs that are useful for certain rendering purposes.

The Arabic Extra font contains the glyphs necessary for characters that don't have all of their possible shapes encoded in ISO 10646. The glyphs are roughly ordered according to the order of the characters in the ISO 10646 standard.

The Ligature font contains ligatures for various scripts that may be useful for improved presentation of text.

Standard scalable fonts

X11R7.7 includes all the scalable fonts distributed with X11R6.

Standard Type 1 fonts

The IBM Courier set of fonts cover ISO 8859-1 and ISO 8859-2 as well as Adobe Standard Encoding. These fonts have XLFD

-adobe-courier-medium-*-*--0-0-0-0-m-0-*-*

and reside in the font files

/usr/share/fonts/X11/Type1/cour*.pfa

The Adobe Utopia set of fonts only cover ISO 8859-1 as well as Adobe Standard Encoding. These fonts have XLFD

-adobe-utopia-*-*-normal--0-0-0-0-p-0-iso8859-1

and reside in the font files

/usr/share/fonts/X11/Type1/UT*.pfa

Finally, X11R7.7 also comes with Type 1 versions of Bitstream Courier and Charter. These fonts have XLFD

-bitstream-courier-*-*-normal--0-0-0-0-m-0-iso8859-1
-bitstream-charter-*-*-normal--0-0-0-0-p-0-iso8859-1

and reside in the font files

/usr/share/fonts/X11/Type1/c*bt_.pfb

The Bigelow & Holmes Luxi family

X11R7.7 includes the Luxi family of scalable fonts, in both TrueType and Type 1 format. This family consists of the fonts Luxi Serif, with XLFD

-b&h-luxi serif-medium-*-normal--*-*-*-*-p-*-*-*

Luxi Sans, with XLFD

-b&h-luxi sans-medium-*-normal--*-*-*-*-p-*-*-*

and Luxi Mono, with XLFD

-b&h-luxi mono-medium-*-normal--*-*-*-*-m-*-*-*

Each of these fonts comes Roman, oblique, bold and bold oblique variants The TrueType version have glyphs covering the basic ASCII Unicode range, the Latin 1 range, as well as the Extended Latin range and some additional punctuation characters. In particular, these fonts include all the glyphs needed for ISO 8859 parts 1, 2, 3, 4, 9, 13 and 15, as well as all the glyphs in the Adobe Standard encoding and the Windows 3.1 character set.

The glyph coverage of the Type 1 versions is somewhat reduced, and only covers ISO 8859 parts 1, 2 and 15 as well as the Adobe Standard encoding.

The Luxi fonts are original designs by Kris Holmes and Charles Bigelow. Luxi fonts include seriffed, sans serif, and monospaced styles, in roman and oblique, and normal and bold weights. The fonts share stem weight, x-height, capital height, ascent and descent, for graphical harmony.

The character width metrics of Luxi roman and bold fonts match those of core fonts bundled with popular operating and window systems.

The license terms for the Luxi fonts are included in the file COPYRIGHT.BH, as well as in the License document.

Charles Bigelow and Kris Holmes from Bigelow and Holmes Inc. developed the Luxi typeface designs in Ikarus digital format.

URW++ Design and Development GmbH converted the Ikarus format fonts to TrueType and Type1 font programs and implemented the grid-fitting "hints" and kerning tables in the Luxi fonts.

For more information, please contact or , or consult the URW++ web site.

An earlier version of the Luxi fonts was made available under the name Lucidux. This name should no longer be used due to trademark uncertainties, and all traces of the Lucidux name have been removed from X11R7.7.

More about core fonts

This section describes XFree86-created enhancements to the core X11 fonts system that were adopted by X.Org.

Core fonts and internationalisation

The scalable font backends (Type 1 and TrueType) can automatically re-encode fonts to the encoding specified in the XLFD in fonts.dir. For example, a fonts.dir file can contain entries for the Type 1 Courier font such as

cour.pfa -adobe-courier-medium-r-normal--0-0-0-0-m-0-iso8859-1
cour.pfa -adobe-courier-medium-r-normal--0-0-0-0-m-0-iso8859-2

which will lead to the font being recoded to ISO 8859-1 and ISO 8859-2 respectively.

The fontenc layer

Two of the scalable backends (Type 1 and the FreeType TrueType backend) use a common fontenc layer for font re-encoding. This allows these backends to share their encoding data, and allows simple configuration of new locales independently of font type.

Please note: the X-TrueType (X-TT) backend is not included in X11R7.7. That functionality has been merged into the FreeType backend.

In the fontenc layer, an encoding is defined by a name (such as iso8859-1), possibly a number of aliases (alternate names), and an ordered collection of mappings. A mapping defines the way the encoding can be mapped into one of the target encodings known to fontenc; currently, these consist of Unicode, Adobe glyph names, and arbitrary TrueType cmaps.

A number of encodings are hardwired into fontenc, and are therefore always available; the hardcoded encodings cannot easily be redefined. These include:

  • iso10646-1: Unicode;

  • iso8859-1: ISO Latin-1 (Western Europe);

  • iso8859-2: ISO Latin-2 (Eastern Europe);

  • iso8859-3: ISO Latin-3 (Southern Europe);

  • iso8859-4: ISO Latin-4 (Northern Europe);

  • iso8859-5: ISO Cyrillic;

  • iso8859-6: ISO Arabic;

  • iso8859-7: ISO Greek;

  • iso8859-8: ISO Hebrew;

  • iso8859-9: ISO Latin-5 (Turkish);

  • iso8859-10: ISO Latin-6 (Nordic);

  • iso8859-15: ISO Latin-9, or Latin-0 (Revised Western-European);

  • koi8-r: KOI8 Russian;

  • koi8-u: KOI8 Ukrainian (see RFC 2319);

  • koi8-ru: KOI8 Russian/Ukrainian;

  • koi8-uni: KOI8 Unified (Russian, Ukrainian, and Byelorussian);

  • koi8-e: KOI8 European, ISO-IR-111, or ECMA-Cyrillic;

  • microsoft-symbol and apple-roman: these are only likely to be useful with TrueType symbol fonts.

Additional encodings can be added by defining encoding files. When a font encoding is requested that the fontenc layer doesn't know about, the backend checks the directory in which the font file resides (not necessarily the directory with fonts.dir!) for a file named encodings.dir. If found, this file is scanned for the requested encoding, and the relevant encoding definition file is read in. The mkfontdir utility, when invoked with the -e option followed by the name of a directory containing encoding files, can be used to automatically build encodings.dir files. Please see the mkfontdir(1) manual page for more details.

A number of encoding files for common encodings are included with X11R7.7. Information on writing new encoding files can be found in Format of encoding directory files and Format of encoding files later in this document.

Backend-specific notes about fontenc

The FreeType backend

For TrueType and OpenType fonts, the FreeType backend scans the mappings in order. Mappings with a target of PostScript are ignored; mappings with a TrueType or Unicode target are checked against all the cmaps in the file. The first applicable mapping is used.

For Type 1 fonts, the FreeType backend first searches for a mapping with a target of PostScript. If one is found, it is used. Otherwise, the backend searches for a mapping with target Unicode, which is then composed with a built-in table mapping codes to glyph names. Note that this table only covers part of the Unicode code points that have been assigned names by Adobe.

Specifying an encoding value of adobe-fontspecific for a Type 1 font disables the encoding mechanism. This is useful with symbol and incorrectly encoded fonts (see Hints about using badly encoded fonts below).

If a suitable mapping is not found, the FreeType backend defaults to ISO 8859-1.

Format of encoding directory files

In order to use a font in an encoding that the font backend does not know about, you need to have an encodings.dir file either in the same directory as the font file used or in a system-wide location (/usr/share/fonts/X11/encodings/ by default).

The encodings.dir file has a similar format to fonts.dir. Its first line specifies the number of encodings, while every successive line has two columns, the name of the encoding, and the name of the encoding file; this can be relative to the current directory, or absolute. Every encoding name should agree with the encoding name defined in the encoding file. For example,

3
mulearabic-0 /usr/share/fonts/X11/encodings/mulearabic-0.enc
mulearabic-1 /usr/share/fonts/X11/encodings/mulearabic-1.enc
mulearabic-2 /usr/share/fonts/X11/encodings/mulearabic-2.enc

The name of an encoding must be specified in the encoding file's STARTENCODING or ALIAS line. It is not enough to create an encodings.dir entry.

If your platform supports it (it probably does), encoding files may be compressed or gzipped.

The encoding.dir files are best maintained by the mkfontdir utility. Please see the mkfontdir(1) manual page for more information.

Format of encoding files

The encoding files are free form, i.e. any string of whitespace is equivalent to a single space. Keywords are parsed in a non-case-sensitive manner, meaning that size, SIZE, and SiZE all parse as the same keyword; on the other hand, case is significant in glyph names.

Numbers can be written in decimal, as in 256, in hexadecimal, as in 0x100, or in octal, as in 0400.

Comments are introduced by a hash sign #. A # may appear at any point in a line, and all characters following the # are ignored, up to the end of the line.

The encoding file starts with the definition of the name of the encoding, and possibly its alternate names (aliases):

STARTENCODING mulearabic-0
ALIAS arabic-0

The name of the encoding and its aliases should be suitable for use in an XLFD font name, and therefore contain exactly one dash -.

The encoding file may then optionally declare the size of the encoding. For a linear encoding (such as ISO 8859-1), the SIZE line specifies the maximum code plus one:

SIZE 0x2B

For a matrix encoding, it should specify two numbers. The first is the number of the last row plus one, the other, the highest column number plus one. In the case of jisx0208.1990-0 (JIS X 0208(1990), double-byte encoding, high bit clear), it should be

SIZE 0x75 0x80

In the case of a matrix encoding, a FIRSTINDEX line may be included to specify the minimum glyph index in an encoding. The keyword FIRSTINDEX is followed by two integers, the minimum row number followed by the minimum column number:

FIRSTINDEX 0x20 0x20

In the case of a linear encoding, a FIRSTINDEX line is not very useful. If for some reason however you chose to include on, it should be followed by a single integer.

Note that in most font backends inclusion of a FIRSTINDEX line has the side effect of disabling default glyph generation, and this keyword should therefore be avoided unless absolutely necessary.

Codes outside the region defined by the SIZE and FIRSTINDEX lines are understood to be undefined. Encodings default to linear encoding with a size of 256 (0x100). This means that you must declare the size of all 16 bit encodings.

What follows is one or more mapping sections. A mapping section starts with a STARTMAPPING line stating the target of the mapping. The target may be one of:

  • Unicode (ISO 10646):

    STARTMAPPING unicode
    

  • a given TrueType cmap:

    STARTMAPPING cmap 3 1
    

  • PostScript glyph names:

    STARTMAPPING postscript
    

Every line in a mapping section maps one from the encoding being defined to the target of the mapping. In mappings with a Unicode or TrueType mapping, codes are mapped to codes:

0x21 0x0660
0x22 0x0661
...

As an abbreviation, it is possible to map a contiguous range of codes in a single line. A line consisting of three integers

<it/start/ <it/end/ <it/target/

is an abbreviation for the range of lines

start     target

start+1   target+1

...

end       target+end-start

For example, the line

0x2121 0x215F 0x8140

is an abbreviation for

0x2121 0x8140
0x2122 0x8141
...
0x215F 0x817E

Codes not listed are assumed to map through the identity (i.e. to the same numerical value). In order to override this default mapping, you may specify a range of codes to be undefined by using an UNDEFINE line:

UNDEFINE 0x00 0x2A

or, for a single code,

UNDEFINE 0x1234

PostScript mappings are different. Every line in a PostScript mapping maps a code to a glyph name

0x41 A
0x42 B
...

and codes not explicitly listed are undefined.

A mapping section ends with an ENDMAPPING line

ENDMAPPING

After all the mappings have been defined, the file ends with an ENDENCODING line

ENDENCODING

In order to make future extensions to the format possible, lines starting with an unknown keyword are silently ignored, as are mapping sections with an unknown target.

Using symbol fonts

Type 1 symbol fonts should be installed using the adobe-fontspecific encoding.

In an ideal world, all TrueType symbol fonts would be installed using one of the microsoft-symbol and apple-roman encodings. A number of symbol fonts, however, are not marked as such; such fonts should be installed using microsoft-cp1252, or, for older fonts, microsoft-win3.1.

In order to guarantee consistent results (especially between Type 1 and TrueType versions of the same font), it is possible to define a special encoding for a given font. This has already been done for the ZapfDingbats font; see the file encodings/adobe-dingbats.enc.

Hints about using badly encoded fonts

A number of text fonts are incorrectly encoded. Incorrect encoding is sometimes done by design, in order to make a font for an exotic script appear like an ordinary Western text font on systems which are not easily extended with new locale data. It is often the result of the font designer's laziness or incompetence; for some reason, most people seem to find it easier to invent idiosyncratic glyph names rather than follow the Adobe glyph list.

There are two ways of dealing with such fonts: using them with the encoding they were designed for, and creating an ad hoc encoding file.

Using fonts with the designer's encoding

In the case of Type 1 fonts, the font designer can specify a default encoding; this encoding is requested by using the adobe-fontspecific encoding in the XLFD name. Sometimes, the font designer omitted to specify a reasonable default encoding, in which case you should experiment with adobe-standard, iso8859-1, microsoft-cp1252, and microsoft-win3.1. (The encoding microsoft-symbol doesn't make sense for Type 1 fonts).

TrueType fonts do not have a default encoding. However, most TrueType fonts are designed with either Microsoft or Apple platforms in mind, so one of microsoft-symbol, microsoft-cp1252, microsoft-win3.1, or apple-roman should yield reasonable results.

Specifying an ad hoc encoding file

It is always possible to define an encoding file to put the glyphs in a font in any desired order. Again, see the encodings/adobe-dingbats.enc file to see how this is done.

Specifying font aliases

By following the directions above, you will find yourself with a number of fonts with unusual names --- with encodings such as adobe-fontspecific, microsoft-win3.1 etc. In order to use these fonts with standard applications, it may be useful to remap them to their proper names.

This is done by writing a fonts.alias file. The format of this file is very simple: it consists of a series of lines each mapping an alias name to a font name. A fonts.alias file might look as follows:

"-ogonki-alamakota-medium-r-normal--0-0-0-0-p-0-iso8859-2" \
  "-ogonki-alamakota-medium-r-normal--0-0-0-0-p-0-adobe-fontspecific"

(both XLFD names on a single line). The syntax of the fonts.alias file is more precisely described in the mkfontdir(1) manual page.

Additional notes about scalable core fonts

About the FreeType backend

The FreeType backend (formerly xfsft) is a backend based on version 2 of the FreeType library (see the FreeType web site) and has the X-TT functionalities for CJKV support provided by the After X-TT Project (see the After X-TT Project web site). The FreeType backend has support for the fontenc style of internationalisation (see The fontenc layer). This backend supports TrueType font files (*.ttf), OpenType font files (*.otf), TrueType Collections (*.ttc), OpenType Collections (*.otc) and Type 1 font files (*.pfa and *.pfb).

In order to access the faces in a TrueType Collection file, the face number must be specified in the fonts.dir file before the filename, within a pair of colons, or by setting the 'fn' TTCap option. For example,

:1:mincho.ttc -misc-pmincho-medium-r-normal--0-0-0-0-p-0-jisx0208.1990-0

refers to face 1 in the mincho.ttc TrueType Collection file.

The new FreeType backend supports the extended fonts.dir syntax introduced by X-TrueType with a number of options, collectively known as TTCap. A TTCap entry follows the general syntax

option=value:

and should be specified before the filename. The new FreeType almost perfectly supports TTCap options that are compatible with X-TT 1.4. The Automatic Italic (ai), Double Strike (ds) and Bounding box Width (bw) options are indispensable in CJKV. For example,

mincho.ttc -misc-mincho-medium-r-normal--0-0-0-0-c-0-jisx0208.1990-0
ds=y:mincho.ttc -misc-mincho-bold-r-normal--0-0-0-0-c-0-jisx0208.1990-0
ai=0.2:mincho.ttc -misc-mincho-medium-i-normal--0-0-0-0-c-0-jisx0208.1990-0
ds=y:ai=0.2:mincho.ttc -misc-mincho-bold-i-normal--0-0-0-0-c-0-jisx0208.1990-0
bw=0.5:mincho.ttc -misc-mincho-medium-r-normal--0-0-0-0-c-0-jisx0201.1976-0
bw=0.5:ds=y:mincho.ttc -misc-mincho-bold-r-normal--0-0-0-0-c-0-jisx0201.1976-0
bw=0.5:ai=0.2:mincho.ttc -misc-mincho-medium-i-normal--0-0-0-0-c-0-jisx0201.1976-0
bw=0.5:ds=y:ai=0.2:mincho.ttc -misc-mincho-bold-i-normal--0-0-0-0-c-0-jisx0201.1976-0

setup the complete combination of jisx0208 and jisx0201 using mincho.ttc only. More information on the TTCap syntax is found on the After X-TT Project page.

The FreeType backend uses the fontenc layer in order to support recoding of fonts; this was described in The fontenc layer and especially The FreeType backend earlier in this document.

Delayed glyph rasterisation

When loading a proportional fonts which contain a huge number of glyphs, the old FreeType delayed glyph rasterisation until the time at which the glyph was first used. The new FreeType (libfreetype-xtt2) has an improved very lazy metric calculation method to speed up the process when loading TrueType or OpenType fonts. Although the X-TT module also has this method, the "vl=y" TTCap option must be set if you want to use it. This is the default method for FreeType when it loads multi-byte fonts. Even if you use a unicode font which has tens of thousands of glyphs, this delay will not be worrisome as long as you use the new FreeType backend -- its very lazy method is super-fast.

The maximum error of bitmap position using very lazy method is 1 pixel, and is the same as that of a character-cell spacing. When the X-TT backend is used with the vl=y option, a chipped bitmap is displayed with certain fonts. However, the new FreeType backend has minimal problem with this, since it corrects left- and right-side bearings using italicAngle in the TrueType/OpenType post table, and does automatic correction of bitmap positions when rasterisation so that chipped bitmaps are not displayed. Nevertheless if you don't want to use the very lazy method when using multi-bytes fonts, set vl=n in the TTCap option to disable it:

vl=n:luxirr.ttf -b&h-Luxi Serif-medium-r-normal--0-0-0-0-p-0-iso10646-1

Of course, both backends also support an optimisation for character-cell fonts (fonts with all glyph metrics equal, or terminal fonts). A font with an XLFD specifying a character-cell spacing c, as in

-misc-mincho-medium-r-normal--0-0-0-0-c-0-jisx0208.1990-0

or

fs=c:mincho.ttc -misc-mincho-medium-r-normal--0-0-0-0-p-0-jisx0208.1990-0

will not compute the metric for each glyph, but instead trust the font to be a character-cell font. You are encouraged to make use of this optimisation when useful, but be warned that not all monospaced fonts are character-cell fonts.

Appendix: background and terminology

Characters and glyphs

A computer text-processing system inputs keystrokes and outputs glyphs, small pictures that are assembled on paper or on a computer screen. Keystrokes and glyphs do not, in general, coincide: for example, if the system does generate ligatures, then to the sequence of two keystrokes <f><i> will typically correspond a single glyph. Similarly, if the system shapes Arabic glyphs in a vaguely reasonable manner, then multiple different glyphs may correspond to a single keystroke.

The complex transformation rules from keystrokes to glyphs are usually factored into two simpler transformations, from keystrokes to characters and from characters to glyphs. You may want to think of characters as the basic unit of text that is stored e.g. in the buffer of your text editor. While the definition of a character is intrinsically application-specific, a number of standardised collections of characters have been defined.

A coded character set is a set of characters together with a mapping from integer codes --- known as codepoints --- to characters. Examples of coded character sets include US-ASCII, ISO 8859-1, KOI8-R, and JIS X 0208(1990).

A coded character set need not use 8 bit integers to index characters. Many early systems used 6 bit character sets, while 16 bit (or more) character sets are necessary for ideographic writing systems.

Font files, fonts, and XLFD

Traditionally, typographers speak about typefaces and founts. A typeface is a particular style or design, such as Times Italic, while a fount is a molten-lead incarnation of a given typeface at a given size.

Digital fonts come in font files. A font file contains the information necessary for generating glyphs of a given typeface, and applications using font files may access glyph information in an arbitrary order.

Digital fonts may consist of bitmap data, in which case they are said to be bitmap fonts. They may also consist of a mathematical description of glyph shapes, in which case they are said to be scalable fonts. Common formats for scalable font files are Type 1 (sometimes incorrectly called ATM fonts or PostScript fonts), TrueType and OpenType.

The glyph data in a digital font needs to be indexed somehow. How this is done depends on the font file format. In the case of Type 1 fonts, glyphs are identified by glyph names. In the case of TrueType fonts, glyphs are indexed by integers corresponding to one of a number of indexing schemes (usually Unicode --- see below).

The X11 core fonts system uses the data in a font file to generate font instances, which are collections of glyphs at a given size indexed according to a given encoding.

X11 core font instances are usually specified using a notation known as the X Logical Font Description (XLFD). An XLFD starts with a dash -, and consists of fourteen fields separated by dashes, for example:

-adobe-courier-medium-r-normal--12-120-75-75-m-70-iso8859-1

Or particular interest are the last two fields iso8859-1, which specify the font instance's encoding.

A scalable font is specified by an XLFD which contains zeroes instead of some fields:

-adobe-courier-medium-r-normal--0-0-0-0-m-0-iso8859-1

X11 font instances may also be specified by short name. Unlike an XLFD, a short name has no structure and is simply a conventional name for a font instance. Two short names are of particular interest, as the server will not start if font instances with these names cannot be opened. These are fixed, which specifies the fallback font to use when the requested font cannot be opened, and cursor, which specifies the set of glyphs to be used by the mouse pointer.

Short names are usually implemented as aliases to XLFDs; the standard fixed and cursor aliases are defined in

/usr/share/font/X11/misc/fonts.alias

Unicode

Unicode (https://www.unicode.org/) is a coded character set with the goal of uniquely identifying all characters for all scripts, current and historical. While Unicode was explicitly not designed as a glyph encoding scheme, it is often possible to use it as such.

Unicode is an open character set, meaning that codepoint assignments may be added to Unicode at any time (once specified, though, an assignment can never be changed). For this reason, a Unicode font will be sparse, meaning that it only defines glyphs for a subset of the character registry of Unicode.

The Unicode standard is defined in parallel with the international standard ISO 10646. Assignments in the two standards are always equivalent, and we often use the terms Unicode and ISO 10646 interchangeably.

When used in the X11 core fonts system, Unicode-encoded fonts should have the last two fields of their XLFD set to iso10646-1.

References

X11R7.7 comes with extensive documentation in the form of manual pages and typeset documents. Before installing fonts, you really should read the fontconfig(3) and mkfontdir(1) manual pages; other manual pages of interest include X(7), Xserver(1), xset(1), Xft(3), xlsfonts(1) and showfont(1). In addition, you may want to read the X Logical Font Description document by Jim Flowers.

The comp.fonts FAQ, which is unfortunately no longer being maintained, contains a wealth of information about digital fonts.

Xft and Fontconfig are described on the Fontconfig site.

The xfsft home page has been superseded by this document, and is now obsolete; you may however still find some of the information that it contains useful. Joerg Pommnitz' xfsft page is the canonical source for the ttmkfdir utility, which is the ancestor of mkfontscale.

The author's software pages might or might not contain related scribbles and development versions of software.

The documentation of X-TrueType is available from the After X-TT Project page.

While the Unicode consortium site may be of interest, you are more likely to find what you need in Markus Kuhn's UTF-8 and Unicode FAQ.

The IETF RFC documents, available from a number of sites throughout the world, often provide interesting information about character set issues; see for example RFC 373.