3.8 KiB
Pixel Subsampling
wuffs_base__pixel_subsampling is a uint32_t that encodes whether samples
cover one pixel or cover multiple pixels. RGBA or BGRA pixel formats are
typically one pixel per sample. For YCbCr or YCgCo pixel formats (e.g. the
native format of JPEG and WebP lossy images), the luma channel (Y) is also
typically one pixel per sample but the chroma channels are often 2 or 4 pixels
per sample. In JPEG terminology, 1, 2 or 4 pixels per chroma
sample correspond to 4:4:4,
4:2:2 or 4:2:0 subsampling.
Equivalently, wuffs_base__pixel_subsampling encodes the mapping of pixel
space coordinates (x, y) to sample space coordinates (i, j), also known as
pixel buffer indices. That mapping can differ for each plane p. A Wuffs image
can have up to 4 planes or channels. For a depth of 8 bits (1 byte), the p'th
plane's sample starts at (planes[p].ptr + (j * planes[p].stride) + i).
For interleaved pixel formats, which are always one pixel per sample, the
mapping is trivial: i = x and j = y. For planar pixel formats, the mapping
can differ due to chroma subsampling. For example, consider a three plane YCbCr
pixel format with 4:2:2 subsampling. For the luma (Y) channel, there is one
sample for every pixel, but for the chroma (Cb, Cr) channels, there is one
sample for every two pixels: pairs of horizontally adjacent pixels form one
macropixel, i = x / 2 and j == y. In general, for a given p:
i = (x + bias_x) >> shift_x.j = (y + bias_y) >> shift_y.
where biases and shifts are in the range 0 ..= 3 and 0 ..= 2 respectively.
In general, the biases will be zero after decoding an image. However, making
a sub-image may change the bias, since the (x, y) coordinates are relative
to the sub-image's top-left origin, but the backing pixel buffers were
created relative to the original image's origin.
For example, consider a 10×3 image with what JPEG calls 4:1:1 sampling, where
each Chroma sample covers a macropixel (a block of pixels) 4 wide and 1 high.
For a Chroma channel, there are 30 pixels and 9 samples. bias_x = 0 and
shift_x = 2, so that the 6th pixel column (x = 5) maps to the 2nd sample
column (i = 1).
Pixel space:
+---------------------------------------+
|l00 l01 l02 l03 m04 m05 m06 m07 n08 n09|
| |
|p10 p11 p12 p13 q14 q15 q16 q17 r18 r19|
| +-----------+ |
|t21 t21 t22|t23 u24 u25|u26 u27 v28 v29|
+-----------+-----------+---------------+
Sample space:
+-----+
|l m n|
| |
|p q r|
| |
|t u v|
+-----+
Now consider the 3×1 sub-image shown above. Even though its pixel width (3) is
less than the macropixel width (4 columns per sample), as that sub-image shares
the sample buffer with its containing image, it still straddles 2 sample
columns (t and u). shift_x = 2, the same as before, but now bias_x = 3.
Pixel space:
+-----------+
|t23 u24 u25|
+-----------+
Sample space:
+---+
|t u|
+---+
Bit Packing
For each plane p, each of those four numbers (two biases and two shifts) are
encoded in two bits, which combine to form an 8 bit unsigned integer:
e_p = (bias_x << 6) | (shift_x << 4) | (bias_y << 2) | (shift_y << 0)
Those e_p values (e_0 for the first plane, e_1 for the second plane, etc)
combine to form a wuffs_base__pixel_subsampling value:
pixsub = (e_3 << 24) | (e_2 << 16) | (e_1 << 8) | (e_0 << 0)
For example, 4:2:2 YCbCr (with no bias) is encoded in the uint32_t value
0x101000.
API Stability
The wuffs_base__pixel_subsampling bit packing is documented for explanation
and to assist in debugging (e.g. printf'ing the bits in %x format).
However, do not manipulate its bits directly; they are private implementation
details. Use functions such as wuffs_base__pixel_subsampling__bias_x instead.