22.2: Polynomial Codes
( \newcommand{\kernel}{\mathrm{null}\,}\)
With knowledge of polynomial rings and finite fields, it is now possible to derive more sophisticated codes than those of Chapter 8. First let us recall that an (n,k)-block code consists of a one-to-one encoding function E:Zk2→Zn2 and a decoding function D:Zn2→Zk2. The code is error-correcting if D is onto. A code is a linear code if it is the null space of a matrix H∈Mk×n(Z2).
We are interested in a class of codes known as cyclic codes. Let ϕ:Zk2→Zn2 be a binary (n,k)-block code. Then ϕ is a cyclic code if for every codeword (a1,a2,…,an), the cyclically shifted n-tuple (an,a1,a2,…,an−1) is also a codeword. Cyclic codes are particularly easy to implement on a computer using shift registers [2, 3].
Example 22.14.
Consider the (6,3)-linear codes generated by the two matrices
Solution
Messages in the first code are encoded as follows:
It is easy to see that the codewords form a cyclic code. In the second code, 3-tuples are encoded in the following manner:
This code cannot be cyclic, since (101101) is a codeword but (011011) is not a codeword.
Polynomial Codes
We would like to find an easy method of obtaining cyclic linear codes. To accomplish this, we can use our knowledge of finite fields and polynomial rings over Z2. Any binary n-tuple can be interpreted as a polynomial in Z2[x]. Stated another way, the n-tuple (a0,a1,…,an−1) corresponds to the polynomial
where the degree of f(x) is at most n−1. For example, the polynomial corresponding to the 5-tuple (10011) is
Conversely, with any polynomial f(x)∈Z2[x] with degf(x)<n we can associate a binary n-tuple. The polynomial x+x2+x4 corresponds to the 5-tuple (01101).
Let us fix a nonconstant polynomial g(x) in Z2[x] of degree n−k. We can define an (n,k)-code C in the following manner. If (a0,…,ak−1) is a k-tuple to be encoded, then f(x)=a0+a1x+⋯+ak−1xk−1 is the corresponding polynomial in Z2[x]. To encode f(x), we multiply by g(x). The codewords in C are all those polynomials in Z2[x] of degree less than n that are divisible by g(x). Codes obtained in this manner are called polynomial codes.
Example 22.15.
If we let g(x)=1+x3, we can define a (6,3)-code C as follows. To encode a 3-tuple (a0,a1,a2), we multiply the corresponding polynomial f(x)=a0+a1x+a2x2 by 1+x3. We are defining a map ϕ:Z32→Z62 by ϕ:f(x)↦g(x)f(x). It is easy to check that this map is a group homomorphism. In fact, if we regard Zn2 as a vector space over Z2, ϕ is a linear transformation of vector spaces (see Exercise 20.5.15, Chapter 20). Let us compute the kernel of ϕ. Observe that ϕ(a0,a1,a2)=(000000) exactly when
Solution
Since the polynomials over a field form an integral domain, a0+a1x+a2x2 must be the zero polynomial. Therefore, kerϕ={(000)} and ϕ is one-to-one.
To calculate a generator matrix for C, we merely need to examine the way the polynomials 1, x, and x2 are encoded:
We obtain the code corresponding to the generator matrix G1 in Example 22.14. The parity-check matrix for this code is
Since the smallest weight of any nonzero codeword is 2, this code has the ability to detect all single errors.
Rings of polynomials have a great deal of structure; therefore, our immediate goal is to establish a link between polynomial codes and ring theory. Recall that xn−1=(x−1)(xn−1+⋯+x+1). The factor ring
can be considered to be the ring of polynomials of the form
that satisfy the condition tn=1. It is an easy exercise to show that Zn2 and Rn are isomorphic as vector spaces. We will often identify elements in Zn2 with elements in Z[x]/⟨xn−1⟩. In this manner we can interpret a linear code as a subset of Z[x]/⟨xn−1⟩.
The additional ring structure on polynomial codes is very powerful in describing cyclic codes. A cyclic shift of an n-tuple can be described by polynomial multiplication. If f(t)=a0+a1t+⋯+an−1tn−1 is a code polynomial in Rn, then
is the cyclically shifted word obtained from multiplying f(t) by t. The following theorem gives a beautiful classification of cyclic codes in terms of the ideals of Rn.
Theorem 22.16.
A linear code C in Zn2 is cyclic if and only if it is an ideal in Rn=Z[x]/⟨xn−1⟩.
- Proof
-
Let C be a linear cyclic code and suppose that f(t) is in C. Then tf(t) must also be in C. Consequently, tkf(t) is in C for all k∈N. Since C is a linear code, any linear combination of the codewords f(t),tf(t),t2f(t),…,tn−1f(t) is also a codeword; therefore, for every polynomial p(t), p(t)f(t) is in C. Hence, C is an ideal.
Conversely, let C be an ideal in Z2[x]/⟨xn+1⟩. Suppose that f(t)=a0+a1t+⋯+an−1tn−1 is a codeword in C. Then tf(t) is a codeword in C; that is, (a1,…,an−1,a0) is in C.
Theorem 22.16 tells us that knowing the ideals of Rn is equivalent to knowing the linear cyclic codes in Zn2. Fortunately, the ideals in Rn are easy to describe. The natural ring homomorphism ϕ:Z2[x]→Rn defined by ϕ[f(x)]=f(t) is a surjective homomorphism. The kernel of ϕ is the ideal generated by xn−1. By Theorem 16.34, every ideal C in Rn is of the form ϕ(I), where I is an ideal in Z2[x] that contains ⟨xn−1⟩. By Theorem 17.20, we know that every ideal I in Z2[x] is a principal ideal, since Z2 is a field. Therefore, I=⟨g(x)⟩ for some unique monic polynomial in Z2[x]. Since ⟨xn−1⟩ is contained in I, it must be the case that g(x) divides xn−1. Consequently, every ideal C in Rn is of the form
The unique monic polynomial of the smallest degree that generates C is called the minimal generator polynomial of C.
Example 22.17.
If we factor x7−1 into irreducible components, we have
Solution
We see that g(t)=(1+t+t3) generates an ideal C in R7. This code is a (7,4)-block code. As in Example 22.15, it is easy to calculate a generator matrix by examining what g(t) does to the polynomials 1, t, t2, and t3. A generator matrix for C is
In general, we can determine a generator matrix for an (n,k)-code C by the manner in which the elements tk are encoded. Let xn−1=g(x)h(x) in Z2[x]. If g(x)=g0+g1x+⋯+gn−kxn−k and h(x)=h0+h1x+⋯+hkxk, then the n×k matrix
is a generator matrix for the code C with generator polynomial g(t). The parity-check matrix for C is the (n−k)×n matrix
We will leave the details of the proof of the following proposition as an exercise.
Proposition 22.18.
Let C=⟨g(t)⟩ be a cyclic code in Rn and suppose that xn−1=g(x)h(x). Then G and H are generator and parity-check matrices for C, respectively. Furthermore, \(HG = 0\text{.}\
Example 22.19.
In Example 22.17,
Solution
Therefore, a parity-check matrix for this code is
To determine the error-detecting and error-correcting capabilities of a cyclic code, we need to know something about determinants. If α1,…,αn are elements in a field F, then the n×n matrix
is called the Vandermonde matrix. The determinant of this matrix is called the Vandermonde determinant. We will need the following lemma in our investigation of cyclic codes.
Lemma 22.20.
Let α1,…,αn be elements in a field F with n≥2. Then
In particular, if the \alpha_i's are distinct, then the determinant is nonzero.
- Proof
-
We will induct on n\text{.} If n = 2\text{,} then the determinant is \alpha_2 - \alpha_1\text{.} Let us assume the result for n - 1 and consider the polynomial p(x) defined by
p(x) = \det \begin{pmatrix} 1 & 1 & \cdots & 1 & 1 \\ \alpha_1 & \alpha_2 & \cdots & \alpha_{n-1} & x \\ \alpha_1^2 & \alpha_2^2 & \cdots & \alpha_{n-1}^2 & x^2 \\ \vdots & \vdots & \ddots & \vdots & \vdots \\ \alpha_1^{n-1} & \alpha_2^{n-1} & \cdots & \alpha_{n-1}^{n-1} & x^{n-1} \end{pmatrix}\text{.} \nonumberExpanding this determinant by cofactors on the last column, we see that p(x) is a polynomial of at most degree n-1\text{.} Moreover, the roots of p(x) are \alpha_1, \ldots, \alpha_{n-1}\text{,} since the substitution of any one of these elements in the last column will produce a column identical to the last column in the matrix. Remember that the determinant of a matrix is zero if it has two identical columns. Therefore,
p(x) = (x - \alpha_1)(x - \alpha_2) \cdots (x - \alpha_{n-1}) \beta\text{,} \nonumberwhere
\beta = (-1)^{n + n} \det \begin{pmatrix} 1 & 1 & \cdots & 1 \\ \alpha_1 & \alpha_2 & \cdots & \alpha_{n-1} \\ \alpha_1^2 & \alpha_2^2 & \cdots & \alpha_{n-1}^2 \\ \vdots & \vdots & \ddots & \vdots \\ \alpha_1^{n-2} & \alpha_2^{n-2} & \cdots & \alpha_{n-1}^{n-2} \end{pmatrix}\text{.} \nonumberBy our induction hypothesis,
\beta = (-1)^{n+n} \prod_{1 \leq j \lt i \leq n - 1} (\alpha_i - \alpha_j)\text{.} \nonumberIf we let x = \alpha_n\text{,} the result now follows immediately.
The following theorem gives us an estimate on the error detection and correction capabilities for a particular generator polynomial.
Theorem 22.21.
Let C = \langle g(t) \rangle be a cyclic code in R_n and suppose that \omega is a primitive nth root of unity over {\mathbb Z}_2\text{.} If s consecutive powers of \omega are roots of g(x)\text{,} then the minimum distance of C is at least s + 1\text{.}
- Proof
-
Suppose that
g( \omega^r) = g(\omega^{r + 1}) = \cdots = g( \omega^{r + s - 1}) = 0\text{.} \nonumberLet f(x) be some polynomial in C with s or fewer nonzero coefficients. We can assume that
f(x) = a_{i_0} x^{i_0} + a_{i_1} x^{i_1} + \cdots + a_{i_{s - 1}} x^{i_{s - 1}} \nonumberbe some polynomial in C\text{.} It will suffice to show that all of the a_i's must be 0. Since
g( \omega^r) = g(\omega^{r + 1}) = \cdots = g( \omega^{r + s - 1}) = 0 \nonumberand g(x) divides f(x)\text{,}
f( \omega^r) = f(\omega^{r + 1}) = \cdots = f( \omega^{r + s - 1}) = 0\text{.} \nonumberEquivalently, we have the following system of equations:
\begin{align*} a_{i_0} (\omega^r)^{i_0} + a_{i_1} (\omega^r)^{i_1} + \cdots + a_{i_{s - 1}} (\omega^r)^{i_{s - 1}} & = 0\\ a_{i_0} (\omega^{r + 1})^{i_0} + a_{i_1} (\omega^{r + 1})^{i_2} + \cdots + a_{i_{s-1}} (\omega^{r+1})^{i_{s-1}} & = 0\\ & \vdots\\ a_{i_0} (\omega^{r + s - 1})^{i_0} + a_{i_1} (\omega^{r + s - 1})^{i_1} + \cdots + a_{i_{s - 1}} (\omega^{r + s - 1})^{i_{s - 1}} & = 0\text{.} \end{align*}Therefore, (a_{i_0}, a_{i_1}, \ldots, a_{i_{s - 1}}) is a solution to the homogeneous system of linear equations
\begin{align*} (\omega^{i_0})^r x_0 + (\omega^{i_1})^r x_1 + \cdots + (\omega^{i_{s - 1}})^r x_{n - 1} & = 0\\ (\omega^{i_0})^{r + 1} x_0 + (\omega^{i_1})^{r + 1} x_1 + \cdots + (\omega^{i_{s - 1}})^{r + 1} x_{n - 1} & = 0\\ & \vdots\\ (\omega^{i_0})^{r + s - 1} x_0 + (\omega^{i_1})^{r + s - 1} x_1 + \cdots + (\omega^{i_{s - 1}})^{r + s - 1} x_{n - 1} & = 0\text{.} \end{align*}However, this system has a unique solution, since the determinant of the matrix
\begin{pmatrix} (\omega^{i_0})^r & (\omega^{i_1})^r & \cdots & (\omega^{i_{s-1}})^r \\ (\omega^{i_0})^{r+1} & (\omega^{i_1})^{r+1} & \cdots & (\omega^{i_{s-1}})^{r+1} \\ \vdots & \vdots & \ddots & \vdots \\ (\omega^{i_0})^{r+s-1} & (\omega^{i_1})^{r+s-1} & \cdots & (\omega^{i_{s-1}})^{r+s-1} \end{pmatrix} \nonumbercan be shown to be nonzero using Lemma 22.20 and the basic properties of determinants (Exercise). Therefore, this solution must be a_{i_0} = a_{i_1} = \cdots = a_{i_{s - 1}} = 0\text{.}
BCH Codes
Some of the most important codes, discovered independently by A. Hocquenghem in 1959 and by R. C. Bose and D. V. Ray-Chaudhuri in 1960, are BCH codes. The European and transatlantic communication systems both use BCH codes. Information words to be encoded are of length 231\text{,} and a polynomial of degree 24 is used to generate the code. Since 231 + 24 = 255 = 2^8-1\text{,} we are dealing with a (255, 231)-block code. This BCH code will detect six errors and has a failure rate of 1 in 16 million. One advantage of BCH codes is that efficient error correction algorithms exist for them.
The idea behind BCH codes is to choose a generator polynomial of smallest degree that has the largest error detection and error correction capabilities. Let d = 2r + 1 for some r \geq 0\text{.} Suppose that \omega is a primitive nth root of unity over {\mathbb Z}_2\text{,} and let m_i(x) be the minimal polynomial over {\mathbb Z}_2 of \omega^i\text{.} If
then the cyclic code \langle g(t) \rangle in R_n is called the BCH code of length n and distance d\text{.} By Theorem 22.21, the minimum distance of C is at least d\text{.}
Theorem 22.22.
Let C = \langle g(t) \rangle be a cyclic code in R_n\text{.} The following statements are equivalent.
- The code C is a BCH code whose minimum distance is at least d\text{.}
- A code polynomial f(t) is in C if and only if f( \omega^i) = 0 for 1 \leq i \lt d\text{.}
- The matrix
H = \begin{pmatrix} 1 & \omega & \omega^2 & \cdots & \omega^{n-1}\\ 1 & \omega^2 & \omega^{4} & \cdots & \omega^{(n-1)(2)} \\ 1 & \omega^3 & \omega^{6} & \cdots & \omega^{(n-1)(3)} \\ \vdots & \vdots & \vdots & \ddots & \vdots \\ 1 & \omega^{2r} & \omega^{4r} & \cdots & \omega^{(n-1)(2r)} \end{pmatrix} \nonumber
is a parity-check matrix for C\text{.}
- Proof
-
(1) \Rightarrow (2). If f(t) is in C\text{,} then g(x) \mid f(x) in {\mathbb Z}_2[x]\text{.} Hence, for i = 1, \ldots, 2r\text{,} f( \omega^i) = 0 since g( \omega^i ) = 0\text{.} Conversely, suppose that f( \omega^i) = 0 for 1 \leq i \leq d\text{.} Then f(x) is divisible by each m_i(x)\text{,} since m_i(x) is the minimal polynomial of \omega^i\text{.} Therefore, g(x) \mid f(x) by the definition of g(x)\text{.} Consequently, f(x) is a codeword.
(2) \Rightarrow (3). Let f(t) = a_0 + a_1 t + \cdots + a_{n - 1}v t^{n - 1} be in R_n\text{.} The corresponding n-tuple in {\mathbb Z}_2^n is {\mathbf x} = (a_0 a_1 \cdots a_{n - 1})^\transpose\text{.} By (2),
H {\mathbf x} = \begin{pmatrix} a_0 + a_1 \omega + \cdots + a_{n-1} \omega^{n-1} \\ a_0 + a_1 \omega^2 + \cdots + a_{n-1} (\omega^2)^{n-1} \\ \vdots \\ a_0 + a_1 \omega^{2r} + \cdots + a_{n-1} (\omega^{2r})^{n-1} \end{pmatrix} = \begin{pmatrix} f(\omega) \\ f(\omega^2) \\ \vdots \\ f(\omega^{2r}) \end{pmatrix} = 0 \nonumberexactly when f(t) is in C\text{.} Thus, H is a parity-check matrix for C\text{.}
(3) \Rightarrow (1). By (3), a code polynomial f(t) = a_0 + a_1 t + \cdots + a_{n - 1} t^{n - 1} is in C exactly when f(\omega^i) = 0 for i = 1, \ldots, 2r\text{.} The smallest such polynomial is g(t) = \lcm[ m_1(t),\ldots, m_{2r}(t)]\text{.} Therefore, C = \langle g(t) \rangle\text{.}
Example 22.23.
It is easy to verify that x^{15} - 1 \in {\mathbb Z}_2[x] has a factorization
where each of the factors is an irreducible polynomial. Let \omega be a root of 1 + x + x^4\text{.} The Galois field \gf(2^4) is
Solution
By Example 22.8, \omega is a primitive 15th root of unity. The minimal polynomial of \omega is m_1(x) = 1 + x + x^4\text{.} It is easy to see that \omega^2 and \omega^4 are also roots of m_1(x)\text{.} The minimal polynomial of \omega^3 is m_2(x) = 1 + x + x^2 + x^3 + x^4\text{.} Therefore,
has roots \omega\text{,} \omega^2\text{,} \omega^3\text{,} \omega^4\text{.} Since both m_1(x) and m_2(x) divide x^{15} - 1\text{,} the BCH code is a (15, 7)-code. If x^{15} -1 = g(x)h(x)\text{,} then h(x) = 1 + x^4 + x^6 + x^7\text{;} therefore, a parity-check matrix for this code is
Theorem 22.22.
Proof.
Example 22.23.