A leading entry of a row is the leftmost nonzero entry of that (nonzero) row.
A matrix is in echelon form (REF) if:
All nonzero rows are above any rows of all zeros.
Each leading entry is in a column to the right of the leading entry of the row above it (“staircase”).
All entries in a column below a leading entry are zeros.
It is in reduced echelon form (RREF) if, in addition:
The leading entry in each nonzero row is 1.
Each leading 1 is the only nonzero entry in its column (zeros above it too).
Schematically (■ = nonzero leading entry, ∗ = any value):
REF: ■00∗■0∗∗0∗∗0RREF: 100010∗∗0∗∗0
Theorem 1 — Uniqueness of the Reduced Echelon Form (Lay §1.2): Each matrix is row equivalent to one and only one reduced echelon matrix.
REF vs RREF:
REF is not unique: different row operations give different echelon forms, and the pivot values can change — but the pivot locations are always the same.
RREF is unique: both the pivots (all 1) and their locations are fixed. That’s why we can talk about “the” RREF of A.
To go from REF to RREF: scale all pivots to 1 and create zeros above the pivots.
Pivot Positions and Pivot Columns
A pivot position in A is a location that corresponds to a leading 1 in the RREF of A (equivalently, to a leading entry in any echelon form of A).
A pivot column is a column of A that contains a pivot position.
A pivot is a nonzero number in a pivot position (used to create zeros via row ops).
Because pivot locations are the same in every echelon form, you can find them from any REF — you don’t need the full RREF.
The Row Reduction Algorithm
Forward phase (produces an echelon form):
Begin with the leftmost nonzero column. This is a pivot column; the pivot position is at the top.
Select a nonzero entry in the pivot column as the pivot. If necessary, interchange rows to move it to the pivot position.
Use row replacement to create zeros in all positions below the pivot.
Cover (ignore) the row containing the pivot and repeat steps 1–3 on the submatrix that remains, until there are no more nonzero rows.
Backward phase (produces the RREF):
Starting with the rightmost pivot and working up and to the left, create zeros above each pivot. If a pivot is not 1, scale its row to make it 1.
Mini-example (Lay §1.2, Example 3)
0333−7−9−68126−5−9486−5915
Forward phase. Column 1 is the first pivot column, but its top entry is 0: swap R1↔R3. Then R2←R2−R1, and R3←R3−23R2:
Basic vs Free Variables and the Parametric Description
When the RREF of an augmented matrix is reached, read off the solution:
Variables corresponding to pivot columns are basic variables.
All other variables are free variables — they can take any value.
Each nonzero row of the RREF gives one equation that expresses a basic variable in terms of the free variables. Writing the solution set this way is a parametric description: the free variables act as parameters.
If the matrix in the mini-example above is the augmented matrix of a system in x1,…,x5, the RREF gives
x1−2x3+3x4x2−2x3+2x4x5=−24=−7=4⟹⎩⎨⎧x1=−24+2x3−3x4x2=−7+2x3−2x4x3 is freex4 is freex5=4
Every choice of x3,x4 gives a solution, so there are infinitely many.
Common mistakes with free variables:
A variable that does not appear in any equation of the RREF (its column is all zeros) is still a variable — it is free, not zero. (See Exercise 2 below, textbook Exercise 8: x3 is free, notx3=0.)
A basic variable can be a plain number with no free variables in its formula (like x5=4 above) — it is still basic.
Always solve for the basic variables in terms of the free ones, never the other way around.
Existence and Uniqueness
Theorem 2 — Existence and Uniqueness Theorem (Lay §1.2): A linear system is consistent if and only if the rightmost column of the augmented matrix is not a pivot column — that is, if and only if an echelon form of the augmented matrix has no row of the form
[0⋯0b]with b=0.
If the system is consistent, then the solution set contains either
(i) a unique solution, when there are no free variables, or
(ii) infinitely many solutions, when there is at least one free variable.
How to answer “consistent? unique?” questions — only an echelon form is needed:
Row reduce the augmented matrix to echelon form (RREF not required).
Is the last (augmented) column a pivot column? Yes → inconsistent. Stop.
Otherwise consistent. Is every coefficient column a pivot column? Yes → unique solution. No → free variable(s) → infinitely many solutions.
Using Row Reduction to Solve a Linear System (Lay §1.2 summary)
Write the augmented matrix.
Row reduce to echelon form; decide consistency. If inconsistent, stop.
Continue to the RREF.
Write the system of equations corresponding to the RREF.
Rewrite each nonzero equation to express its basic variable in terms of the free variables.
Solved Examples (Textbook Questions)
Exercise 1
(Adapted from Lay §1.2, Exercises 3 & 4)
Row reduce each matrix to reduced echelon form. Identify the pivot positions in the final matrix and in the original matrix, and list the pivot columns.
Classic error: writing x3=0 because x3 “doesn’t appear”. Column 3 has no pivot, so x3 is free — the basic variables just happen not to depend on it.
Both matrices are already in echelon form, so only the backward phase is needed.
(a) Exercise 13. Pivots in columns 1, 2, 4. Clear above the pivots: R1←R1+R3 (kills the −1 in column 4), then R1←R1+3R2 (kills the −3 in column 2):
⎩⎨⎧x1=−9−7x3x2=2+6x3+3x4x3 is freex4 is freex5=0
(Here x5=0 is correct: x5 is a basic variable whose equation happens to say x5=0.)
Exercise 5
(Adapted from Lay §1.2, Exercises 15 & 16)
Each matrix below is the augmented matrix of a linear system, in echelon form (■ = nonzero leading entry, ∗ = any value, possibly zero). In each case determine whether the system is consistent, and if so, whether the solution is unique.
Apply Theorem 2: (1) is the last column a pivot column? (2) if not, is every variable column a pivot column?
15(a) 3 variables (columns 1–3), last column = augmented. Pivots in columns 1, 2, 3; the augmented column has no pivot (its bottom entry is 0, below no leading entry) → consistent. Every variable column has a pivot → no free variables → unique solution.
15(b) 4 variables (columns 1–4). The last row is [0000■], i.e. 0=nonzero. The rightmost column is a pivot column → inconsistent.
16(a) 2 variables (columns 1–2). Pivots in columns 1 and 2; the last row is all zeros (0=0, harmless), so the augmented column has no pivot → consistent. Both variable columns are pivot columns → unique solution.
16(b) 4 variables (columns 1–4). Pivots in columns 1, 3, 4; the augmented column (5) has no pivot → consistent. Column 2 has no pivot, so x2 is free → infinitely many solutions.
These questions never need numbers — only the shape (where the pivots are). Count variable columns carefully: the last column is always the augmented column, not a variable.
Exercise 6
(Adapted from Lay §1.2, Exercises 17 & 18)
Determine the value(s) of h such that the matrix is the augmented matrix of a consistent linear system.
(a)[2436h7](b)[15−3h−2−7]
Show solution ↓Hide solution ↑
Solution
(a) Exercise 17.R2←R2−2R1:
[2436h7]∼[2030h7−2h]
Row 2 says 0=7−2h. The system has a solution only if7−2h=0, i.e. h=27. (Then the two equations describe the same line → infinitely many solutions. For any other h the lines are parallel → no solution.)
(b) Exercise 18.R2←R2−5R1:
[15−3h−2−7]∼[10−3h+15−23]
If h+15=0, i.e. h=−15, row 2 reads 0=3 → no solution.
If h=−15, h+15 is a pivot and the augmented column is not a pivot column → consistent (unique solution).
Answer: consistent for all h=−15.
Notice the two different shapes of answer: in (a) the h sits in the augmented column, so consistency requires one specific value; in (b) the h sits in a coefficient position, so consistency fails for one specific value. Always reduce first, then ask “can the last row become [00∣nonzero]?”