The Gauss-Jordan Elimination Algorithm
Named after mathematicians Carl Friedrich Gauss and Wilhelm Jordan, the Gauss-Jordan elimination algorithm is a systematic method for solving systems of linear equations and manipulating matrices. While Gaussian elimination stops at an upper triangular matrix (Row Echelon Form), Gauss-Jordan goes a step further to yield the unique Reduced Row Echelon Form (RREF).
The algorithm consists of two main phases:
- Forward Phase (Gaussian Elimination): We work from left to right, column by column. In each column, we select a row with a non-zero entry in that column to act as our pivot. We swap this row to the top, scale the pivot to 1, and subtract multiples of this row from all rows *below* it to clear out the column. This results in Row Echelon Form (REF).
- Backward Phase (Jordan Elimination): We work from right to left, bottom to top. For each pivot, we subtract multiples of its row from the rows *above* it to turn all entries in the pivot's column to zero. This results in Reduced Row Echelon Form (RREF).
The Three Elementary Row Operations
Gauss-Jordan elimination is executed entirely using three types of operations that preserve the relationships between matrix rows:
- Row Swap: Exchanging the positions of two rows (written as Ri ↔ Rj). This is used when a zero is present at the pivot position.
- Row Scaling: Multiplying a row by a non-zero scalar (written as Ri → cRi). This is used to scale a leading entry to 1.
- Row Addition/Subtraction: Adding or subtracting a multiple of one row to another row (written as Ri → Ri + cRj). This is used to eliminate non-zero entries in a pivot's column.
Why Use Gauss-Jordan Elimination?
Although numerical computing packages often use LU decomposition for efficiency, Gauss-Jordan remains the standard teaching tool because it represents the most direct way to resolve a matrix into its constituent spaces. It provides a clear, algebraic representation of the relationships between vectors and shows whether a system of equations has a unique solution, no solution, or infinitely many solutions.