Systems of EquationsTopic #16 of 30

Solution Types

Consistent vs inconsistent systems, unique vs infinite solutions, and free variables.

Overview

A system of linear equations Ax=bA\mathbf{x} = \mathbf{b} can have no solution, exactly one solution, or infinitely many solutions. Understanding when each occurs is fundamental to linear algebra.

Three Possibilities

TypeNumber of SolutionsVisual (2D)
Inconsistent0Parallel lines
Consistent, unique1Intersecting lines
Consistent, infinite\inftySame line

Determining Solution Type

After row reducing the augmented matrix [Ab][A \mid \mathbf{b}]:

No Solution (Inconsistent)

A row of the form [0  0    0c][0 \; 0 \; \cdots \; 0 \mid c] where c0c \neq 0.

[123401230005]0=5 (contradiction)\left[\begin{array}{ccc|c} 1 & 2 & 3 & 4 \\ 0 & 1 & 2 & 3 \\ 0 & 0 & 0 & 5 \end{array}\right] \leftarrow 0 = 5 \text{ (contradiction)}

Unique Solution

Every column of AA has a pivot (full column rank).

[100201030014]\left[\begin{array}{ccc|c} 1 & 0 & 0 & 2 \\ 0 & 1 & 0 & 3 \\ 0 & 0 & 1 & 4 \end{array}\right]

Infinitely Many Solutions

Consistent, but AA has at least one free variable (column without pivot).

[120300140000]\left[\begin{array}{ccc|c} 1 & 2 & 0 & 3 \\ 0 & 0 & 1 & 4 \\ 0 & 0 & 0 & 0 \end{array}\right]

Testing with Rank

For system Ax=bA\mathbf{x} = \mathbf{b} where AA is m×nm \times n:

ConditionResult
rank(A)<rank([Ab])\text{rank}(A) < \text{rank}([A \mid \mathbf{b}])No solution
rank(A)=rank([Ab])=n\text{rank}(A) = \text{rank}([A \mid \mathbf{b}]) = nUnique solution
rank(A)=rank([Ab])<n\text{rank}(A) = \text{rank}([A \mid \mathbf{b}]) < nInfinitely many solutions

Free Variables

When infinitely many solutions exist:

  • Free variables: correspond to non-pivot columns
  • Basic variables: correspond to pivot columns
  • Dimension of solution set = number of free variables

Parametric Solutions

Express basic variables in terms of free variables.

Example

RREF:

[1302500146]\left[\begin{array}{cccc|c} 1 & 3 & 0 & 2 & 5 \\ 0 & 0 & 1 & 4 & 6 \end{array}\right]

Variables: x1,x2,x3,x4x_1, x_2, x_3, x_4

  • Pivot columns: 1, 3 (basic variables: x1x_1, x3x_3)
  • Free columns: 2, 4 (free variables: x2x_2, x4x_4)

Solution:

x1=53x22x4x_1 = 5 - 3x_2 - 2x_4 x3=64x4x_3 = 6 - 4x_4 x2=s (free)x_2 = s \text{ (free)} x4=t (free)x_4 = t \text{ (free)}

Vector form:

x=[5060]+s[3100]+t[2041]\mathbf{x} = \begin{bmatrix} 5 \\ 0 \\ 6 \\ 0 \end{bmatrix} + s\begin{bmatrix} -3 \\ 1 \\ 0 \\ 0 \end{bmatrix} + t\begin{bmatrix} -2 \\ 0 \\ -4 \\ 1 \end{bmatrix}

Homogeneous Systems

For Ax=0A\mathbf{x} = \mathbf{0}:

  • Always consistent (x=0\mathbf{x} = \mathbf{0} is always a solution)
  • Either unique solution (x=0\mathbf{x} = \mathbf{0}) or infinitely many

When Only Trivial Solution

  • AA has full column rank (nn pivots for m×nm \times n matrix)
  • Columns of AA are linearly independent

When Non-trivial Solutions Exist

  • AA does not have full column rank
  • n>rank(A)n > \text{rank}(A)
  • For m<nm < n (more variables than equations): always non-trivial solutions

General Solution Structure

For Ax=bA\mathbf{x} = \mathbf{b} (consistent):

x=xp+xh\mathbf{x} = \mathbf{x}_p + \mathbf{x}_h

where:

  • xp\mathbf{x}_p is any particular solution to Ax=bA\mathbf{x} = \mathbf{b}
  • xh\mathbf{x}_h is the general solution to Ax=0A\mathbf{x} = \mathbf{0}

The solution set is a translate of the null space.

Examples

Example 1: Unique Solution

x+y=5x + y = 5 xy=1x - y = 1

RREF:

[103012]\left[\begin{array}{cc|c} 1 & 0 & 3 \\ 0 & 1 & 2 \end{array}\right]

Solution: x=3x = 3, y=2y = 2

Example 2: No Solution

x+y=5x + y = 5 2x+2y=82x + 2y = 8

RREF:

[115002]\left[\begin{array}{cc|c} 1 & 1 & 5 \\ 0 & 0 & -2 \end{array}\right]

0=20 = -2: No solution

Example 3: Infinitely Many Solutions

x+y+z=3x + y + z = 3 2x+2y+2z=62x + 2y + 2z = 6

RREF:

[11130000]\left[\begin{array}{ccc|c} 1 & 1 & 1 & 3 \\ 0 & 0 & 0 & 0 \end{array}\right]

Free: y=sy = s, z=tz = t

Solution: x=3stx = 3 - s - t, y=sy = s, z=tz = t