Vector Spaces Explained | Linear Algebra Intro

Three major algebraic properties govern operations with numbers. The distributive property eliminates parentheses by multiplying the outside coefficient with each term inside: a(b + c) = ab + ac. The commutative property ensures order doesn't matter in addition and multiplication: a + b + c = c + b + a and a × b × c = c × b × a. The associative property confirms grouping doesn't affect results: (a + b) + c = a + (b + c) and (a × b) × c = a × (b × c). These properties apply only to addition and multiplication, not subtraction or division.

The four fundamental algebraic properties are: (1) Commutative Property - order of addition or multiplication doesn't change the result (a+b+c = a+c+b, a×b×c = a×c×b); (2) Associative Property - grouping of numbers doesn't change the result (a+(b+c) = (a+b)+c, (a×b)×c = a×(b×c)); (3) Distributive Property - multiplication distributes over addition/subtraction (a×(b+c) = a×b + a×c); (4) Identity Property - adding zero or multiplying by one doesn't change the value (a+0 = a, a×1 = a). These properties form the foundation for simplifying algebraic expressions.

This section explains three fundamental algebraic properties. The commutative property states that changing the order of numbers in addition or multiplication does not change the result (a + b = b + a, a × b = b × a). The associative property states that changing the grouping of numbers does not change the result ((a + b) + c = a + (b + c), (a × b) × c = a × (b × c)). The distributive property is crucial for algebra: a(b + c) = ab + ac. This property allows multiplying a number by a sum by distributing to each term, which is essential for simplifying expressions and solving equations.

Four key algebraic properties: (1) Commutative property: order doesn't matter in addition/multiplication (3+5=5+3, 3×5=5×3); (2) Associative property: grouping doesn't matter in addition/multiplication ((2+3)+5=2+(3+5)); (3) Distributive property: multiplication distributes over addition/subtraction (5×(3+2)=5×3+5×2); (4) Substitution property: equal quantities can replace each other. These properties apply only to addition and multiplication, not subtraction or division.

Three fundamental properties govern algebraic operations: (1) The commutative property allows rearranging terms in addition and multiplication without changing results (a+b=b+a, ab=ba), but does NOT apply to subtraction or division; (2) The associative property allows regrouping terms using parentheses in addition and multiplication without affecting outcomes ((a+b)+c=a+(b+c), (ab)c=a(bc)); (3) The distributive property enables multiplying a single term by each term inside parentheses before addition (a(b+c)=ab+ac). These properties form the foundation for algebraic manipulation and problem-solving.

A linear system of equations consists of m equations with n variables, where each equation has the form a11x1 + a12x2 + ... + a1nxn = b1, a21x1 + a22x2 + ... + a2nxn = b2, ..., am1x1 + am2x2 + ... + amnxn = bm. The system is linear because all variables appear with degree one and there are no products of variables or non-linear functions. A system can be represented as an augmented matrix [A|b]. Three elementary row operations preserve the solution set: row swapping (Ri ↔ Rj), row scaling (Ri → αRi for α ≠ 0), and row addition (Ri → Ri + αRj). These operations correspond to reordering equations, multiplying equations by non-zero constants, and adding multiples of equations to each other.

Linear systems appear in numerical methods for ODEs and PDEs. A linear system has equations where all unknown variables have the same power (typically 1). Systems are classified as properly determined (equal equations and unknowns), overdetermined (more equations), or underdetermined (fewer equations). Two basic techniques exist: elimination (removing variables) and substitution (expressing variables in terms of others). Gaussian elimination transforms systems through forward elimination (creating upper triangular form) and backward substitution (solving from last equation). Linear systems are represented as Ax = b, where A is the coefficient matrix, x is the variable vector, and b is the constant vector. Matrix operations include addition (same dimensions, element-wise), scalar multiplication (each element multiplied by scalar), and matrix multiplication (columns of first matrix must equal rows of second). Special matrices include diagonal matrices (non-zero only on main diagonal), identity matrices (1s on diagonal, 0 elsewhere), symmetric matrices (A_ij = A_ji), and triangular matrices (zeros above or below diagonal).

Systems of simultaneous linear equations arise from engineering and science applications including electrical network analysis (using Kirchhoff's Current Law) and statics problems (using equilibrium equations). Small systems (fewer than 2,000 equations) use direct methods, while large systems (tens of millions of unknowns in finite element analysis) require iterative methods. Linear systems are represented as Ax = b, where A is the coefficient matrix, x is the variable vector, and b is the right-hand side vector. Matrix-vector multiplication produces new vectors through linear transformations (rotation, stretching, shrinking). A system has a unique solution if and only if equations are linearly independent (non-zero determinant). Matrix operations include: addition/subtraction (element-wise, commutative), multiplication (rows by columns, not commutative), transpose (switching rows and columns, (AB)^T = B^T A^T), and inverse (A × A^(-1) = I). For 2x2 matrices, inverse is (1/det(A)) × [[d,-b],[-c,a]]. The determinant of a 2x2 matrix [[a,b],[c,d]] is ad - bc. For 3x3 matrices, use cofactor expansion along the first row. Cramer's rule calculates determinants but requires n! operations (16×16 requires 2.1 × 10^13 operations), making it impractical for large systems.

A general first-order linear system consists of n equations where each equation has the form x_i' = P_i1(t)x_1 + P_i2(t)x_2 + ... + P_in(t)x_n + G_i(t), and matrices are rectangular arrays of numbers with M rows and N columns that provide a convenient notation for representing and analyzing linear systems; basic matrix operations include equality (same dimensions and matching elements), addition (component-wise), scalar multiplication (multiplying each element by a number), and the identity matrix (square matrix with 1s on the main diagonal and 0s elsewhere).

A linear system consists of two or more linear equations. The minimum number of equations is two. These systems can be solved using matrix methods. The three allowed row operations are: (1) Multiply any row by any non-zero number, (2) Swap any two rows, (3) Add one row to another row. An augmented matrix is formed by placing coefficients in the left part and constants in the rightmost column, separated by an augmented line. The goal is to transform the augmented matrix into Reduced Row Echelon Form (RREF), where the main diagonal elements are all 1s and all elements below the main diagonal are 0s.

The set of real numbers (R) forms a field and can serve as the scalar field for a vector space. Real numbers include all rational and irrational numbers. When real numbers are used as scalars, the vector space operations follow standard real arithmetic. The field properties of real numbers (closure under addition, subtraction, multiplication, and division) ensure that real vector spaces are well-defined and satisfy all vector space axioms.

The real numbers (denoted by ℝ) are typically treated as an undefined term in basic set theory courses, similar to the concept of a set itself. They represent all numbers that can be placed on a number line, including both rational and irrational numbers.

Set theory is a fundamental branch of mathematics dealing with collections of objects. Sets are used to organize items systematically, such as a set of pens, books, or tables. Real numbers (bastab songkha) encompass all numbers used in mathematics, including natural numbers, whole numbers, integers, rational numbers, irrational numbers, and imaginary numbers. Understanding real numbers is essential before learning set theory, as sets are built upon these numerical foundations.

This section covers the field axioms for real numbers. The closure property states that for any real numbers a and b, a + b and a × b are also real numbers. The commutative property states that a + b = b + a and a × b = b × a. The associative property states that (a + b) + c = a + (b + c) and (a × b) × c = a × (b × c). The additive identity is 0, and the additive inverse of a is -a. The multiplicative identity is 1, and the multiplicative inverse of a (a ≠ 0) is 1/a.

Real numbers are defined as numbers whose squares are greater than or equal to zero. They include rational and irrational numbers and follow order relations (less than, greater than), which complex numbers do not. The set of all real numbers is denoted by R and includes negative numbers, positive numbers, zero, integers, natural numbers, prime numbers, composite numbers, even numbers, and odd numbers. Sets are collections of well-defined objects denoted by capital letters. Elements are denoted by lowercase letters. The notation 'x ∈ A' means x is an element of set A, while 'A ⊂ B' means A is a subset of B. Integers (Z) include all whole numbers and their negatives. Natural numbers (N) are positive integers starting from 1. Rational numbers are expressed as p/q where p and q are integers and q ≠ 0. Irrational numbers are real numbers that are not rational.