Calculus of Variations & Euler-Lagrange Equation Derivation

This comprehensive section covers the foundational concepts of optimization in calculus. The instructor introduces optimization as finding maximum or minimum values of functions, such as maximizing profit. The derivative is defined as the limit of the ratio of function change to independent variable change as the change approaches zero. The necessary condition for local extrema is that the derivative must equal zero at such points. The instructor explains that a derivative of zero does not guarantee an extremum, as the function may have an inflection point. The second derivative test is introduced to determine whether critical points are maxima (negative second derivative), minima (positive second derivative), or inconclusive. The section concludes with the concept of global extrema, which requires checking all local extrema and boundary points, as the global extremum may occur at the boundary of the domain rather than at a local extremum.

This section establishes the core concepts of single-variable optimization. Local maxima occur where function values exceed neighboring points, while local minima occur where values are lower. A function is increasing when its derivative is positive and decreasing when negative. Stationary points exist where the derivative equals zero, representing potential extrema. Global extrema are the absolute maximum or minimum across the entire domain. The sign test determines extremum type by examining how the derivative changes sign around stationary points—positive-to-negative indicates a maximum, while negative-to-positive indicates a minimum.

At local extrema (maximum or minimum points), the derivative of the function equals zero. This is a fundamental property of differentiable functions: at points where the function reaches a local maximum or minimum, the tangent line is horizontal, meaning the slope (derivative) is zero. This principle is used to find critical points for optimization problems.

Optimization is a process to find the best solution by maximizing or minimizing an objective function. Key concepts include local extrema (maximum/minimum within a neighborhood) and global extrema (absolute highest/lowest points). For single variable optimization: (1) Calculate first derivative, (2) Set to zero to find critical points (turning points), (3) Calculate second derivative, (4) Substitute critical points into second derivative. If second derivative < 0, it's a maximum; if > 0, it's a minimum. A point of inflection occurs when second derivative equals zero at a critical point, confirmed by non-zero third derivative. Example: f(x) = 60x^4 - 3x^3 + 2x^2 has critical points at x=0,1,2 where x=1 is a maximum and x=2 is a minimum.

This section teaches how to find local maximum and minimum values using derivatives. First, find the derivative and set it equal to zero to find critical points. For f(x) = 2x^3 - 6x + 15, f'(x) = 6x^2 - 6, so x = 1 or x = -1. Then substitute these x-values into the original function to find y-values: f(-1) = 19 and f(1) = 11. The larger y-value (19) corresponds to the local maximum, and the smaller (11) to the local minimum. This is a fundamental optimization technique.

Simple first-order ODEs like dy/dx = λy have solutions y(x) = ce^(λx), with constants determined by initial conditions. The separation of variables method solves equations like dy/dx = y² by separating variables, integrating, and applying initial conditions. Second-order ODEs like f(x) = m(d²x/dt²) describe physical systems. For f(x) = kx, the equation (d²x/dt²) + (k/m)x = 0 has solutions x(t) = c1 sin(√(k/m)t) + c2 cos(√(k/m)t). Newton's principle of determinancy states that initial positions and velocities uniquely determine all future motion.

First-order ordinary differential equations can be classified into different types based on their form. The general form is F(x, y, y') = 0. One important class is separable equations, which can be written in the form y' = f(x)/g(y) or y' = f(x)g(y) or y' = g(y)/f(x). This means the variables x and y can be separated on opposite sides of the equation, allowing integration on each side independently. To solve a separable equation: isolate y', check if separable, separate variables, integrate both sides, and solve for y.

First-order ODEs classify into three types: separable (variables separated by multiplication/division), linear (dy/dx + P(x)y = Q(x)), and homogeneous (dy/dx = F(y/x)). Equations may belong to multiple categories. The key skill is recognizing which category applies for efficient solving. Choose the method you're most comfortable with for each problem.

The existence and uniqueness theorem states that if f(x,y) and ∂f/∂y are continuous in a region containing the initial point, then a unique solution exists. Geometrically, uniqueness means solution curves cannot cross. When conditions fail, any behavior is possible: no solution, unique solution, or infinitely many solutions. For y' = 2y, uniqueness fails at y = 0, allowing multiple solutions through the origin. For y' = y/x, the equation exhibits all three cases: unique solutions for x ≠ 0, no solution for x = 0, y ≠ 0, and infinitely many solutions at (0,0). For second-order ODEs, reduction of order transforms them to first-order equations: substitute v = y' when y is absent, or v = y' treating y as independent when x is absent. Solve the reduced equation, then substitute back and integrate again.

First-order ODEs include: (1) Separable: f(x)dx = g(y)dy, integrate both sides. (2) Homogeneous: y' = f(y/x), substitute u = y/x. (3) Bernoulli: y' + P(x)y = Q(x)y^n, substitute z = y^(1-n). (4) Linear: y' + P(x)y = Q(x), use integrating factor e^(∫P(x)dx). Example: (1+x²)y' + 2xy = cos(5x)/(1+x²) becomes y' + (2x/(1+x²))y = cos(5x)/(1+x²), with integrating factor 1+x², solution y = (1/5)sin(5x)/(1+x²) + C/(1+x²).

Newtonian mechanics consists of two parts: kinematics, which describes the present state of a system (position and velocity), and dynamics, which explains how systems change over time; for motion with constant acceleration, the position is given by x(t) = x₀ + v₀t + ½at² and velocity by v(t) = v₀ + at, with the relationship v² = v₀² + 2a(x-x₀) allowing prediction of future motion from initial conditions.

In Newtonian mechanics, the position vector (OM) describes the location of a system as a function of time, with its components (x(t), y(t)) forming the equations of motion; the velocity vector (V) represents the rate of change of position, calculated as the derivative of OM with respect to time (V = d(OM)/dt), with components Vx = dx/dt and Vy = dy/dt; and the acceleration vector (A) represents the rate of change of velocity, calculated as the derivative of V with respect to time (A = dV/dt), with components Ax = dVx/dt and Ay = dVy/dt. The primitive of 0 is a constant, the primitive of a constant m is m×t + C, and the primitive of m×t is (1/2)m×t² + C.

The fundamental equations of Newtonian mechanics include: velocity-time relationship (v = u + at), displacement-time relationship (s = ut + ½at²), velocity-displacement relationship (v² = u² + 2as), and Newton's second law (F = ma). Kinetic energy is given by ½mv², while gravitational potential energy near Earth's surface is mgh, where h is the height above ground.

Newton revolutionized science by introducing numerical and data-based approaches, moving beyond experience-based observation. He unified celestial and terrestrial mechanics, showing the same physical laws apply to both. His work established absolute space and time as separate, fixed backgrounds, but these assumptions were later proven incorrect by Einstein's relativity and quantum mechanics. Physics requires mathematical tools including scalars (magnitude only, like mass) and vectors (magnitude and direction, like force). Weight is a vector measured in Newtons, not kilograms. Coordinate systems (Cartesian, polar, cylindrical, spherical) provide frameworks for describing positions. Kinematics describes motion without considering forces: position describes where an object is relative to a reference point, velocity is the rate of change of position (vector), speed is the rate of change of distance (scalar). Instantaneous velocity is the velocity at a specific moment, while average velocity is total displacement over total time. Acceleration is the rate of change of velocity. Motion is relative to the observer's reference frame. The same object may appear stationary or moving depending on the reference frame. Relative velocity is calculated by subtracting the velocity of one object from another.

This section covers kinematics and Newton's laws: (1) Kinematic Quantities: Position (x, unit meter), Velocity (v, unit m/s), Acceleration (a, unit m/s²); (2) Mathematical Relationships: velocity = derivative of position (v = dx/dt), acceleration = derivative of velocity (a = dv/dt), acceleration = second derivative of position (a = d²x/dt²); (3) Newton's First Law (Law of Inertia) - in an inertial frame, a body maintains rest or uniform rectilinear motion unless acted upon by external force (ΣF = 0); (4) Newton's Second Law - in an inertial frame, sum of external forces equals mass times acceleration (ΣF = ma); (5) Newton's Third Law - when body A exerts force on body B, body B exerts equal and opposite force on body A (F_AB = -F_BA).