Geometry behind optimization
Optimization is an animal of many faces. More precisely, this post is about what is called the First Order Conditions (FOC's) and Second Order Conditions (SOC's). Make sure to go through this visual introduction to derivatives, then everything will be easy.
Case of a minimum
Draw a simple function that has a clear minimum. For example, just use a parabola with branches looking upward. Below it draw the graph of its derivative. Satisfy yourself that the derivative at the minimum point is zero. Then look at the behavior of the second derivative at the minimum point. Establish its sign; that will be the second order condition.
Video 1. Conditions sufficient for a minimum point
Case of a maximum
Here you turn the previous discussion upside down. Draw a simple function that has a clear maximum. For example, just use a parabola with branches looking downward. Below it draw the graph of its derivative. Satisfy yourself that the derivative at the maximum point is zero. Then look at the behavior of the second derivative at the maximum point. Establish its sign; that will be the second order condition.
Video 2. Conditions sufficient for a maximum point
When first and second order conditions don't work
The example in case is the cubic function. The derivative at zero is zero. However, the origin is neither maximum nor minimum. This is an inflection point (concavity changes to convexity). The general rule that arises from the analysis of the Taylor decomposition is this. Look for the first derivative in the decomposition that is not zero. If the order of the derivative is even, then the sign of the derivative determines whether it's a maximum or a minimum. If the order of the derivative is odd, then it's an inflection point, regardless of the sign of the derivative.
Summary
A point where the first derivative vanishes is called a critical point. Suppose
Case 1. If the second derivative at
Case 2. If the second derivative at
Case 3. If the second derivative at
If
Leave a Reply
You must be logged in to post a comment.