Uniqueness of the maximum of a multi-dimensional function
Clash Royale CLAN TAG#URR8PPP
up vote
0
down vote
favorite
I have a somewhat complicated function of $M+1$ variables, which looks as follows.
$$f (x_0, x_1, x_2, dots, x_M) = sum_i=1^N_A ln left[1 - texterfleft(x_0 + sum_j=1^M a_ij x_jright) right] + sum_i=1^N_B ln left[1 + texterfleft(x_0 + sum_j=1^M b_ij x_jright) right].$$
All is real here, but in in principle other than that there are no restrictions on the possible values of the coefficients $a_ij$ and $b_ij$. $N_A$ and $N_B$ are in general some "larger" numbers (say, at least on the order of 100 or 1000), while $M$ tends to be pretty small, say for example 5 to 10 or so. Not that it should matter, but to add some context, this is actually a likelihood expression for some model.
Now my question is, is this a concave function with a unique maximum? Intuitively, the answer seems to be yes, and "numerical evidence" hints to the same direction, but I have a hard time proving it rigorously. I tried to calculate the Hessian, and eventually a general expression for its eigenvalues (which should all be negative in case my assumptions holds true), but it was just too much.
Any suggestions would be appreciated!
Thanks,
Lennex
real-analysis multivariable-calculus optimization eigenvalues-eigenvectors convex-optimization
add a comment |Â
up vote
0
down vote
favorite
I have a somewhat complicated function of $M+1$ variables, which looks as follows.
$$f (x_0, x_1, x_2, dots, x_M) = sum_i=1^N_A ln left[1 - texterfleft(x_0 + sum_j=1^M a_ij x_jright) right] + sum_i=1^N_B ln left[1 + texterfleft(x_0 + sum_j=1^M b_ij x_jright) right].$$
All is real here, but in in principle other than that there are no restrictions on the possible values of the coefficients $a_ij$ and $b_ij$. $N_A$ and $N_B$ are in general some "larger" numbers (say, at least on the order of 100 or 1000), while $M$ tends to be pretty small, say for example 5 to 10 or so. Not that it should matter, but to add some context, this is actually a likelihood expression for some model.
Now my question is, is this a concave function with a unique maximum? Intuitively, the answer seems to be yes, and "numerical evidence" hints to the same direction, but I have a hard time proving it rigorously. I tried to calculate the Hessian, and eventually a general expression for its eigenvalues (which should all be negative in case my assumptions holds true), but it was just too much.
Any suggestions would be appreciated!
Thanks,
Lennex
real-analysis multivariable-calculus optimization eigenvalues-eigenvectors convex-optimization
add a comment |Â
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I have a somewhat complicated function of $M+1$ variables, which looks as follows.
$$f (x_0, x_1, x_2, dots, x_M) = sum_i=1^N_A ln left[1 - texterfleft(x_0 + sum_j=1^M a_ij x_jright) right] + sum_i=1^N_B ln left[1 + texterfleft(x_0 + sum_j=1^M b_ij x_jright) right].$$
All is real here, but in in principle other than that there are no restrictions on the possible values of the coefficients $a_ij$ and $b_ij$. $N_A$ and $N_B$ are in general some "larger" numbers (say, at least on the order of 100 or 1000), while $M$ tends to be pretty small, say for example 5 to 10 or so. Not that it should matter, but to add some context, this is actually a likelihood expression for some model.
Now my question is, is this a concave function with a unique maximum? Intuitively, the answer seems to be yes, and "numerical evidence" hints to the same direction, but I have a hard time proving it rigorously. I tried to calculate the Hessian, and eventually a general expression for its eigenvalues (which should all be negative in case my assumptions holds true), but it was just too much.
Any suggestions would be appreciated!
Thanks,
Lennex
real-analysis multivariable-calculus optimization eigenvalues-eigenvectors convex-optimization
I have a somewhat complicated function of $M+1$ variables, which looks as follows.
$$f (x_0, x_1, x_2, dots, x_M) = sum_i=1^N_A ln left[1 - texterfleft(x_0 + sum_j=1^M a_ij x_jright) right] + sum_i=1^N_B ln left[1 + texterfleft(x_0 + sum_j=1^M b_ij x_jright) right].$$
All is real here, but in in principle other than that there are no restrictions on the possible values of the coefficients $a_ij$ and $b_ij$. $N_A$ and $N_B$ are in general some "larger" numbers (say, at least on the order of 100 or 1000), while $M$ tends to be pretty small, say for example 5 to 10 or so. Not that it should matter, but to add some context, this is actually a likelihood expression for some model.
Now my question is, is this a concave function with a unique maximum? Intuitively, the answer seems to be yes, and "numerical evidence" hints to the same direction, but I have a hard time proving it rigorously. I tried to calculate the Hessian, and eventually a general expression for its eigenvalues (which should all be negative in case my assumptions holds true), but it was just too much.
Any suggestions would be appreciated!
Thanks,
Lennex
real-analysis multivariable-calculus optimization eigenvalues-eigenvectors convex-optimization
asked Aug 10 at 23:45
Lennex
31
31
add a comment |Â
add a comment |Â
1 Answer
1
active
oldest
votes
up vote
1
down vote
accepted
A sum of concave functions is concave, and $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are easily seen to be concave. So your function is concave.
Moreover, since $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are strictly concave,
the only way for a maximum of your function (assuming it exists) to be non-unique would be for all the $x_0 + sum_j a_ij x_j$ and all the $x_0 + sum_j b_ij x_j$ to be equal
at two different points, i.e. the matrix $pmatrix1 & Acr 1 & Bcr$ to have rank $< M+1$, where $A$ and $B$ are the matrices of coefficients $a_ij$ and $b_ij$, and the $1$'s are column vectors of all $1$'s.
Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
â Lennex
Aug 13 at 17:15
add a comment |Â
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
1
down vote
accepted
A sum of concave functions is concave, and $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are easily seen to be concave. So your function is concave.
Moreover, since $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are strictly concave,
the only way for a maximum of your function (assuming it exists) to be non-unique would be for all the $x_0 + sum_j a_ij x_j$ and all the $x_0 + sum_j b_ij x_j$ to be equal
at two different points, i.e. the matrix $pmatrix1 & Acr 1 & Bcr$ to have rank $< M+1$, where $A$ and $B$ are the matrices of coefficients $a_ij$ and $b_ij$, and the $1$'s are column vectors of all $1$'s.
Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
â Lennex
Aug 13 at 17:15
add a comment |Â
up vote
1
down vote
accepted
A sum of concave functions is concave, and $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are easily seen to be concave. So your function is concave.
Moreover, since $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are strictly concave,
the only way for a maximum of your function (assuming it exists) to be non-unique would be for all the $x_0 + sum_j a_ij x_j$ and all the $x_0 + sum_j b_ij x_j$ to be equal
at two different points, i.e. the matrix $pmatrix1 & Acr 1 & Bcr$ to have rank $< M+1$, where $A$ and $B$ are the matrices of coefficients $a_ij$ and $b_ij$, and the $1$'s are column vectors of all $1$'s.
Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
â Lennex
Aug 13 at 17:15
add a comment |Â
up vote
1
down vote
accepted
up vote
1
down vote
accepted
A sum of concave functions is concave, and $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are easily seen to be concave. So your function is concave.
Moreover, since $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are strictly concave,
the only way for a maximum of your function (assuming it exists) to be non-unique would be for all the $x_0 + sum_j a_ij x_j$ and all the $x_0 + sum_j b_ij x_j$ to be equal
at two different points, i.e. the matrix $pmatrix1 & Acr 1 & Bcr$ to have rank $< M+1$, where $A$ and $B$ are the matrices of coefficients $a_ij$ and $b_ij$, and the $1$'s are column vectors of all $1$'s.
A sum of concave functions is concave, and $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are easily seen to be concave. So your function is concave.
Moreover, since $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are strictly concave,
the only way for a maximum of your function (assuming it exists) to be non-unique would be for all the $x_0 + sum_j a_ij x_j$ and all the $x_0 + sum_j b_ij x_j$ to be equal
at two different points, i.e. the matrix $pmatrix1 & Acr 1 & Bcr$ to have rank $< M+1$, where $A$ and $B$ are the matrices of coefficients $a_ij$ and $b_ij$, and the $1$'s are column vectors of all $1$'s.
edited Aug 11 at 0:40
answered Aug 11 at 0:34
Robert Israel
305k22201443
305k22201443
Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
â Lennex
Aug 13 at 17:15
add a comment |Â
Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
â Lennex
Aug 13 at 17:15
Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
â Lennex
Aug 13 at 17:15
Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
â Lennex
Aug 13 at 17:15
add a comment |Â
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2878916%2funiqueness-of-the-maximum-of-a-multi-dimensional-function%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password