Uniqueness of the maximum of a multi-dimensional function

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP











up vote
0
down vote

favorite












I have a somewhat complicated function of $M+1$ variables, which looks as follows.



$$f (x_0, x_1, x_2, dots, x_M) = sum_i=1^N_A ln left[1 - texterfleft(x_0 + sum_j=1^M a_ij x_jright) right] + sum_i=1^N_B ln left[1 + texterfleft(x_0 + sum_j=1^M b_ij x_jright) right].$$



All is real here, but in in principle other than that there are no restrictions on the possible values of the coefficients $a_ij$ and $b_ij$. $N_A$ and $N_B$ are in general some "larger" numbers (say, at least on the order of 100 or 1000), while $M$ tends to be pretty small, say for example 5 to 10 or so. Not that it should matter, but to add some context, this is actually a likelihood expression for some model.



Now my question is, is this a concave function with a unique maximum? Intuitively, the answer seems to be yes, and "numerical evidence" hints to the same direction, but I have a hard time proving it rigorously. I tried to calculate the Hessian, and eventually a general expression for its eigenvalues (which should all be negative in case my assumptions holds true), but it was just too much.



Any suggestions would be appreciated!



Thanks,
Lennex







share|cite|improve this question
























    up vote
    0
    down vote

    favorite












    I have a somewhat complicated function of $M+1$ variables, which looks as follows.



    $$f (x_0, x_1, x_2, dots, x_M) = sum_i=1^N_A ln left[1 - texterfleft(x_0 + sum_j=1^M a_ij x_jright) right] + sum_i=1^N_B ln left[1 + texterfleft(x_0 + sum_j=1^M b_ij x_jright) right].$$



    All is real here, but in in principle other than that there are no restrictions on the possible values of the coefficients $a_ij$ and $b_ij$. $N_A$ and $N_B$ are in general some "larger" numbers (say, at least on the order of 100 or 1000), while $M$ tends to be pretty small, say for example 5 to 10 or so. Not that it should matter, but to add some context, this is actually a likelihood expression for some model.



    Now my question is, is this a concave function with a unique maximum? Intuitively, the answer seems to be yes, and "numerical evidence" hints to the same direction, but I have a hard time proving it rigorously. I tried to calculate the Hessian, and eventually a general expression for its eigenvalues (which should all be negative in case my assumptions holds true), but it was just too much.



    Any suggestions would be appreciated!



    Thanks,
    Lennex







    share|cite|improve this question






















      up vote
      0
      down vote

      favorite









      up vote
      0
      down vote

      favorite











      I have a somewhat complicated function of $M+1$ variables, which looks as follows.



      $$f (x_0, x_1, x_2, dots, x_M) = sum_i=1^N_A ln left[1 - texterfleft(x_0 + sum_j=1^M a_ij x_jright) right] + sum_i=1^N_B ln left[1 + texterfleft(x_0 + sum_j=1^M b_ij x_jright) right].$$



      All is real here, but in in principle other than that there are no restrictions on the possible values of the coefficients $a_ij$ and $b_ij$. $N_A$ and $N_B$ are in general some "larger" numbers (say, at least on the order of 100 or 1000), while $M$ tends to be pretty small, say for example 5 to 10 or so. Not that it should matter, but to add some context, this is actually a likelihood expression for some model.



      Now my question is, is this a concave function with a unique maximum? Intuitively, the answer seems to be yes, and "numerical evidence" hints to the same direction, but I have a hard time proving it rigorously. I tried to calculate the Hessian, and eventually a general expression for its eigenvalues (which should all be negative in case my assumptions holds true), but it was just too much.



      Any suggestions would be appreciated!



      Thanks,
      Lennex







      share|cite|improve this question












      I have a somewhat complicated function of $M+1$ variables, which looks as follows.



      $$f (x_0, x_1, x_2, dots, x_M) = sum_i=1^N_A ln left[1 - texterfleft(x_0 + sum_j=1^M a_ij x_jright) right] + sum_i=1^N_B ln left[1 + texterfleft(x_0 + sum_j=1^M b_ij x_jright) right].$$



      All is real here, but in in principle other than that there are no restrictions on the possible values of the coefficients $a_ij$ and $b_ij$. $N_A$ and $N_B$ are in general some "larger" numbers (say, at least on the order of 100 or 1000), while $M$ tends to be pretty small, say for example 5 to 10 or so. Not that it should matter, but to add some context, this is actually a likelihood expression for some model.



      Now my question is, is this a concave function with a unique maximum? Intuitively, the answer seems to be yes, and "numerical evidence" hints to the same direction, but I have a hard time proving it rigorously. I tried to calculate the Hessian, and eventually a general expression for its eigenvalues (which should all be negative in case my assumptions holds true), but it was just too much.



      Any suggestions would be appreciated!



      Thanks,
      Lennex









      share|cite|improve this question











      share|cite|improve this question




      share|cite|improve this question










      asked Aug 10 at 23:45









      Lennex

      31




      31




















          1 Answer
          1






          active

          oldest

          votes

















          up vote
          1
          down vote



          accepted










          A sum of concave functions is concave, and $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are easily seen to be concave. So your function is concave.
          Moreover, since $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are strictly concave,
          the only way for a maximum of your function (assuming it exists) to be non-unique would be for all the $x_0 + sum_j a_ij x_j$ and all the $x_0 + sum_j b_ij x_j$ to be equal
          at two different points, i.e. the matrix $pmatrix1 & Acr 1 & Bcr$ to have rank $< M+1$, where $A$ and $B$ are the matrices of coefficients $a_ij$ and $b_ij$, and the $1$'s are column vectors of all $1$'s.






          share|cite|improve this answer






















          • Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
            – Lennex
            Aug 13 at 17:15










          Your Answer




          StackExchange.ifUsing("editor", function ()
          return StackExchange.using("mathjaxEditing", function ()
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          );
          );
          , "mathjax-editing");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "69"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          convertImagesToLinks: true,
          noModals: false,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          noCode: true, onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );








           

          draft saved


          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2878916%2funiqueness-of-the-maximum-of-a-multi-dimensional-function%23new-answer', 'question_page');

          );

          Post as a guest






























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          up vote
          1
          down vote



          accepted










          A sum of concave functions is concave, and $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are easily seen to be concave. So your function is concave.
          Moreover, since $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are strictly concave,
          the only way for a maximum of your function (assuming it exists) to be non-unique would be for all the $x_0 + sum_j a_ij x_j$ and all the $x_0 + sum_j b_ij x_j$ to be equal
          at two different points, i.e. the matrix $pmatrix1 & Acr 1 & Bcr$ to have rank $< M+1$, where $A$ and $B$ are the matrices of coefficients $a_ij$ and $b_ij$, and the $1$'s are column vectors of all $1$'s.






          share|cite|improve this answer






















          • Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
            – Lennex
            Aug 13 at 17:15














          up vote
          1
          down vote



          accepted










          A sum of concave functions is concave, and $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are easily seen to be concave. So your function is concave.
          Moreover, since $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are strictly concave,
          the only way for a maximum of your function (assuming it exists) to be non-unique would be for all the $x_0 + sum_j a_ij x_j$ and all the $x_0 + sum_j b_ij x_j$ to be equal
          at two different points, i.e. the matrix $pmatrix1 & Acr 1 & Bcr$ to have rank $< M+1$, where $A$ and $B$ are the matrices of coefficients $a_ij$ and $b_ij$, and the $1$'s are column vectors of all $1$'s.






          share|cite|improve this answer






















          • Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
            – Lennex
            Aug 13 at 17:15












          up vote
          1
          down vote



          accepted







          up vote
          1
          down vote



          accepted






          A sum of concave functions is concave, and $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are easily seen to be concave. So your function is concave.
          Moreover, since $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are strictly concave,
          the only way for a maximum of your function (assuming it exists) to be non-unique would be for all the $x_0 + sum_j a_ij x_j$ and all the $x_0 + sum_j b_ij x_j$ to be equal
          at two different points, i.e. the matrix $pmatrix1 & Acr 1 & Bcr$ to have rank $< M+1$, where $A$ and $B$ are the matrices of coefficients $a_ij$ and $b_ij$, and the $1$'s are column vectors of all $1$'s.






          share|cite|improve this answer














          A sum of concave functions is concave, and $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are easily seen to be concave. So your function is concave.
          Moreover, since $ln(1+texterf(t))$ and $ln(1-texterf(t))$ are strictly concave,
          the only way for a maximum of your function (assuming it exists) to be non-unique would be for all the $x_0 + sum_j a_ij x_j$ and all the $x_0 + sum_j b_ij x_j$ to be equal
          at two different points, i.e. the matrix $pmatrix1 & Acr 1 & Bcr$ to have rank $< M+1$, where $A$ and $B$ are the matrices of coefficients $a_ij$ and $b_ij$, and the $1$'s are column vectors of all $1$'s.







          share|cite|improve this answer














          share|cite|improve this answer



          share|cite|improve this answer








          edited Aug 11 at 0:40

























          answered Aug 11 at 0:34









          Robert Israel

          305k22201443




          305k22201443











          • Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
            – Lennex
            Aug 13 at 17:15
















          • Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
            – Lennex
            Aug 13 at 17:15















          Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
          – Lennex
          Aug 13 at 17:15




          Thanks a lot! Intuitively, I knew that both sums, having only contributions from concave functions, should be concave as well, since they are both monotonic. However, I was not sure if the some of a increasing concave function and a decreasing one would still be concave.
          – Lennex
          Aug 13 at 17:15












           

          draft saved


          draft discarded


























           


          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2878916%2funiqueness-of-the-maximum-of-a-multi-dimensional-function%23new-answer', 'question_page');

          );

          Post as a guest













































































          這個網誌中的熱門文章

          How to combine Bézier curves to a surface?

          Carbon dioxide

          Why am i infinitely getting the same tweet with the Twitter Search API?