Decomposition of the Outer Product
$begingroup$
I have an $m times n$ matrix that is statistical data. I have a theoretical model about how that data is constructed in which the matrix is the outer product of two vectors. Let's call those vectors $u$ and $v$. Their size is $m times 1$ and $ntimes 1$ respectively such that the outer product is $uv^{ prime}$. The hitch is that there is also missing data, i.e. not all cells in the matrix are in the data. In other words, it is an outer product that is then multiplied cell by cell by a matrix of the same size with zeros and ones. Any idea how I can estimate the vectors $hat{u}$ and $hat{v}$ that yield an outer product matrix that is the closest to the one in the data? I do know where the missing data is (i.e. I know the matrix of zeros and ones that is multiplied by the outer product matrix). Thank you!
matrix-decomposition outer-product
edited Dec 1 '18 at 8:51
Daniele Tampieri
1,9561619
asked Dec 1 '18 at 8:11
Frederic TremblayFrederic Tremblay
1
$endgroup$
add a comment |
$begingroup$
I have an $m times n$ matrix that is statistical data. I have a theoretical model about how that data is constructed in which the matrix is the outer product of two vectors. Let's call those vectors $u$ and $v$. Their size is $m times 1$ and $ntimes 1$ respectively such that the outer product is $uv^{ prime}$. The hitch is that there is also missing data, i.e. not all cells in the matrix are in the data. In other words, it is an outer product that is then multiplied cell by cell by a matrix of the same size with zeros and ones. Any idea how I can estimate the vectors $hat{u}$ and $hat{v}$ that yield an outer product matrix that is the closest to the one in the data? I do know where the missing data is (i.e. I know the matrix of zeros and ones that is multiplied by the outer product matrix). Thank you!
matrix-decomposition outer-product
edited Dec 1 '18 at 8:51
Daniele Tampieri
1,9561619
asked Dec 1 '18 at 8:11
Frederic TremblayFrederic Tremblay
1
$endgroup$
$begingroup$
HINT: The columns of the matrix are all scalar multiples of $u$ and the rows are all scalar multiples of $v'$. You won’t be able to recover $u$ and $v$, however, since for any nonzero scalar $k$, $uv'=(ku)(1/k,v')$.
$endgroup$
– amd
Dec 1 '18 at 8:30
$begingroup$
So I could recover them up to a constant k?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:26
$begingroup$
It seems that singular value decomposition (SVD) could help me here. Assuming I fill in the missing values somehow (with weighted row or column averages), I could use SVD to get $M=sum_{i=1}^{k}sigma_i u_i v_{i}'$. This would give me a number of vectors $u$ and $v$. I presume there would be a way to solve for an optimal unique pair that would give the matrix that is the closest to the one from the data. Would the weighting $sigma_i$ help here?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:32
$begingroup$
Also, all values in the matrix of data are between 0 and 1, and all values in $u$ and $v$ should be between 0 and 1.
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 21:17
$begingroup$
Going to the SVD is overkill. Pick any complete nonzero column (which you might’ve had to fill in) and call that $u$. You can then compute the corresponding $v$ with simple division.
$endgroup$
– amd
Dec 2 '18 at 0:08
add a comment |
$begingroup$
I have an $m times n$ matrix that is statistical data. I have a theoretical model about how that data is constructed in which the matrix is the outer product of two vectors. Let's call those vectors $u$ and $v$. Their size is $m times 1$ and $ntimes 1$ respectively such that the outer product is $uv^{ prime}$. The hitch is that there is also missing data, i.e. not all cells in the matrix are in the data. In other words, it is an outer product that is then multiplied cell by cell by a matrix of the same size with zeros and ones. Any idea how I can estimate the vectors $hat{u}$ and $hat{v}$ that yield an outer product matrix that is the closest to the one in the data? I do know where the missing data is (i.e. I know the matrix of zeros and ones that is multiplied by the outer product matrix). Thank you!
matrix-decomposition outer-product
edited Dec 1 '18 at 8:51
Daniele Tampieri
1,9561619
asked Dec 1 '18 at 8:11
Frederic TremblayFrederic Tremblay
1
$endgroup$
I have an $m times n$ matrix that is statistical data. I have a theoretical model about how that data is constructed in which the matrix is the outer product of two vectors. Let's call those vectors $u$ and $v$. Their size is $m times 1$ and $ntimes 1$ respectively such that the outer product is $uv^{ prime}$. The hitch is that there is also missing data, i.e. not all cells in the matrix are in the data. In other words, it is an outer product that is then multiplied cell by cell by a matrix of the same size with zeros and ones. Any idea how I can estimate the vectors $hat{u}$ and $hat{v}$ that yield an outer product matrix that is the closest to the one in the data? I do know where the missing data is (i.e. I know the matrix of zeros and ones that is multiplied by the outer product matrix). Thank you!
matrix-decomposition outer-product
matrix-decomposition outer-product
edited Dec 1 '18 at 8:51
Daniele Tampieri
1,9561619
asked Dec 1 '18 at 8:11
Frederic TremblayFrederic Tremblay
1
edited Dec 1 '18 at 8:51
Daniele Tampieri
1,9561619
asked Dec 1 '18 at 8:11
Frederic TremblayFrederic Tremblay
1
edited Dec 1 '18 at 8:51
Daniele Tampieri
1,9561619
edited Dec 1 '18 at 8:51
Daniele Tampieri
1,9561619
edited Dec 1 '18 at 8:51
Daniele Tampieri
1,9561619
1,9561619
asked Dec 1 '18 at 8:11
Frederic TremblayFrederic Tremblay
1
asked Dec 1 '18 at 8:11
Frederic TremblayFrederic Tremblay
1
asked Dec 1 '18 at 8:11
Frederic TremblayFrederic Tremblay
1
1
$begingroup$
HINT: The columns of the matrix are all scalar multiples of $u$ and the rows are all scalar multiples of $v'$. You won’t be able to recover $u$ and $v$, however, since for any nonzero scalar $k$, $uv'=(ku)(1/k,v')$.
$endgroup$
– amd
Dec 1 '18 at 8:30
$begingroup$
So I could recover them up to a constant k?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:26
$begingroup$
It seems that singular value decomposition (SVD) could help me here. Assuming I fill in the missing values somehow (with weighted row or column averages), I could use SVD to get $M=sum_{i=1}^{k}sigma_i u_i v_{i}'$. This would give me a number of vectors $u$ and $v$. I presume there would be a way to solve for an optimal unique pair that would give the matrix that is the closest to the one from the data. Would the weighting $sigma_i$ help here?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:32
$begingroup$
Also, all values in the matrix of data are between 0 and 1, and all values in $u$ and $v$ should be between 0 and 1.
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 21:17
$begingroup$
Going to the SVD is overkill. Pick any complete nonzero column (which you might’ve had to fill in) and call that $u$. You can then compute the corresponding $v$ with simple division.
$endgroup$
– amd
Dec 2 '18 at 0:08
add a comment |
$begingroup$
HINT: The columns of the matrix are all scalar multiples of $u$ and the rows are all scalar multiples of $v'$. You won’t be able to recover $u$ and $v$, however, since for any nonzero scalar $k$, $uv'=(ku)(1/k,v')$.
$endgroup$
– amd
Dec 1 '18 at 8:30
$begingroup$
So I could recover them up to a constant k?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:26
$begingroup$
It seems that singular value decomposition (SVD) could help me here. Assuming I fill in the missing values somehow (with weighted row or column averages), I could use SVD to get $M=sum_{i=1}^{k}sigma_i u_i v_{i}'$. This would give me a number of vectors $u$ and $v$. I presume there would be a way to solve for an optimal unique pair that would give the matrix that is the closest to the one from the data. Would the weighting $sigma_i$ help here?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:32
$begingroup$
Also, all values in the matrix of data are between 0 and 1, and all values in $u$ and $v$ should be between 0 and 1.
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 21:17
$begingroup$
Going to the SVD is overkill. Pick any complete nonzero column (which you might’ve had to fill in) and call that $u$. You can then compute the corresponding $v$ with simple division.
$endgroup$
– amd
Dec 2 '18 at 0:08
$begingroup$
HINT: The columns of the matrix are all scalar multiples of $u$ and the rows are all scalar multiples of $v'$. You won’t be able to recover $u$ and $v$, however, since for any nonzero scalar $k$, $uv'=(ku)(1/k,v')$.
$endgroup$
– amd
Dec 1 '18 at 8:30
$begingroup$
HINT: The columns of the matrix are all scalar multiples of $u$ and the rows are all scalar multiples of $v'$. You won’t be able to recover $u$ and $v$, however, since for any nonzero scalar $k$, $uv'=(ku)(1/k,v')$.
$endgroup$
– amd
Dec 1 '18 at 8:30
$begingroup$
So I could recover them up to a constant k?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:26
$begingroup$
So I could recover them up to a constant k?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:26
$begingroup$
It seems that singular value decomposition (SVD) could help me here. Assuming I fill in the missing values somehow (with weighted row or column averages), I could use SVD to get $M=sum_{i=1}^{k}sigma_i u_i v_{i}'$. This would give me a number of vectors $u$ and $v$. I presume there would be a way to solve for an optimal unique pair that would give the matrix that is the closest to the one from the data. Would the weighting $sigma_i$ help here?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:32
$begingroup$
It seems that singular value decomposition (SVD) could help me here. Assuming I fill in the missing values somehow (with weighted row or column averages), I could use SVD to get $M=sum_{i=1}^{k}sigma_i u_i v_{i}'$. This would give me a number of vectors $u$ and $v$. I presume there would be a way to solve for an optimal unique pair that would give the matrix that is the closest to the one from the data. Would the weighting $sigma_i$ help here?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:32
$begingroup$
Also, all values in the matrix of data are between 0 and 1, and all values in $u$ and $v$ should be between 0 and 1.
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 21:17
$begingroup$
Also, all values in the matrix of data are between 0 and 1, and all values in $u$ and $v$ should be between 0 and 1.
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 21:17
$begingroup$
Going to the SVD is overkill. Pick any complete nonzero column (which you might’ve had to fill in) and call that $u$. You can then compute the corresponding $v$ with simple division.
$endgroup$
– amd
Dec 2 '18 at 0:08
$begingroup$
Going to the SVD is overkill. Pick any complete nonzero column (which you might’ve had to fill in) and call that $u$. You can then compute the corresponding $v$ with simple division.
$endgroup$
– amd
Dec 2 '18 at 0:08
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3021115%2fdecomposition-of-the-outer-product%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3021115%2fdecomposition-of-the-outer-product%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
HINT: The columns of the matrix are all scalar multiples of $u$ and the rows are all scalar multiples of $v'$. You won’t be able to recover $u$ and $v$, however, since for any nonzero scalar $k$, $uv'=(ku)(1/k,v')$.
$endgroup$
– amd
Dec 1 '18 at 8:30
$begingroup$
So I could recover them up to a constant k?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:26
$begingroup$
It seems that singular value decomposition (SVD) could help me here. Assuming I fill in the missing values somehow (with weighted row or column averages), I could use SVD to get $M=sum_{i=1}^{k}sigma_i u_i v_{i}'$. This would give me a number of vectors $u$ and $v$. I presume there would be a way to solve for an optimal unique pair that would give the matrix that is the closest to the one from the data. Would the weighting $sigma_i$ help here?
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 20:32
$begingroup$
Also, all values in the matrix of data are between 0 and 1, and all values in $u$ and $v$ should be between 0 and 1.
$endgroup$
– Frederic Tremblay
Dec 1 '18 at 21:17
$begingroup$
Going to the SVD is overkill. Pick any complete nonzero column (which you might’ve had to fill in) and call that $u$. You can then compute the corresponding $v$ with simple division.
$endgroup$
– amd
Dec 2 '18 at 0:08