<html><head></head><body><div style="color:#000; background-color:#fff; font-family:times new roman, new york, times, serif;font-size:14px"><div id="yiv3455516307"><div id="yui_3_16_0_1_1444470509775_86262"><div style="color:#000;background-color:#fff;font-family:times new roman, new york, times, serif;font-size:14px;" id="yui_3_16_0_1_1444470509775_86261"><div id="yiv3455516307yui_3_16_0_1_1444470509775_84694"><span id="yiv3455516307yui_3_16_0_1_1444470509775_84796">Hi,</span></div><div id="yiv3455516307yui_3_16_0_1_1444470509775_84694"><span><br clear="none"></span></div><div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_84694"><span id="yiv3455516307yui_3_16_0_1_1444470509775_84845">A*B is supposed to be ~orthogonal to A and B, so that answers my previous question. Sorry was a bit hasty in dashing off the previous question.</span></div> <div style="color:#000;background-color:#fff;font-family:times new roman, new york, times, serif;font-size:14px;" id="yui_3_16_0_1_1444470509775_86261"><br></div><div style="color:#000;background-color:#fff;font-family:times new roman, new york, times, serif;font-size:14px;" id="yui_3_16_0_1_1444470509775_86261">Cheers,</div>Aditya.<br clear="none"><div class="yiv3455516307qtdSeparateBR" id="yiv3455516307yui_3_16_0_1_1444470509775_84725"><br clear="none"><br clear="none"></div><div class="yiv3455516307yqt5996568444" id="yiv3455516307yqt56152"></div></div></div></div><div class=".yiv3455516307yahoo_quoted" id="yui_3_16_0_1_1444470509775_86687"> <div id="yiv3455516307yui_3_16_0_1_1444470509775_84718" style="font-family:times new roman, new york, times, serif;font-size:14px;"> <div id="yiv3455516307yui_3_16_0_1_1444470509775_84717" style="font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, Sans-Serif;font-size:16px;"> <div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_84723"> <font id="yiv3455516307yui_3_16_0_1_1444470509775_84722" size="2" face="Arial"> On Wednesday, 14 October 2015 1:33 PM, Aditya Gilra <aditya_gilra@yahoo.com> wrote:<br clear="none"> </font> </div> <blockquote id="yiv3455516307yui_3_16_0_1_1444470509775_84716" style="border-left:2px solid rgb(16, 16, 255);margin-left:5px;margin-top:5px;padding-left:5px;"> <br clear="none"><br clear="none"> <div class="yiv3455516307y_msg_container" id="yiv3455516307yui_3_16_0_1_1444470509775_84715"><div id="yiv3455516307"><div id="yiv3455516307yui_3_16_0_1_1444470509775_84714"><div id="yiv3455516307yui_3_16_0_1_1444470509775_84713" style="color:#000;background-color:#fff;font-family:times new roman, new york, times, serif;font-size:14px;"><div id="yiv3455516307yui_3_16_0_1_1444470509775_78857"><span id="yui_3_16_0_1_1444470509775_86773">Hi,</span></div><div id="yiv3455516307yui_3_16_0_1_1444470509775_78857"><br clear="none"></div><div id="yiv3455516307yui_3_16_0_1_1444470509775_78857">I had not specified the vocabulary for the model (spa.SPA()) and for the buffers, and was comparing the memory output to the default vocabulary of the model.</div><div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_78857">After specifying the same vocabulary consistently, both Fact0 and A*B give the same high similarity post cue-ing. So that solves the previous issue. Sorry for the traffic.</div><div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_78857"><br clear="none"></div><div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_78857">Now however, I'm surprised that A and B have negative dot products (similarity) with A*B. I'd expect the dot product to be at least greater than zero. Or am I missing something?</div><div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_78857"><br clear="none"></div><div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_78857">My code is updated at:</div><div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_78857"><a rel="nofollow" shape="rect" id="yiv3455516307yui_3_16_0_1_1444470509775_79287" target="_blank" href="https://gist.github.com/adityagilra/c3077515722662499ff6">https://gist.github.com/adityagilra/c3077515722662499ff6</a><br clear="none"></div><div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_78857"><br clear="none"></div><div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_78857">Thanks,</div><div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_78857">Aditya.</div><div class="yiv3455516307qtdSeparateBR" id="yiv3455516307yui_3_16_0_1_1444470509775_79002"><br clear="none"></div><div class="yiv3455516307yqt8966752459" id="yiv3455516307yqt71856"><div class="yiv3455516307yahoo_quoted" id="yiv3455516307yui_3_16_0_1_1444470509775_78994" style="display:block;"> <div id="yiv3455516307yui_3_16_0_1_1444470509775_78993" style="font-family:times new roman, new york, times, serif;font-size:14px;"> <div id="yiv3455516307yui_3_16_0_1_1444470509775_78992" style="font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, Sans-Serif;font-size:16px;"> <div dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_78998"> <font id="yiv3455516307yui_3_16_0_1_1444470509775_79000" size="2" face="Arial"> On Tuesday, 13 October 2015 1:23 PM, Aditya Gilra <aditya_gilra@yahoo.com> wrote:<br clear="none"> </font> </div> <blockquote id="yiv3455516307yui_3_16_0_1_1444470509775_78991" style="border-left:2px solid rgb(16, 16, 255);margin-left:5px;margin-top:5px;padding-left:5px;"> <br clear="none"><br clear="none"> <div class="yiv3455516307y_msg_container" id="yiv3455516307yui_3_16_0_1_1444470509775_78990"><div id="yiv3455516307"><div id="yiv3455516307yui_3_16_0_1_1444470509775_78989"><div id="yiv3455516307yui_3_16_0_1_1444470509775_78988" style="color:#000;background-color:#fff;font-family:times new roman, new york, times, serif;font-size:14px;"><div id="yiv3455516307yui_3_16_0_1_1444470509775_56850"><font id="yiv3455516307yui_3_16_0_1_1444470509775_57035" size="3">Hi,</font></div><div id="yiv3455516307yui_3_16_0_1_1444470509775_56851"><font size="3"><br clear="none"></font></div><div class="yiv3455516307" id="yiv3455516307yui_3_16_0_1_1444470509775_56853" style="margin-top:0px;margin-bottom:0px;text-align:justify;font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;line-height:20px;"><font id="yiv3455516307yui_3_16_0_1_1444470509775_57040" size="3">I created a semantic pointer 'Fact0'='A*B' in the spa.Vocabulary facts by:<br clear="none" class="yiv3455516307" id="yiv3455516307yui_3_16_0_1_1444470509775_56855" style="margin:0px;padding:0px;">facts.add('Fact0',facts.parse('A*B'))</font></div><div class="yiv3455516307" id="yiv3455516307yui_3_16_0_1_1444470509775_56853" style="margin-top:0px;margin-bottom:0px;text-align:justify;font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;line-height:20px;"><font size="3"><br clear="none"></font></div><div class="yiv3455516307" id="yiv3455516307yui_3_16_0_1_1444470509775_56853" style="margin-top:0px;margin-bottom:0px;text-align:justify;font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;line-height:20px;"><font size="3">Then, I created an spa.AssociativeMemory with above vocabulary.<br clear="none" class="yiv3455516307" id="yiv3455516307yui_3_16_0_1_1444470509775_56857" style="margin:0px;padding:0px;"></font></div><div class="yiv3455516307" dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_56859" style="margin-top:1em;margin-bottom:0px;text-align:justify;font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;line-height:20px;"><font id="yiv3455516307yui_3_16_0_1_1444470509775_57039" size="3">Now when I query this associative memory with 'A*B' versus 'Fact0', I get very different responses!</font></div><div class="yiv3455516307" dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_56859" style="margin-top:1em;margin-bottom:0px;text-align:justify;font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;line-height:20px;"><font id="yiv3455516307yui_3_16_0_1_1444470509775_57109" size="3">I'd expect the underlying neural activations to be the same for the two and the associative memory should return the same Fact0 match for both.<br clear="none" class="yiv3455516307" id="yiv3455516307yui_3_16_0_1_1444470509775_56863" style="margin:0px;padding:0px;">Why this difference?</font></div><div id="yiv3455516307yui_3_16_0_1_1444470509775_56875"><font size="3"><br clear="none"></font></div><div class="yiv3455516307" dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_56812"><font id="yiv3455516307yui_3_16_0_1_1444470509775_57037" size="3">My code is at:<a rel="nofollow" shape="rect" class="yiv3455516307" id="yiv3455516307yui_3_16_0_1_1444470509775_56810" target="_blank" href="https://gist.github.com/adityagilra/c3077515722662499ff6"><br clear="none" class="yiv3455516307" id="yiv3455516307yui_3_16_0_1_1444470509775_56880">https://gist.github.com/adityagilra/c3077515722662499ff6</a><br clear="none" class="yiv3455516307" id="yiv3455516307yui_3_16_0_1_1444470509775_56882"></font></div><div class="yiv3455516307" dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_56884"><font size="3"><br clear="none" class="yiv3455516307" id="yiv3455516307yui_3_16_0_1_1444470509775_56886"></font></div><div class="yiv3455516307" dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_56884"><font size="3" id="yui_3_16_0_1_1444470509775_86786">Thanks,</font></div><div class="yiv3455516307" dir="ltr" id="yiv3455516307yui_3_16_0_1_1444470509775_56884"><font id="yiv3455516307yui_3_16_0_1_1444470509775_57140" size="3">Aditya.</font></div></div></div></div><br clear="none"><br clear="none"></div> </blockquote> </div> </div> </div></div></div></div></div><br clear="none"><br clear="none"></div> </blockquote> </div> </div> </div></div></body></html>