<div>I learned a great deal from your book <em>Search Engine Society</em>, Alex, and thanks for the comments below.</div>
<div> </div>
<div>The concept of a public option in search is a great idea. I promoted it at a conference earlier this year at Yale on the future of libraries, in a talk called "From Managed Care to Managed Knowledge." It's archived here, along with a very good talk from Brewster Kahle: </div>
<div><a href="http://www.youtube.com/watch?v=pcktP5jz7mc&feature=youtube_gdata">http://www.youtube.com/watch?v=pcktP5jz7mc&feature=youtube_gdata</a></div>
<div> </div>
<div>I have also promoted it in a book chapter that will come out next year; I'll excerpt some parts of it below: </div>
<div> </div>
<div>
<p class="MsoBodyText" style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: justify"><span style="FONT-FAMILY: 'Calibri','sans-serif'"><font size="3">The recent Google Book Search settlement negotiations have led Siva Vaidhyanathan to characterize Google’s archive project as evidence of a “public failure.”</font><font size="3"><span style="mso-spacerun: yes"> </span>Whereas government intervention is often necessary in cases of “market failure,” Vaidhyanathan argues that the reverse can occur: market actors can step into a vacuum where government should have been.<span style="mso-spacerun: yes"> </span>In the case of digitized books, the problem is presented starkly: why has the Library of Congress failed to require <i style="mso-bidi-font-style: normal">digital </i>deposit of books, instead of merely accepting paper copies?<span style="mso-spacerun: yes"> </span>We can debate when such a requirement became plausible; however, had the government required such deposit as soon as it became feasible, the problematic possibility of a Google monopoly here would be much less troubling.<span style="mso-spacerun: yes"> </span>If digital deposit ever is adopted, the government could license its corpus to alternative search services.<span style="mso-spacerun: yes"> </span>There is no good reason why the company that is best capable of reproducing books should have a monopoly on search technologies used to organize and distribute them.<span style="mso-spacerun: yes"> </span></font></span><span style="FONT-FAMILY: 'Calibri','sans-serif'; mso-fareast-font-family: 'Times New Roman'; mso-fareast-language: EN-US"></span></p>
<p class="MsoBodyText" style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: justify"><span style="FONT-FAMILY: 'Calibri','sans-serif'"><font size="3"> </font></span></p>
<p class="MsoBodyText" style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: justify"><span style="FONT-FAMILY: 'Calibri','sans-serif'"><font size="3">More ambitiously, an NGO or quasi-administrative NGO (QANGO) could undertake to index and archive the web, licensing opportunities to search and organize it to various entities that promise to maintain open standards for ranking and rating websites and other internet presences.</font><font size="3"><span style="mso-spacerun: yes"> </span>Wikipedia, Slashdot, and eBay all suggest methods of evaluating relevance and authority that could be employed by open search engines.<span style="mso-spacerun: yes"> </span>If such a search engine became at least somewhat popular (or popular within a given niche), it could provide an important alternative source of information and metadata on ranking processes.</font></span></p>
<p class="MsoBodyText" style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: justify"><b style="mso-bidi-font-weight: normal"><span style="FONT-FAMILY: 'Calibri','sans-serif'; mso-bidi-font-family: Arial"><font size="3"> </font></span></b></p>
</div>
<div>
<p class="MsoBodyText" style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: justify"><font size="3"><span style="FONT-FAMILY: 'Calibri','sans-serif'; mso-bidi-font-family: Arial">The need for a public option in search becomes even more apparent when we consider the waste and inefficiency causes by opaque intermediaries in other fields.<span style="mso-spacerun: yes"> </span>Like private health insurers, </span><span style="COLOR: #000033; FONT-FAMILY: 'Calibri','sans-serif'">Google is a middleman, standing between consumers and producers of knowledge. In </span><span style="FONT-FAMILY: 'Calibri','sans-serif'">programs like Book Search, it will effectively collaborate with copyright owners to determine what access knowledge consumers get, how much they have to pay, and on what terms.<span style="mso-spacerun: yes"> </span>In the health field, providers and private insurers are often concentrated industries in the US, and consumers (i.e., the businesses and individuals<span style="COLOR: #000033"> who buy insurance plans) are not. Insurers and providers also jealously guard the secrecy of many pricing decisions.<span style="mso-spacerun: yes"> </span>That is one key reason why<span class="apple-converted-space"> </span>the US spends so much more on health care than other industrialized nations, without getting consistently better results, access, or quality.</span></span><span style="FONT-FAMILY: 'Calibri','sans-serif'; mso-bidi-font-family: Arial"></span></font></p>
<p class="MsoBodyText" style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: justify"><b style="mso-bidi-font-weight: normal"><span style="FONT-FAMILY: 'Calibri','sans-serif'; mso-bidi-font-family: Arial"><font size="3"> </font></span></b></p>
<p class="MsoBodyText" style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: justify"><span style="FONT-FAMILY: 'Calibri','sans-serif'; mso-bidi-font-family: Arial"><font size="3">In contemporary debates on health reform in the US, reformists split into two camps: those who believe that regulation of middlemen like insurers can bring about fair results, and those who believe that only a public option can serve as a benchmark for judging the behavior of private insurers.<span style="mso-spacerun: yes"> </span>Even if the public option in health care falters now, it will remain a policy option in the future if new regulations on private insurers fail to improve their efficiency and quality, or to expand access to care.<span style="mso-spacerun: yes"> </span>If search engines block or frustrate measures to increase their accountability, governments should seriously consider funding public alternatives.<span style="mso-spacerun: yes"> </span></font></span></p>
</div>
<div>
<p style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.5in"><font size="3"><font face="Times New Roman"><em><span style="mso-bidi-font-weight: bold">from The Troubling Trend Toward Trade Secrecy in Search Engine Rankings and Ratings</span></em>, forthcoming in <span style="FONT-VARIANT: small-caps">The Law and Theory of Trade Secrecy: A Handbook of Contemporary Research</span> (Rochelle C. Dreyfuss and Katherine J. Strandburg, eds., Edward Elgar Publishing, forthcoming 2010).</font></font></p>
<p style="MARGIN-LEFT: 0.5in; TEXT-INDENT: -0.5in">As the US considers a second stimulus, let's hope that some visionaries promote a "Cyber WPA) that could carry out some of the ideas mentioned above. A small investment now could pay great dividends in the future. Advances in search technology should not be shackled to ownership of the most comprehensive database of content and search behavior (even if that ownership were monopolized via entirely legitimate means).</p>
</div>
<div>All best,</div>
<div>--Frank</div>
<div> </div>
<div class="gmail_quote">On Thu, Nov 19, 2009 at 2:10 PM, Alexander Halavais <span dir="ltr"><<a href="mailto:halavais@gmail.com">halavais@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="PADDING-LEFT: 1ex; MARGIN: 0px 0px 0px 0.8ex; BORDER-LEFT: #ccc 1px solid">I'm sorry to say I also missed Frank Pasquale's presentation...<br><br>The "security through obscurity" argument that drives the black boxing<br>
of Google's algorithm doesn't eliminate "gaming" the system, it<br>professionalizes it. If the government requires Coke to give us some<br>indication of what goes into their products, isn't it fair to ask<br>
something similar of those who are "organizing the world's<br>information"? There is a middle ground between fully disclosing the<br>algorithm and providing some indication of the policy choices that<br>have gone into its formation.<br>
<br>A robust public option seems to be the most interesting alternative<br>here. The (chiefly French & German) state effort in this direction<br>seems to be dead in the water. There are ways this might be done in a<br>
distributed fashion, but not the collective will to do so yet. It will<br>take some much clearer outrages on the part of Google before that<br>changes...<br><br>- Alex<br>
<div class="im"><br>On Thu, Nov 19, 2009 at 3:08 AM, Zbigniew Lukasiak <<a href="mailto:zzbbyy@gmail.com">zzbbyy@gmail.com</a>> wrote:<br></div>
<div>
<div></div>
<div class="h5">> Hi there,<br>><br>> I have not been at the conference and I don't know if this point was<br>> raised, if it was then - please forgive me.<br>><br>> On Wed, Nov 18, 2009 at 6:28 AM, nathan jurgenson<br>
> <<a href="mailto:nathanjurgenson@gmail.com">nathanjurgenson@gmail.com</a>> wrote:<br>>> Frank Pasquale forcefully called on Google to be more transparent. Given<br>>> what was discussed above, as well as Google’s central status in our<br>
>> day-to-day knowledge-seeking life, Pasquale leaves us with questions to<br>>> ponder: should its page-rank algorithm be public? Should Google be allowed<br>>> to up-rank or down-rank links based their relationship to the company?<br>
>> Should Google be able to simply remove pages from its listings? Should<br>>> Google be forced to let us know when they do these things? ~nathan<br>><br>> I am also more and more afraid of the kafquesque world of Google<br>
> government of our information sources - but they do have a valid point<br>> for the secrecy of page-rank: this is about defending against those<br>> that try to game the system. If the page-rank algorithm was public it<br>
> would be analysed and effective ways to game it would be found and we<br>> would drown under the deluge of spam. Now there are still people and<br>> companies that try to analyse the black-box - but at least their<br>
> actions cannot be very effective.<br>><br>> If we are to be constructive in our criticism Google for the black-box<br>> algorithm we should also propose some alternative. Most probably<br>> there is no alternative that Google could unilaterally deploy - most<br>
> probably this would require a complex web of law, social norms and<br>> technical changes. This would be an interesting project.<br>><br>> Cheers,<br>> Zbigniew Lukasiak<br>> <a href="http://brudnopis.blogspot.com/" target="_blank">http://brudnopis.blogspot.com/</a><br>
> <a href="http://perlalchemy.blogspot.com/" target="_blank">http://perlalchemy.blogspot.com/</a><br>> _______________________________________________<br>> iDC -- mailing list of the Institute for Distributed Creativity (<a href="http://distributedcreativity.org/" target="_blank">distributedcreativity.org</a>)<br>
> <a href="mailto:iDC@mailman.thing.net">iDC@mailman.thing.net</a><br>> <a href="https://mailman.thing.net/mailman/listinfo/idc" target="_blank">https://mailman.thing.net/mailman/listinfo/idc</a><br>><br>> List Archive:<br>
> <a href="http://mailman.thing.net/pipermail/idc/" target="_blank">http://mailman.thing.net/pipermail/idc/</a><br>><br>> iDC Photo Stream:<br>> <a href="http://www.flickr.com/photos/tags/idcnetwork/" target="_blank">http://www.flickr.com/photos/tags/idcnetwork/</a><br>
><br>> RSS feed:<br>> <a href="http://rss.gmane.org/gmane.culture.media.idc" target="_blank">http://rss.gmane.org/gmane.culture.media.idc</a><br>><br>> iDC Chat on Facebook:<br>> <a href="http://www.facebook.com/group.php?gid=2457237647" target="_blank">http://www.facebook.com/group.php?gid=2457237647</a><br>
><br>> Share relevant URLs on <a href="http://del.icio.us/" target="_blank">Del.icio.us</a> by adding the tag iDCref<br><br><br><br></div></div>--<br><font color="#888888">--<br>//<br>// This email is<br>// [x] assumed public and may be blogged / forwarded.<br>
// [ ] assumed to be private, please ask before redistributing.<br>//<br>// Alexander C. Halavais, ciberflâneur<br>// <a href="http://alex.halavais.net/" target="_blank">http://alex.halavais.net</a><br></font>
<div>
<div></div>
<div class="h5">//<br>_______________________________________________<br>iDC -- mailing list of the Institute for Distributed Creativity (<a href="http://distributedcreativity.org/" target="_blank">distributedcreativity.org</a>)<br>
<a href="mailto:iDC@mailman.thing.net">iDC@mailman.thing.net</a><br><a href="https://mailman.thing.net/mailman/listinfo/idc" target="_blank">https://mailman.thing.net/mailman/listinfo/idc</a><br><br>List Archive:<br><a href="http://mailman.thing.net/pipermail/idc/" target="_blank">http://mailman.thing.net/pipermail/idc/</a><br>
<br>iDC Photo Stream:<br><a href="http://www.flickr.com/photos/tags/idcnetwork/" target="_blank">http://www.flickr.com/photos/tags/idcnetwork/</a><br><br>RSS feed:<br><a href="http://rss.gmane.org/gmane.culture.media.idc" target="_blank">http://rss.gmane.org/gmane.culture.media.idc</a><br>
<br>iDC Chat on Facebook:<br><a href="http://www.facebook.com/group.php?gid=2457237647" target="_blank">http://www.facebook.com/group.php?gid=2457237647</a><br><br>Share relevant URLs on <a href="http://del.icio.us/" target="_blank">Del.icio.us</a> by adding the tag iDCref<br>
</div></div></blockquote></div><br>