Transcript Google: The answer to life, the universe and everything? The Anybook Oxford Libraries Conference 2015 University of Oxford, Andrew Wiles Building Tuesday, 21st July.

Google: The answer to life, the universe
and everything?
The Anybook Oxford Libraries Conference 2015
University of Oxford, Andrew Wiles Building
Tuesday, 21st July 2015
Karen Blakeman, RBA Information
Services
[email protected]
twitter.com/karenblakeman
http://www.rba.co.uk/as/
Photo of the Andrew Wiles building taken by Karen
Blakeman and licensed Creative Commons Public
Domain dedication
This work is licensed under a Creative Commons Attribution-ShareAlike International License.
11/6/2015
www.rba.co.uk
1
11/6/2015
www.rba.co.uk
2
11/6/2015
www.rba.co.uk
3
11/6/2015
www.rba.co.uk
4
http://searchengineland.com/google-now-on-tap-finds-answers-navigatesbetween-apps-without-search-222780
11/6/2015
www.rba.co.uk
5
Google's Eric Schmidt: 'The Internet Will
Disappear‘ CNBC - YouTube
https://www.youtube.com/watch?v=Tf49
T45GNd0
11/6/2015
www.rba.co.uk
6
http://www.engadget.com/2015/07/07/google
-self-driving-tests-austin-texas/
11/6/2015
www.rba.co.uk
7
Nest, Google and beyond: how much technology do we really want in our
homes?
http://www.theguardian.com/artanddesign/2014/jun/27/-sp-the-nestgoogle-technology-future-homes
11/6/2015
www.rba.co.uk
8
http://www.itproportal.com/2
015/06/11/googles-newcompany-wants-to-redesigncity-living/
11/6/2015
www.rba.co.uk
9
Artificial Intelligence machine plays video games like a pro - CBBC
Newsround http://www.bbc.co.uk/newsround/31633702
Google buys two more UK artificial intelligence startups
http://www.theguardian.com/technology/2014/oct/23/google-uk-artificialintelligence-startups-machine-learning-dark-blue-labs-vision-factory
Google buys UK artificial intelligence startup Deepmind for £400m
http://www.theguardian.com/technology/2014/jan/27/google11/6/2015
www.rba.co.uk
acquires-uk-artificial-intelligence-startup-deepmind
10
Google wants to rank websites based on facts not links - 28 February 2015 New Scientist http://www.newscientist.com/article/mg22530102.600-googlewants-to-rank-websites-based-on-facts-not-links.html
http://arxiv.org/abs/1502.03519
11/6/2015
www.rba.co.uk
11
New Google, New Challenges http://www.cilip.org.uk/uk-einformationgroup/elucidate-ukeigs-journal/elucidate-current-issue/new-googlenew-challenges
The Internet of Things (IoT): Creating Really Big Data
http://www.cilip.org.uk/uk-einformation-group/elucidate-ukeigsjournal/elucidate-current-issue/internet-things-iot-creating
11/6/2015
www.rba.co.uk
12
Google no longer looks at keywords in isolation
Tries to make “sense” of your search and put it into context, natural
language queries, uses what others have searched and clicked on
Artificial intelligence part of the mix?
Heavy personalisation
Constantly changing – all bets are off when it comes to predicting
what your results will look like
How you ask your question is taken into account, device you are
using is taken into account
Providing Quick Answers and “facts”, extracts from websites giving
you the “answer”
11/6/2015
www.rba.co.uk
13
Compare
11/6/2015
compare chocolate with banana
www.rba.co.uk
14
11/6/2015
www.rba.co.uk
15
11/6/2015
www.rba.co.uk
16
11/6/2015
www.rba.co.uk
17
And then on another day...
11/6/2015
www.rba.co.uk
18
http://googlesystem.blogspot.co.uk/2013/11/googleknowledge-graph-gets-confused.html
11/6/2015
www.rba.co.uk
19
One of many wrong Quick Answers submitted to me by a
delegate at a recent conference
Many thanks to Philip Stirups for the example. About 24 hours after taking this
screen shot Google corrected the error.
11/6/2015
www.rba.co.uk
20
EU - so called “right to be forgotten” ruling
Mario Costeja Gonzalez
Edition of Monday, January 19, 1998, page 23 Newspaper - Lavanguardia.es
http://hemeroteca.lavanguardia.com/preview/19
98/01/19/pagina-23/33842001/pdf.html
EU Court of Justice ruled that Google is a “data
controller” under Data Protection legislation
and must remove, if requested, links to
information that is “inadequate, irrelevant .... or
excessive” from search results on a person’s
name.
11/6/2015
www.rba.co.uk
21
EU - so called “right to be forgotten” ruling
Information is NOT removed from the web, only the link to
information in the search results
Not automatic – subject has to apply to have links that point to
specific information about themselves removed from the
results. Google may decide not to remove.
Google accidentally reveals data on 'right to be forgotten'
requests
http://www.theguardian.com/technology/2015/jul/14/googleaccidentally-reveals-right-to-be-forgotten-requests
Not just Google – all search engines with an EU presence
At present it only applies to searches conducted in the EU +
Norway, Switzerland, Iceland and Lichtenstein but may
become worldwide.
06/11/2015
www.rba.co.uk
22
EU - so called “right to be forgotten” ruling
Google adds removal statement from all results for searches on
personal names even if nothing has been removed. (Does not
apply to public figures, famous people or celebrities)
Use non-European Google to see all results e.g. Google.com,
Google.ca but France and others want all country versions of
search engines to remove links
Russian Parliament Approves "Right To Be Forgotten" In Search
Engines http://searchengineland.com/russia-right-to-forget224466
06/11/2015
www.rba.co.uk
23
Google automatically looks for variations on your search terms
and sometimes drops terms from your search
– Google now tells you which terms it has ignored (some of the
time)
– “..” around terms, phrases, names, titles of documents does not
always work
– To force an exact match and inclusion of a term in a search prefix
it with ‘intext:’
intext:agricultural occupational asthma
– Use Verbatim for an exact match search
11/6/2015
www.rba.co.uk
24
Google Verbatim
06/11/2015
www.rba.co.uk
25
Google web search does not search everything it has in its
database
– two indexes: main, default index and the supplemental index
– supplemental index may contain less popular, unusual, specialist
material
– supplemental index comes into play when Google thinks your
search has returned too few results
– Verbatim and some advanced search commands seems to
trigger a search in the supplemental index
11/6/2015
www.rba.co.uk
26
“Normal search”
204,000
06/11/2015
Search after Verbatim is applied
946,000
www.rba.co.uk
27
Think file format
PDF for research documents, government reports, industry papers
ppt or pptx for presentations, tracking down an expert on a topic
xls or xlsx for spreadsheets containing data
Use the advanced search screen or filetype:
UK waste vegetable oil energy generation filetype:pdf
UK waste vegetable oil energy generation filetype:ppt
UK waste vegetable oil energy generation filetype:pptx
UK waste vegetable oil energy generation filetype:xls
UK waste vegetable oil energy generation filetype:xlsx
11/6/2015
www.rba.co.uk
28
Google commands
Site search
For searching large websites, or groups of sites by type for
example government, NHS, academic
Can exclude sites using -site:
agricultural occupational asthma UK site:nhs.uk
agricultural occupational asthma UK site:ac.uk
agricultural occupational asthma UK site:www.gov.uk
agricultural occupational asthma UK site:gov.uk
agricultural occupational asthma UK site:gov.uk
-site:hse.gov.uk
11/6/2015
www.rba.co.uk
29
Date/Any time
Restrict your results to information that has been published
within the last hour, day, week, month, year or your own date
range
Search tools, Any time and select an option [does NOT work
with Verbatim]
06/11/2015
www.rba.co.uk
30
daterange:
Date/Any time menu option can not be used with Verbatim
Use daterange: command instead
Uses Julian date format (fractions omitted)
Julian Date Converter, and information on Julian date format) is
at http://aa.usno.navy.mil/data/docs/JulianDate.php/
Convert your dates to the Julian format and then, omitting the
fractions, copy and paste them into your search
Syntax
– for example articles between September 1st and November 1st
2014 on the roll out of universal credit
universal credit announcement
daterange:2456901-2456962
Then apply Verbatim to the results page
06/11/2015
www.rba.co.uk
31
06/11/2015
www.rba.co.uk
32
Run your search and then apply Verbatim
06/11/2015
www.rba.co.uk
33
http://www.google.com/publicdata/
Google Public Data Explorer - minimum wage search
Some countries were missing
e.g. Germany
11/6/2015
www.rba.co.uk
34
Eurostat - Minimum Wage
11/6/2015
www.rba.co.uk
35
Google Scholar http://scholar.google.com/
11/6/2015
www.rba.co.uk
36
Google Patents http://patents.google.com/
Free sources for patent searching
http://bir.sagepub.com/content/31/4/216.abstract
Full-text patent searching on free websites
http://bir.sagepub.com/content/31/4/226.abstract
11/6/2015
www.rba.co.uk
37
books.google.com
Or use the Books option under More on the results page.
Includes archives of some magazines and newspapers
11/6/2015
www.rba.co.uk
38
Other search tools
11/6/2015
www.rba.co.uk
39
Bing/Yahoo
Yahoo now uses Bing’s database, commands and ranking algorithms
Yahoo Finance still available
No advanced search screen on Bing - use commands
List at Advanced Operator Reference http://msdn.microsoft.com/enus/library/ff795620.aspx
filetype:
site:
inbody:
intitle:
AND, NOT, OR parentheses for complex Boolean searches
near:n where n is a number, specifies that the terms must be within
that number of words of each other and in any order
11/6/2015
www.rba.co.uk
40
bingiton.com
11/6/2015
www.rba.co.uk
41
DuckDuckGo – http://duckduckgo.com/
Does not track, does not personalise
Results are a compilation of about 50 sources including
Wikipedia, Wolfram Alpha, Bing, and its own Web crawler
DuckDuckBot. “In partnership with Yandex”
Advanced search commands include:
site: inbody: intitle: filetype:
region:cc (e.g. de) to boost a country
DuckDuckGo Syntax
http://help.duckduckgo.com/customer/portal/articles/300304
DuckDuckGo – silly name but a neat little search tool
http://www.rba.co.uk/wordpress/2011/11/07/duckduckgo-silly-name-buta-neat-little-search-tool/
11/6/2015
www.rba.co.uk
42
Million Short
11/6/2015
www.rba.co.uk
43
Carrotsearch http://carrotsearch.com/
11/6/2015
www.rba.co.uk
44
eTools.ch
11/6/2015
www.rba.co.uk
45
Specialist search tools
11/6/2015
www.rba.co.uk
46
Institutional repositories and open access
BASE - Bielefeld Academic Search Engine http://www.base-search.net/
CORE (COnnecting Repositories) http://core.kmi.open.ac.uk/search
DART-Europe E-theses Portal http://www.dart-europe.eu/basic-search.php
DOAJ: Directory of Open Access Journals http://www.doaj.org/
British Library EThOS - Search and order theses online http://ethos.bl.uk/
Open DOAR http://opendoar.org/
RIAN - Pathways to Irish Research http://rian.ie
ROAR - Registry of Open Access Repositories http://roar.eprints.org/
OpenAIRE http://www.openaire.eu/
11/6/2015
www.rba.co.uk
47
Specialist search tools for research information
ArXiv http://arxiv.org/
BioMed Central http://www.biomedcentral.com/
Chemistry Central http://www.chemistrycentral.com/
ChemSpider http://www.chemspider.com/
Deep Web Technologies
Mednar http://mednar.com/
Science.gov http://www.science.gov/
Science Research http://scienceresearch.com/
WorldWideScience http://worldwidescience.org/
11/6/2015
www.rba.co.uk
48
Specialist search tools for research information
Europe PubMed Central http://europepmc.org/
Open Biology http://rsob.royalsocietypublishing.org/
PhilPapers: Online Research in Philosophy http://philpapers.org/
PubMed Central http://www.ncbi.nlm.nih.gov/pmc/
SSRN http://www.ssrn.com/en/
11/6/2015
www.rba.co.uk
49
ResearchGate - http://www.researchgate.net/
11/6/2015
www.rba.co.uk
50
Slideshare.net
11/6/2015
www.rba.co.uk
51
Oh joy - NOT!
More UK information vanishes into GOV.UK
http://www.rba.co.uk/wordpress/2015/02/28/more-uk-informationvanishes-into-gov-uk/
11/6/2015
www.rba.co.uk
52
http://www.nationalarchives.gov.uk/webarchive/
11/6/2015
www.rba.co.uk
53
http://www.webarchive.org.uk/ukwa/
11/6/2015
www.rba.co.uk
54
Wayback Machine http://www.archive.org/
11/6/2015
www.rba.co.uk
55
Digital Education Resource Archive (DERA)
http://dera.ioe.ac.uk/
11/6/2015
www.rba.co.uk
56
http://www.offstats.auckland.ac.nz/
11/6/2015
www.rba.co.uk
57
The Guardian http://www.theguardian.com/data
11/6/2015
www.rba.co.uk
58
Spurious correlations!
Per capita consumption of cheese (US) correlates with Number of
people who died by becoming tangled in their bedsheets
http://www.tylervigen.com/view_correlation?id=7
11/6/2015
www.rba.co.uk
59
News
For tracking down individual newspapers
– http://www.abyznewslinks.com/
Google News
– advanced search options limited and not always reliable
– no source list and sources frequently change
– key industry publications may not be included and definitely not
included if subscription
Use Google news and web search to identify specialist news
portals or aggregators for your subject and monitor those direct
06/11/2015
www.rba.co.uk
60
Social and professional networks
06/11/2015
www.rba.co.uk
61
06/11/2015
www.rba.co.uk
62
Topsy.com
06/11/2015
www.rba.co.uk
63
Topsy analytics and advanced
search
06/11/2015
www.rba.co.uk
64
Meltwater Icerocket blogs trend tool
www.icerocket.com/c?p=trend
06/11/2015
www.rba.co.uk
65
Boardreader http://boardreader.com//
11/6/2015
www.rba.co.uk
66
What could possibly go wrong?
Unofficial Facebook page
Fake Facebook page
Parody account
06/11/2015
www.rba.co.uk
67
Further reading
Search Strategies - Search Tools Summary and Comparison
http://www.rba.co.uk/search/compare.shtml
Inside Search Power Searching with Google
http://www.powersearchingwithgoogle.com/
Search Engine Watch http://searchenginewatch.com/
Search Engine http://searchengineland.com/
Search Engine Roundtable http://www.seroundtable.com/
Phil Bradley's weblog http://www.philbradley.typepad.com/
Karen Blakeman's Blog | News and comments on search tools
and electronic resources for research
http://www.rba.co.uk/wordpress/
11/6/2015
www.rba.co.uk
68
11/6/2015
www.rba.co.uk
69