Wednesday, 6 June 2018

New research needs to be better reported and librarians can help with that

Image of Andy Tattersall
Andy Tattersall

I delivered a talk at the 'This is not a Fake News  Conference' hosted by the London South Bank University on June 5th. The conference was aimed at librarians and information professionals but also had members of the academic publishing sector, journalists and academics in attendance. My slides and abstract are below and you can read more about the conference here


New research needs to be better reported and librarians can help with that

Scientific research is increasingly being given coverage and attention in the media. The problem is that the media often fail to acknowledge who actually carried out the research and link to a publicly available version of that work or institute. This can lead to misreporting (sometimes intentional) and biased news coverage. Whilst academics, collaborators and institutions do not get the credit they deserve. As the REF and impact agenda become increasingly more important, so does the accurate reporting and collection of such impact, through such as altmetrics and media monitoring. Without citing and linking back to the work it becomes harder to track as a story takes on a life of its own through social media and reposts. Linking to the research makes it harder to misreport or cherry pick facts and stats as interested parties are able to check the facts for themselves. At a time when we have been told ‘people have had enough of experts’ and world leaders denouncing scientific fact, proper and accurate reporting of research has never mattered more. There are a few important things librarians can do to support the better reporting of research through encouraging linking to the open access versions and exploring how research is received through altmetrics. This talk will explore the issue and what can be done to tackle it.


Monday, 4 June 2018

Andy Tattersall and Mark Clowes write for the latest issue of MmIT Journal

Image of Andy Tattersall
Andy Tattersall
Image of Mark Clowes
Mark Clowes
Andy Tattersall and Mark Clowes have written articles for the latest edition of the MmIT Journal. Andy Tattersall has penned a piece on using the superb software Adobe Spark to create short animated videos; whilst he has co-authored a piece with Mark on their work in setting up a pop up radio station to support the Sheffield Based charity Inspiration for Life and their yearly 24 Hour Inspire event. 





Both articles can be read in the latest issue online. MmIT is the open access journal for the Cilip special interest group Multimedia Information Technology. You can find out more about MmIT here. 

Thursday, 17 May 2018

Andy Tattersall to deliver Keynote at the Business Librarians Association Conference

Information Specialist Andy Tattersall is one of the three keynotes at this year's BLA Conference taking place at Swansea University. The three day conference takes place from 27th-29th June with the theme 'Making Waves'. Andy will be delivering his keynote on the 28th with a talk titled; "Staying afloat in a sea of technological change". 

The other two keynote speakers are 
Michael Draper, Associate Professor in Law, Swansea University and Professor Sally Bradley, Academic Lead in Accreditation, Award and Recognition, HEA and Professor, Sheffield Hallam University.
The conference web page and booking details can be viewed here

Thursday, 19 April 2018

Andy Tattersall's talk on Altmetrics at The British Psychological Society Research Day

Andy Tattersall was invited to give a talk about Altmetrics at The British Psychological Society Research Day held at the impressive Senate House Library in March. The recording of the talk and his participation in the final panel discussion can be viewed below. the slides are also at the end of this blog post.

Tuesday, 10 April 2018

Many a true word is spoken in jest, part two: more social media content that mocks, self-ridicules, and brings a smile to academia

Image of Andy Tattersall
Andy Tattersall
Two years ago, Andy Tattersall highlighted those Twitter accounts that offered some light relief from the often all-too-serious world of academia. This 2018 instalment includes an account “sadly” overlooked last time, as well as moving beyond the Twittersphere to share some the best memes, videos, and more to provide sharp commentary on peer review, academic advisors, and altmetrics.

In April 2016 I wrote about the growing number of parody Twitter accounts that take the best and worst of academia and serve it up as a comedy dish. As the title suggests, many a true word is spoken in jest but we all know that just below the surface lie the real home truths of our industry. The problem, however, for many academics trying to be “witty”, is that they can fall flat on their face. I thought it would be good to visit some of the other tongue-in-cheek academic excursions that capture the weird and wonderful within academia.

When I wrote the first post it was solely focused on the Twitter community, and sadly neglected to include one of the scholarly Twitterati’s most vocal protagonists - @ScientistTrump. When my post went live I was flattered to receive a tweet from Donald Trump, PhD calling my piece “biased” as it had not included him - he even concluded his tweet with one of the real Donald Trump’s trademark sign-offs: “SAD”. Thankfully the Trump obsession with fake news was not yet in full flow, but I am sure the post and the LSE Impact Blog would have been labelled as such. Whoever is behind this great account - and it is the greatest scientific Twitter account - has expanded to a full website and a forthcoming web store. Not wanting to inflate that already fully blown narcissistic ego any more, but the tweets are that of a very stable genius and reflect the kind of communication that is typical of President Trump but with a scientific slant applied. For example, in December Donald Trump, PhD proudly reported:

https://twitter.com/ScientistTrump/status/943093184384655361
His supporters will no doubt still be keen to see that wall built to ensure academic literature stays out of the public domain.

Given the daily communications coming out of the White House, it is not hard to satirise the 45th President of the United States. Putting an academic spin on The Donald is not so easy but Psychologist Matt Crawford made a good go of it with a fictional paper he published. The paper titled “A title for a really great piece of research, just the best, really” is full of classic Trump boasts, so much so that you will hear Donald’s voice inside your head as you read it.

https://twitter.com/MCrawford221/status/715835369170796544

Donald Trump’s tweets might make you feel outraged, but imagine how your social media stream would have looked with Hitler kicking and screaming across the web? Putting an academic slant on it, how would he have dealt with scientific peer review? Thankfully someone took that much-parodied scene in Hitler’s bunker from the film Downfall and re-subtitled it to show how Hitler would have responded to negative comments from the third reviewer. After a raging tirade, the Führer concedes that maybe he should just submit to one of those new “open access” journals.

Captioned images shared across the web, better known as memes, also offer much light-hearted humour that only those within academia will truly get. Some of the sharpest include the popular memes Boromir (Lord of the rings) and Willy Wonka alongside the tweets from Research Wahlberg and the Hey Girl. I like the library too blog.

https://twitter.com/ResearchMark/status/743502152367210496

A personal favourite comes from that most cosmic of sages, Yoda:

https://twitter.com/AcademicsSay/status/792860220020121601

Some of the finest moments can be found by searching “academic meme”s on Google Image Search or Pinterest.

Every institution has professors who are dapper in their fashion choices and those who look like they have crawled out of a hedge before heading into work. Prof or Hobo tests your ability to spot the professors from the tramps. I was made aware of the quiz by a professor in reference to one of his peers who proudly wears his dishevelled look as a badge of honour, actively trying his best to look like he lost a fight with a bear. The site features ten images and for each you simply have to choose whether the man in question is a professor or a hobo. Just remember that looks can be deceiving.

Whilst we are on the topic of chairs, there are also the kind you sit on to conduct your research. In case you wondered what happened to them after they were retired from duty, they appear on the Sad Chairs of Academia blog. Before they are dispatched to that great office in the sky, they are captured for one last time for this most surreal of blogs. I’m waiting for the best images to be compiled into a 2019 calendar.

Metrics and social media are never are far away from academic discussion, and both are valuable tools in communicating and gauging interest in a piece of research. The two are combined perfectly to calculate the satirical Kardashian Index where a scientist’s citations are compared to followers on Twitter. Of course citations and Twitter followers are no true measure as to a researcher’s true worth, but those with a high Kardashian Index score could indicate popularity over productivity. We are eagerly awaiting the Kanye West Index.

For most publishing in the academic sphere, you will no doubt receive regular invites to write for predatory journals. Whilst this issue becomes increasingly problematic there are a few things you can do to tackle these charlatans whilst also having a bit of fun. One idea is to use the tool Re:Scam which is part of the New Zealand online safety website Netsafe. This tool bounces replies back to scam emailers and keeps them tied up with computer-generated emails. Whether this will work with those actually sending out the phishing messages will be hard to tell, but it’s certainly worth a try in case any are bots. If that fails you can do as I did (in my lunch break) after receiving several requests to publish in a dubious fisheries and agriculture journal. I sent them a PDF formatted manuscript with the word “fish” repeated 6000 times, with a few fishy references to Jacques Cousteau and Michael Fish thrown in too, in addition to a table of different fish. For some reason they did not accept. Nor did they ever contact me again. Funny that.

The article originally appeared on the LSE Impact of Social Sciences Blog

Wednesday, 28 March 2018

Calling Australia!

Members of the Information Resources team recently hosted an online course for librarians based in Australia.   Led by Anthea Sutton, the FOLIO programme has been delivering web-based CPD courses to library and information professionals for over a decade.

Recently, FOLIOz (see what we did there?) has been partnering with ALIA, the Australian Library and Information Association to offer bespoke training catering for the needs identified by its members.

For the latest course, on Evidence-Based Library and Information Practice (EBLIP for short), Anthea was joined by a small team including Andrew Booth, Helen Buckley Woods and Mark Clowes to design and deliver the course content (which included video lectures, readings and assessed course work); as well as facilitating the group discussion boards and hosting two live webinars (a particular challenge given the time difference between ourselves in the UK and our participants "down under").   We were also delighted to welcome Professor Alison Brettle (from Salford University) to deliver a guest lecture on the future of EBLIP.

The course attracted participants from a range of sectors, including education and public libraries as well as from health - all keen to apply an evidence-based approach to solving problems and achieving best practice in the settings of their different services.

As one delegate commented: "This course is right on point as far as the skills I need to develop so our unit can reach its goals."


If you are interested in discussing how FOLIO could help with the training needs of your library/information team, please get in touch with us at folio@sheffield.ac.uk










Wednesday, 21 March 2018

What Can Altmetric.com Tell Us About Policy Citations of Research? An Analysis of Altmetric.com Data for Research Articles from the University of Sheffield

Image of Andy Tattersall
Andy Tattersall
Image of Chris Carroll
Chris Carroll              
Andy Tattersall (ScHARR Information Resources) and Dr Chris Carroll (ScHARR Health Economics and Decision Science) have published a new paper in Frontiers in Research Metrics and Analytics. The paper looked at published University of Sheffield research and what the data says about the impact of its research on national and international policy. The percentage of outputs with at least one policy mention compares favourably with previous studies, while huge variations were found between the time of publication and the time of the first policy citation. However, some problems with the quality of the data were identified, highlighting the need for careful scrutiny and corroboration.
 
Altmetrics offers all kinds of insights into how a piece of research has been communicated and cited. In 2014 Altmetric.com added policy document tracking to its sources of attention, offering another valuable insight into how research outputs are used post-publication. At the University of Sheffield we thought it would be useful to explore the Altmetric.com data for policy document citations to see what impact our work is having on national and international policy.

We analysed all published research from authors at the University of Sheffield indexed in the Altmetric.com database; a total of 96,550 research outputs, of which we were able to identify 1,463 pieces of published research cited between one and 13 times in policy. This represented 0.65% of our research outputs. Of these 1,463 artefacts, 21 were cited in five or more policy documents, with the vast majority – 1,185 documents – having been cited just once. Our sample compared very well with previous studies by Haunschild and Bornmann, who looked at papers indexed in Web of Science and found 0.5% were cited in policy, and Bornmann, Haunschild and Marx, who found 1.2% of climate change research publications with at least one policy mention. From our sample we found 92 research articles cited in three or more policy documents. Of those 92 we found medicine, dentistry, and health had the greatest policy impact, followed by social science and pure science.

We also wanted to explore whether research published by the University of Sheffield had a limited time span between publication and policy citation. We looked at the time lag and found it ranged from just three months to 31 years. This highlighted a long tail of publications influencing policy, something we would have struggled to identify prior to Altmetric.com without manual trawling. The earliest piece of research from our sample to be cited in policy was published in 1979 and took until 2010 before receiving its first policy citation. We manually checked the records as we found many pre-1979 publications to have been published much later, often this century. This is likely due to misreported data in the institutional dataset, giving a false date; highlighting the need to manually check such records for authenticity. The shortest time between research publication and policy citation was a mere three months: a paper published in November 2016 and first cited in National Institute for Health and Care Excellence (NICE) policy in January 2017.

The Altmetric.com reports are only as good as the data they analyse and our research did uncover some errors. Looking at those 21 papers with more than five policy document citations, we found seven were not fit for inclusion. One such example was identified when we discovered research papers had been attributed to the University of Sheffield when the authors were not, in fact, affiliated to the university. As this data is sourced from our research publications system, we assume this was a mistake made by the author; this can happen when authors incorrectly accept as their own papers suggested to them by the system. While this was almost certainly a genuine error, and may have been rectified later, the system had not yet updated to take account of such corrections. Another of these papers was mistakenly attributed to an author who had no direct involvement in the paper but who was part of a related wider research project. Another of the publications was excluded due to it not, in fact, having actually been cited in the relevant policy document. One of the papers that was included belonged to an author not at Sheffield at the time of publication, but who has since joined the institution. This showed that Altmetric.com’s regular updates were able to discover updated institutional information and realign authors with their current employer.

The two most cited papers came from our own department, the School of Health and Related Research (ScHARR), in the field of health economics. Only two of the 14 most cited publications were in a field other than health economics or pure economics, both of which were in environmental studies. In total, the 14 most cited research outputs were cited by 175 policy documents, but we identified 9% (16) of these as duplicates. Of those 175 citations we found that 61% (107) were national, i.e. from the UK, and 39% (68) were international, i.e. from countries other than the UK or from international bodies such as the United Nations or World Health Organization.

Altmetric.com continues to add further policy sources to its database to trawl for citations. As a result, it should follow that our sample of 1,463 research outputs will not only grow with more fresh policy citations, but as older research citations are identified through new policy sources of attention. This work also highlights the importance of research outputs having unique identifiers so they can be tracked through altmetric platforms; it is certain that more of our research will be cited in policy, but if no unique identifier is attached, especially to older outputs, it is unlikely the Altmetric.com system will pick it up.
Altmetric.com is a very useful indicator of interest in and influence of research within global policy. Yet there are clearly problems with the quality of the data and how it is attributed to subsequent Altmetric.com data. We found one third of our sample of the 21 most cited research outputs had been erroneously attributed to an institution or author. Whether this is representative of the whole dataset only further studies will find out. Therefore it is essential that any future explorations of research outputs and policy document citations be double-checked and not taken on face value.

This blog post is based on the authors’ article, “What Can Altmetric.com Tell Us About Policy Citations of Research? An Analysis of Altmetric.com Data for Research Articles from the University of Sheffield”, published in Frontiers in Research Metrics and Analytics (DOI: 10.3389/frma.2017.00009).

The blog post was originally written for the LSE Impact Blog and is licensed under a Creative Commons Attribution 3.0 Unported License unless otherwise stated. The original article appears here 
 
Creative Commons Licence