Wikipedia:Wikipedia Signpost/2015-11-25/Recent research

Do Wikipedia citations mirror scholarly impact?; co-star networks in silent films: Scholarly research about Wikipedia and related projects.

Recent research

Do Wikipedia citations mirror scholarly impact?; co-star networks in silent films

By Daniel Mietchen, Guillaume Paumier, Piotr Konieczny, and Tilman Bayer

A monthly overview of recent academic research about Wikipedia and other Wikimedia projects, also published as the Wikimedia Research Newsletter.

"Are Wikipedia citations important evidence of the impact of scholarly articles and books?"

Reviewed by Piotr Konieczny

This paper contributes to the discussion of the relation of Wikipedia and academia, in the context of the use of academic publications on Wikipedia. The authors looked at whether articles and academic books (monographs) indexed in the Scopus database (302,328 articles and 18,735 books) are cited by Wikipedia, other articles, and books. They found that only about 5% of all academic articles are cited on Wikipedia, compared with about 33% of books. Arts, humanities and social science books are cited almost twice as often as those from natural and medical sciences. The authors conclude that Wikipedia citations are not strongly related to scientific impact, but more so to the work's educational and cultural one. They further conclude that Wikipedia citations are likely a good source for understanding the work's non-scholarly impact, particularly for books. On that note, while the authors discuss some limitations of their study, they do not address the topic of open access, which could explain the discrepancy between the use of books (many of which are at least partially available through online through Google Books, a database the authors themselves used as well in this study) and articles (most of which are not available to an average reader). Therefore the authors' conclusion should be moderated by the fact that while in Wikipedia is not currently citing the majority of academic articles, as said majority is not readily available to the project contributors, further research is needed on whether Wikipedia can be used to understand the impact of scholarly open access sources. (See also the review of a related paper in our August issue: "Amplifying the Impact of Open Access: Wikipedia and the Diffusion of Science".)

Greta Garbo and Ricardo Cortez linked together (d:Q638165#claims) in the 1926 silent film "Torrent"

Exploration of co-stardom networks between 1920 and 1930 using Wikidata

Reviewed by Guillaume (WMF)

In this blog post, Pierre-Carl Langlais relates how he used actor–movie relationships from Wikidata to graph and examine co-stardom networks in the 1920s and 1930s. His exploration, based on the assumption that transnational collaborations were easier in silent films productions, aimed to determine whether co-stardom networks tightened by country after the move to spoken film.

The author queried actor–movie data from Wikidata, processed it with R to create actor–actor relationships, and created graphs using Gephi for two periods: 1920–29 and 1930–39. He found that (software-determined) clusters of actors did seem to follow countries for the 1930–1939 period, with some overlap for countries with the same language. However, the software had less success identifying clusters for the 1920–1929 period. Some clusters mixed different countries, and some countries were split into several clusters. The author invited readers to explain those results. He also highlighted the case of transnational actors like Greta Garbo and Maurice Chevalier.

Briefly

"Editing for equality: the outcomes of the Art+Feminism Wikipedia edit-a-thons"

Reviewed by Piotr Konieczny

This article discusses the Art and Feminism Wikipedia edit-a-thon, an event the authors describe as the largest of such events ever. Framed in the context of importance of gendered activism and information activism for librarians, it discusses what the authors perceive as a growing collaboration between gender and information activists that also includes Wikipedia GLAM activists. The article presents an interesting overview of this developing movement.

Research at Wikimania 2016

By Daniel Mietchen

The planning for next year's Wikimania is in full swing. The organizers are experimenting with approaches that differ from those of previous years, and that includes asking the community a bit more explicitly as to what issues they'd like to see covered and what they'd like to learn about during Wikimania. One of the topics considered for this advance feedback is research, which is understood to encompass Wikimedia coverage of research-related topics as well as research on Wikimedia-related topics, and everything in between. How should such research-related topics be addressed by the event? If you have suggestions in this regard, please put them forward here. Thanks!

Other recent publications

A list of other recent publications that could not be covered in time for this issue – contributions are always welcome for reviewing or summarizing newly published research.

• "Do experts or collective intelligence write with more bias? Evidence from Encyclopædia Britannica and Wikipedia." From the abstract: "We evaluate these questions empirically by examining slanted and biased phrases in content on US political issues from two sources—Encyclopædia Britannica and Wikipedia. ... Using a matched sample of pairs of articles from Britannica and Wikipedia, we show that, overall, Wikipedia articles are more slanted towards Democrat than Britannica articles, as well as more biased. Slanted Wikipedia articles tend to become less biased than Britannica articles on the same topic as they become substantially revised, and the bias on a per word basis hardly differs between the sources." (See also our 2012 reviews of two related papers by the same authors, including a critique of their reliance on the method of using the US Congressional Record as a gold standard of unbiased language: "Language analysis finds Wikipedia's political bias moving from left to right"; "Given enough eyeballs, do articles become neutral?")
• "Towards better visual tools for exploring Wikipedia article development – the use case of 'Gamergate controversy'." From the abstract: "We present a comparative analysis of three tools for visually exploring the revision history of a Wikipedia article. We do so on the use case of 'Gamergate Controversy', an article that has been the setting of a major editor dispute in the last half of 2014 and early 2015, resulting in multiple editor bans and gathering news media attention. We show how our tools can be used to visually explore editor disagreement interactions and networks, as well as conflicted content and provenance ..."
• "What triggers human remembering of events? A large-scale analysis of catalysts for collective memory in Wikipedia." From the "Conclusions and future work" section: "we managed to identify some first pattern for event memory triggering for diverse event types including natural and manmade disasters as well as accidents and terrorism. For doing this we have combined correlation detection, analysis of the surprise aspect (unexpected change) in the distribution of the past event surrounding the peak time of the triggering event and analysis of the skewness of the distribution of the past event at the peak time of the triggering event. Our analysis confirmed the influence of closeness in time and location, but also has shown that these aspects cannot be considered in isolation and that high-impact events and semantic similarity of events also influences, which event memories are triggered by an event."
• "As dinâmicas do conhecimento científico e tecnológico na era da Web 2.0 : um estudo sobre a Wikipédia lusófona." In Portuguese; from the English abstract: "This investigation has been made from the analysis of 'formal' Wikipedian’s structure and from semi-structured interviews with 24 collaborators users of the 'highlighted subjects' on scientific and technological issues of the Lusophone Wikipedia. The thesis' conclusions are: on one hand, that the Wikipedian’s interface tends to reproduce the disciplines’ hierarchy of the S&T [science and technology] knowledge and the distribution of users' areas of interest according to the social places occupied by them, as well as express values, representations and practices associated with modern science paradigm. On the other hand, this study observes that Lusophone Wikipedia is propitious, not only to diversify the profile of the collaborators involved in the production, dissemination and achievement of scientific and technological subjects compared to the conventional spaces of the S&T knowledge, but also opening various possibilities for participation in the site, included ownership of collective product."
• "Generating quizzes for history learning based on Wikipedia articles." From the abstract: "Aiming at reducing the cost of developing educational contents, this study proposes a method to generate multiple-choice history quizzes using Wikipedia articles."
• "Detecting spatial patterns of natural hazards from the Wikipedia knowledge base" From the abstract: "Over 230,000 geo-tagged articles are [...] extracted from the Wikipedia database, spatially covering the contiguous United States. ... In this work, Wikipedia articles about wildfires are extracted from the Wikipedia database, forming a wildfire corpus [...]. The spatial distribution of wildfire outbreaks in the US is estimated [...] and mapped using GIS. To provide an evaluation of the approach, the estimation is compared to wildfire hazard potential maps created by the USDA Forest service. "
• "Extraction of career profiles from Wikipedia" From the abstract: "We describe a system that gathers the work experience of a person from her or his Wikipedia page. We first extract an ontology of profession names from the Wikidata graph. We then parse the Wikipedia pages using a dependency parser and we connect persons to professions through the analysis of parts of speech and dependency relations we extract from text."
• "Extracting and visualising biographical events from Wikipedia" From the abstract: "This work presents a proposal for the development of a natural language processing module for event and temporal analysis of biographies as available in Wikipedia" (using DBpedia; no mention of Wikidata)
• "The Descent of Pluto: Interactive dynamics, specialisation and reciprocity of roles in a Wikipedia debate." From the abstract: "... we performed a longitudinal analysis of a specific case-study within the French-speaking “astronomy” Wikipedia OEC ["Online Epistemic Community"], revolving around the renaming of the article on the celestial body "Pluto", given the 'descent' of its scientific status from that of a planet to an asteroid. Our choice was to focus on the analysis of dialogic and epistemic roles, as an appropriate meso-level unit of analysis. We present a qualitative-quantitative method for analysis of roles, based on filtering major participants and analysing the dialogic functions and epistemic contents of their communicative acts. Our analyses showed that [...] roles become gradually specialised and reciprocal over sequences of the discussion: when one participant changes role from one sequence to another, other participants ‘fill in’ for the vacant role. Secondly, we show that OECs, in the case of Wikipedia, do not function purely on a knowledge-level, but also involve, crucially, negotiation of images of participants’ competences with respect to the knowledge domain."

References

← Previous "Recent research"

Next "Recent research" →

In this issue

25 November 2015 (all comments)

Op-ed

News and notes

In the media

Recent research

Featured content

Traffic report

Arbitration report

Technology report

Blog

+ Add a comment

Discuss this story

These comments are automatically transcluded from this article's talk page. To follow comments, add the page to your watchlist. If your comment has not appeared here, you can try .

• For scientific papers, Wikipedia citations are inherently a very poor metric for impact. For medical articles in particular, our citation policy (WP:MEDRS) specifically discourages citing primary research studies, which make up the great bulk of the literature; instead we favor the use of secondary review articles. The same principle applies, less explicitly, to other areas of science. So there is a very strong bias in which articles we use that has nothing to do with impact. Looie496 (talk) 12:58, 29 November 2015 (UTC)

• Many non-science articles are hard to source from academic papers, and books are often the only source, certainly pre-1900. Academic books are a good source, often better than papers or their equivalent as they provide an overview of the contemporary understanding of the topic, rather than advancing one particular hypothesis. All the best: Rich Farmbrough, 17:00, 30 November 2015 (UTC).
  

I'll put it more succinctly than Rich: don't expect your stuff to show up on Wikipedia if it's behind a paywall.--Wehwalt (talk) 16:33, 3 December 2015 (UTC)

Want the latest Signpost delivered to your talk page each month?

Home

About

Archives

Newsroom

Subscribe

Suggestions