- Research article
- Open Access
The 100 most influential manuscripts in andrology: a bibliometric analysis
Basic and Clinical Andrologyvolume 28, Article number: 15 (2018)
As the specialty of Andrology expands it is important to establish the most important studies that have shaped, and continue to shape, current research and clinical practice. Bibliometric analysis involving a citation rank list is an established means by which to identify the published material within a given field that has greatest intellectual influence. This bibliometric analysis sought to identify the 100 most influential manuscripts in Andrology, as well as the key research themes that have shaped contemporary understanding and management of andrological conditions.
The Thompson Reuters Web of Science citation indexing database was interrogated using a number of search terms chosen to reflect the full spectrum of andrological practice. Results were ranked according to citation number and further analysed according to subject, first and senior author, journal, year of publication, institution and country of origin.
The Web of Science search returned a total of 24,128 manuscripts. Citation number of the top 100 articles ranged from 2819 to 218 (median 320). The most cited manuscript (by Feldman et al., The Journal of Urology 1994; 2819 citations) reported the prevalence and risk factors for erectile dysfunction (ED) in the Massachusetts Male Ageing Study. The Journal of Urology published the highest number of manuscripts (n = 11), followed by the New England Journal of Medicine (n = 10). The most common theme represented within the top 100 manuscripts was erectile dysfunction (n = 46), followed jointly by hypogonadism and male factor infertility (n = 24 respectively).
Erectile dysfunction should be considered the most widely researched, published and cited field within andrological practice. This study provides a list of the most influential manuscripts in andrology and serves as a reference of what comprises a ‘highly citable’ paper for both researchers and clinicians.
Etant donné que la spécialité Andrologie se développe, il est important de dresser un inventaire des études les plus importantes qui ont façonné, et qui continuent à façonner, la recherche actuelle et la pratique clinique. L’analyse bibliométrique, qui inclue une liste de rang de citations, est un moyen bien établi pour identifier le matériel publié, dans un champ donné, qui a la plus grande influence intellectuelle. La présente analyse bibliométrique cherche à identifier les 100 manuscrits les plus influents en Andrologie, ainsi que les principaux thèmes de recherche qui ont façonné la compréhension et la prise en charge contemporaines des situations andrologiques.
La base de données d’indexation des citations du Web of Science de Thompson Reuters a été interrogée en utilisant un nombre de termes de recherche choisis pour refléter l’éventail complet de la pratique andrologique. Les résultats ont été classés selon leur nombre de citations, puis ensuite analysés en fonction du sujet, des premier et dernier auteurs, du journal, de l’année de publication, de l’institution et du pays d’origine.
La recherche sur le Web of Science a rapporté un total de 24 128 manuscrits. Le nombre de citations des 100 premiers articles va de 2 819 à 218 (médiane 320). L’article le plus cité (de Feldman et al., The Journal of Urology 1994 ; 2 819 citations) rapportait la prévalence et les facteurs de risque de la dysfonction érectile (DE) dans l’étude du Massachusetts menée chez l’homme vieillissant. The Journal of Urology a publié le plus grand nombre de manuscrits (n=11), suivi du New England Journal of Medicine (n=10). Le thème le plus souvent représenté dans les manuscrits du top 100 était la dysfonction érectile (n=46), suivi conjointement par l’hypogonadisme et l’infertilité d’origine masculine (respectivement n=24).
La dysfonction érectile devrait être considérée comme le champ de la pratique andrologique qui a le plus largement fait l’objet de recherches, de publications et de citations. La présente étude fournit une liste des manuscrits les plus influents en andrologie, et constitue une référence sur ce que signifie un article ‘fortement cité’ à la fois pour les chercheurs et pour les cliniciens.
Andrology is the medical specialty that focuses on many aspects of male health, comprising a wide range of conditions of the male reproductive system, as well as urological pathologies that are specific to men. Although the clinical science had been studied for many years, it was not until after the introduction of the term ‘andrology’ in 1951 that scientists and clinicians from a diverse range of backgrounds began to refer to themselves as ‘andrologists’ . Since then the discipline has continued to evolve, with the introduction of national and international societies, recognised and accredited training courses and a number of high quality dedicated journals. In the present day, andrologists are involved in the management of a wide spectrum of diseases ranging from male factor infertility through to hypogonadism and penile cancer. As the specialty grows and the body of literature focusing on andrological topics expands it is important to establish the most important and influential manuscripts that have shaped, and continue to shape, current research and clinical practice.
The generation of a citation rank list is one method of identifying the published material within a given field that has greatest intellectual influence . A citation refers to the referencing of an article by another peer-reviewed publication. It is therefore probable that articles which have the greatest impact on the scientific and clinical communities are cited many times more than those which have had little impact. Citation analysis is the process of ranking the most frequently cited articles in order to produce a citation rank list. In addition, citation numbers can be used to rank journals through calculation of their ‘impact factor.’ This is a measure of the average number of citations a manuscript published in a particular journal received during a specific timeframe and is often used a surrogate marker for journal quality.
A number of clinical disciplines have employed citation analysis to determine the most influential articles in their field. These include entire specialties such as general surgery , plastic surgery  and orthopaedic surgery , as well as subspecialties such as laparoscopic and emergency abdominal surgery [6, 7]. Whilst citation analysis has been conducted within urology as a whole [8, 9], and more specifically for male factor infertility , no study to date has been undertaken to determine the most influential manuscripts in andrology. This bibliometric analysis therefore aimed to identify the most influential articles in the field, as well as key research themes that have been instrumental in developing our contemporary understanding and management of andrological conditions.
The Thompson Reuters Web of Science citation indexing database was interrogated using the method previously described by Ellul et al. . As andrology is a broad subspecialty that draws from a range of other disciplines, it is probable that influential articles pertaining to relevant topics have been published in a wide array of journals, not just those specific to urology and sexual medicine. A number of title search terms were therefore selected and combined to ensure all relevant manuscripts were identified, as follows: ‘andrology’, ‘male infertility’, ‘erectile dysfunction’, ‘impotence’, ‘penile deformity’, ‘penile curvature’, ‘peyronie’s disease’, ‘priapism’, ‘penile fracture’, ‘ejaculatory disorder’, ‘male sexual dysfunction’, ‘hypogonadism’, ‘penile cancer’, ‘squamous cell carcinoma’ and ‘penis’. Truncation using the asterisk function (*) was utilised for particular words with multiple relevant variations, for example the term ‘peni*’ was used to capture both ‘penis’ and ‘penile’. These search terms were chosen to reflect the core topics published in the European Academy of Andrology-European Society of Andrological Urology Joint Educational Curriculum for Clinical Andrology Training in Europe .
The search was conducted on 5th June 2018 and included all manuscripts published in the English language from 1900 onwards. Results were subsequently ranked by citation number. Final interrogation of the database was independently performed by two assessors (NB and TE). The 100 most cited articles were further evaluated according to subject, first and senior author, journal, year of publication, institution and country of origin. The 2016 impact factor of each journal was also identified from the Journal Citation Reports dataset . In order to adjust for older articles accruing a higher number of citations over time the citation rate was calculated by dividing the number of citations by the number of years since publication. Articles were excluded if published prior to 1900, in languages other than English and/or if, after independent assessment by two researchers, it was agreed the main focus was not directly relevant to the field andrology. In cases of disagreement on the suitability for inclusion, the manuscript in question was discussed by both assessors and a consensus decision reached.
The Web of Science search returned a total of 24,128 manuscripts. Table 1 lists the 100 most cited articles as ranked by citation number, following application of exclusion criteria. Where two articles had equal numbers of citations, further stratification was based on citation rate. The most cited article was that by Feldman et al. describing the prevalence of and risk factors for erectile dysfunction (ED) in the Massachusetts Male Ageing Study, published in The Journal of Urology in 1994 and has been cited 2819 times .
The 100 most cited manuscripts were published over a broad time period, with the greatest proportion between 2000 and 2009 (n = 41), as demonstrated in Fig. 1. The most historic article was that by Macleod and Gold reporting comparative semen analysis in both ‘fertile’ and ‘infertile’ men, published in The Journal of Urology in 1951 and cited 239 times . The most recent manuscript was that published in 2010 in European Urology by Hatzimouratidis, et al. outlining the European Association of Urology guidelines on investigation and management of male sexual dysfunction, which has been cited 420 times .
Table 2 outlines the 43 journals in which the top 100 manuscripts were published. The Journal of Urology (impact factor 5.157) published the highest number (n = 11), including the most cited article by Feldman et al. , and accrued a total overall citation number of 6771. This was followed by The New England Journal of Medicine, which published 10 manuscripts and was also the journal with the highest impact factor (72.406).
The country with the greatest number of publications was the United States of America (n = 66), followed by the United Kingdom (n = 12) and Canada (n = 5). The Massachusetts General Hospital was the institution with the greatest number of manuscripts (n = 7), followed jointly by the Cleveland Clinic and New England Research Institute (n = 6 respectively), all of which are based in the USA. RC Rosen [16,17,18,19] and TF Lue [20,21,22] were the first authors with the highest number of manuscripts in the top 100, achieving 4 and 3 respectively. A number of senior authors published more than one manuscript, with JB McKinlay achieving the greatest (n = 5), including the most cited article [13, 23,24,25,26].
Figure 2 gives the top 100 manuscripts according to type. The majority were original research articles (n = 77, Fig. 2a), of which 59 (76.6%) reported clinical outcomes (based on either observational or interventional methodology) and 18 (23.4%) reported the findings of basic scientific work (Fig. 2b). The number of manuscripts pertaining to each of the main andrology themes are given in Fig. 3a. ED was the most common (n = 46), followed jointly by hypogonadism and male factor infertility (n = 24 respectively). Figure 3b demonstrates manuscript theme as strafitied by decade of publication. Hypogonadism was the most common theme prior to 1980 (n = 4), after which ED remained the most common up until 2010. Despite an overall trend of increasing numbers of manuscripts focussing on ED within the top 100 during this period, the relative proportion of manuscripts fell with each decade (66.7, 47.1 and 46.3% between 1980 and 89, 1990–99 and 2000–09 respectivelty).
The citation rate of the top 10 manuscripts ranged from 118 to 45, as shown in Table 3. A number of articles from the top 10 remained the same when ranked by citation rate, although three were replaced by the more contemporary manuscripts by Wu, et al. (2010, 524 citations) , Hatzimouratidis, et al. (2010, 420 citations)  and Tremellen (2008, 479 citations) .
This study is the first bibliometric analysis to identify and analyse the most influential manuscripts in the field of andrology. A range of topics were represented within the top 100, which reflects the spectrum of clinical andrological practice as well as the variation in the specialist backgrounds of andrological practitioners and researchers. Similarly, there is significant overlap with other medical specialties including, but not limited to, endocrinology. Despite this overlap, the most prevalent theme of publication was the assessment and/or treatment of patients with ED, constituting 46 papers within the top 100. This included the most cited article by Feldman, et al.  describing the prevalence of, and risk factors for, ED in the Massachusetts Male Ageing Study, published in The Journal of Urology in 1994 and cited 2819 times. The Massachusetts Male Aging Study was a community-based, observational survey of non-institutionalised men between 40 and 70 years old conducted between 1987 to 1989 in cities and towns near Boston, Massachusetts. The aim was to correlate a self-administered erectile function questionnaire with an assessment of patients’ overall health. The authors noted a strong correlation with patients who had vascular, cardiac or smoking-related diseases and concluded that ED was associated with potentially reversible age-related changes.
The self-administered erectile function questionnaire reported in the Feldman, et al. study differed from the now more commonly used International Index of Erectile Function (IIEF), which was first described three years later in 1997 by Rosen, et al. . This landmark publication constituted the second most cited article in this bibliometric analysis. Similarly, the fourth most cited article described an updated version of the IIEF questionnaire and was again published by Rosen, et al. . The reason that these papers have been cited so frequently is most likely due to both the high overall prevalence of publications focussing on ED, and the fact that the IIEF-5 is widely used in clinical practice to measure the severity of ED and is hence frequently used in research studies as an ‘objective’ measurement of function, treatment efficacy or response.
Fourteen manuscripts in the top 100 focussed specifically on the treatment of ED. These ranged in age from the article by Brindley in 1983 examining the effects of intra-cavernosal alpha-blockade , to that by McVary, et al. in 2007 reporting the results of a randomised controlled trial investigating the effects of oral sildenafil on both ED and urinary symptoms . This analysis demonstrates that there was a significant increase in the number of influential manuscripts focussing on the treatment of ED following publication of the landmark paper by Goldstein, et al. in 1998 reporting the effectiveness of oral sildenafil . This was the first paper to describe an oral treatment for ED and is the third most cited manuscript in the top 100. Prior to this time, treatments had been relatively intolerable for patients, including vacuum tumescence devices, intracavernosal injections of vasoactive agents, transurethral delivery of alprostadil, and invasive surgical procedures. The availability of oral treatments for ED subsequently resulted in a rapid increase in research being undertaken into all aspects of the condition, which is reflected in the numerous manuscripts published after 1998 that feature in the top 100 (Figs. 1 and 3b). Furthermore, it is probable that there was an increase in self-reporting of ED and a drive towards increased research funding and activity when a number of ‘tolerable’ treatments became available.
A significant majority of manuscripts were published by authors in the United States of America (n = 66), followed by the United Kingdom (n = 12) and Canada (n = 5). This disparity between the USA and other countries may reflect the subspecialisation that occurs in contemporary American Urological practice compared with other geographical regions . This means that clinicians are more likely to be solely practicing andrology, with less emphasis on provision of ‘core urological’ services, therefore potentially allowing more time for academic pursuits. This geographical dominance has also been observed in other bibliometric analyses  and may also be explained by differences in academic focus in relation to clinical practice, with more funding provided to clinicians’ academic work in the USA compared to elsewhere, which in turn appears to correlate with a higher quality of research .
It is important to note that only two manuscripts within the top 100 focus on the management of penile cancer (Maden, ranked 79  and Daling, ranked 98 ). This is the only cancer that is commonly managed by andrologists and therefore one would expect to see a greater number of manuscripts related to its pathophysiology, treatment and follow-up within the top 100. However, it is likely that the low incidence of this condition makes it a relative ‘Cinderella’ subspecialty within the field and therefore papers focussed on penile cancer are less widely cited when compared to the much more commonly encountered conditions of ED and hypogonadism . Moreover, due to the paucity of cases seen in routine practice it is difficult to establish a cohort of sufficient size for high quality observational or interventional research. This, coupled with the known difficulties in conducting high quality surgical trials , means that manuscripts are often of low levels of evidence, thus precluding them from publication in high impact factor journals.
The journals in which the top 100 manuscripts were published varied significantly both in theme and impact factor. The latter was particularly varied and ranged from 72.406 to 1.293 (median 5.5025). Interestingly, impact factor did not necessarily correlate with the most cited papers. For example, the second most cited paper by Rosen, et al.  was published in ‘Urology’, which was the sixth-lowest ranked journal in terms of impact factor within this analysis (2.309). One explanation for this variation is the multidisciplinary nature of many conditions encountered under the umbrella of andrology. Furthermore, the subspecialised nature of many andrological conditions means that manuscripts pertaining to these topics are often not directly relevant to ‘core’ clinical practice and are therefore less likely to be published in higher impact factor journals that seek to meet the interests of a broad audience.
The main limitation of bibliometric analysis is the potential for a number of types of bias. Firstly, disproportionate citation may result from institutional bias, language biases, self-citation or powerful person bias. In addition, older manuscripts may receive more citations due to the length of time in which they are in the public domain. Although the use of citation rate attempts to control for this, it may take a number of years for influential manuscripts to accrue citations due to the publication lead-time for their citing manuscript. A further limitation is the inclusion of only first and senior authors, and the institution of the first author. It is possible that several first authors will have co-authored other papers in the top 100 and therefore be underrepresented in the current study. Finally, searching based on title means a small number of manuscripts that have key andrological themes without pertaining to these in their title may not have been identified.
This list of highly cited papers identifies the topics and authors that have made the most impact in the discipline of andrology over the last century. There is a clear predominance of manuscripts focusing on the treatment and pathophysiology of ED, which should therefore be considered the most widely researched, published and cited field within andrological practice. This study provides a reference of what may be considered as the most influential papers in andrology and serves as a inidcation of what comprises a ‘highly citable’ manuscript for both researchers and clinicians.
International Index of Erectile Function
United States of America
Isidori A. The history of modern andrology. Med Secoli. 2001;13(2):255–68.
Murray MR, Wang T, Schroeder GD, Hsu WK. The 100 most cited spine articles. Eur. Spine J. 2012;21(10):2059–69.
Paladugu R, Schein M, Gardezi S, Wise L. One hundred citation classics in general surgical journals. World J Surg. 2002;26(9):1099–105.
Loonen MP, Hage JJ, Kon M. Plastic surgery classics: characteristics of 50 top-cited articles in four plastic surgery journals since 1946. Plast Reconstr Surg. 2008;121(5):320–7.
Kelly J, Glynn R, O’Briain D, Felle P, McCabe J. The 100 classic papers of orthopaedic surgery a bibliometric analysis. J Bone Joint Surg Br. 2010;92(10):1338–43.
Ellul T, Bullock N, Abdelrahman T, Powell AG, Witherspoon J, Lewis WG. The 100 most cited manuscripts in emergency abdominal surgery: a bibliometric analysis. Int J Surg. 2017;37:29–35.
Mellor KL, Powell AG, Lewis WG. Laparoscopic surgery’s 100 most influential manuscripts: a bibliometric analysis. Surg Laparosc Endosc Percutan Tech. 2018;28(1):13–9.
Hennessey K, Afshar K, MacNeily AE. The top 100 cited articles in urology. Can Urol Assoc J. 2009;3(4):293–302.
Nason GJ, Tareen F, Mortell A. The top 100 cited articles in urology: an update. Can Urol Assoc J. 2013;7(1–2):16–24.
Zhang Y, Xiao F, Lu S, Song J, Zhang C, Li J, et al. Research trends and perspectives of male infertility: a bibliometric analysis of 20 years of scientific literature. Andrology. 2016;4(6):990–1001.
European Academy of Andrology-European Society of Andrological Urology. Joint educational curriculum for clinical andrology training in Europe: the sub-speciality in andrology. Munster, Germany: European academy of Andrology; 2008.
Clarivate Analytics. 2016 journal impact factor. Journal citation reports, Clarivate Analytics; 2017.
Feldman HA, Goldstein I, Hatzichristou DG, Krane RJ, McKinlay JB. Impotence and its medical and psychosocial correlates - results of the Massachusetts male aging study. J Urol. 1994;151(1):54–61.
Macleod J, Gold RZ. The male factor in fertility and infertility .II. Spermatozoon counts in 1000 men of known fertility and in 1000 cases of infertile marriage. J Urol. 1951;66(3):436–49.
Hatzimouratidis K, Amar E, Eardley I, Giuliano F, Hatzichristou D, Montorsi F, et al. Guidelines on male sexual dysfunction: erectile dysfunction and premature ejaculation. Eur Urol. 2010;57(5):804–14.
Rosen RC, Riley A, Wagner G, Osterloh IH, Kirkpatrick J, Mishra A. The international index of erectile function (IIEF): a multidimensional scale for assessment of erectile dysfunction. Urology. 1997;49(6):822–30.
Rosen RC, Cappelleri JC, Smith MD, Lipsky J, Pena BM. Development and evaluation of an abridged, 5-item version of the international index of erectile function (IIEF-5) as a diagnostic tool for erectile dysfunction. Int J Impot Res. 1999;11(6):319–26.
Rosen R, Altwein J, Boyle P, Kirby RS, Lukacs B, Meuleman E, et al. Lower urinary tract symptoms and male sexual dysfunction: the multinational survey of the aging male (msam-7). Eur Urol. 2003;44(6):637–49.
Rosen RC, Fisher WA, Eardley I, Niederberger C, Nadel A, Sand M. The multinational men's attitudes to life events and sexuality (males) study: I. prevalence of erectile dysfunction and related health concerns in the general population. Curr Med Res Opin. 2004;20(5):607–17.
Lue TF. Drug therapy: erectile dysfunction. N Engl J Med. 2000;342(24):1802–13.
Lue TF, Tanagho EA. Physiology of erection and pharmacological management of impotence. J Urol. 1987;137(5):829–36.
Lue TF, Hricak H, Marich KW, Tanagho EA. Vasculogenic impotence evaluated by high-resolution ultrasonography and pulsed doppler spectrum analysis. Radiology. 1985;155(3):777–81.
Johannes CB, Araujo AB, Feldman HA, Derby CA, Kleinman KP, McKinlay JB. Incidence of erectile dysfunction in men 40 to 69 years old: longitudinal results from the Massachusetts male aging study. J Urol. 2000;163(2):460–3.
Feldman HA, Johannes CB, Derby CA, Kleinman IC, Mohr BA, Araujo AB, et al. Erectile dysfunction and coronary risk factors: prospective results from the Massachusetts male aging study. Prev Med. 2000;30(4):328–38.
Araujo AB, Durante R, Feldman HA, Goldstein I, McKinlay JB. The relationship between depressive symptoms and male erectile dysfunction: cross-sectional results from the Massachusetts male aging study. Psychosom Med. 1998;60(4):458–65.
Derby CA, Mohr BA, Goldstein I, Feldman HA, Johannes CB, McKinlay JB. Modifiable risk factors and erectile dysfunction: can lifestyle changes modify risk? Urology. 2000;56(2):302–6.
Wu FCW, Tajar A, Beynon JM, Pye SR, Silman AJ, Finn JD, et al. Identification of late-onset hypogonadism in middle-aged and elderly men. N Engl J Med. 2010;363(2):123–35.
Tremellen K. Oxidative stress and male infertility - a clinical perspective. Hum Reprod Update. 2008;14(3):243–58.
Brindley GS. Cavernosal alpha-blockade - a new technique for investigating and treating erectile impotence. Br J Psychiatry. 1983;143:332–7.
McVary KT, Monnig W, Camps JL, Young JM, Tseng LJ, van den Ende G. Sildenafil citrate improves erectile function and urinary symptoms in men with erectile dysfunction and lower urinary tract symptoms associated with benign prostatic hyperplasia: a randomized, double-blind trial. J Urol. 2007;177(3):1071–7.
Goldstein I, Lue TF, Padma-Nathan H, Rosen RC, Steers WD, Wicker PA, et al. Oral sildenafil in the treatment of erectile dysfunction. N Engl J Med. 1998;338(20):1397–404.
Gee WF, Holtgrewe HL, Albertsen PC, Cooper TP, Fenninger RB, Litwin MS, et al. Subspecialization, recruitment and retirement trends of american urologists. J Urol. 1998;159(2):509–11.
Reed DA, Cook DA, Beckman TJ, Levine RB, Kern DE, Wright SM. Association between funding and quality of published medical education research. JAMA. 2007;298(9):1002–9.
Maden C, Sherman KJ, Beckmann AM, Hislop TG, Teh CZ, Ashley RL, et al. History of circumcision, medical conditions, and sexual-activity and risk of penile cancer. J Natl Cancer Inst. 1993;85(1):19–24.
Daling JR, Madeleine MM, Johnson LG, Schwartz SM, Shera KA, Wurscher MA, et al. Penile cancer: importance of circumcision, human papillomavirus and smoking in in situ and invasive disease. Int J Cancer. 2005;116(4):606–16.
Pow-Sang MR, Ferreira U, Pow-Sang JM, Nardi AC, Destefano V. Epidemiology and natural history of penile cancer. Urology. 2010;76(2):S2–6.
Cook JA. The challenges faced in the design, conduct and analysis of surgical randomised controlled trials. Trials. 2009;10(1):9.
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Availability of data and materials
All relevant data included in this manuscript.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.