Skip to main content

Main menu

  • Home
  • Content
    • Published Ahead of Print
    • Current Issue
    • JASN Podcasts
    • Article Collections
    • Archives
    • ASN Meeting Abstracts
    • Saved Searches
  • Authors
    • Submit a Manuscript
    • Author Resources
  • Editorial Team
  • Editorial Fellowship
    • Editorial Fellowship Team
    • Editorial Fellowship Application Process
  • More
    • About JASN
    • Advertising
    • Alerts
    • Feedback
    • Impact Factor
    • Reprints
    • Subscriptions
  • ASN Kidney News
  • Other
    • CJASN
    • Kidney360
    • Kidney News Online
    • American Society of Nephrology

User menu

  • Subscribe
  • My alerts
  • Log in
  • My Cart

Search

  • Advanced search
American Society of Nephrology
  • Other
    • CJASN
    • Kidney360
    • Kidney News Online
    • American Society of Nephrology
  • Subscribe
  • My alerts
  • Log in
  • My Cart
Advertisement
American Society of Nephrology

Advanced Search

  • Home
  • Content
    • Published Ahead of Print
    • Current Issue
    • JASN Podcasts
    • Article Collections
    • Archives
    • ASN Meeting Abstracts
    • Saved Searches
  • Authors
    • Submit a Manuscript
    • Author Resources
  • Editorial Team
  • Editorial Fellowship
    • Editorial Fellowship Team
    • Editorial Fellowship Application Process
  • More
    • About JASN
    • Advertising
    • Alerts
    • Feedback
    • Impact Factor
    • Reprints
    • Subscriptions
  • ASN Kidney News
  • Follow JASN on Twitter
  • Visit ASN on Facebook
  • Follow JASN on RSS
  • Community Forum
Up Front MattersEditorials
You have accessRestricted Access

AI: What Have You Done for Us Lately?

Richard Torres and Eben Olson
JASN August 2018, 29 (8) 2031-2032; DOI: https://doi.org/10.1681/ASN.2018050566
Richard Torres
Department of Laboratory Medicine, Yale University School of Medicine, New Haven, Connecticut
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eben Olson
Department of Laboratory Medicine, Yale University School of Medicine, New Haven, Connecticut
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Info & Metrics
  • View PDF
Loading
  • glomerulus
  • renal morphology
  • pathology

Artificial intelligence, deep learning, neural networks: the phrases conjure up images of autonomous cars and humanoid interactive robots performing menial and complex human tasks with absolute precision—a source of hope or dread for the future. However, amid the buzzwords and dizzying hype related to this technologic transformation, there are some tools with palpable, near-term, practical effect that are already finding use in renal research.

Investigators have relied on computer-based analysis since systems have been in existence. Multivariate statistics using matrix algebra found expanded application early on in the genesis of computers. Also, as far back as 1964, the late Ledley,1 a pioneer in the biomedical informatics field, touted high-speed automated image pattern recognition as a tool that “may well bring numerous problems now occupying the minds of biomedical research scientists within reach of a solution.” We have become accustomed to using every manner of computerized measure on our experimental data for decades, but without a doubt there have been significant recent advancements that portend accelerated progress in all scientific disciplines.

One of the most significant of these recent technologic developments has been the evolution of methods for pattern recognition popularized by their application to classification of friends in your Facebook and Google Photos images as well as voice recognition on your smartphone and interactive responses from customer service chatbots. Specific to images, an oft-quoted marker of progress is the result of an annual open competition for computer-based classification of a carefully characterized (curated) set of over a million images known as ImageNet. After the introduction of the first deep learning–based approaches in 2012, gains in model performance accelerated dramatically. As of 2016, performance by computer algorithms can match or arguably outperform humans on the dataset. The advancement has been potentiated by a convergence of factors: vastly more capable graphics cards that can execute the math-intensive steps efficiently, availability of digital training data, and the advent of specialized algorithms known as convolutional neural networks (CNNs) with their “deep learning” variants.

These new variants are specific forms of the general concept of machine learning—methods of statistical analysis and pattern recognition in which features are determined from a dataset in an automatic fashion rather than being handcrafted by a human expert. Neural networks are one form of machine learning, in which data are processed by layers of “neurons,” taking variable combinations of the output from prior layers to produce new output, somewhat analogously to the operation of biologic neurons. CNNs are a specialization of neural networks, in which signals are mathematically mixed (convolved) with spatial patterns (filters) aimed at producing a response signaling the presence of a target feature. In initial layers of the network, these filters are often graphically reminiscent of zebra stripes and recapitulate the manner in which mammalian visual cortex spatially filters visual input. This type of processing is particularly suited to detecting patterns in data with spatial structure, such as images, audio, or time series. The “deep learning” part refers to a combination of recent hardware and algorithm breakthroughs that have enabled much larger networks with many more layers to be used, with consequent gains in performance and successful application to many new problems.

In this issue of the Journal of the American Society of Nephrology, Bukowy et al.2 apply these advanced techniques to the automated recognition and localization of rat glomeruli in whole-slide images of routinely stained histologic sections. An otherwise impossibly laborious task of culling through thousands of images to find glomeruli for scoring of damage can thereby become easily achievable. The authors adapt a widely successful (and at one time, ImageNet champion) CNN algorithm known as AlexNet.3 They couple this analysis with software for presentation and scoring of glomeruli in a standardized and reproducible fashion for significantly improved workflow efficiency.

This article fits within a series of recent computationally focused conference papers applying CNN to glomerular identification and segmentation, including those presented by Pedraza et al.4 and Temerinac-Ott et al.5 In complement to these publications, Bukowy et al.2 have implemented a practical investigative mode of the CNN techniques and contributed to paving the way for further developments. It is easily inferred that the natural evolution is toward the automated detection, classification, and quantification of renal damage in disease models and human specimens. However, we are not quite there yet. A principal challenge for any automated image analysis is robustness. Biologic morphology variability is extensive, and performance suffers when algorithms encounter features not seen before, such as artifacts or uncharacterized diseased conditions. Experimentation can often lead to unexpected histology, and if improperly trained, even the most advanced recognition algorithms will fail. Therefore, extension of these techniques to other specific applications will require detailed validation as evidenced by the more limited success of the algorithm trained on rat glomeruli when applied to human specimens. Notably, Bukowy et al.2 show how training by simpler “region-based” classification of images (quick and easy) rather than detailed manual segmentation (harder and more time consuming) can yield useful results. Also, they show a general approach by which well defined image pattern recognition problems in renal research can already be adequately addressed with machine learning tools.

CNN and other pattern recognition techniques will undoubtedly be further potentiated by the continuing adoption of whole-slide imaging and rapid advancements in other digital histology techniques. Routine digitization of microscopic data that can be readily correlated with electronically recorded interpretations or objective outcomes, when properly organized and collated, will help provide critically lacking training sets for more massive application of pattern recognition, even if it will take some time and effort for specific tasks to be individually trained and tested. In the interim, whether you are in the dystopic camp or the utopic camp on the future of artificial intelligence, consider that there are avenues to explore today that can make your counting and classifying of glomeruli more accurate, more informative, and much easier!

Disclosures

This study was supported, in part, by National Institutes of Health grants UL1 TR001863 from the National Center for Advancing Translational Science and R44CA189522 from the National Cancer Institute.

Footnotes

  • Published online ahead of print. Publication date available at www.jasn.org.

  • See related article, “Region-Based Convolutional Neural Nets for Localization of Glomeruli in Trichrome-Stained Whole Kidney Sections,” on pages 2081–2088.

  • Copyright © 2018 by the American Society of Nephrology

References

  1. ↵
    1. Ledley RS
    : High-speed automatic analysis of biomedical pictures. Science 146: 216–223, 1964pmid:14185312
    OpenUrlFREE Full Text
  2. ↵
    1. Bukowy JD,
    2. Dayton A,
    3. Cloutier D,
    4. Manis AD,
    5. Staruschendo A,
    6. Lombard JH, et al
    .: Region-based convolutional neural nets for localization of glomeruli in trichrome stained whole kidney sections. J Am Soc Nephrol 29: 2081–2088, 2018
    OpenUrlAbstract/FREE Full Text
  3. ↵
    Krizhevsky A, Sutskever I, Hinton GE: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, 2012, pp 1097–1105
  4. ↵
    1. edited by
    2. Valdés Hernández M,
    3. González-Castro V,
    4. Springer,
    5. Cham
    1. Pedraza A,
    2. Gallego J,
    3. Lopez S,
    4. Gonzalez L,
    5. Laurinavicius A,
    6. Bueno G:
    Glomerulus Classification with Convolutional Neural Networks. In: Medical Image Understanding and Analysis. MIUA 2017, Communications in Computer and Information Science, Vol. 723, edited by Valdés Hernández M, González-Castro V, Springer, Cham, Switzerland, 2017, pp 839–849
    OpenUrl
  5. ↵
    Temerinac-Ott M, Forestier G, Schmitz J, Hermsen M, Braseni JH, Feuerhake F, et al.: Detection of glomeruli in renal pathology by mutual comparison of multiple staining modalities. In: Image and Signal Processing and Analysis (ISPA), 2017 10th International Symposium on, 2017, pp 19–24
PreviousNext
Back to top

In this issue

Journal of the American Society of Nephrology: 29 (8)
Journal of the American Society of Nephrology
Vol. 29, Issue 8
August 2018
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
View Selected Citations (0)
Print
Download PDF
Sign up for Alerts
Email Article
Thank you for your help in sharing the high-quality science in JASN.
Enter multiple addresses on separate lines or separate them with commas.
AI: What Have You Done for Us Lately?
(Your Name) has sent you a message from American Society of Nephrology
(Your Name) thought you would like to see the American Society of Nephrology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
AI: What Have You Done for Us Lately?
Richard Torres, Eben Olson
JASN Aug 2018, 29 (8) 2031-2032; DOI: 10.1681/ASN.2018050566

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
AI: What Have You Done for Us Lately?
Richard Torres, Eben Olson
JASN Aug 2018, 29 (8) 2031-2032; DOI: 10.1681/ASN.2018050566
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like

Jump to section

  • Article
    • Disclosures
    • Footnotes
    • References
  • Info & Metrics
  • View PDF

More in this TOC Section

Up Front Matters

  • QALYs, DALYs and Now PALYs: Strengthening the Argument for Prevention of CKD
  • Management of Obesity in Adults with CKD
  • Me Or Your Own Eyes: RNA-Seq and the Kidney
Show more Up Front Matters

Editorials

  • Race and the Estimation of GFR: Getting it Right
  • Monkeying about with Nephron Formation
  • Kidney Transplant Rejection Clusters and Graft Outcomes: Revisiting Banff in the Era of “Big Data”
Show more Editorials

Cited By...

  • Machine Learning Comes to Nephrology
  • Google Scholar

Similar Articles

Related Articles

  • Region-Based Convolutional Neural Nets for Localization of Glomeruli in Trichrome-Stained Whole Kidney Sections
  • PubMed
  • Google Scholar

Keywords

  • glomerulus
  • renal morphology
  • pathology

Articles

  • Current Issue
  • Early Access
  • Subject Collections
  • Article Archive
  • ASN Annual Meeting Abstracts

Information for Authors

  • Submit a Manuscript
  • Author Resources
  • Editorial Fellowship Program
  • ASN Journal Policies
  • Reuse/Reprint Policy

About

  • JASN
  • ASN
  • ASN Journals
  • ASN Kidney News

Journal Information

  • About JASN
  • JASN Email Alerts
  • JASN Key Impact Information
  • JASN Podcasts
  • JASN RSS Feeds
  • Editorial Board

More Information

  • Advertise
  • ASN Podcasts
  • ASN Publications
  • Become an ASN Member
  • Feedback
  • Follow on Twitter
  • Password/Email Address Changes
  • Subscribe to ASN Journals

© 2021 American Society of Nephrology

Print ISSN - 1046-6673 Online ISSN - 1533-3450

Powered by HighWire