Minimum intensity projection of embossed quadrant-detection images for improved photoreceptor mosaic visualisation

For the past twenty five years the NIH family of imaging software, NIH Image and ImageJ have been pioneers as open tools for scientific image analysis. We discuss the origins, challenges and solutions of these two programs, and how their history can serve to advise and inform other software projects.

Many biological applications require the segmentation of cell bodies, membranes and nuclei from microscopy images. Deep learning has enabled great progress on this problem, but current methods are specialized for images that have large training datasets. Here we introduce a generalist, deep learning-based segmentation method called Cellpose, which can precisely segment cells from a wide range of image types and does not require model retraining or parameter adjustments. Cellpose was trained on a new dataset of highly varied images of cells, containing over 70,000 segmented objects. We also demonstrate a three-dimensional (3D) extension of Cellpose that reuses the two-dimensional (2D) model and does not require 3D-labeled data. To support community contributions to the training data, we developed software for manual labeling and for curation of the automated results. Periodically retraining the model on the community-contributed data will ensure that Cellpose improves constantly.

An often overlooked prerequisite to cone photoreceptor gene therapy development is residual photoreceptor structure that can be rescued. While advances in adaptive optics (AO) retinal imaging have recently enabled direct visualization of individual cone and rod photoreceptors in the living human retina, these techniques largely detect strongly directionally-backscattered (waveguided) light from normal intact photoreceptors. This represents a major limitation in using existing AO imaging to quantify structure of remnant cones in degenerating retina. Photoreceptor inner segment structure was assessed with a novel AO scanning light ophthalmoscopy (AOSLO) differential phase technique, that we termed nonconfocal split-detector, in two healthy subjects and four subjects with achromatopsia. Ex vivo preparations of five healthy donor eyes were analyzed for comparison of inner segment diameter to that measured in vivo with split-detector AOSLO. Nonconfocal split-detector AOSLO reveals the photoreceptor inner segment with or without the presence of a waveguiding outer segment. The diameter of inner segments measured in vivo is in good agreement with histology. A substantial number of foveal and parafoveal cone photoreceptors with apparently intact inner segments were identified in patients with the inherited disease achromatopsia. The application of nonconfocal split-detector to emerging human gene therapy trials will improve the potential of therapeutic success, by identifying patients with sufficient retained photoreceptor structure to benefit the most from intervention. Additionally, split-detector imaging may be useful for studies of other retinal degenerations such as AMD, retinitis pigmentosa, and choroideremia where the outer segment is lost before the remainder of the photoreceptor cell. Copyright 2014 The Association for Research in Vision and Ophthalmology, Inc.