Ultrasound image segmentation: a survey
---
paper_title: Endocardial border identification in two-dimensional echocardiographic images: review of methods.

paper_content:

A basic goal in the analysis of echocardiographic images is to identify the locations of the endocardial borders. This is necessary in order to create three-dimensional reconstructions, and to derive precise quantitative parameters from the images. Endocardial borders can be identified manually; however, this is time-consuming, inconvenient, and liable to human subjectivity. For this reason there has been a great deal of interest in automatic border identification methods. In recent years numerous studies have been published, describing a wide variety of proposed border identification algorithms. In spite of the large number of published studies, however, the relative merits of the various methods remain unclear. In this paper the various analysis techniques are reviewed and discussed. The reasons for the lack of definitive conclusions regarding the utility of these methods are described. Finally, the basic methodological requirements necessary for empirical evaluation of border identification techniques are described.
---
paper_title: Automatic segmentation of echocardiographic sequences by active appearance motion models

paper_content:

A novel extension of active appearance models (AAMs) for automated border detection in echocardiographic image sequences is reported. The active appearance motion model (AAMM) technique allows fully automated robust and time-continuous delineation of left ventricular (LV) endocardial contours over the full heart cycle with good results. Nonlinear intensity normalization was developed and employed to accommodate ultrasound-specific intensity distributions. The method was trained and tested on 16-frame phase-normalized transthoracic four-chamber sequences of 129 unselected infarct patients, split randomly into a training set (n = 65) and a test set (n = 64). Borders were compared to expert drawn endocardial contours. On the test set, fully automated AAMM performed well in 97% of the cases (average distance between manual and automatic landmark points was 3.3 mm, comparable to human interobserver variabilities). The ultrasound-specific intensity normalization proved to be of great value for good results in echocardiograms. The AAMM was significantly more accurate than an equivalent set of two-dimensional AAMs.
---
paper_title: Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions

paper_content:

Breast cancer is the most frequently diagnosed malignancy and the second leading cause of mortality in women . In the last decade, ultrasound along with digital mammography has come to be regarded as the gold standard for breast cancer diagnosis. Automatically detecting tumors and extracting lesion boundaries in ultrasound images is difficult due to their specular nature and the variance in shape and appearance of sonographic lesions. Past work on automated ultrasonic breast lesion segmentation has not addressed important issues such as shadowing artifacts or dealing with similar tumor like structures in the sonogram. Algorithms that claim to automatically classify ultrasonic breast lesions, rely on manual delineation of the tumor boundaries. In this paper, we present a novel technique to automatically find lesion margins in ultrasound images, by combining intensity and texture with empirical domain specific knowledge along with directional gradient and a deformable shape-based model. The images are first filtered to remove speckle noise and then contrast enhanced to emphasize the tumor regions. For the first time, a mathematical formulation of the empirical rules used by radiologists in detecting ultrasonic breast lesions, popularly known as the "Stavros Criteria" is presented in this paper. We have applied this formulation to automatically determine a seed point within the image. Probabilistic classification of image pixels based on intensity and texture is followed by region growing using the automatically determined seed point to obtain an initial segmentation of the lesion. Boundary points are found on the directional gradient of the image. Outliers are removed by a process of recursive refinement. These boundary points are then supplied as an initial estimate to a deformable model. Incorporating empirical domain specific knowledge along with low and high-level knowledge makes it possible to avoid shadowing artifacts and lowers the chance of confusing similar tumor like structures for the lesion. The system was validated on a database of breast sonograms for 42 patients. The average mean boundary error between manual and automated segmentation was 6.6 pixels and the normalized true positive area overlap was 75.1%. The algorithm was found to be robust to 1) variations in system parameters, 2) number of training samples used, and 3) the position of the seed point within the tumor. Running time for segmenting a single sonogram was 18 s on a 1.8-GHz Pentium machine.
---
paper_title: Parametric shape modeling using deformable superellipses for prostate segmentation

paper_content:

Automatic prostate segmentation in ultrasound images is a challenging task due to speckle noise, missing boundary segments, and complex prostate anatomy. One popular approach has been the use of deformable models. For such techniques, prior knowledge of the prostate shape plays an important role in automating model initialization and constraining model evolution. In this paper, we have modeled the prostate shape using deformable superellipses. This model was fitted to 594 manual prostate contours outlined by five experts. We found that the superellipse with simple parametric deformations can efficiently model the prostate shape with the Hausdorff distance error (model versus manual outline) of 1.32/spl plusmn/0.62 mm and mean absolute distance error of 0.54/spl plusmn/0.20 mm. The variability between the manual outlinings and their corresponding fitted deformable superellipses was significantly less than the variability between human experts with p-value being less than 0.0001. Based on this deformable superellipse model, we have developed an efficient and robust Bayesian segmentation algorithm. This algorithm was applied to 125 prostate ultrasound images collected from 16 patients. The mean error between the computer-generated boundaries and the manual outlinings was 1.36/spl plusmn/0.58 mm, which is significantly less than the manual interobserver distances. The algorithm was also shown to be fairly insensitive to the choice of the initial curve.
---
paper_title: Segmentation and tracking in echocardiographic sequences: active contours guided by optical flow estimates

paper_content:

This paper presents a method for segmentation and tracking of cardiac structures in ultrasound image sequences. The developed algorithm is based on the active contour framework. This approach requires initial placement of the contour close to the desired position in the image, usually an object outline. Best contour shape and position are then calculated, assuming that at this configuration a global energy function, associated with a contour, attains its minimum. Active contours can be used for tracking by selecting a solution from a previous frame as an initial position in a present frame. Such an approach, however, fails for large displacements of the object of interest. This paper presents a technique that incorporates the information on pixel velocities (optical flow) into the estimate of initial contour to enable tracking of fast-moving objects. The algorithm was tested on several ultrasound image sequences, each covering one complete cardiac cycle. The contour successfully tracked boundaries of mitral valve leaflets, aortic root and endocardial borders of the left ventricle. The algorithm-generated outlines were compared against manual tracings by expert physicians. The automated method resulted in contours that were within the boundaries of intraobserver variability.
---
paper_title: Prostate Boundary Detection From Ultrasonographic Images

paper_content:

OBJECTIVE ::: Prostate diseases are very common in adult and elderly men, and prostate boundary detection from ultrasonographic images plays a key role in prostate disease diagnosis and treatment. However, because of the poor quality of ultrasonographic images, prostate boundary detection still remains a challenging task. Currently, this task is performed manually, which is arduous and heavily user dependent. To improve the efficiency by automating the boundary detection process, numerous methods have been proposed. We present a review of these methods, aiming to find a good solution that could efficiently detect the prostate boundary on ultrasonographic images. ::: ::: ::: METHODS ::: A full description of various methods is beyond the scope of this article; instead, we focus on providing an introduction to the different methods with a discussion of their advantages and disadvantages. Moreover, verification methods for estimating the accuracies of the algorithms reported in the literature are discussed as well. ::: ::: ::: RESULTS ::: From the investigation, we summarize several key issues that might be confronted and project possible future research. ::: ::: ::: CONCLUSIONS ::: Those model-based methods that minimize user involvement but allow for interactive guidance of experts will likely be most immediately successful.
---
paper_title: Towards ultrasound cardiac image segmentation based on the radiofrequency signal

paper_content:

In echocardiography, the radio-frequency (RF) image is a rich source of information about the investigated tissues. Nevertheless, very few works are dedicated to boundary detection based on the RF image, as opposed to envelope image. In this paper, we investigate the feasibility and limitations of boundary detection in echocardiographic images based on the RF signal. We introduce two types of RF-derived parameters: spectral autoregressive parameters and velocity-based parameters, and we propose a discontinuity adaptive framework to perform the detection task. In classical echographic cardiac acquisitions, we show that it is possible to use the spectral contents for boundary detection, and that improvement can be expected with respect to traditional methods. Using the system approach, we study on simulations how the spectral contents can be used for boundary detection. We subsequently perform boundary detection in high frame rate simulated and in vivo cardiac sequences using the variance of velocity, obtaining very promising results. Our work opens the perspective of a RF-based framework for ultrasound cardiac image segmentation and tracking.
---
paper_title: Fully automatic luminal contour segmentation in intracoronary ultrasound imaging-a statistical approach

paper_content:

In this paper, a fully automatic method for luminal contour segmentation in intracoronary ultrasound imaging is introduced. Its principle is based on a contour with a priori properties that evolves according to the statistics of the ultrasound texture brightness, which is generally Rayleigh distributed. The main interest of the technique is its fully automatic character. This is insured by an initial contour that is not set by the user, like in classical snake-based algorithms, but estimated and, thus, adapted to each image. Its estimation combines two pieces of information extracted from the a posteriori probability function of the contour position: the function maximum location (or maximum a posteriori estimator) and the first zero-crossing of its derivative. Then, starting from the initial contour, a region of interest is automatically selected and the process iterated until the contour evolution can be ignored. In vivo coronary images from 15 patients, acquired with the 20-MHz central frequency Jomed Invision ultrasound scanner, were segmented with the developed method. Automatic contours were compared to those manually drawn by two physicians in terms of mean absolute difference. The results demonstrate that the error between automatic contours and the average of manual ones is of small amplitude, and only very slightly higher (0.099 +/- 0.032 mm) than the interexpert error (0.097 +/- 0.027 mm).
---
paper_title: Estimating Blood Vessel Areas in Ultrasound Images Using a Deformable Template Model

paper_content:

We consider the problem of obtaining interval estimates of vessel areas from ultrasound images of cross sections through the carotid artery. Robust and automatic estimates of the cross sectional area is of medical interest and of help in diagnosing atherosclerosis, which is caused by plaque deposits in the carotid artery. We approach this problem by using a deformable template to model the blood vessel outline, and use recent developments in ultrasound science to model the likelihood. We demonstrate that by using an explicit model for the outline, we can easily adjust for an important feature in the data: strong edge reflections called specular reflection. The posterior is challenging to explore, and naive standard MCMC algorithms simply converge too slowly. To obtain an efficient MCMC algorithm we make extensive use of computational efficient Gaussian Markov random fields, and use various block sampling constructions that jointly update large parts of the model.
---
paper_title: Evaluation of three-dimensional segmentation algorithms for the identification of luminal and medial-adventitial borders in intravascular ultrasound images

paper_content:

Intravascular ultrasound (IVUS) provides direct depiction of coronary artery anatomy, including plaque and vessel area, which is important in quantitative studies on the progression or regression of coronary artery disease. Traditionally, these studies have relied on manual evaluation, which is laborious, time consuming, and subject to large interobserver and intraobserver variability. A new technique, called active surface segmentation, alleviates these limitations and makes strides toward routine analyses. However, for three-dimensional (3-D) plaque assessment or 3-D reconstruction to become a clinical reality, methods must be developed which can analyze many images quickly. Presented is a comparison between two active surface techniques for three-dimensional segmentation of luminal and medial-adventitial borders. The force-acceleration technique and the neighborhood-search technique accurately detected both borders in vivo (r2 = 0.95 and 0.99, Williams' index = 0.67 and 0.65, and r2 = 0.95 and 0.99, WI = 0.67 and 0.70, respectively). However, the neighborhood-search technique was significantly faster and required less computation. Volume calculations for both techniques (r2 = 0.99 and r2 = 0.99) also agreed with a known-volume phantom. Active surface segmentation allows 3-D assessment of coronary morphology and further developments with this technology will provide clinical analysis tools.
---
paper_title: Milestones on the road to higher resolution, quantitative, and functional ultrasonic imaging

paper_content:

Ultrasonography is evolving rapidly with important recent advances in high-density transducer arrays, one-and-one-half-dimensional transducers, broad-band transducers, increased scanner bandwidth, and more sophisticated image-formation routines. Technical advances have clearly improved accuracy of image readings, heightened contrast and resolution, reduced noise, and reduced image slice thickness. It is within this fertile environment that very high-frequency ultrasound, harmonic imaging, and ultrasound contrast agents have emerged. Clinical applications of ultrasonography have also been extended to new fields, such as skeletal status assessment, which have long been considered beyond ultrasound's reach, and over the past 15 years, quantitative ultrasound bone densitometry has become an important part of the armamentarium for osteoporosis diagnosis. The state of these innovations, their contributions to diagnostic and monitoring capabilities, as well as the new applications they bring into reach will be discussed. We will explore several applications currently under development including ultrasound biomicroscopy (eye, skin, small animals), quantitative perfusion assessment, and pathology evaluation. Thus, ongoing research has not only significantly added to diagnostic ultrasound's existing capabilities, but also promises to further broaden the range of its clinical and biological applications.
---
paper_title: Endocardial border identification in two-dimensional echocardiographic images: review of methods.

paper_content:

A basic goal in the analysis of echocardiographic images is to identify the locations of the endocardial borders. This is necessary in order to create three-dimensional reconstructions, and to derive precise quantitative parameters from the images. Endocardial borders can be identified manually; however, this is time-consuming, inconvenient, and liable to human subjectivity. For this reason there has been a great deal of interest in automatic border identification methods. In recent years numerous studies have been published, describing a wide variety of proposed border identification algorithms. In spite of the large number of published studies, however, the relative merits of the various methods remain unclear. In this paper the various analysis techniques are reviewed and discussed. The reasons for the lack of definitive conclusions regarding the utility of these methods are described. Finally, the basic methodological requirements necessary for empirical evaluation of border identification techniques are described.
---
paper_title: Real-time volumetric ultrasound imaging system

paper_content:

A real time volumetric ultrasound imaging system has been developed for medical diagnosis. The scanner produces images analogous to an optical camera and supplies more information than conventional sonograms. Potential medical applications include improved anatomic visualization, tumor localization, and better assessment of cardiac function. The system uses pulse-echo phased array principles to steer a two-dimensional array transducer of 289 elements in a pyramidal scan format. Parallel processing in the receive mode produces 4992 scan lines at a rate of approximately B frames/second. Echo data for the scanned volume is presented as projection images with depth perspective, stereoscopic pairs, multiple tomographic images, or C-mode scans.
---
paper_title: Three-dimensional modeling for functional analysis of cardiac images, a review

paper_content:

Three-dimensional (3-D) imaging of the heart is a rapidly developing area of research in medical imaging. Advances in hardware and methods for fast spatio-temporal cardiac imaging are extending the frontiers of clinical diagnosis and research on cardiovascular diseases. In the last few years, many approaches have been proposed to analyze images and extract parameters of cardiac shape and function from a variety of cardiac imaging modalities. In particular, techniques based on spatio-temporal geometric models have received considerable attention. This paper surveys the literature of two decades of research on cardiac modeling. The contribution of the paper is three-fold: (1) to serve as a tutorial of the field for both clinicians and technologists, (2) to provide an extensive account of modeling techniques in a comprehensive and systematic manner, and (3) to critically review these approaches in terms of their performance and degree of clinical evaluation with respect to the final goal of cardiac functional analysis. From this review it is concluded that whereas 3-D model-based approaches have the capability to improve the diagnostic value of cardiac images, issues as robustness, 3-D interaction, computational complexity and clinical validation still require significant attention.
---
paper_title: Automatic segmentation of echocardiographic sequences by active appearance motion models

paper_content:

A novel extension of active appearance models (AAMs) for automated border detection in echocardiographic image sequences is reported. The active appearance motion model (AAMM) technique allows fully automated robust and time-continuous delineation of left ventricular (LV) endocardial contours over the full heart cycle with good results. Nonlinear intensity normalization was developed and employed to accommodate ultrasound-specific intensity distributions. The method was trained and tested on 16-frame phase-normalized transthoracic four-chamber sequences of 129 unselected infarct patients, split randomly into a training set (n = 65) and a test set (n = 64). Borders were compared to expert drawn endocardial contours. On the test set, fully automated AAMM performed well in 97% of the cases (average distance between manual and automatic landmark points was 3.3 mm, comparable to human interobserver variabilities). The ultrasound-specific intensity normalization proved to be of great value for good results in echocardiograms. The AAMM was significantly more accurate than an equivalent set of two-dimensional AAMs.
---
paper_title: A GA based approach for boundary detection of left ventricle with echocardiographic image sequences

paper_content:

Abstract In this paper automatic detection of the boundary of left ventricle (LV) in a sequence of cardiac images has been proposed. The contour detection algorithm is formulated as a constrained optimization problem based on active contour model. The optimization problem has been solved using Genetic Algorithm (GA). The result obtained by the proposed GA based approach is compared with conventional nonlinear programming methods. Validation of the computer-generated boundaries is done after comparing them with manually outlined contours by expert observers. The performance of the algorithm is comparable to inter-observer anomalies.
---
paper_title: Automatic ventricular cavity boundary detection from sequential ultrasound images using simulated annealing.

paper_content:

An automatic algorithm has been developed for high-speed detection of cavity boundaries in sequential 2-D echocardiograms using an optimization algorithm called simulated annealing (SA). The algorithm has three stages. (1) A predetermined window of size nxm is decimated to size n'xm' after low-pass filtering. (2) An iterative radial gradient algorithm is employed to determine the center of gravity (CG) of the cavity. (3) 64 radii which originate from the CG defined in stage 2 are bounded by the high-probability region. Each bounded radius is defined as a link in a 1-D, 64-member cyclic Markov random field. This algorithm is unique in that it compounds spatial and temporal information along with a physical model in its decision rule, whereas most other algorithms base their decisions on spatial data alone. This is the first implementation of a relaxation algorithm for edge detection in echocardiograms. Results attained using this algorithm on real data have been highly encouraging.
---
paper_title: A multiscale optimization approach for the dynamic contour-based boundary detection issue

paper_content:

We present a new multiscale approach for deformable contour optimization. The method relies on a multigrid minimization method and a coarse-to-fine relaxation algorithm. This approach consists in minimizing a cascade of optimization problems of reduced and increasing complexity instead of considering the minimization problem on the full and original configuration space. Contrary to classical multiresolution algorithms, no reduction of image is applied. The family of defined energy functions are derived from the original (full resolution) objective function, ensuring that the same function is handled at each scale and that the energy decreases at each step of the deformable contour minimization process. The efficiency and the speed of this multiscale optimization strategy is demonstrated in the difficult context of the minimization of a region-based contour energy function ensuring the boundary detection of anatomical structures in ultrasound medical imagery. In this context, the proposed multiscale segmentation method is compared to other classical region-based segmentation approaches such as Maximum Likelihood or Markov Random Field-based segmentation techniques. We also extend this multiscale segmentation strategy to active contour models using a classical edge-based likelihood approach. Finally, time and performance analysis of this approach, compared to the (commonly used) dynamic programming-based optimization procedure, is given and allows to attest the accuracy and the speed of the proposed method.
---
paper_title: Applying improved fast marching method to endocardial boundary detection in echocardiographic images

paper_content:

An improved fast marching approach for endocardial boundary detection and tracking in echocardiographic images is presented. Firstly, the traditional fast marching algorithm is applied to the echocardiographic images. And the existing problems are discussed. Then, the algorithm is improved by introducing the average energy of the whole advancing front into the speed term instead of determining the speed term only with the local image features. The experimental results show that the improved algorithm is very effective and stable.
---
paper_title: Maximum likelihood segmentation of ultrasound images with Rayleigh distribution

paper_content:

This study presents a geometric model and a computational algorithm for segmentation of ultrasound images. A partial differential equation (PDE)-based flow is designed in order to achieve a maximum likelihood segmentation of the target in the scene. The flow is derived as the steepest descent of an energy functional taking into account the density probability distribution of the gray levels of the image as well as smoothness constraints. To model gray level behavior of ultrasound images, the classic Rayleigh probability distribution is considered. The steady state of the flow presents a maximum likelihood segmentation of the target. A finite difference approximation of the flow is derived, and numerical experiments are provided. Results are presented on ultrasound medical images as fetal echography and echocardiography.
---
paper_title: Combinative Multi-scale Level Set Framework for Echocardiographic Image Segmentation

paper_content:

In the automatic segmentation of echocardiographic images, a priori shape knowledge is used to compensate poor features in ultrasound images. The shape knowledge is often learned via off-line training process, which requires tedious human effort and is unavoidably expertise-dependent. More importantly, a learned shape template can only be used to segment a specific class of images with similar boundary shapes.In this paper, we present a multi-scale level set framework for echo image segmentation. We extract echo image boundaries automatically at a very coarse scale. These boundaries are then not only used as boundary initials at finer scales, but also as an external constraint to guide contour evolutions. This constraint functions similar to a traditional shape prior. Experimental results validate this combinative framework.
---
paper_title: Multiple Resolution Bayesian Segmentation of Ultrasound Images

paper_content:

We propose a novel method for obtaining the maximum a posteriori (MAP) probabilistic segmentation of speckle-laden ultrasound images. Our technique is multiple-resolution based, and relies on the conversion of speckle images with Rayleigh statistics to subsampled images with Gaussian statistics. This conversion reduces computation time, as well as allowing accurate parameter estimation for a probabilistic segmentation algorithm. Results appear to provide improvements over previous techniques in terms of low-contrast detail and accuracy.
---
paper_title: Using Prior Shapes in Geometric Active Contours in a Variational Framework

paper_content:

In this paper, we report an active contour algorithm that is capable of using prior shapes. The energy functional of the contour is modified so that the energy depends on the image gradient as well as the prior shape. The model provides the segmentation and the transformation that maps the segmented contour to the prior shape. The active contour is able to find boundaries that are similar in shape to the prior, even when the entire boundary is not visible in the image (i.e., when the boundary has gaps). A level set formulation of the active contour is presented. The existence of the solution to the energy minimization is also established. ::: ::: We also report experimental results of the use of this contour on 2d synthetic images, ultrasound images and fMRI images. Classical active contours cannot be used in many of these images.
---
paper_title: 3-D active appearance models: segmentation of cardiac MR and ultrasound images

paper_content:

A model-based method for three-dimensional image segmentation was developed and its performance assessed in segmentation of volumetric cardiac magnetic resonance (MR) images and echocardiographic temporal image sequences. Comprehensive design of a three-dimensional (3-D) active appearance model (AAM) is reported for the first time as an involved extension of the AAM framework introduced by Cootes et al. The model's behavior is learned from manually traced segmentation examples during an automated training stage. Information about shape and image appearance of the cardiac structures is contained in a single model. This ensures a spatially and/or temporally consistent segmentation of three-dimensional cardiac images. The clinical potential of the 3-D AAM is demonstrated in short-axis cardiac MR images and four-chamber echocardiographic sequences. The method's performance was assessed by comparison with manually identified independent standards in 56 clinical MR and 64 clinical echo image sequences. The AAM method showed good agreement with the independent standard using quantitative indexes of border positioning errors, endo- and epicardial volumes, and left ventricular mass. In MR, the endocardial volumes, epicardial volumes, and left ventricular wall mass correlation coefficients between manual and AAM were R/sup 2/=0.94,0.97,0.82, respectively. For echocardiographic analysis, the area correlation was R/sup 2/=0.79. The AAM method shows high promise for successful application to MR and echocardiographic image analysis in a clinical setting.
---
paper_title: A multiple active contour model for cardiac boundary detection on echocardiographic sequences

paper_content:

Tracing of left-ventricular epicardial and endocardial borders on echocardiographic sequences is essential for quantification of cardiac function. The authors designed a method based on an extension of active contour models to detect both epicardial and endocardial borders on short-axis cardiac sequences spanning the entire cardiac cycle. They validated the results by comparing the computer-generated boundaries to the boundaries manually outlined by four expert observers on 44 clinical data sets. The mean boundary distance between the computer-generated boundaries and the manually outlined boundaries was 2.80 mm (/spl sigma/=1.28 mm) for the epicardium and 3.61 (/spl sigma/=1.68 mm) for the endocardium. These distances were comparable to interobserver distances, which had a mean of 3.79 mm (/spl sigma/=1.53 mm) for epicardial borders and 2.67 mm (/spl sigma/=0.88 mm) for endocardial borders. The correlation coefficient between the areas enclosed by the computer-generated boundaries and the average manually outlined boundaries was 0.95 for epicardium and 0.91 for endocardium. The algorithm is fairly insensitive to the choice of the initial curve. Thus, the authors have developed an effective and robust algorithm to extract left-ventricular boundaries from echocardiographic sequences.
---
paper_title: Unsupervised Contour Representation and Estimation Using B-Splines and a Minimum Description Length Criterion

paper_content:

This paper describes a new approach to adaptive estimation of parametric deformable contours based on B-spline representations. The problem is formulated in a statistical framework with the likelihood function being derived from a region-based image model. The parameters of the image model, the contour parameters, and the B-spline parameterization order (i.e., the number of control points) are all considered unknown. The parameterization order is estimated via a minimum description length (MDL) type criterion. A deterministic iterative algorithm is developed to implement the derived contour estimation criterion, the result is an unsupervised parametric deformable contour: it adapts its degree of smoothness/complexity (number of control points) and it also estimates the observation (image) model parameters. The experiments reported in the paper, performed on synthetic and real (medical) images, confirm the adequate and good performance of the approach.
---
paper_title: Using prior shape and intensity profile in medical image segmentation

paper_content:

In this note we present a coupled optimization model for boundary determination. One part of the model incorporates a prior shape into a geometric active contour model with a fixed parameter. The second part determines the 'best' parameter used in the first part by maximizing the mutual information of the image geometry between the prior and an aligned novel image over all the alignments that are the solutions of the first part corresponding to different parameters. We also present an alternative method, which generates an intensity model formed as the average of a set of aligned training images. Experimental results on cardiac ultrasound images are presented. These results indicate that the proposed model provides close agreement with expert traced borders, and the parameter determined in this model for one image can be used for images with similar properties. The existence of a solution to the proposed minimization problem is also discussed.
---
paper_title: 2D+T acoustic boundary detection in echocardiography

paper_content:

Abstract In this paper we address the problem of spatio-temporal acoustic boundary detection in echocardiography. We propose a phase-based feature detection method to be used as the front end to higher-level 2D+T/3D+T reconstruction algorithms. We develop a 2D+T version of this algorithm and illustrate its performance on some typical echocardiogram sequences. We show how our temporal-based algorithm helps to reduce the number of spurious feature responses due to speckle and provides feature velocity estimates. Further, our approach is intensity-amplitude invariant. This makes it particularly attractive for echocardiographic segmentation, where choosing a single global intensity-based edge threshold is problematic.
---
paper_title: Automatic cardiac LV boundary detection and tracking using hybrid fuzzy temporal and fuzzy multiscale edge detection

paper_content:

This paper describes a new fully automatic fuzzy multiresolution-based algorithm for cardiac left ventricular (LV) epicardial and endocardial boundary detection and tracking on a sequence of short axis (SA) echocardiographic images of a complete cardiac cycle. This is a necessary step for automatic quantification of cardiac function using echo images, The proposed method is a "center-based" approach in which epicardial and endocardial boundary edge points are searched for on radial lines emanating from the LV center point. The central point of the LV cavity is estimated using a fuzzy-based technique in which the "uncertain" spatial, morphological, and intensity information of the image are represented as fuzzy sets and then combined by fuzzy operators. Edge-detection stage uses multiscale spatial and temporal information in a fuzzy multiresolution framework to identify a single moving edge point for each one of the epicardial and endocardial boundaries over the M radii in the N frames of a complete cardiac cycle. The raw extracted edge points are then processed in the wavelet domain to reduce the effects of noise from the boundaries and papillary muscles from the endocardial boundary extraction process. Finally, a uniform cubic B-spline approximation method is used to define the closed LV boundaries. Experiments with simulated and real echocardiographic images are presented.
---
paper_title: Automated 3-D echocardiography analysis compared with manual delineations and SPECT MUGA

paper_content:

A major barrier for using 3-D echocardiography for quantitative analysis of heart function in routine clinical practice is the absence of accurate and robust segmentation and tracking methods necessary to make the analysis automatic. In this paper, we present an automated three-dimensional (3-D) echocardiographic acquisition and image-processing methodology for assessment of left ventricular (LV) function. We combine global image information provided by a novel multiscale fuzzy-clustering segmentation algorithm, with local boundaries obtained with phase-based acoustic feature detection. We then use the segmentation results to fit and track the LV endocardial surface using a 3-D continuous transformation. To our knowledge, this is the first report of a completely automated method. The protocol is evaluated in a small clinical case study (nine patients). We compare ejection fractions (EFs) computed with the new approach to those obtained using the standard clinical technique, single-photon emission computed tomography multigated acquisition. Errors on six datasets were found to be within six percentage points. A further two, with poor image quality, improved upon EFs from manually delineated contours, and the last failed due to artifacts in the data. Volume-time curves were derived and the results compared to those from manual segmentation. Improvement over an earlier published version of the method is noted.
---
paper_title: Image-flow computation: an estimation-theoretic framework and a unified perspective

paper_content:

Abstract Image flow is a major source of three-dimensional information. This paper describes a new framework for computing image flow from time-varying imagery. In this framework, image-flow information is classified into two categories—conservation information and neighborhood information. Each type of information is recovered in the form of an estimate accompanied by a covariance matrix. Image flow is then computed by fusing the two estimates using estimation-theoretic techniques. This framework offers the following principal advantages. First, it allows estimation of certain types of discontinuous flow fields without any a priori knowledge about the location of discontinuities. The flow fields thus recovered are not blurred at motion boundaries. Second, covariance matrices (or alternatively, confidence measures) are associated with the estimate of image flow at each stage of computation. The estimation-theoretic nature of the framework and its ability to provide covariance matrices make it very useful in the context of applications such as incremental estimation of scene depth using techniques based on Kalman filtering. Finally, this framework serves to unify various existing approaches for image-flow estimation. In this paper, two algorithms based on this framework are described and are used to recover image flow from a variety of image sequences. To illustrate the usefulness of the framework in the context of an application, the image-flow estimates and their covariance matrices recovered from some representative image sequences are also used to recover scene depth.
---
paper_title: Segmentation and tracking in echocardiographic sequences: active contours guided by optical flow estimates

paper_content:

This paper presents a method for segmentation and tracking of cardiac structures in ultrasound image sequences. The developed algorithm is based on the active contour framework. This approach requires initial placement of the contour close to the desired position in the image, usually an object outline. Best contour shape and position are then calculated, assuming that at this configuration a global energy function, associated with a contour, attains its minimum. Active contours can be used for tracking by selecting a solution from a previous frame as an initial position in a present frame. Such an approach, however, fails for large displacements of the object of interest. This paper presents a technique that incorporates the information on pixel velocities (optical flow) into the estimate of initial contour to enable tracking of fast-moving objects. The algorithm was tested on several ultrasound image sequences, each covering one complete cardiac cycle. The contour successfully tracked boundaries of mitral valve leaflets, aortic root and endocardial borders of the left ventricle. The algorithm-generated outlines were compared against manual tracings by expert physicians. The automated method resulted in contours that were within the boundaries of intraobserver variability.
---
paper_title: A Coupled Minimization Problem for Medical Image Segmentation with Priors

paper_content:

We present a coupled minimization problem for image segmentation using prior shape and intensity profile. One part of the model minimizes a shape related energy and the energy of geometric active contour with a parameter that balances the influence from these two. The minimizer corresponding to a fixed parameter in this minimization gives a segmentation and an alignment between the segmentation and prior shape. The second part of this model optimizes the selection of the parameter by maximizing the mutual information of image geometry between the prior and the aligned novel image over all the alignments corresponding to different parameters in the first part. By this coupling the segmentation arrives at higher image gradient, forms a shape similar to the prior, and captures the prior intensity profile. We also propose using mutual information of image geometry to generate intensity model from a set of training images. Experimental results on cardiac ultrasound images are presented. These results indicate that the proposed model provides close agreement with expert traced borders, and the parameter determined in this model for one image can be used for images with similar properties.
---
paper_title: A shape-space-based approach to tracking myocardial borders and quantifying regional left-ventricular function applied in echocardiography

paper_content:

This paper presents a new semi-automatic method for quantifying regional heart function from two-dimensional echocardiography. In the approach, we first track the endocardial and epicardial boundaries using a new variant of the dynamic snake approach. The tracked borders are then decomposed into clinically meaningful regional parameters, using a novel interpretational shape-space motivated by the 16-segment model used in clinical practice for qualitative assessment of heart function. We show how a quantitative and automatic scoring scheme for the endocardial excursion and myocardial thickening can be derived from this. Results illustrating our approach on apical long-axis two-chamber-view data from a patient with a myocardial infarct in the apical anterior/inferior region of the heart are presented. In a case study (five patients, nine data sets) the performance of the tracking and interpretation techniques are compared with manual delineations of borders using a number of quantitative measures of regional comparison.
---
paper_title: Segmentation of sequences of echocardiographic images using a simplified 3D active contour model with region-based external forces

paper_content:

A method of segmenting echocardiography images based on three dimensional (two spatial and one time) surface was developed and tested on transcutaneous images from 38 patients and a four-dimensional (three spatial and one time) transesophageal scan of one patient. Active contour models with finite elements representing the curves in the imaging planes and finite difference description linking curves from time frame to time frame were employed. Region-based external forces were incorporated into the framework of the model and an analytical procedure for estimating the values of most of the model parameters was developed and used.
---
paper_title: Endocardial Boundary E timation and Tracking in Echocardiographic Images using Deformable Template and Markov Random Fields

paper_content:

We present a new approach to shape-based segmentation and tracking of deformable anatomical structures in medical images, and validate this approach by detecting and tracking the endocardial contour in an echocardiographic image sequence. To this end, some global prior shape knowledge of the endocardial boundary is captured by a prototype template with a set of predefined global and local deformations to take into account its inherent natural variability over time. In this deformable model-based Bayesian segmentation, the data likelihood model relies on an accurate statistical modelling of the grey level distribution of each class present in the ultrasound image. The parameters of this distribution mixture are given by a preliminary iterative estimation step. This estimation scheme relies on a Markov Random Field prior model, and takes into account the imaging process as well as the distribution shape of each class present in the image. Then the detection and the tracking problem is stated in a Bayesian framework, where it ends up as a cost function minimisation problem for each image of the sequence. In our application, this energy optimisation problem is efficiently solved by a genetic algorithm combined with a steepest ascent procedure. This technique has been successfully applied on synthetic images, and on a real echocardiographic image sequence.
---
paper_title: Evaluating a robust contour tracker on echocardiographic sequences

paper_content:

Abstract In this paper we present an evaluation of a robust visual image tracker on echocardiographic image sequences. We show how the tracking framework can be customized to define an appropriate shape space that describes heart shape deformations that can be learnt from a training data set. We also investigate energy-based temporal boundary enhancement methods to improve image feature measurement. Results are presented demonstrating real-time tracking on real normal heart motion data sequences and abnormal synthesized and real heart motion data sequences. We conclude by discussing some of our current research efforts.
---
paper_title: Segmentation of ultrasound B-mode images with intensity inhomogeneity correction

paper_content:

Displayed ultrasound (US) B-mode images often exhibit tissue intensity inhomogeneities dominated by nonuniform beam attenuation within the body. This is a major problem for intensity-based, automatic segmentation of video-intensity images because conventional threshold-based or intensity-statistic-based approaches do not work well in the presence of such image distortions. Time gain compensation (TGC) is typically used in standard US machines in an attempt to overcome this. However this compensation method is position-dependent which means that different tissues in the same TGC time-range (or corresponding depth range) will be, incorrectly, compensated by the same amount. Compensation should really be tissue-type dependent but automating this step is difficult. The main contribution of this paper is to develop a method for simultaneous estimation of video-intensity inhomogeities and segmentation of US image tissue regions. The method uses a combination of the maximum a posteriori (MAP) and Markov random field (MRF) methods to estimate the US image distortion field assuming it follows a multiplicative model while at the same time labeling image regions based on the corrected intensity statistics. The MAP step is used to estimate the intensity model parameters while the MRF step provides a novel way of incorporating the distributions of image tissue classes as a spatial smoothness constraint. We explain how this multiplicative model can be related to the ultrasonic physics of image formation to justify our approach. Experiments are presented on synthetic images and a gelatin phantom to evaluate quantitatively the accuracy of the method. We also discuss qualitatively the application of the method to clinical breast and cardiac US images. Limitations of the method and potential clinical applications are outlined in the conclusion.
---
paper_title: Multiscale minimization of global energy functions in some visual recovery problems

paper_content:

Abstract Many image analysis and computer vision problems have been expressed as the minimization of global energy functions describing the interactions between the observed data and the image representations to be extracted in a given task. In this note, we investigate a new comprehensive approach to minimize global energy functions using a multiscale relaxation algorithm. The energy function is minimized over nested subspaces of the original space of possible solutions. These subspaces consist of solutions which are constrained at different scales. The constrained relaxation is implemented via a coarse-to-fine multiresolution algorithm that yields fast convergence towards high quality estimates when compared to standard monoresolution or multigrid relaxation schemes. It also appears to be far less sensitive to local minima than standard relaxation algorithms. The efficiency of the approach is demonstrated on a highly nonlinear combinatorial problem which consists of estimating long-range motion in an image sequence on a discrete label space. The method is compared to standard relaxation algorithms on real world and synthetic image sequences.
---
paper_title: Quantitative regional analysis of myocardial wall motion.

paper_content:

Abstract This paper presents a new technique for semiautomatic quantification of regional heart function from 2-D echocardiography. It uses a novel left ventricular border tracking algorithm based on shape-space ideas that we have recently described. In this paper, we show how to decompose the tracked output into clinically meaningful segmental parameters (wall excursion and thickening), using what we call a computational interpretational space (CIS). This leads to a quantitative and automatic scoring scheme for endocardial excursion and myocardial thickening. The method is illustrated on data from a patient with a myocardial infarct in the apical anterior/inferior region of the heart and is also assessed in a small retrospective dobutamine stress echocardiography clinical case study. (E-mail: noble@robots.ox.ac.uk)
---
paper_title: Artificial neural networks and spatial temporal contour linking for automated endocardial contour detection on echocardiograms: a novel approach to determine left ventricular contractile function.

paper_content:

This study investigated the use of artificial neural networks (ANN) for image segmentation and spatial temporal contour linking for the detection of endocardial contours on echocardiographic images. Using a backpropagation network, the system was trained with 279 sample regions obtained from eight training images to segment images into either tissue or blood pool region. The ANN system was then applied to parasternal short axis images of 38 patients. Spatial temporal contour linking was performed on the segmented images to extract endocardial boarders. Left ventricular areas (end-systolic and end-diastolic) determined with the automated system were calculated and compared to results obtained by manual contour tracing performed by two independent investigators. In addition, ejection fractions (EF) were derived using the area-length method and compared with radionuclide ventriculography. Image quality was classified as good in 12 (32%), moderate in 13 (34%) and poor in 13 (34%) patients. The ANN system provided estimates of end-diastolic and end-systolic areas in 36 (89%) of echocardiograms, which correlated well with those obtained by manual tracing (R = 0.99, SEE = 1.44). A good agreement was also found for the comparison of EF between the ANN system and Tc-radionuclide ventriculography (RNV, R = 0.93, SEE = 6.36). The ANN system also performed well in the subset of patients with poor image quality. Endocardial contour detection using artificial neural networks and spatial temporal contour linking allows accurate calculations of ventricular areas from transthoracic echocardiograms and performs well even in images with poor quality. This system could greatly enhance the feasibility, accuracy and reproducibility of calculating cardiac areas to derive left ventricular volumes and ejection fractions.
---
paper_title: Segmentation of echocardiographic images using mathematical morphology

paper_content:

A semiautomatic technique for isolating the ventricular endocardial border in echocardiograms from a commercially available two-dimensional phased array ultrasound system is presented. This method processes echo images using mathematical morphology to reduce the effects of range and azimuth variation inherent in echo. After morphological filtering, the endocardial border is extracted with traditional segmentation methods. Further processing of the resulting border using binary morphology produces a region of interest suitable for derivation of motion parameters of the endocardium. The area and the shape of semiautomatically-derived regions correlate well (r>0.93) with those defined by expert observers in a study of induced ischemia in seven canines. >
---
paper_title: 3-D freehand echocardiography for automatic left ventricle reconstruction and analysis based on multiple acoustic windows

paper_content:

A new method is proposed to reconstruct and analyze the left ventricle (LV) from multiple acoustic window three-dimensional (3-D) ultrasound acquired using a transthoracic 3-D rotational probe. Prior research in this area has been based on one acoustic window acquisition. However, the data suffers from several limitations that degrade the reconstruction and reduce the clinical value of interpretation, such as the presence of shadow due to bone (ribs) and air (in the lungs) and motion of the probe during the acquisition. In this paper, we show how to overcome these limitations by automatically fusing information from multiple acoustic window sparse-view acquisitions and using a position sensor to track the probe in real time. Geometric constraints of the object shape, and spatiotemporal information relating to the image acquisition process, are used in new algorithms for 1) grouping endocardial edge cues from an initial image segmentation and 2) defining a novel reconstruction method that utilizes information from multiple acoustic windows. The new method has been validated on a phantom and three real heart data sets. In the phantom study, one finger of a latex glove was scanned from two acoustic windows and reconstructed using the new method. The volume error was measured to be less than 4%. In the clinical case study, 3-D ultrasound and magnetic resonance imaging (MRI) scanning were performed on the same healthy volunteers. Quantitative ejection fractions (EFs) and volume-time curves over a cardiac cycle were estimated using the new method and compared to cardiac MRI measurements. This showed that the new method agrees better with MRI measurements than the previous approach we have developed based on a single acoustic window. The EF errors of the new method with respect to MRI measurements were less than 6%. A more extensive clinical validation is required to establish whether these promising first results translate to a method suitable for routine clinical use.
---
paper_title: Morphological image sequence processing

paper_content:

We present a morphological multi-scale method for image sequence processing, which results in a truly coupled spatio-temporal anisotropic diffusion. The aim of the method is not to smooth the level-sets of single frames but to denoise the whole sequence while retaining geometric features such as spatial edges and highly accelerated motions. This is obtained by an anisotropic spatio-temporal level-set evolution, where the additional artificial time variable serves as the multi-scale parameter. The diffusion tensor of the evolution depends on the morphology of the sequence, given by spatial curvatures of the level-sets and the curvature of trajectories (=acceleration) in sequence-time. We discuss different regularization techniques and describe an operator splitting technique for solving the problem. Finally we compare the new method with existing multi-scale image sequence processing methodologies.
---
paper_title: On Anisotropic Geometric Diffusion in 3D Image Processing and Image Sequence Analysis

paper_content:

A morphological multiscale method in 3D image and 3D image sequence processing is discussed which identifies edges on level sets and the motion of features in time. Based on these indicator evaluation the image data is processed applying nonlinear diffusion and the theory of geometric evolution problems. The aim is to smooth level sets of a 3D image while preserving geometric features such as edges and corners on the level sets and to simultaneously respect the motion and acceleration of object in time. An anisotropic curvature evolution is considered in space. Whereas, in case of an image sequence a weak coupling of these separate curvature evolutions problems is incorporated in the time direction of the image sequence. The time of the actual evolution problem serves as the multiscale parameter. The spatial diffusion tensor depends on a regularized shape operator of the evolving level sets and the evolution speed is weighted according to an approximation of the apparent acceleration of objects. As one suitable regularization tool local L 2—projection onto polynomials is considered. A spatial finite element discretization on hexahedral meshes, a semi-implicit, regularized backward Euler discretization in time, and an explicit coupling of subsequent images in case of image sequences are the building blocks of the algorithm. Different applications underline the efficiency of the presented image processing tool.
---
paper_title: A level set method for anisotropic geometric diffusion in 3D image processing

paper_content:

A new morphological multiscale method in three-dimensional (3D) image processing is presented which combines the image processing methodology based on nonlinear diffusion equations and the theory of geometric evolution problems. Its aim is to smooth the level sets of a 3D image while simultaneously preserving geometric features such as edges and corners on the level sets. This is obtained by an anisotropic curvature evolution, where time serves as the multiscale parameter. Thereby the diffusion tensor depends on a regularized shape operator of the evolving level sets. As one suitable regularization, local L2 projection onto quadratic polynomials is considered. The method is compared to a related parametric surface approach, and a geometric interpretation of the evolution and its invariance properties is given. A spatial finite element discretization on hexahedral meshes and a semi-implicit, regularized backward Euler discretization in time are the building blocks of the easy-to-code algorithm. Different a...
---
paper_title: LV volume quantification via spatiotemporal analysis of real-time 3-D echocardiography

paper_content:

This paper presents a method of four-dimensional (4-D) (3-D+Time) space-frequency analysis for directional denoising and enhancement of real-time three-dimensional (RT3D) ultrasound and quantitative measures in diagnostic cardiac ultrasound. Expansion of echocardiographic volumes is performed with complex exponential wavelet-like basis functions called brushlets. These functions offer good localization in time and frequency and decompose a signal into distinct patterns of oriented harmonics, which are invariant to intensity and contrast range. Deformable-model segmentation is carried out on denoised data after thresholding of transform coefficients. This process attenuates speckle noise while preserving cardiac structure location. The superiority of 4-D over 3-D analysis for decorrelating additive white noise and multiplicative speckle noise on a 4-D phantom volume expanding in time is demonstrated. Quantitative validation, computed for contours and volumes, is performed on in vitro balloon phantoms. Clinical applications of this spatiotemporal analysis tool are reported for six patient cases providing measures of left ventricular volumes and ejection fraction.
---
paper_title: A morphological, affine, and Galilean invariant scale-space for movies.

paper_content:

We study a model of multiscale analysis (or scale-space) applied to movies. This model comes from a thorough formalization that has been done in the theory of scale-space of static image. This formulation has led to associate with each multiscale analysis a partial differential equation (PDE). We intend here to examine the case of movies, and to insist on the motion aspects. More precisely, it has been proved in that there exists a unique affine and morphological and Galilean invariant scale-space for movies, the AMG model. This model is described by a partial differential equation. In this paper,we focus on terms appearing in that equation. We show that this model provides a reliable definition of an optical multiscale acceleration. At the practical level, scale is interpreted as a way of characterizing reliable trajectories. As we prove by experiments,the AMG model is a riddle for decimating spurious trajectories due to any kinds of nonadditive impurities and noise. Simple discrete formulae are given to implement the model.
---
paper_title: Recovery of the 3-D shape of the left ventricle from echocardiographic images

paper_content:

A computational method is reported which allows the fully automated recovery of the three-dimensional shape of the cardiac left ventricle from a reduced set of apical echo views. Two typically ill-posed problems have been faced: 1) the detection of the left ventricle contours in each view, and 2) the integration of the detected contour points (which form a sparse and partially inconsistent data set) into a single surface representation. The authors' solution to these problems is based on a careful integration of standard computer vision algorithms with neural networks. Boundary detection comprises three steps: edge detection, edge grouping, and edge classification. The first and second steps (which are typical early-vision tasks not involving specific domain-knowledge) have been performed through fast, well-established algorithms of computer vision. The higher level task of left ventricle-edge discrimination, which involves the exploitation of specific knowledge about the left ventricle silhouette, has been performed by feedforward neural networks. Following the most recent results in the field of computer vision, the first step in solving the problem of recovering the ventricle surface has been the adoption of a physically inspired model of it. Basically, the authors have modeled the left ventricle surface as a closed, thin, elastic surface and the data as a set of radial springs acting on it. The recovery process is equivalent to the settling of the surface-plus-springs system into a stable configuration of minimum potential energy. The finite element discretization of this model leads directly to an analog neural-network implementation. The efficiency of such an implementation has been remarkably enhanced through a learning algorithm which embeds specific knowledge about the shape of the left ventricle in the network. Experiments using clinical echographic sequences are described. Four apical views (each with a different rotation of the probe) have been acquired during a heartbeat from a set of seven normal subjects. These images have been utilized to set the various processing modules and test their capabilities. >
---
paper_title: Left ventricular volume estimation for real-time three-dimensional echocardiography

paper_content:

The application of level set techniques to echocardiographic data is presented. This method allows semiautomatic segmentation of heart chambers, which regularizes the shapes and improves edge fidelity, especially in the presence of gaps, as is common in ultrasound data. The task of the study was to reconstruct left ventricular shape and to evaluate left ventricular volume. Data were acquired with a real-time three-dimensional (3-D) echocardiographic system. The method was applied directly in the three-dimensional domain and was based on a geometric-driven scheme. The numerical scheme for solving the proposed partial differential equation is borrowed from numerical methods for conservation law. Results refer to in vitro and human in vivo acquired 3-D+time echocardiographic data. Quantitative validation was performed on in vitro balloon phantoms. Clinical application of this segmentation technique is reported for 20 patient cases providing measures of left ventricular volumes and ejection fraction.
---
paper_title: Subjective surfaces: a geometric model for boundary completion

paper_content:

We present a geometric model and a computational method for segmentation of images with missing boundaries. In many situations, the human visual system fills in missing gaps in edges and boundaries, building and completing information that is not present. Boundary completion presents a considerable challenge in computer vision, since most algorithms attempt to exploit existing data. A large body of work concerns completion models, which postulate how to construct missing data; these models are often trained and specific to particular images. In this paper, we take the following, alternative perspective: we consider a reference point within an image as given, and then develop an algorithm which tries to build missing information on the basis of the given point of view and the available information as boundary data to the algorithm. Starting from this point of view, a surface is constructed. It is then evolved with the mean curvature flow in the metric induced by the image until a piecewise constant solution is reached. We test the computational model on modal completion, amodal completion, texture, photo and medical images. We extend the geometric model and the algorithm to 3D in order to extract shapes from low signal/noise ratio medical volumes. Results in 3D echocardiography and 3D fetal echography are presented.
---
paper_title: ROPES: a semiautomated segmentation method for accelerated analysis of three-dimensional echocardiographic data

paper_content:

Echocardiography (cardiac ultrasound) is today the predominant technique for quantitative assessment of cardiac function and valvular heart lesions. Segmentation of cardiac structures is required to determine many important diagnostic parameters. As the heart is a moving organ, reliable information can be obtained only from three-dimensional (3-D) data over time (3-D + time = 4-D). Due to their size, the resulting four-dimensional (4-D) data sets are not reasonably accessible to simple manual segmentation methods. Automatic segmentation often yields unsatisfactory results in a clinical environment, especially for ultrasonic images. We describe a semiautomated segmentation algorithm (ROPES) that is able to greatly reduce the time necessary for user interaction and its application to extract various parameters from 4-D echocardiographic data. After searching for candidate contour points, which have to fulfill a multiscale edge criterion, the candidates are connected by minimizing a cost function to line segments that then are connected to form a closed contour. The contour is automatically checked for plausibility. If necessary, two correction methods that can also be used interactively are applied (fitting of other line segments into the contour and searching for additional candidates with a relaxed criterion). The method is validated using in vivo transesophageal echocardiographic data sets.
---
paper_title: Nonlinear Multiscale Analysis of 3D Echocardiographic Sequences

paper_content:

Introduces a new model for multiscale analysis of space-time echocardiographic sequences. The proposed nonlinear partial differential equation, representing the multiscale analysis, filters the sequence while keeping the space-time coherent structures. It combines the ideas of regularized Perona-Malik anisotropic diffusion and the Galilean invariant movie multiscale analysis of Alvarez et al. (Arch. Rat. Mech. Anal., vol. 123, p. 200-57, 1993). A numerical method for solving the proposed partial differential equation is suggested and its stability is shown. Computational results on synthesized and real sequences are provided. A qualitative and quantitative evaluation of the accuracy of the method is presented.
---
paper_title: Subjective surfaces: A method for completing missing boundaries

paper_content:

We present a model and algorithm for segmentation of images with missing boundaries. In many situations, the human visual system fills in missing gaps in edges and boundaries, building and completing information that is not present. This presents a considerable challenge in computer vision, since most algorithms attempt to exploit existing data. Completion models, which postulate how to construct missing data, are popular but are often trained and specific to particular images. In this paper, we take the following perspective: We consider a reference point within an image as given and then develop an algorithm that tries to build missing information on the basis of the given point of view and the available information as boundary data to the algorithm. We test the algorithm on some standard images, including the classical triangle of Kanizsa and low signal/noise ratio medical images.
---
paper_title: Integrated surface model optimization for freehand three-dimensional echocardiography

paper_content:

The major obstacle of three-dimensional (3-D) echocardiography is that the ultrasound image quality is too low to reliably detect features locally. Almost all available surface-finding algorithms depend on decent quality boundaries to get satisfactory surface models. We formulate the surface model optimization problem in a Bayesian framework, such that the inference made about a surface model is based on the integration of both the low-level image evidence and the high-level prior shape knowledge through a pixel class prediction mechanism. We model the probability of pixel classes instead of making explicit decisions about them. Therefore, we avoid the unreliable edge detection or image segmentation problem and the pixel correspondence problem. An optimal surface model best explains the observed images such that the posterior probability of the surface model for the observed images is maximized. The pixel feature vector as the image evidence includes several parameters such as the smoothed grayscale value and the minimal second directional derivative. Statistically, we describe the feature vector by the pixel appearance probability model obtained by a nonparametric optimal quantization technique. Qualitatively, we display the imaging plane intersections of the optimized surface models together with those of the ground-truth surfaces reconstructed from manual delineations. Quantitatively, we measure the projection distance error between the optimized and the ground-truth surfaces. In our experiment, we use 20 studies to obtain the probability models offline. The prior shape knowledge is represented by a catalog of 86 left ventricle surface models. In another set of 25 test studies, the average epicardial and endocardial surface projection distance errors are 3.2 +/- 0.85 mm and 2.6 +/- 0.78 mm, respectively.
---
paper_title: Epicardial boundary detection using fuzzy reasoning

paper_content:

A fully automated system for detecting the endocardial and epicardial boundaries in a two-dimensional echocardiography by using fuzzy reasoning techniques is proposed. The image is first enhanced by applying the Laplacian-of-Gaussian edge detector. Second, the center of the left ventricle is determined automatically by analyzing the original image. Next, a search process radiated from the estimated center is performed to locate the endocardial boundary by using the zero-crossing points. After this step, the estimation of the range of radius of a possible epicardial boundary is carried out by comparing the high-level knowledge of intensity changes along all directions with the actual image intensity changes. The high-level knowledge of global intensity change in the image is acquired from experts in advance, and is represented in the form of fuzzy linguistic descriptions and relations. Knowledge of local intensity change can therefore be deduced from the knowledge of global intensity change through fuzzy reasoning. >
---
paper_title: Automatic segmentation of echocardiographic sequences by active appearance motion models

paper_content:

A novel extension of active appearance models (AAMs) for automated border detection in echocardiographic image sequences is reported. The active appearance motion model (AAMM) technique allows fully automated robust and time-continuous delineation of left ventricular (LV) endocardial contours over the full heart cycle with good results. Nonlinear intensity normalization was developed and employed to accommodate ultrasound-specific intensity distributions. The method was trained and tested on 16-frame phase-normalized transthoracic four-chamber sequences of 129 unselected infarct patients, split randomly into a training set (n = 65) and a test set (n = 64). Borders were compared to expert drawn endocardial contours. On the test set, fully automated AAMM performed well in 97% of the cases (average distance between manual and automatic landmark points was 3.3 mm, comparable to human interobserver variabilities). The ultrasound-specific intensity normalization proved to be of great value for good results in echocardiograms. The AAMM was significantly more accurate than an equivalent set of two-dimensional AAMs.
---
paper_title: Echocardiographic texture analysis using the wavelet transform: differentiation of early heart muscle disease.

paper_content:

Echocardiographic quantitation of myocardial texture for diagnosis of early cardiomyopathy (CMP) remains problematic. Conventional statistical methods are limited, contributed by a small image region-of-interest (ROI) and difficulty in discrimination from noise. This study was performed to evaluate the 2-D Haar wavelet decomposition method as a tool to identify textural changes in a rat model of early CMP, focusing on changes that occur before development of M-mode structural abnormalities. Early diabetic CMP, ethanol CMP and diabetic-ethanol CMP rat models were evaluated. Echocardiography was performed on two groups of rats. Group I (5 week cohort, n = 4 per subgroup) included controls, rats on 12% ethanol, a diabetic subgroup, and diabetic rats on 4% ethanol. Group II (10 week cohort, n = 5 per subgroup) included the same categories as group I with an additional subgroup taking 4% ethanol was also studied. M-mode left ventricular measurements were comparable in all subgroups of group I. However, diabetic rats in group II had an increased left ventricular dimension (LVD) compared to all others and an increased septal dimension (IVSD) and posterior wall dimension (PWD) were noted in the 4% and 12% ethanol groups. End-diastolic digital images of all rats in the parasternal short axis view, at the papillary muscle level, were downloaded to a computer. A 16 x 16 (ROI) was selected from the anterior interventricular septum. Although standard statistical methods could not differentiate any of the groups, calculation of textural energy and normalized textural energy with the 2-D Haar wavelet decomposition method found at 5 weeks increased normalized texture energy in diabetics compared to all others. At 10 weeks increased texture energy was noted in diabetics. Diabetic-ethanol rats at both 5 and 10 weeks revealed a blunted textural energy compared to diabetic rats. In a rat model of diabetic cardiomyopathy, the 2-D wavelet decomposition method identified textural energy changes before development of echocardiographic structural changes. Ethanol-associated blunting of textural changes in diabetic rats was also noted. This method for quantitation of ventricular texture may be relevant for diagnosis of early cardiomyopathy.
---
paper_title: 3-D active appearance models: segmentation of cardiac MR and ultrasound images

paper_content:

A model-based method for three-dimensional image segmentation was developed and its performance assessed in segmentation of volumetric cardiac magnetic resonance (MR) images and echocardiographic temporal image sequences. Comprehensive design of a three-dimensional (3-D) active appearance model (AAM) is reported for the first time as an involved extension of the AAM framework introduced by Cootes et al. The model's behavior is learned from manually traced segmentation examples during an automated training stage. Information about shape and image appearance of the cardiac structures is contained in a single model. This ensures a spatially and/or temporally consistent segmentation of three-dimensional cardiac images. The clinical potential of the 3-D AAM is demonstrated in short-axis cardiac MR images and four-chamber echocardiographic sequences. The method's performance was assessed by comparison with manually identified independent standards in 56 clinical MR and 64 clinical echo image sequences. The AAM method showed good agreement with the independent standard using quantitative indexes of border positioning errors, endo- and epicardial volumes, and left ventricular mass. In MR, the endocardial volumes, epicardial volumes, and left ventricular wall mass correlation coefficients between manual and AAM were R/sup 2/=0.94,0.97,0.82, respectively. For echocardiographic analysis, the area correlation was R/sup 2/=0.79. The AAM method shows high promise for successful application to MR and echocardiographic image analysis in a clinical setting.
---
paper_title: Tracking the left ventricle in echocardiographic images by learning heart dynamics

paper_content:

In this paper a temporal learning-filtering procedure is applied to refine the left ventricle (LV) boundary detected by an active-contour model. Instead of making prior assumptions about the LV shape or its motion, this information is incrementally gathered directly from the images and is exploited to achieve more coherent segmentation. A Hough transform technique is used to find an initial approximation of the object boundary at the first frame of the sequence. Then, an active-contour model is used in a coarse-to-fine framework, for the estimation of a noisy LV boundary. The PCA transform is applied to form a reduced ordered orthonormal basis of the LV deformations based on a sequence of noisy boundary observations. Then this basis Is used to constrain the motion of the active contour in subsequent frames, and thus provide more coherent identification. Results of epicardial boundary identification in B-mode images are presented.
---
paper_title: Artificial neural networks and spatial temporal contour linking for automated endocardial contour detection on echocardiograms: a novel approach to determine left ventricular contractile function.

paper_content:

This study investigated the use of artificial neural networks (ANN) for image segmentation and spatial temporal contour linking for the detection of endocardial contours on echocardiographic images. Using a backpropagation network, the system was trained with 279 sample regions obtained from eight training images to segment images into either tissue or blood pool region. The ANN system was then applied to parasternal short axis images of 38 patients. Spatial temporal contour linking was performed on the segmented images to extract endocardial boarders. Left ventricular areas (end-systolic and end-diastolic) determined with the automated system were calculated and compared to results obtained by manual contour tracing performed by two independent investigators. In addition, ejection fractions (EF) were derived using the area-length method and compared with radionuclide ventriculography. Image quality was classified as good in 12 (32%), moderate in 13 (34%) and poor in 13 (34%) patients. The ANN system provided estimates of end-diastolic and end-systolic areas in 36 (89%) of echocardiograms, which correlated well with those obtained by manual tracing (R = 0.99, SEE = 1.44). A good agreement was also found for the comparison of EF between the ANN system and Tc-radionuclide ventriculography (RNV, R = 0.93, SEE = 6.36). The ANN system also performed well in the subset of patients with poor image quality. Endocardial contour detection using artificial neural networks and spatial temporal contour linking allows accurate calculations of ventricular areas from transthoracic echocardiograms and performs well even in images with poor quality. This system could greatly enhance the feasibility, accuracy and reproducibility of calculating cardiac areas to derive left ventricular volumes and ejection fractions.
---
paper_title: Detection of lines and boundaries in speckle images-application to medical ultrasound

paper_content:

This paper describes an approach to boundary detection in ultrasound speckle based on an image enhancement technique. The enhancement algorithm works by filtering the image with "sticks," short line segments which are varied in orientation to achieve the maximum projected value at each point. The statistical properties of this approach have been described in an earlier paper; in this work we present three significant extensions to improve the performance of the basic method. First, we investigate the effect of varying the size and shape of the sticks. We show that these variations affect the performance of the algorithm in very fundamental ways, for example by making it more or less sensitive to thinner or more tightly curving boundaries. Second, we present a means of improving the performance of this technique by estimating the distribution function of the orientation of the line passing through each point. Finally, we show that images can be "stained" for easier visual interpretation by applying to each pixel a false color whose hue is related to the orientation of the most prominent line segment at that point. Examples are given to illustrate the performance of the different settings on a single image.
---
paper_title: 3-D breast ultrasound segmentation using active contour model.

paper_content:

In this study, we made use of the discrete active contour model to overcome the natural properties of ultrasound (US) images, speckle, noise and tissue-related textures, to segment the breast tumors precisely. Determination of the real tumor boundary with the snake-deformation process requires an initial contour estimate. However, the manual way to sketch an initial contour is very time-consuming. Thus, we propose an automatic initial contour-finding method that not only maintains the tumor shape, but also is close to the tumor boundary and inside the tumor. During the deformation process, to prevent the snake trapping into the false position caused by tissue-related texture or speckle, we added the edge information as an image feature to define the external force. In addition, because the 3-D volume of a tumor is essentially constructed by a sequence of 2-D images, our method for finding boundaries of a tumor can be extended to 3-D cases. By precisely counting the volume of the 3-D images, we can get the volume of tumor. Finally, we will show that the proposed techniques have rather good performance and lead to a satisfactory result in comparison with the estimated volume and physician's estimate.
---
paper_title: Segmentation of breast tumor in three-dimensional ultrasound images using three-dimensional discrete active contour model.

paper_content:

In this paper, we apply the three-dimensional (3-D) active contour model to a 3-D ultrasonic data file for segmenting of the breast tumor. The 3-D ultrasonic file is composed of a series of two-dimensional (2-D) images. Most of traditional techniques of 2-D image segmentation will not use the information between adjacent images. To suit the property of the 3-D data, we introduce the concept of the 3-D stick, the 3-D morphologic process and the 3-D active contour model. The 3-D stick can get over the problem that the ultrasonic image is full of speckle noise and highlight the edge information in images. The 3-D morphologic process helps to determine the contour of the tumor and the resulting contour can be regarded as the initial contour of the active contour model. Finally, the 3-D active contour model will make the initial contour approach to the real contour of the tumor. However, there is emphasis on these 3-D techniques that they do not consist of a series of 2-D techniques. When they work, they will consider the horizontal, vertical and depth directions at the same time. The use of these 3-D techniques not only segments the 3-D shape but also obtains the volume of the tumor. The volume of the tumor calculated by the proposed method will be compared with the volume calculated by the VOCAL software with the physician's manually drawn shape and it shows that the performance of our method is satisfactory.
---
paper_title: Computerized detection and classification of cancer on breast ultrasound.

paper_content:

RATIONALE AND OBJECTIVES ::: To develop and evaluate a two-stage computerized method that first detects suspicious regions on ultrasound images, and subsequently distinguishes among different lesion types. ::: ::: ::: MATERIALS AND METHODS ::: The first stage of detecting potential lesions was based on expected lesion shape and margin characteristics. After the detection stage, all candidate lesions were classified by a Bayesian neural net based on computer-extracted lesion features. Two separate tasks were performed and evaluated at the classification stage: the first classification task was the distinction between all actual lesions and false-positive detections; the second classification task was the distinction between actual cancer and all other detected lesion candidates (including false-positive detections). The neural nets were trained on a database of 400 cases (757 images), consisting of complex cysts and benign and malignant lesions, and tested on an independent database of 458 cases (1,740 images including 578 normal images). ::: ::: ::: RESULTS ::: In the distinction between all actual lesions and false-positive detections, Az values of 0.94 and 0.91 were obtained with the training and testing data sets, respectively. Sensitivity by patient of 90% at 0.45 false-positive detections per image was achieved for this detection-plus-classification scheme for the testing data set. Distinguishing cancer from all other detections (false-positives plus all benign lesions) proved to be more challenging, and Az values of 0.87 and 0.81 were obtained during training and testing, respectively. Sensitivity by patient of 100% at 0.43 false-positive malignancies per image was achieved in the detection and classification of cancerous lesions for the testing dataset. ::: ::: ::: CONCLUSION ::: The results show promising performance of the computerized lesion detection and classification method, and indicate the potential of such a system for clinical breast ultrasound.
---
paper_title: Computerized lesion detection on breast ultrasound

paper_content:

We investigated the use of a radial gradient index (RGI) filtering technique to automatically detect lesions on breast ultrasound. After initial RGI filtering, a sensitivity of 87% at 0.76 false-positive detections per image was obtained on a database of 400 patients (757 images). Next, lesion candidates were segmented from the background by maximizing an average radial gradient (ARD) index for regions grown from the detected points. At an overlap of 0.4 with a radiologist lesion outline, 75% of the lesions were correctly detected. Subsequently, round robin analysis was used to assess the quality of the classification of lesion candidates into actual lesions and false-positives by a Bayesian neural network. The round robin analysis yielded an Az value of 0.84, and an overall performance by case of 94% sensitivity at 0.48 false-positives per image. Use of computerized analysis of breast sonograms may ultimately facilitate the use of sonography in breast cancer screening programs.
---
paper_title: Diagnosis of breast tumors with sonographic texture analysis using wavelet transform and neural networks.

paper_content:

To increase the ability of ultrasonographic technology for the differential diagnosis of solid breast tumors, we describe a novel computer-aided diagnosis (CADx) system using neural networks for classification of breast tumors. Tumor regions and surrounding tissues are segmented from the physician-located region-of-interest (ROI) images by applying our proposed segmentation algorithm. Cooperating with the segmentation algorithm, three feasible features, including variance contrast, autocorrelation contrast and distribution distortion of wavelet coefficients, were extracted from the ROI images for further classification. A multilayered perceptron (MLP) neural network trained using error back-propagation algorithm with momentum was then used for the differential diagnosis of breast tumors on sonograms. In the experiment, 242 cases (including benign breast tumors from 161 patients and carcinomas from 82 patients) were sampled with k-fold cross-validation (k = 10) to evaluate the performance. The receiver operating characteristic (ROC) area index for the proposed CADx system is 0.9396 +/- 0.0183, the sensitivity is 98.77%, the specificity is 81.37%, the positive predictive value is 72.73% and the negative predictive value is 99.24%. Experimental results showed that our diagnosis model performed very well for breast tumor diagnosis.
---
paper_title: Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions

paper_content:

Breast cancer is the most frequently diagnosed malignancy and the second leading cause of mortality in women . In the last decade, ultrasound along with digital mammography has come to be regarded as the gold standard for breast cancer diagnosis. Automatically detecting tumors and extracting lesion boundaries in ultrasound images is difficult due to their specular nature and the variance in shape and appearance of sonographic lesions. Past work on automated ultrasonic breast lesion segmentation has not addressed important issues such as shadowing artifacts or dealing with similar tumor like structures in the sonogram. Algorithms that claim to automatically classify ultrasonic breast lesions, rely on manual delineation of the tumor boundaries. In this paper, we present a novel technique to automatically find lesion margins in ultrasound images, by combining intensity and texture with empirical domain specific knowledge along with directional gradient and a deformable shape-based model. The images are first filtered to remove speckle noise and then contrast enhanced to emphasize the tumor regions. For the first time, a mathematical formulation of the empirical rules used by radiologists in detecting ultrasonic breast lesions, popularly known as the "Stavros Criteria" is presented in this paper. We have applied this formulation to automatically determine a seed point within the image. Probabilistic classification of image pixels based on intensity and texture is followed by region growing using the automatically determined seed point to obtain an initial segmentation of the lesion. Boundary points are found on the directional gradient of the image. Outliers are removed by a process of recursive refinement. These boundary points are then supplied as an initial estimate to a deformable model. Incorporating empirical domain specific knowledge along with low and high-level knowledge makes it possible to avoid shadowing artifacts and lowers the chance of confusing similar tumor like structures for the lesion. The system was validated on a database of breast sonograms for 42 patients. The average mean boundary error between manual and automated segmentation was 6.6 pixels and the normalized true positive area overlap was 75.1%. The algorithm was found to be robust to 1) variations in system parameters, 2) number of training samples used, and 3) the position of the seed point within the tumor. Running time for segmenting a single sonogram was 18 s on a 1.8-GHz Pentium machine.
---
paper_title: Automatic segmentation of breast lesions on ultrasound

paper_content:

In this paper we present a computationally efficient segmentation algorithm for breast masses on sonography that is based on maximizing a utility function over partition margins defined through gray-value thresholding of a preprocessed image. The performance of the segmentation algorithm is evaluated on a database of 400 cases in two ways. Of the 400 cases, 124 were complex cysts, 182 were benign solid lesions, and 94 were malignant lesions. In the first evaluation, the computer-delineated margins were compared to manually delineated margins. At an overlap threshold of 0.40, the segmentation algorithm correctly delineated 94% of the lesions. In the second evaluation, the performance of our computer-aided diagnosis method on the computer-delineated margins was compared to the performance of our method on the manually delineated margins. Round robin evaluation yielded Az values of 0.90 and 0.87 on the manually delineated margins and the computer-delineated margins, respectively, in the task of distinguishing between malignant and nonmalignant lesions.
---
paper_title: Watershed segmentation for breast tumor in 2-D sonography.

paper_content:

Automatic contouring for breast tumors using medical ultrasound (US) imaging may assist physicians without relevant experience, in making correct diagnoses. This study integrates the advantages of neural network (NN) classification and morphological watershed segmentation to extract precise contours of breast tumors from US images. Textural analysis is employed to yield inputs to the NN to classify ultrasonic images. Autocovariance coefficients specify texture features to classify breasts imaged by US using a self-organizing map (SOM). After the texture features in sonography have been classified, an adaptive preprocessing procedure is selected by SOM output. Finally, watershed transformation automatically determines the contours of the tumor. In this study, the proposed method was trained and tested using images from 60 patients. The results of computer simulations reveal that the proposed method always identified similar contours and regions-of-interest (ROIs) to those obtained by manual contouring (by an experienced physician) of the breast tumor in ultrasonic images. As US imaging becomes more widespread, a functional automatic contouring method is essential and its clinical application is becoming urgent. Such a method provides robust and fast automatic contouring of US images. This study is not to emphasize that the automatic contouring technique is superior to the one undertaken manually. Both automatic and manual contours did not, after all, necessarily result in the same factual pathologic border. In computer-aided diagnosis (CAD) applications, automatic segmentation can save much of the time required to sketch a precise contour, with very high stability.
---
paper_title: Computerized diagnosis of breast lesions on ultrasound

paper_content:

We present a computer-aided diagnosis(CAD) method for breast lesions on ultrasound that is based on the automatic segmentation of lesions and the automatic extraction of four features related to the lesion shape, margin, texture, and posterior acoustic behavior. Using a database of 400 cases (94 malignant lesions, 124 complex cysts, and 182 benign solid lesions), we investigate the marginal benefit of each feature in our CAD method and the performance of our CAD method in distinguishing malignant lesions from various classes of benign lesions. Finally, independent validation is performed on our CAD method. Eleven independent trials yielded an average A z value of 0.87 in the task of distinguishing malignant from benign lesions.
---
paper_title: A real-time biopsy needle segmentation technique using Hough transform.

paper_content:

Real-time needle segmentation and tracking is very important in image-guided surgery, biopsy, and therapy. Due to its robustness to the addition of extraneous noise, the Hough Transform is one of the most powerful line-detection techniques nowadays and has been widely used in different areas. Unfortunately, its high computation needs often prevent it from being applied in real-time applications without the help of specially designed hardware. In order to solve this problem, a variety of fast implementation algorithms have been proposed. However, none of them can be performed in a real time on an affordable computer. In this paper, we describe a fast implementation of the Hough Transform based on coarse-fine search and the determination of the optimal image resolution. Compared to conventional techniques, our approach decreases the time for needle segmentation by an order of magnitude. Experiments with agar phantom and patient breast biopsy ultrasound (US) image sequences showed that our approach can segment the biopsy needle in real time (i.e., less than 33 ms) on an affordable PC computer without the help of specially designed hardware with the angular rms error of about 1 degrees and the position rms error of about 0.5 mm.
---
paper_title: Performance of computer-aided diagnosis in the interpretation of lesions on breast sonography

paper_content:

Abstract Rationale and objectives To investigate the potential usefulness of computer-aided diagnosis as a tool for radiologists in the characterization and classification of mass lesions on ultrasound. Materials and methods Previously, a computerized method for the automatic classification of breast lesions on ultrasound was developed. The computerized method includes automatic segmentation of the lesion from the ultrasound image background and automatic extraction of four features related to lesion shape, margin, texture, and posterior acoustic behavior. In this study, the effectiveness of the computer output as an aid to radiologists in their ability to distinguish between malignant and benign lesions, and in their patient management decisions in terms of biopsy recommendation are evaluated. Six expert mammographers and six radiologists in private practice at an institution accredited by the American Ultrasound Institute of Medicine participated in the study. Each observer first interpreted 25 training cases with feedback of biopsy results, and then interpreted 110 additional ultrasound cases without feedback. Simulating an actual clinical setting, the 110 cases were unknown to both the observers and the computer. During interpretation, observers gave their confidence that the lesion was malignant and also their patient management recommendation (biopsy or follow-up). The computer output was then displayed, and observers again gave their confidence that the lesion was malignant and their patient management recommendation. Statistical analyses included receiver operator characteristic analysis and Student t -test. Results For the expert mammographers and for the community radiologists, the A z (area under the receiver operator characteristic curve) increased from 0.83 to 0.87 ( P = .02) and from 0.80 to 0.84 ( P = .04), respectively, when the computer aid was used in the interpretation of the ultrasound images. Also, the A z values for the community radiologists with aid and for the expert mammographers without aid are similar to the A z value for the computer alone (A z = 0.83). Conclusion Computer analysis of ultrasound images of breast lesions has been shown to improve the diagnostic accuracy of radiologists in the task of distinguishing between malignant and benign breast lesions and in recommending cases for biopsy.
---
paper_title: Ultrasound of the breast.

paper_content:

Summary Ultrasound examination of the breast has recently come to maturity with the availability of high-frequency, hand-held transducers. It is now routinely used in breast imaging centers as an essential complement to physical examination and mammography not only to differentiate cystic from solid masses but also to further characterize solid masses. New diagnostic parameters include the tumor's shape, vascularity, and mobility. Although sonography can detect some carcinomas missed by mammography, its inability to demonstrate microcalcifications and minimal carcinomas and its dependence on operator skill are insurmountable obstacles that prevent its use for cancer screening. New applications of breast ultrasound in cancer management include the refinement of cancer staging through the detection of nonpalpable regional lymph node metastases, the evaluation of response to chemotherapy of locally advanced carcinomas, and the early detection of local recurrences following conservative treatment. Because of its unique real-time capability, sonography is the most accurate and convenient technique for guiding needle biopsy or localization of any nonpalpable breast mass or lymph node visible on sonograms.
---
paper_title: Segmentation of ultrasound B-mode images with intensity inhomogeneity correction

paper_content:

Displayed ultrasound (US) B-mode images often exhibit tissue intensity inhomogeneities dominated by nonuniform beam attenuation within the body. This is a major problem for intensity-based, automatic segmentation of video-intensity images because conventional threshold-based or intensity-statistic-based approaches do not work well in the presence of such image distortions. Time gain compensation (TGC) is typically used in standard US machines in an attempt to overcome this. However this compensation method is position-dependent which means that different tissues in the same TGC time-range (or corresponding depth range) will be, incorrectly, compensated by the same amount. Compensation should really be tissue-type dependent but automating this step is difficult. The main contribution of this paper is to develop a method for simultaneous estimation of video-intensity inhomogeities and segmentation of US image tissue regions. The method uses a combination of the maximum a posteriori (MAP) and Markov random field (MRF) methods to estimate the US image distortion field assuming it follows a multiplicative model while at the same time labeling image regions based on the corrected intensity statistics. The MAP step is used to estimate the intensity model parameters while the MRF step provides a novel way of incorporating the distributions of image tissue classes as a spatial smoothness constraint. We explain how this multiplicative model can be related to the ultrasonic physics of image formation to justify our approach. Experiments are presented on synthetic images and a gelatin phantom to evaluate quantitatively the accuracy of the method. We also discuss qualitatively the application of the method to clinical breast and cardiac US images. Limitations of the method and potential clinical applications are outlined in the conclusion.
---
paper_title: Computerized characterization of breast masses on three-dimensional ultrasound volumes

paper_content:

We are developing computer vision techniques for the characterization of breast masses as malignant or benign on radiologic examinations. In this study, we investigated the computerized characterization of breast masses on three-dimensional (3-D) ultrasound(US) volumetric images. We developed 2-D and 3-D active contour models for automated segmentation of the mass volumes. The effect of the initialization method of the active contour on the robustness of the iterative segmentation method was studied by varying the contour used for its initialization. For a given segmentation, texture and morphological features were automatically extracted from the segmented masses and their margins. Stepwise discriminant analysis with the leave-one-out method was used to select effective features for the classification task and to combine these features into a malignancy score. The classification accuracy was evaluated using the area A z under the receiver operating characteristic (ROC) curve, as well as the partial area index A z (0.9) , defined as the relative area under the ROC curve above a sensitivity threshold of 0.9. For the purpose of comparison with the computer classifier, four experienced breast radiologists provided malignancy ratings for the 3-D US masses. Our dataset consisted of 3-D US volumes of 102 biopsied masses (46 benign, 56 malignant). The classifiers based on 2-D and 3-D segmentation methods achieved test A z values of 0.87±0.03 and 0.92±0.03, respectively. The difference in the A z values of the two computer classifiers did not achieve statistical significance. The A z values of the four radiologists ranged between 0.84 and 0.92. The difference between the computer’s A z value and that of any of the four radiologists did not achieve statistical significance either. However, the computer’s A z (0.9) value was significantly higher than that of three of the four radiologists. Our results indicate that an automated and effective computer classifier can be designed for differentiating malignant and benign breast masses on 3-D US volumes. The accuracy of the classifier designed in this study was similar to that of experienced breast radiologists.
---
paper_title: Detection of lines and boundaries in speckle images-application to medical ultrasound

paper_content:

This paper describes an approach to boundary detection in ultrasound speckle based on an image enhancement technique. The enhancement algorithm works by filtering the image with "sticks," short line segments which are varied in orientation to achieve the maximum projected value at each point. The statistical properties of this approach have been described in an earlier paper; in this work we present three significant extensions to improve the performance of the basic method. First, we investigate the effect of varying the size and shape of the sticks. We show that these variations affect the performance of the algorithm in very fundamental ways, for example by making it more or less sensitive to thinner or more tightly curving boundaries. Second, we present a means of improving the performance of this technique by estimating the distribution function of the orientation of the line passing through each point. Finally, we show that images can be "stained" for easier visual interpretation by applying to each pixel a false color whose hue is related to the orientation of the most prominent line segment at that point. Examples are given to illustrate the performance of the different settings on a single image.
---
paper_title: Edge detection in ultrasound imagery using the instantaneous coefficient of variation

paper_content:

The instantaneous coefficient of variation (ICOV) edge detector, based on normalized gradient and Laplacian operators, has been proposed for edge detection in ultrasound images. In this paper, the edge detection and localization performance of the ICOV-squared (ICOVS) detector are examined. First, a simplified version of the ICOVS detector, the normalized gradient magnitude squared, is scrutinized in order to reveal the statistical performance of edge detection and localization in speckled ultrasound imagery. Both the probability of detection and the probability of false alarm are evaluated for the detector. Edge localization is characterized by the position of the peak and the 3-dB width of the detector response. Then, the speckle-edge response of the ICOVS as applied to a realistic edge model is studied. Through theoretical analysis, we reveal the compensatory effects of the normalized Laplacian operator in the ICOV edge detector for edge-localization error. An ICOV-based edge-detection algorithm is implemented in which the ICOV detector is embedded in a diffusion coefficient in an anisotropic diffusion process. Experiments with real ultrasound images have shown that the proposed algorithm is effective in extracting edges in the presence of speckle. Quantitatively, the ICOVS provides a lower localization error, and qualitatively, a dramatic improvement in edge-detection performance over an existing edge-detection method for speckled imagery.
---
paper_title: A practical clinical method for contour determination in ultrasonographic prostate images.

paper_content:

This paper describes a practical method for automated determination of the contour of the prostate in ultrasonographic images. In this method, we use specific edge detection techniques, based on nonlinear Laplace filtering. Possible edges are located at zero-crossings of the second derivative of the image. The strength of the edge is reflected by the value of the gradient of the image at that location. Combining the information about location and strength, an edge intensity image is constructed from the initial ultrasonographic image. In our method, edge enhancement techniques are performed on the edge intensity image. Edges that actually represent a boundary are selected and linked: interpolation techniques are used to fill the gaps between detected boundary edges. The method for contour determination in ultrasonographic images is used for accurate volume measurements in an everyday clinical environment. Its computer implementation is fast, accurate (mean difference within 6% of exact volume) and easy to use.
---
paper_title: Edge-guided boundary delineation in prostate ultrasound images

paper_content:

Accurate detection of prostate boundaries is required in many diagnostic and treatment procedures for prostate disease. In this paper, a new paradigm for guided edge delineation is described, which involves presenting automatically detected prostate edges as a visual guide to the observer, followed by manual editing. This approach enables robust delineation of the prostate boundaries, making it suitable for routine clinical use. The edge-detection algorithm is comprised of three stages. An algorithm called sticks is used to enhance contrast and at the same time reduce speckle in the transrectal ultrasound prostate image. The resulting image is further smoothed using an anisotropic diffusion filter. In the third stage, some basic prior knowledge of the prostate, such as shape and echo pattern, is used to detect the most probable edges describing the prostate. Finally, patient-specific anatomic information is integrated during manual linking of the detected edges. The algorithm was tested on 125 images from 16 patients. The performance of the algorithm was statistically evaluated by employing five expert observers. Based on this study, we found that consistency in prostate delineation increases when automatically detected edges are used as visual guide during outlining, while the accuracy of the detected edges was found to be at least as good as those of the human observers. The use of edge guidance for boundary delineation can also be extended to other applications in medical imaging where poor contrast in the images and the complexity in the anatomy limit the clinical usability of fully automatic edge-detection techniques.
---
paper_title: A preprocessing algorithm for edge detection with multiple scales of resolution

paper_content:

Describes a preprocessing algorithm for automated determination of object contours to determine changes in gray level in noisy images. The algorithm is illustrated for one-dimensional signals using different scales of resolution. Furthermore, a possibility for application of the proposed edge detector operator with multiple scales of resolution is described and illustrated.
---
paper_title: A methodology for evaluation of boundary detection algorithms on medical images

paper_content:

Image segmentation is the partition of an image into a set of nonoverlapping regions whose union is the entire image. The image is decomposed into meaningful parts which are uniform with respect to certain characteristics, such as gray level or texture. In this paper, we propose a methodology for evaluating medical image segmentation algorithms wherein the only information available is boundaries outlined by multiple expert observers. In this case, the results of the segmentation algorithm can be evaluated against the multiple observers' outlines. We have derived statistics to enable us to find whether the computer-generated boundaries agree with the observers' hand-outlined boundaries as much as the different observers agree with each other. We illustrate the use of this methodology by evaluating image segmentation algorithms on two different applications in ultrasound imaging. In the first application, we attempt to find the epicardial and endocardial boundaries from cardiac ultrasound images, and in the second application, our goal is to find the fetal skull and abdomen boundaries from prenatal ultrasound images.
---
paper_title: Prostate segmentation algorithm using dyadic wavelet transform and discrete dynamic contour

paper_content:

Knowing the location and the volume of the prostate is important for ultrasound-guided prostate brachytherapy, a commonly used prostate cancer treatment method. The prostate boundary must be segmented before a dose plan can be obtained. However, manual segmentation is arduous and time consuming. This paper introduces a semi-automatic segmentation algorithm based on the dyadic wavelet transform (DWT) and the discrete dynamic contour (DDC). A spline interpolation method is used to determine the initial contour based on four user-defined initial points. The DDC model then refines the initial contour based on the approximate coefficients and the wavelet coefficients generated using the DWT. The DDC model is executed under two settings. The coefficients used in these two settings are derived using smoothing functions with different sizes. A selection rule is used to choose the best contour based on the contours produced in these two settings. The accuracy of the final contour produced by the proposed algorithm is evaluated by comparing it with the manual contour outlined by an expert observer. A total of 114 2D TRUS images taken for six different patients scheduled for brachytherapy were segmented using the proposed algorithm. The average difference between the contour segmented using the proposed algorithm and the manually outlined contour is less than 3 pixels.
---
paper_title: Parametric shape modeling using deformable superellipses for prostate segmentation

paper_content:

Automatic prostate segmentation in ultrasound images is a challenging task due to speckle noise, missing boundary segments, and complex prostate anatomy. One popular approach has been the use of deformable models. For such techniques, prior knowledge of the prostate shape plays an important role in automating model initialization and constraining model evolution. In this paper, we have modeled the prostate shape using deformable superellipses. This model was fitted to 594 manual prostate contours outlined by five experts. We found that the superellipse with simple parametric deformations can efficiently model the prostate shape with the Hausdorff distance error (model versus manual outline) of 1.32/spl plusmn/0.62 mm and mean absolute distance error of 0.54/spl plusmn/0.20 mm. The variability between the manual outlinings and their corresponding fitted deformable superellipses was significantly less than the variability between human experts with p-value being less than 0.0001. Based on this deformable superellipse model, we have developed an efficient and robust Bayesian segmentation algorithm. This algorithm was applied to 125 prostate ultrasound images collected from 16 patients. The mean error between the computer-generated boundaries and the manual outlinings was 1.36/spl plusmn/0.58 mm, which is significantly less than the manual interobserver distances. The algorithm was also shown to be fairly insensitive to the choice of the initial curve.
---
paper_title: 2D+T acoustic boundary detection in echocardiography

paper_content:

Abstract In this paper we address the problem of spatio-temporal acoustic boundary detection in echocardiography. We propose a phase-based feature detection method to be used as the front end to higher-level 2D+T/3D+T reconstruction algorithms. We develop a 2D+T version of this algorithm and illustrate its performance on some typical echocardiogram sequences. We show how our temporal-based algorithm helps to reduce the number of spurious feature responses due to speckle and provides feature velocity estimates. Further, our approach is intensity-amplitude invariant. This makes it particularly attractive for echocardiographic segmentation, where choosing a single global intensity-based edge threshold is problematic.
---
paper_title: Edge detection in prostatic ultrasound images using integrated edge maps

paper_content:

Abstract Objective: We investigated an algorithm to detect grey level transitions with multiple scales of resolution to improve edge detection and localisation in ultrasound images of the prostate. Introduction: We had developed a non-analytical operator for prostate contour determination implemented with minimum and maximum filters to identify and locate edges. We implemented a technique for improved determination of boundary parts in prostatic ultrasound images by adjusting the edge detection parameter to signal information. Methods: First the influence of prefilter settings and edge detection parameters is investigated in a test image and a real ultrasound image. Then, local standard deviation is used to identify more or fewer homogeneous regions that are filtered with course resolution, while areas with larger deviation indicate that grey level transitions occur, which should be preserved using smaller filter sizes to improve edge localisation. Results: Analysis of images with different filter sizes indicated that areas are merged for increasing filter sizes: less pronounced edges disappear or displace for larger filters. Two scales of resolution lead to an improved localisation of edges when smaller filter sizes are used in areas with an increased local standard deviation. Conclusions: This paper illustrates an edge detection method suitable as pre-processing step in interpretation of medical images. By adapting input parameters to signal information, object recognition can be applied in images from different imaging modalities. Also, disadvantages are discussed, resulting in a new application combining a localisation algorithm to find the initial contour and a delineation algorithm to improve the outlining of the resulting contour.
---
paper_title: Automated texture-based segmentation of ultrasound images of the prostate

paper_content:

Segmenting two-dimensional images of the prostate into prostate and nonprostate regions is required when forming a three-dimensional image of the prostate from a set of parallel two-dimensional images. The texture-based segmentation method presented here is a pixel classifier based on four texture energy measures associated with each pixel in the image. An automated clustering procedure is used to label each pixel in the image with the label of its most probable class. The segmented images produced as the result of applying the algorithm to an example image are presented and discussed. The automated segmentation algorithm has been found to hold promise as an automated segmentation method.
---
paper_title: Geometric Level Set Methods in Imaging, Vision, and Graphics

paper_content:

* Level set methods * Deformable models * Fast methods for implicit active contour models * Fast edge integration * Variational snake theory * Multiplicative denoising and deblurring * Total varation minimization for scalar/vector regularization * Morphological global reconstruction and levelings * Fast marching techniques for visual grouping and segmentation * Multiphase object detection and image segmentation * Adaptive segmentation of vector-valued images * Mumford-Shah for segmentation and stereo * Shape analysis toward model-based segmentation * Joint image registration and segmentation * Image alignment * Variational principles in optical flow estimation and tracking * Region matching and tracking under deformations or occlusions * Computational stereo * Visualization, analysis and shape reconstruction of sparse data * Variational problems and partial differential equations on implicit surfaces * Knowledge-based segmentation of medical images * Topology preserving geometric deformable models for brain reconstruction * Editing geometric models * Simulating natural phenomena
---
paper_title: Segmentation of prostate contours from ultrasound images

paper_content:

The paper presents a novel segmentation technique to extract prostate contours from transrectal ultrasound (TRUS) images. A sticks filter is first used to reduce the speckle and enhance the image contrast. The problem is then discretized by projecting equispaced radii from an arbitrary seed point inside the prostate cavity towards its boundary. The distance of the prostate boundary from the seed point is modeled by the trajectory of a moving object. The motion of this moving object is assumed to be governed by a finite set of dynamical models subject to uncertainty. Candidate edge points obtained along each radius include the measurement of the object position and some false returns. This modeling approach enables us to employ the interacting multiple model (IMM) estimator along with a probabilistic data association filter (PDAF) for prostate contour extraction. Since the method does not employ any numerical optimization, convergence is very fast. The robustness and accuracy of the method is demonstrated by segmenting contours from a series of prostate ultrasound images.
---
paper_title: An interacting multiple model probabilistic data association filter for cavity boundary extraction from ultrasound images

paper_content:

This paper presents a novel segmentation technique for extracting cavity contours from ultrasound images. The problem is first discretized by projecting equispaced radii from an arbitrary seed point inside the cavity toward its boundary. The distance of the cavity boundary from the seed point is modeled by the trajectory of a moving object. The motion of this moving object is assumed to be governed by a finite set of dynamical models subject to uncertainty. Candidate edge points obtained along each radius include the measurement of the object position and some false returns. The modeling approach enables us to use the interacting multiple model estimator along with a probabilistic data association filter, for contour extraction. The convergence rate of the method is very fast because it does not employ any numerical optimization. The robustness and accuracy of the method are demonstrated by segmenting contours from a series of ultrasound images. The results are validated through comparison with manual segmentations performed by an expert. An application of the method in segmenting bone contours from computed tomography images is also presented.
---
paper_title: A three-dimensional deformable model for segmentation of human prostate from ultrasound images

paper_content:

Segmentation of human prostate from ultrasound(US)images is a crucial step in radiation therapy, especially in real-time planning for USimage-guided prostate seed implant. This step is critical to determine the radioactive seed placement and to ensure the adequate dose coverage of prostate. However, due to the low contrast of prostate and very low signal-to-noise ratio in USimages, this task remains as an obstacle. The manual segmentation of this object is time consuming and highly subjective. In this work, we have proposed a three-dimensional (3D) deformable surface model for automatic segmentation of prostate. The model has a discrete structure made from a set of vertices in the 3D space that form triangle facets. The model converges from an initial shape to its equilibrium iteratively, by a weighted sum of the internal and external forces. Internal forces are based on the local curvature of the surface and external forces are extracted from the volumetric image data by applying an appropriate edge filter. We have also developed a method for initialization of the model from a few initial contours that are drawn on different slices. During the deformation, a resampling procedure is used to maintain the resolution of the model. The entire model is applied in a multiscale scheme, which increases the robustness and speed, and guarantees a better convergence. The model is tested on real clinical data and initial results are very promising.
---
paper_title: Segmentation of the prostate from suprapubic ultrasound images

paper_content:

We present a technique for semiautomated segmentation of human prostates using suprapubic ultrasound (US) images. In this approach, a speckle reducing anisotropic diffusion (SRAD) is applied to enhance the images and the instantaneous coefficient of variation (ICOV) is utilized for edge detection. Segmentation is accomplished via a parametric active contour model in a polar coordinate system that is tailored to the application. The algorithm initially approximates the prostate boundary in two stages. First a primary contour is detected using an elliptical model, followed by a primary contour optimization using an area-weighted mean-difference binary flow geometric snake model. The algorithm was assessed by comparing the computer-derived contours with contours produced manually by three sonographers. The proposed method has application in radiation therapy planning and delivery, as well as in automated volume measurements for ultrasonic diagnosis. The average root mean square discrepancy between computed and manual outlines is less than the inter-observer variability. Furthermore, 76% of the computer-outlined contour is less than 1 sigma manual outline variance away from "true" boundary of prostate. We conclude that the methods developed herein possess acceptable agreement with manually contoured prostate boundaries and that they are potentially valuable tools for radiotherapy treatment planning and verification.
---
paper_title: Three-dimensional automatic quantitative analysis of intravascular ultrasound images

paper_content:

Abstract Intravascular ultrasound (IVUS) has established itself as a useful tool for coronary assessment. The vast amount of data obtained by a single IVUS study renders manual analysis impractical for clinical use. A computerized method is needed to accelerate the process and eliminate user-dependency. In this study, a new algorithm is used to identify the lumen border and the media-adventitia border (the external elastic membrane). Setting an initial surface on the IVUS catheter perimeter and using active contour principles, the surface inflates until virtual force equilibrium defined by the surface geometry and image features is reached. The method extracts these features in three dimensions (3-D). Eight IVUS procedures were performed using an automatic pullback device. Using the ECG signal for synchronization, sets of images covering the entire studied region and corresponding to the same cardiac phase were sampled. Lumen and media-adventitia border contours were traced manually and compared to the automatic results obtained by the suggested method. Linear regression results for vessel area enclosed by the lumen and media-adventitia border indicate high correlation between manual vs. automatic tracings ( y = 1.07 × −0.38; r = 0.98; SD = 0.112 mm 2 ; n = 88). These results indicate that the suggested algorithm may potentially provide a clinical tool for accurate lumen and plaque assessment.
---
paper_title: Prostate Boundary Detection From Ultrasonographic Images

paper_content:

OBJECTIVE ::: Prostate diseases are very common in adult and elderly men, and prostate boundary detection from ultrasonographic images plays a key role in prostate disease diagnosis and treatment. However, because of the poor quality of ultrasonographic images, prostate boundary detection still remains a challenging task. Currently, this task is performed manually, which is arduous and heavily user dependent. To improve the efficiency by automating the boundary detection process, numerous methods have been proposed. We present a review of these methods, aiming to find a good solution that could efficiently detect the prostate boundary on ultrasonographic images. ::: ::: ::: METHODS ::: A full description of various methods is beyond the scope of this article; instead, we focus on providing an introduction to the different methods with a discussion of their advantages and disadvantages. Moreover, verification methods for estimating the accuracies of the algorithms reported in the literature are discussed as well. ::: ::: ::: RESULTS ::: From the investigation, we summarize several key issues that might be confronted and project possible future research. ::: ::: ::: CONCLUSIONS ::: Those model-based methods that minimize user involvement but allow for interactive guidance of experts will likely be most immediately successful.
---
paper_title: Segmenting ultrasound images of the prostate using neural networks.

paper_content:

This paper describes a method for segmenting transrectal ultrasound images of the prostate using feedforward neural networks. Segmenting two-dimensional images of the prostate into prostate and nonprostate regions is required when forming a three-dimensional image of the prostate from a set of parallel two-dimensional images. Three neural network architectures are presented as examples and discussed. Each of these networks was trained using a small portion of a training image segmented by an expert sonographer. The results of applying the trained networks to the entire training image and to adjacent images in the two-dimensional image set are presented and discussed. The final network architecture was also trained with additional data from two other images in the set. The results of applying this retrained network to each of the images in the set are presented and discussed.
---
paper_title: Optimized prostate biopsy via a statistical atlas of cancer spatial distribution

paper_content:

A methodology is presented for constructing a statistical atlas of spatial distribution of prostate cancer from a large patient cohort, and it is used for optimizing needle biopsy. An adaptive-focus deformable model is used for the spatial normalization and registration of 100 prostate histological samples, which were provided by the Center for Prostate Disease Research of the US Department of Defense, resulting in a statistical atlas of spatial distribution of prostate cancer. Based on this atlas, a statistical predictive model was developed to optimize the needle biopsy sites, by maximizing the probability of detecting cancer. Experimental results using cross-validation show that the proposed method can detect cancer with a 99% success rate using seven needles, in these samples.
---
paper_title: Segmentation of prostate boundaries from ultrasound images using statistical shape model

paper_content:

Presents a statistical shape model for the automatic prostate segmentation in transrectal ultrasound images. A Gabor filter bank is first used to characterize the prostate boundaries in ultrasound images in both multiple scales and multiple orientations. The Gabor features are further reconstructed to be invariant to the rotation of the ultrasound probe and incorporated in the prostate model as image attributes for guiding the deformable segmentation. A hierarchical deformation strategy is then employed, in which the model adaptively focuses on the similarity of different Gabor features at different deformation stages using a multiresolution technique, i.e., coarse features first and fine features later. A number of successful experiments validate the algorithm.
---
paper_title: Adaptive Segmentation of Ultrasound Images.

paper_content:

Abstract This article describes a novel approach to the semi-automatic segmentation of ultrasound images. Assisted segmentation is particularly attractive when processing many slices through a 3D data set, and even though fully automatic segmentation would be ideal, this is currently not feasible given the quality of ultrasound images. The algorithm developed in this article is based on the active contour paradigm, with several important modifications. The contour is attracted to boundaries described locally by statistical models: this allows for the fact that the definition of what constitutes a boundary may vary around the boundary’s length. The statistical models are trained on-the-fly by observing boundaries accepted by the operator. In this way, operator intervention in a particular slice is sensibly exploited to reduce the need for intervention in subsequent slices. The resulting algorithm provides fast, reliable and verifiable segmentation of in vivo ultrasound images.
---
paper_title: Unsupervised segmentation of ultrasonic liver images by multiresolution fractal feature vector

paper_content:

The feasibility of selecting fractal feature vector based on multiresolution analysis to segment suspicious abnormal regions of ultrasonic liver images is described in this paper. The proposed feature extraction algorithm is based on the spatial-frequency decomposition and fractal geometry. Segmentation of various liver diseases reveals that the fractal feature vector based on multiresolution analysis is trustworthy. A quantitative characterization based on the proposed unsupervised segmentation algorithm can be utilized to establish an automatic computer-aided diagnostic system. As well, to increase the visual interpretation capability of ultrasonic liver image for junior physicians, off-line learning software is developed to investigate the visual criteria.
---
paper_title: Segmentation of ultrasound images by using a hybrid neural network

paper_content:

A hybrid neural network is presented for the segmentation of ultrasound images.Feature vectors are formed by the discrete cosine transform of pixel intensities in region of interest (ROI). The elements and the dimension of the feature vectors are determined by considering only two parameters: The amount of ignored coefficients, and the dimension of the ROI.First-layer-nodes of the proposed hybrid network represent hyperspheres (HSs) in the feature space. Feature space is partitioned by intersecting these HSs to represent the distribution of classes. The locations and radii of the HSs are found by the genetic algorithms.Restricted Coulomb energy (RCE) network, modified RCE network, multi-layer perceptron and the proposed hybrid neural network are examined comparatively for the segmentation of ultrasound images.
---
paper_title: An early vision-based snake model for ultrasound image segmentation.

paper_content:

Due to the speckles and the ill-defined edges of the object of interest, the classic image-segmentation techniques are usually ineffective in segmenting ultrasound (US) images. In this paper, we present a new algorithm for segmenting general US images that is composed of two major techniques; namely, the early-vision model and the discrete-snake model. By simulating human early vision, the early-vision model can capture both grey-scale and textural edges while the speckle noise is suppressed. By performing deformation only on the peaks of the distance map, the discrete-snake model promises better noise immunity and more accurate convergence. Moreover, the constraint for most conventional snake models that the initial contour needs to be located very close to the actual boundary has been relaxed substantially. The performance of the proposed snake model has been shown to be comparable to manual delineation and superior to that of the gradient vector flow (GVF) snake model.
---
paper_title: A dual-snake model of high penetrability for ultrasound image boundary extraction.

paper_content:

Abstract Most deformable models require the initial contour to be placed close to the boundary of the object of interest for boundary extraction of ultrasound (US) images, which is impractical in many clinical applications. To allow a distant initial contour, a new dual-snake model promising high penetrability through the interference of the noises is proposed in this paper. The proposed dual-snake model features a new far-reaching external force, called the discrete gradient flow, a connected component-weighted image force, and an effective stability evaluation of two underlying snakes. The experimental results show that, with a distant initial contour, the mean distance from the derived boundary to the desired boundary is less than 1.4 pixels, and most snake elements are within 2.7 pixels of the desired boundaries for the synthetic images with CNR ≥ 1. For the clinical US images, the mean distance is less than 1.9 pixels, and most snake elements are within 3 pixels of the desired boundaries. (E-mail: chung@lotus.mc.ntu.edu.tw)
---
paper_title: A textural approach based on Gabor functions for texture edge detection in ultrasound images.

paper_content:

Edge detection is an important, but difficult, step in quantitative ultrasound (US) image analysis. In this paper, we present a new textural approach for detecting a class of edges in US images; namely, the texture edges with a weak regional mean gray-level difference (RMGD) between adjacent regions. The proposed approach comprises a vision model-based texture edge detector using Gabor functions and a new texture-enhancement scheme. The experimental results on the synthetic edge images have shown that the performances of the four tested textural and nontextural edge detectors are about 20%-95% worse than that of the proposed approach. Moreover, the texture enhancement may improve the performance of the proposed texture edge detector by as much as 40%. The experiments on 20 clinical US images have shown that the proposed approach can find reasonable edges for real objects of interest with the performance of 0.4 +/- 0.08 in terms of the Pratt's figure.
---
paper_title: An Adaptive Snake Model for Ultrasound Image Segmentation: Modified Trimmed Mean Filter, Ramp Integration and Adaptive Weighting Parameters

paper_content:

The snake model is a widely-used approach to finding the boundary of the object of interest in an ultrasound image. However, due to the speckles, the weak edges and the tissue-related textures in an ultrasound image, conventional snake models usually cannot obtain the desired boundary satisfactorily. In this paper, we propose a new adaptive snake model for ultrasound image segmentation. The proposed snake model is composed of three major techniques, namely, the modified trimmed mean (MTM) filtering, ramp integration and adaptive weighting parameters. With the advantages of the mean and median filters, the MTM filter is employed to alleviate the speckle interference in the segmentation process. The weak edge enhancement by ramp integration attempts to capture the slowly varying edges, which are hard to capture by conventional snake models. The adaptive weighting parameter allows weighting of each energy term to change adaptively during the deformation process. The proposed snake model has been verified on the phantom and clinical ultrasound images. The experimental results showed that the proposed snake model achieves a reasonable performance with an initial contour placed 10 to 20 pixels away from the desired boundary. The mean minimal distances from the derived boundary to the desired boundary have been shown to be less than 3.5 (for CNR > or = 0.5) and 2.5 pixels, respectively, for the phantom and ultrasound images.
---
paper_title: Segmentation of kidney from ultrasound images based on texture and shape priors

paper_content:

This work presents a novel texture and shape priors based method for kidney segmentation in ultrasound (US) images. Texture features are extracted by applying a bank of Gabor filters on test images through a two-sided convolution strategy. The texture model is constructed via estimating the parameters of a set of mixtures of half-planed Gaussians using the expectation-maximization method. Through this texture model, the texture similarities of areas around the segmenting curve are measured in the inside and outside regions, respectively. We also present an iterative segmentation framework to combine the texture measures into the parametric shape model proposed by Leventon and Faugeras. Segmentation is implemented by calculating the parameters of the shape model to minimize a novel energy function. The goal of this energy function is to partition the test image into two regions, the inside one with high texture similarity and low texture variance, and the outside one with high texture variance. The effectiveness of this method is demonstrated through experimental results on both natural images and US data compared with other image segmentation methods and manual segmentation.
---
paper_title: Cell-based dual snake model: a new approach to extracting highly winding boundaries in the ultrasound images.

paper_content:

Two common deficiencies of most conventional deformable models are the need to place the initial contour very close to the desired boundary and the incapability of capturing a highly winding boundary for sonographic boundary extraction. To remedy these two deficiencies, a new deformable model (namely, the cell-based dual snake model) is proposed in this paper. The basic idea is to apply the dual snake model in the cell-based deformation manner. While the dual snake model provides an effective mechanism allowing a distant initial contour, the cell-based deformation makes it possible to catch the winding characteristics of the desired boundary. The performance of the proposed cell-based dual snake model has been evaluated on synthetic images with simulated speckles and on the clinical ultrasound (US) images. The experimental results show that the mean distances from the derived to the desired boundary points are 0.9 +/- 0.42 pixels and 1.29 +/- 0.39 pixels for the synthetic and the clinical US images, respectively.
---
paper_title: An approach for contour detection of human kidneys from ultrasound images using Markov random fields and active contours

paper_content:

In this paper, a novel method for the boundary detection of human kidneys from three dimensional (3D) ultrasound (US) is proposed. The inherent difficulty of interpretation of such images, even by a trained expert, makes the problem unsuitable for classical methods. The method here proposed finds the kidney contours in each slice. It is a probabilistic Bayesian method. The prior defines a Markov field of deformations and imposes the restriction of contour smoothness. The likelihood function imposes a probabilistic behavior to the data, conditioned to the contour position. This second function, which is also Markov, uses an empirical model of distribution of the echographical data and a function of the gradient of the data. The model finally includes, as a volumetric extension of the prior, a term that forces smoothness along the depth coordinate. The experiments that have been carried out on echographies from real patients validate the model here proposed. A sensitivity analysis of the model parameters has also been carried out.
---
paper_title: Segmentation of Ultrasonic Images Using Support Vector Machines ⋆

paper_content:

Support Vector Machines (SVMs) are a general algorithm based on guaranteed risk bounds of statistical learning theory. They have found numerous applications, such as in classification of brain PET images, optical character recognition, object detection, face verification, text categorization and so on. In this paper we propose the use of SVMs to segment lesions in ultrasound images and we assess thoroughly their lesion detection ability. We demonstrate that trained SVMs with a radial basis function kernel segment satisfactorily (unseen) ultrasound B-mode images as well as clinical ultrasonic images.
---
paper_title: An automated segmentation method for three-dimensional carotid ultrasound images.

paper_content:

We have developed an automated segmentation method for three-dimensional vascular ultrasound images. The method consists of two steps: an automated initial contour identification, followed by application of a geometrically deformable model (GDM). The formation of the initial contours requires the input of a single seed point by the user, and was shown to be insensitive to the placement of the seed within a structure. The GDM minimizes contour energy, providing a smoothed final result. It requires only three simple parameters, all with easily selectable values. The algorithm is fast, performing segmentation on a 336 x 352 x 200 volume in 25 s when running on a 100 MHz 9500 Power Macintosh prototype. The segmentation algorithm was tested on stenosed vessel phantoms with known geometry, and the segmentation of the cross-sectional areas was found to be within 3% of the true area. The algorithm was also applied to two sets of patient carotid images, one acquired with a mechanical scanner and the other with a freehand scanning system, with good results on both.
---
paper_title: Three-dimensional segmentation of luminal and adventitial borders in serial intravascular ultrasound images

paper_content:

Abstract Intravascular ultrasound (IVUS) provides exact anatomy of arteries, allowing accurate quantitative analysis. Automated segmentation of IVUS images is a prerequisite for routine quantitative analyses. We present a new three-dimensional (3D) segmentation technique, called active surface segmentation, which detects luminal and adventitial borders in IVUS pullback examinations of coronary arteries. The technique was validated against expert tracings by computing correlation coefficients (range 0.83–0.97) and William's index values (range 0.37–0.66). The technique was statistically accurate, robust to image artifacts, and capable of segmenting a large number of images rapidly. Active surface segmentation enabled geometrically accurate 3D reconstruction and visualization of coronary arteries and volumetric measurements.
---
paper_title: Multi-agent segmentation of IVUS images

paper_content:

Abstract A novel multi-agent image interpretation system has been developed which is markedly different from previous approaches in especially its elaborate high-level knowledge-based control over low-level image segmentation algorithms. Agents dynamically adapt segmentation algorithms based on knowledge about global constraints, contextual knowledge, local image information and personal beliefs. Generally agent control allows the underlying segmentation algorithms to be simpler and be applied to a wider range of problems with a higher reliability. The agent knowledge model is general and modular to support easy construction and addition of agents to any image processing task. Each agent in the system is further responsible for one type of high-level object and cooperates with other agents to come to a consistent overall image interpretation. Cooperation involves communicating hypotheses and resolving conflicts between the interpretations of individual agents. The system has been applied to IntraVascular UltraSound (IVUS) images which are segmented by five agents, specialized in lumen, vessel, calcified-plaque, shadow and sidebranch detection. IVUS image sequences from 7 patients were processed and vessel and lumen contours were detected fully automatically. These were compared with expert-corrected semiautomatically detected contours. Results show good correlations between agents and expert with r=0.84 for the lumen and r=0.92 for the vessel cross-sectional areas, respectively.
---
paper_title: Accuracy and variability assessment of a semiautomatic technique for segmentation of the carotid arteries from three-dimensional ultrasound images.

paper_content:

In this paper, we report on a semiautomatic method for segmentation of three-dimensional (3D) carotid vascular ultrasound (US) images. Our method is based on a dynamic balloon model represented by a triangulated mesh. The mesh is manually placed within the interior of the carotid vessels, then is driven outward until it reaches the vessel wall by applying an inflation force to the mesh. Once the mesh is in close proximity to the vessel wall, it is further deformed using an image-based force, in order to better localize the boundary. Since the method requires manual initialization, there is inherent variability in the position and shape of the final segmented boundary. Using a 3D US image of a patient's carotids, we have examined the local variability in boundary position as the initialization position is varied throughout the interior of the carotid vessels in the 3D image. We have compared the semiautomatic segmentation method to a fully manual segmentation method, and found that the semiautomatic approach is less variable than the intraobserver variability for manual segmentation. We have furthermore examined the accuracy of the semiautomatic method by comparing the average surface to an "ideal" surface, determined by the average manually segmented surface. We have found, in general, good agreement between the semiautomatic and manual segmentation methods. For the 3D US image in question, the mean separation between the average segmented surface and the gold standard was found to be 0.35 mm. The two surfaces were determined to agree with each other, within uncertainty, at 65% of the mesh points comprising the two surfaces.
---
paper_title: Automatic ventricular cavity boundary detection from sequential ultrasound images using simulated annealing.

paper_content:

An automatic algorithm has been developed for high-speed detection of cavity boundaries in sequential 2-D echocardiograms using an optimization algorithm called simulated annealing (SA). The algorithm has three stages. (1) A predetermined window of size nxm is decimated to size n'xm' after low-pass filtering. (2) An iterative radial gradient algorithm is employed to determine the center of gravity (CG) of the cavity. (3) 64 radii which originate from the CG defined in stage 2 are bounded by the high-probability region. Each bounded radius is defined as a link in a 1-D, 64-member cyclic Markov random field. This algorithm is unique in that it compounds spatial and temporal information along with a physical model in its decision rule, whereas most other algorithms base their decisions on spatial data alone. This is the first implementation of a relaxation algorithm for edge detection in echocardiograms. Results attained using this algorithm on real data have been highly encouraging.
---
paper_title: A multiscale optimization approach for the dynamic contour-based boundary detection issue

paper_content:

We present a new multiscale approach for deformable contour optimization. The method relies on a multigrid minimization method and a coarse-to-fine relaxation algorithm. This approach consists in minimizing a cascade of optimization problems of reduced and increasing complexity instead of considering the minimization problem on the full and original configuration space. Contrary to classical multiresolution algorithms, no reduction of image is applied. The family of defined energy functions are derived from the original (full resolution) objective function, ensuring that the same function is handled at each scale and that the energy decreases at each step of the deformable contour minimization process. The efficiency and the speed of this multiscale optimization strategy is demonstrated in the difficult context of the minimization of a region-based contour energy function ensuring the boundary detection of anatomical structures in ultrasound medical imagery. In this context, the proposed multiscale segmentation method is compared to other classical region-based segmentation approaches such as Maximum Likelihood or Markov Random Field-based segmentation techniques. We also extend this multiscale segmentation strategy to active contour models using a classical edge-based likelihood approach. Finally, time and performance analysis of this approach, compared to the (commonly used) dynamic programming-based optimization procedure, is given and allows to attest the accuracy and the speed of the proposed method.
---
paper_title: Bayesian contour detection in a time series of ultrasound images through dynamic deformable template models.

paper_content:

Deformable template models and Markov chain Monte Carlo methods are used for analysing a space-time process of intracoronary ultrasound images in order to detect the artery contour and various other characteristics as a function of time.
---
paper_title: Discriminant snakes for 3D reconstruction of anatomical organs

paper_content:

In this work a new statistic deformable model for 3D segmentation of anatomical organs in medical images is proposed. A statistic discriminant snake performs a supervised learning of the object boundary in an image slice to segment the next slice of the image sequence. Each part of the object boundary is projected in a feature space generated by a bank of Gaussian filters. Then, clusters corresponding to different boundary pieces are constructed by means of linear discriminant analysis. Finally, a parametric classifier is generated from each contour in the image slice and embodied into the snake energy-minimization process to guide the snake deformation in the next image slice. The discriminant snake selects and classifies image features by the parametric classifier and deforms to minimize the dissimilarity between the learned and found image features. The new approach is of particular interest for segmenting 3D images with anisotropic spatial resolution, and for tracking temporal image sequences. In particular, several anatomical organs from different imaging modalities are segmented and the results compared to expert tracings.
---
paper_title: A methodology for evaluation of boundary detection algorithms on medical images

paper_content:

Image segmentation is the partition of an image into a set of nonoverlapping regions whose union is the entire image. The image is decomposed into meaningful parts which are uniform with respect to certain characteristics, such as gray level or texture. In this paper, we propose a methodology for evaluating medical image segmentation algorithms wherein the only information available is boundaries outlined by multiple expert observers. In this case, the results of the segmentation algorithm can be evaluated against the multiple observers' outlines. We have derived statistics to enable us to find whether the computer-generated boundaries agree with the observers' hand-outlined boundaries as much as the different observers agree with each other. We illustrate the use of this methodology by evaluating image segmentation algorithms on two different applications in ultrasound imaging. In the first application, we attempt to find the epicardial and endocardial boundaries from cardiac ultrasound images, and in the second application, our goal is to find the fetal skull and abdomen boundaries from prenatal ultrasound images.
---
paper_title: SEGMENTATION OF 3D INTRAVASCULAR ULTRASONIC IMAGES BASED ON A RANDOM FIELD MODEL

paper_content:

Abstract Segmentation of intravascular ultrasound images provides important information about the degree of vessel obstruction as well as about the shape and size of plaques. To address the problems of inter- and intra-observer variances associated with conventional manual tracing, a fully automated segmentation was developed. The algorithm is based on the optimisation of a maximum a posteriori estimator, implementing the Rayleigh distribution of speckle and a priori information about the contours. Within 3D image sets, additional information by the blood flow resulting in a decorrelation of the pixels within the luminal boundary is used to initialise the segmentation. To accelerate the estimation, dynamic programming was used. The segmentation algorithm was realised as a Windows® 95 application on a Pentium® II/233 MHz and delivered reliable and reproducible results independent of the catheter position and the total image brightness (except overflow). In contrast, contours drawn by two physicians for an evaluation of 29 clinical cases showed large intra- and inter-observer variances. In vivo images were acquired with a 20 MHz transducer array (EndoSonics InVision TM ). Comparison with the contours drawn by the physicians and histology demonstrates the potential of the segmentation algorithm.
---
paper_title: Segmentation of intravascular ultrasound images: a machine learning approach mimicking human vision

paper_content:

Abstract This paper describes an approach for fully automated segmentation of intravascular ultrasound (IVUS) images that mimics the procedure performed by human experts. The approach requires no manual initialization or interaction, and is integrated into our previously developed system for reconstruction of coronary arteries by data fusion of IVUS and X-ray angiography. The fusion system is used in an ongoing clinical study assessing the relationships among vessel curvature, plaque thickness, and hemodynamic shear stress. The improved automatic segmentation of IVUS images has resulted in a substantial decrease in the time needed for analysis, thus allowing for an increase in the size and scope of the clinical study. Preliminary results from 10 in vivo cases are presented.
---
paper_title: Automatic 3d segmentation of intravascular ultrasound images using region and contour information

paper_content:

Intravascular ultrasound (IVUS) produces images of arteries that show the lumen in addition to the layered structure of the vessel wall. A new automatic 3D IVUS fast-marching segmentation model is presented. The method is based on a combination of region and contour information, namely the gray level probability density functions (PDFs) of the vessel structures and the image gradient. Accurate results were obtained on in-vivo and simulated data with average point to point distances between detected vessel wall boundaries and validation contours below 0.105 mm. Moreover, Hausdorff distances (that represent the worst point to point variations) resulted in values below 0.344 mm, which demonstrate the potential of combining region and contour information in a fast-marching scheme for 3D automatic IVUS image processing.
---
paper_title: Automated lumen definition from 30 MHz intravascular ultrasound images

paper_content:

Abstract One prerequisite for standard clinical use of intravascular ultrasound imaging is rapid evaluation of the data. The main quantities to be extracted from the data are the size and the shape of the lumen. Until now, no accurate, robust and reproducible method to obtain the lumen boundaries from intravascular ultrasound images has been described. In this study, 21 different (semi-)automated binary-segmentation methods for determining the lumen are compared with manual segmentation to find an alternative for the laborious and subjective procedure of manual editing. After a preprocessing step in which the catheter area is filled with lumen-like grey values, all approaches consist of two steps: (i) smoothing the images with different filtering methods and (ii) extracting the lumen by an object definition method. The combination of different filtering methods and object definition methods results in a total of 21 methods and 80 experiments. The results are compared with a reference image, obtained from manual editing, by use of four different quality parameters—two based on squared distances and two based on Mahalanobis distances. The evaluation has been carried out on 15 images, of which seven are obtained before balloon dilation and eight after balloon dilation. While for the post-dilation images no definite conclusions can be drawn, an automated contour model applied to images smoothed with a large kernel appears to be a good alternative to manual contouring. For pre-dilation images a fully automated active contour model, initialized by thresholding, preceded by filtering with a small-scale median filter is the best alternative for manual delineation. The results of this method are even better than manual segmentation, i.e. they are consistently closer to the reference image than the average distance of all individual manual segmentations.
---
paper_title: Segmentation of intravascular ultrasound images: a knowledge-based approach.

paper_content:

Intravascular ultrasound imaging of coronary arteries provides important information about coronary lumen, wall, and plaque characteristics. Quantitative studies of coronary atherosclerosis using intravascular ultrasound and manual identification of wall and plaque borders are limited by the need for observers with substantial experience and the tedious nature of manual border detection. We have developed a method for segmentation of intravascular ultrasound images that identifies the internal and external elastic laminae and the plaque-lumen interface. The border detection algorithm was evaluated in a set of 38 intravascular ultrasound images acquired from fresh cadaveric hearts using a 30 MHz imaging catheter. To assess the performance of our border detection method we compared five quantitative measures of arterial anatomy derived from computer-detected borders with measures derived from borders manually defined by expert observers. Computer-detected and observer-defined lumen areas correlated very well (r=0.96, y=1.02x+0.52), as did plaque areas (r=0.95, y=1.07x-0.48), and percent area stenosis (r=0.93, y=0.99x-1.34.) Computer-derived segmental plaque thickness measurements were highly accurate. Our knowledge-based intravascular ultrasound segmentation method shows substantial promise for the quantitative analysis of in vivo intravascular ultrasound image data.
---
paper_title: Validation of ultrasonic image boundary recognition in abdominal aortic aneurysm

paper_content:

An aneurysm of the abdominal aorta (AAA) is characterized by modified wall properties, and a balloon-like area usually filled by a thrombus. A rupture of an aortic aneurysm can be fatal, yet there is no way to accurately predict such an occurrence. The study of the wall and thrombus cross-sectional distension, due to a pressure wave, is important as a way of assessing the degradation of the mechanical properties of the vessel wall and the risk of a rupture. Echo ultrasound transverse cross-sectional imaging is used here to study the thrombus and the aortic wall distension, requiring their segmentation within the image. Polar coordinates are defined, and a search is performed for minimizing a cost function, which includes a description of the boundary (based on a limited series of sine and cosine functions) and information from the image intensity gradients along the radii. The method is based on filtering by a modified Canny-Deriche edge detector and then on minimization of an energy function based on five parts. Since echoes from blood in the lumen and the thrombus produce similar patterns and speckle noise, a modified version for identifying the lumen-thrombus border was developed. The method has been validated by various ways, including parameter sensitivity testing and comparison to the performance of an expert. It is robust enough to track the lumen and total arterial cross-sectional area changes during the cardiac cycle. In 34 patients where sequences of images were acquired, the border between the thrombus and the arterial wall was detected with errors less than 2%, while the lumen-thrombus border was detected with a mean error of 4%. Thus, a noninvasive measurement of the AAA cross-sectional area is presented, which has been validated and found to be accurate.
---
paper_title: Three-dimensional automatic quantitative analysis of intravascular ultrasound images

paper_content:

Abstract Intravascular ultrasound (IVUS) has established itself as a useful tool for coronary assessment. The vast amount of data obtained by a single IVUS study renders manual analysis impractical for clinical use. A computerized method is needed to accelerate the process and eliminate user-dependency. In this study, a new algorithm is used to identify the lumen border and the media-adventitia border (the external elastic membrane). Setting an initial surface on the IVUS catheter perimeter and using active contour principles, the surface inflates until virtual force equilibrium defined by the surface geometry and image features is reached. The method extracts these features in three dimensions (3-D). Eight IVUS procedures were performed using an automatic pullback device. Using the ECG signal for synchronization, sets of images covering the entire studied region and corresponding to the same cardiac phase were sampled. Lumen and media-adventitia border contours were traced manually and compared to the automatic results obtained by the suggested method. Linear regression results for vessel area enclosed by the lumen and media-adventitia border indicate high correlation between manual vs. automatic tracings ( y = 1.07 × −0.38; r = 0.98; SD = 0.112 mm 2 ; n = 88). These results indicate that the suggested algorithm may potentially provide a clinical tool for accurate lumen and plaque assessment.
---
paper_title: Fully automatic luminal contour segmentation in intracoronary ultrasound imaging-a statistical approach

paper_content:

In this paper, a fully automatic method for luminal contour segmentation in intracoronary ultrasound imaging is introduced. Its principle is based on a contour with a priori properties that evolves according to the statistics of the ultrasound texture brightness, which is generally Rayleigh distributed. The main interest of the technique is its fully automatic character. This is insured by an initial contour that is not set by the user, like in classical snake-based algorithms, but estimated and, thus, adapted to each image. Its estimation combines two pieces of information extracted from the a posteriori probability function of the contour position: the function maximum location (or maximum a posteriori estimator) and the first zero-crossing of its derivative. Then, starting from the initial contour, a region of interest is automatically selected and the process iterated until the contour evolution can be ignored. In vivo coronary images from 15 patients, acquired with the 20-MHz central frequency Jomed Invision ultrasound scanner, were segmented with the developed method. Automatic contours were compared to those manually drawn by two physicians in terms of mean absolute difference. The results demonstrate that the error between automatic contours and the average of manual ones is of small amplitude, and only very slightly higher (0.099 +/- 0.032 mm) than the interexpert error (0.097 +/- 0.027 mm).
---
paper_title: Evaluation of three-dimensional segmentation algorithms for the identification of luminal and medial-adventitial borders in intravascular ultrasound images

paper_content:

Intravascular ultrasound (IVUS) provides direct depiction of coronary artery anatomy, including plaque and vessel area, which is important in quantitative studies on the progression or regression of coronary artery disease. Traditionally, these studies have relied on manual evaluation, which is laborious, time consuming, and subject to large interobserver and intraobserver variability. A new technique, called active surface segmentation, alleviates these limitations and makes strides toward routine analyses. However, for three-dimensional (3-D) plaque assessment or 3-D reconstruction to become a clinical reality, methods must be developed which can analyze many images quickly. Presented is a comparison between two active surface techniques for three-dimensional segmentation of luminal and medial-adventitial borders. The force-acceleration technique and the neighborhood-search technique accurately detected both borders in vivo (r2 = 0.95 and 0.99, Williams' index = 0.67 and 0.65, and r2 = 0.95 and 0.99, WI = 0.67 and 0.70, respectively). However, the neighborhood-search technique was significantly faster and required less computation. Volume calculations for both techniques (r2 = 0.99 and r2 = 0.99) also agreed with a known-volume phantom. Active surface segmentation allows 3-D assessment of coronary morphology and further developments with this technology will provide clinical analysis tools.
---
paper_title: AUTOMATED CONTOUR DETECTION FOR HIGH-FREQUENCY INTRAVASCULAR ULTRASOUND IMAGING: A TECHNIQUE WITH BLOOD NOISE REDUCTION FOR EDGE ENHANCEMENT

paper_content:

Automated edge detection may standardize measurements among observers, providing for rapid assessment of intravascular ultrasound (IVUS) images. However, with high frequency images, enhanced blood signals make it difficult to define and trace the lumen borders. Accordingly, we evaluated a fully automated contour analysis facilitated with a blood noise reduction algorithm (BNR) for 40-MHz IVUS images in human coronary arteries of 27 patients. This algorithm is based on the principle that blood echo speckles have higher temporal and spatial variations than the arterial wall. A total of 193 paired lumen areas and 78 external elastic membrane (EEM) areas were measured and compared. Automated measurements showed good agreement with manual tracings for lumen and EEM area, with high correlation coefficients (0.945 and 0.950, respectively) and small variability (0.4 ± 14.4% and 0.6 ± 9.7%, respectively). This preliminary finding suggests that automated contour detection facilitated with BNR appeared to be a feasible and reliable technique for area measurements in 40-MHz IVUS imaging.
---
paper_title: Validation of an automated system for luminal and medial-adventitial border detection in three-dimensional intravascular ultrasound

paper_content:

The precise tomographic assessment of coronary artery disease by intravascular ultrasound (IVUS) is useful in quantitative studies. Such studies require identification of luminal and medial-adventitial (MA) borders in a sequence of IVUS images. We have developed a three-dimensional (3D) active-surface system for border detection that facilitates the analysis of many images with minimal user interaction. To assess the validity of the technique, luminal and MA borders in 529 end-diastolic images from nine coronary arterial segments (58.8 ± 14.2 images per patient) were traced manually by four experienced observers. The computer-detected borders were compared with borders determined by the four observers using a modified Williams' index (WI), the ratio of inter-observer variability to computer-observer variability. While manual tracing required 49.2 ± 12.1 min for analysis, the analysis system identified luminal (R2 = 0.92) and MA borders (R2 = 0.97) in 13.8 ± 4.0 min, a decrease of 35.4 min (p < 0.000001). The computer minus observer differences in lumen area and MA area were −0.88 ± 0.90 and −0.07 ± 0.63 mm2. Therefore, the computer system underestimated both lumen and MA area, but this effect was very small in MA area. The WI values and 95% confidence intervals were 0.98 (0.89,1.06) for luminal border detection and 0.99 (0.95,1.04) for MA border detection. Plaque volume measurements, a common endpoint of clinical trials, also verified the accuracy of the technique (R2 = 0.98). The proposed 3D active-surface border detection system provides a faster and less-tedious alternative to manual tracing for assessment of coronary artery anatomy in vivo.
---
paper_title: Bayesian Level Sets for Image Segmentation

paper_content:

This paper presents a new general framework for image segmentation. A level set formulation is used to model the boundaries of the image regions and a new Multilabel Fast Marching is introduced for the evolution of the region contours toward the segmentation result. Statistical tests are performed to yield an initial estimate of high-confidence subsets of the image regions. Furthermore, the velocities for the propagation of the region contours are defined in accordance with the a posteriori probability of the respective regions, leading to the Bayesian Level Set methodology described in this paper. Typical segmentation problems are considered and experimental results are given to illustrate the robustness of the method against noise and its performance in precise region boundary localization.
---
paper_title: Robust 3D Segmentation of Anatomical Structures with Level Sets

paper_content:

This paper is concerned with the use of the level set formalism to segment anatomical structures in 3D medical images (ultrasound or magnetic resonance images). A closed 3D surface propagates towards the desired boundaries through the iterative evolution of a 4D implicit function. The major contribution of this work is the design of a robust evolution model based on adaptive parameters depending on the data. First the iteration step and the external propagation force, both usually constant, are automatically computed at each iteration. Additionally, region-based information rather than the gradient is used, via an estimation of intensity probability density functions over the image. As a result, the method can be applied to various kinds of data. Quantitative and qualitative results on brain MR images and 3D echographies of carotid arteries are discussed.
---
paper_title: Multiresolution texture segmentation with application to diagnostic ultrasound images

paper_content:

A multiresolution texture segmentation (MTS) approach to image segmentation that addresses the issues of texture characterization, image resolution, and time to complete the segmentation is presented. The approach generalizes the conventional simulated annealing method to a multiresolution framework and minimizes an energy function that is dependent on the resolution of the size of the texture blocks in an image. A rigorous experimental procedure is also proposed to demonstrate the advantages of the proposed MTS approach on the accuracy of the segmentation, the efficiency of the algorithm, and the use of varying features at different resolution. Semireal images, created by sampling a series of diagnostic ultrasound images of an ovary in vitro, were tested to produce statistical measures on the performance of the approach. The ultrasound images themselves were then segmented to determine if the approach can achieve accurate results for the intended ultrasound application. Experimental results suggest that the MTS approach converges faster and produces better segmentation results than the single-level approach. >
---
paper_title: A two-dimensional extension of minimum cross entropy thresholding for the segmentation of ultrasound images.

paper_content:

Segmentation is often an important step in medical image analysis. The local entropy is a possible variable for segmenting ultrasound images containing fluid surrounded by a soft tissue. A commonly used tool for image segmentation is thresholding. Recently, a new thresholding technique, known as "minimum cross entropy thresholding" (MCE), has been proposed. We present a multivariate extension of MCE in which the segmented variable (gray level) is replaced by a weighted combination of several image parameters. We propose to use a bivariate extension of MCE, which uses a linear combination of the gray level and the local entropy. The results obtained are demonstrated for ultrasound images of ovarian cysts.
---
paper_title: A methodology for evaluation of boundary detection algorithms on medical images

paper_content:

Image segmentation is the partition of an image into a set of nonoverlapping regions whose union is the entire image. The image is decomposed into meaningful parts which are uniform with respect to certain characteristics, such as gray level or texture. In this paper, we propose a methodology for evaluating medical image segmentation algorithms wherein the only information available is boundaries outlined by multiple expert observers. In this case, the results of the segmentation algorithm can be evaluated against the multiple observers' outlines. We have derived statistics to enable us to find whether the computer-generated boundaries agree with the observers' hand-outlined boundaries as much as the different observers agree with each other. We illustrate the use of this methodology by evaluating image segmentation algorithms on two different applications in ultrasound imaging. In the first application, we attempt to find the epicardial and endocardial boundaries from cardiac ultrasound images, and in the second application, our goal is to find the fetal skull and abdomen boundaries from prenatal ultrasound images.
---
paper_title: Computer Assisted Human Follicle Analysis for Fertility Prospects with 3D Ultrasound

paper_content:

Knowledge about the status of the female reproductive system is important for fertility problems and age-related family planning. The volume of these fertility requests in our emancipated society is steadily increasing. Intravaginal 3D ultrasound imaging of the follicles in the ovary gives important information about the ovarian aging, i.e. number of follicles, size, position and response to hormonal stimulation. Manual analysis of the many follicles is laborious and error-prone. We present a multiscale analysis to automatically detect and quantify the number and shape of the patient's follicles. Robust estimation of the centres of the follicles in the speckled echographic images is done by calculating so-called winding number of the intensity singularity, i.e. the path integral of the angular increment of the direction of the gradient vector over a closed neighbourhood around the point. The principal edges on 200-500 intensity traces radiating from the detected singularity points are calculated by a multiscale edge focussing technique on 1D winding numbers. They are fitted with 3D spherical harmonic functions, from which the volume and shape parameters are derived.
---
paper_title: Interactive automatic fetal head measurements from ultrasound images using multimedia computer technology

paper_content:

Abstract We have developed a tool to automatically detect inner and outer skull boundaries of a fetal head in ultrasound images. These boundaries are used to measure biparietal diameter (BPD) and head circumference (HC). The algorithm is based on active contour models and takes 32 s on a Sun SparcStation 20 71 . A high-performance desktop multimedia system called MediaStation 5000 (MS5000) is used as a model for our future ultrasound subsystem. On the MS5000, the optimized implementation of this algorithm takes 248 ms. The difference (between the computer-measured values on MS5000 and the gold standard) for BPD and HC was 1.43% (σ = 1.00%) and 1.96% (σ = 1.96%), respectively. According to our data analysis, no significant differences exist in the BPD and HC measurements made on the MS5000 and those measurements made on the Sun SparcStation 20 71 . Reduction in the overall execution time from 32 s to 248 ms will help making this algorithm a practical ultrasound tool for sonographers.
---
paper_title: The distribution of the local entropy in ultrasound images.

paper_content:

In this article, a model for the amplitude statistics of the backscattered ultrasonic signal is presented. We propose to view a tissue as being composed of a large number of small units, each having slightly different characteristics. This variability within the tissue is expressed by fluctuations in the parameters of the local probability distribution function (PDF). Based on analogous expressions derived for radio propagation and optical scintillations, the local PDF is modulated by a lognormal distribution of the local standard deviation. Integrating the local contributions yields the amplitude PDF for the entire tissue. We show that the local entropy is a normal variable, since for four different local PDFs it is linearly related to the logarithm of the local standard deviation. When the local entropy histogram exhibits distinct and multiple peaks, the local entropy distribution can be used for region segmentation. This fact is demonstrated for ultrasonic images of ovarian cysts.
---
paper_title: An automatic approach for morphological analysis and malignancy evaluation of ovarian masses using B-scans.

paper_content:

Ovarian masses are a common phenomenon among women of all ages. The importance of prompt diagnosis of ovarian malignancies is obvious, due to the high mortality rate and the difficulty to detect a tumor in its early stages. In this work, an automatic technique for quantitative analysis and malignancy detection of ovarian masses using B-scan ultrasound (US) images is presented. The core of the technique is morphologic analysis of the ovarian mass. The method employed for this task is divided into two major stages: initial classification of the mass (into one of the three major tumor types: cyst, semisolid, solid), and detailed analysis of the mass. Malignancy evaluation is performed based on the collected data and the criteria provided by commonly used scoring systems. The results reflect adequate performance of the automatic method developed (referring to clinical requirements).
---
paper_title: Semiautomated segmentation of ovarian follicular ultrasound images using a knowledge-based algorithm.

paper_content:

The application of a knowledge-based segmentation method to the problem of automatically detecting the outer follicle wall boundary in ultrasonographic images of ovaries is presented. A combination of computer detection and interactive adjustment was used to define an approximate inner follicle-wall boundary, which was then used by the computer algorithm as a priori knowledge to automatically find the outer follicle-wall border. The segmentation algorithm was tested on ultrasonographic images of women's ovaries that were imaged in vivo. The semiautomatic segmentations were compared to segmentations by an expert human observer in terms of border placement differences and in terms of quantitative parameters relevant to the physiologic status of the follicles. These physiological parameters include total and specific signal intensity from the follicle and from the follicle wall. The computer-detected outer follicle wall boundaries correlated well with the human observer-defined wall boundaries, in terms of enclosed follicle area, specific and total follicle signal, enclosed wall area, and specific and total wall signal. The actual border placement differences were also small, with a maximum placement difference of 1.47 +/- 0.83 mm and a root mean square (r.m.s.) placement difference of 0.59 +/- 0.28 mm.
---
paper_title: Ovarian ultrasound image analysis: follicle segmentation

paper_content:

Ovarian ultrasound is an effective tool in infertility treatment. Repeated measurements of the size and shape of follicles over several days are the primary means of evaluation by physicians. Currently, follicle wall segmentation is achieved by manual tracing which is time consuming and susceptible to inter-operator variation. An automated method for follicle wall segmentation is reported that uses a four-step process based on watershed segmentation and knowledge-based graph search algorithm which utilizes priori information about follicle structure for inner and outer wall detection. The automated technique was tested on 36 ultrasonographic images of women's ovaries. Validation against manually traced borders has shown good correlation of manually defined and computer-determined area measurements (R2 = 0.85 - 0.96). The border positioning errors were small: 0.63+/-0.36 mm for inner border and 0.67+/-0.41 mm for outer border detection. The use of watershed segmentation and graph search methods facilitates fast, accurate inner and outer border detection with minimal user-interaction.
---
paper_title: Segmentation of intravascular ultrasound images: a knowledge-based approach.

paper_content:

Intravascular ultrasound imaging of coronary arteries provides important information about coronary lumen, wall, and plaque characteristics. Quantitative studies of coronary atherosclerosis using intravascular ultrasound and manual identification of wall and plaque borders are limited by the need for observers with substantial experience and the tedious nature of manual border detection. We have developed a method for segmentation of intravascular ultrasound images that identifies the internal and external elastic laminae and the plaque-lumen interface. The border detection algorithm was evaluated in a set of 38 intravascular ultrasound images acquired from fresh cadaveric hearts using a 30 MHz imaging catheter. To assess the performance of our border detection method we compared five quantitative measures of arterial anatomy derived from computer-detected borders with measures derived from borders manually defined by expert observers. Computer-detected and observer-defined lumen areas correlated very well (r=0.96, y=1.02x+0.52), as did plaque areas (r=0.95, y=1.07x-0.48), and percent area stenosis (r=0.93, y=0.99x-1.34.) Computer-derived segmental plaque thickness measurements were highly accurate. Our knowledge-based intravascular ultrasound segmentation method shows substantial promise for the quantitative analysis of in vivo intravascular ultrasound image data.
---
paper_title: Three-dimensional Ultrasonographic Presentation of Micrognathia

paper_content:

OBJECTIVE ::: To present the variable appearance of micrognathia in fetuses by three-dimensional ultrasonography and to describe practical methods for analysis of these volume data. ::: ::: ::: METHODS ::: Three-dimensional multiplanar imaging and surface-rendering techniques were used to show various syndromes and diagnostic approaches for the evaluation of fetal micrognathia. ::: ::: ::: RESULTS ::: Nine cases of fetal micrognathia are presented. Orthogonal multiplanar views were used to obtain a midsagittal facial profile. Examples of micrognathia include 3 cases of Pierre Robin sequence, cerebrocostomandibular syndrome, Cornelia de Lange syndrome, and hypochondrogenesis. Diagnostic pitfalls for micrognathia are also shown. ::: ::: ::: CONCLUSIONS ::: Three-dimensional multiplanar imaging increases the likelihood that a true midline sagittal view of the facial profile is being analyzed. Surface rendering provides another way to qualitatively evaluate the fetal chin from different viewing perspectives. Three-dimensional ultrasonographic methods are useful adjuncts to the preliminary diagnostic impression from two-dimensional ultrasonography.
---
paper_title: Automatic fetal head measurements from sonographic images

paper_content:

Rationale and Objectives. We designed an image processing technique to automatically measure the biparietal diameter (BPD) and head circumference (HC) from prenatal sonograms. We evaluated the performance of the algorithm by comparing the resulting measurements with those made by experienced sonographers. Methods. Thirty-five digitized sonograms of the fetal head were obtained during routine imaging. The BPD and HC were automatically computed by detecting the inner and outer boundaries of the fetal skull using the computer vision technique known as the “active contour model.” Six experienced sonographers also measured the BPD and HC on these images. Results. The algorithm failed to locate the boundaries in two of the 35 cases. For the remaining cases, the mean absolute difference between the automated measurements and the average of the six observers was 1.4% for BPD and 2.9% for HC. The correlations were .999 for the BPD and .994 for the HC. The computer's measurements were no different from the six observers' measurements than the observers' measurements were from one another. Conclusion. The tested algorithm effectively and accurately measures BPD and HC automatically. We are currently in the process of integrating this algorithm into an ultrasound machine.
---
paper_title: Segmentation of fetal ultrasound images.

paper_content:

This paper describes a new method for segmentation of fetal anatomic structures from echographic images. More specifically, we estimate and measure the contours of the femur and of cranial cross-sections of fetal bodies, which can thus be automatically measured. Contour estimation is formulated as a statistical estimation problem, where both the contour and the observation model parameters are unknown. The observation model (or likelihood function) relates, in probabilistic terms, the observed image with the underlying contour. This likelihood function is derived from a region-based statistical image model. The contour and the observation model parameters are estimated according to the maximum likelihood (ML) criterion, via deterministic iterative algorithms. Experiments reported in the paper, using synthetic and real images, testify for the adequacy and good performance of the proposed approach.
---
paper_title: Automated analysis of a sequence of ovarian ultrasound images. Part I: segmentation of single 2D images

paper_content:

Abstract An improved algorithm is presented for ovarian follicle detection in ultrasound images. This fully automated recognition algorithm is composed of three successive steps. First, initial homogeneous regions are determined. Then, these initial regions are grown. The growing is controlled by average grey-level and by a newly introduced weighted image gradient. In the last stage, those regions are extracted that probably correspond to the follicles. The algorithm has been tested on 50 ovarian ultrasound images. The recognition rate of follicles using this procedure was around 78%. A possible extension of the algorithm deals with the entire information in the ultrasound image sequence, which is covered in Part II of this paper.
---
paper_title: A methodology for evaluation of boundary detection algorithms on medical images

paper_content:

Image segmentation is the partition of an image into a set of nonoverlapping regions whose union is the entire image. The image is decomposed into meaningful parts which are uniform with respect to certain characteristics, such as gray level or texture. In this paper, we propose a methodology for evaluating medical image segmentation algorithms wherein the only information available is boundaries outlined by multiple expert observers. In this case, the results of the segmentation algorithm can be evaluated against the multiple observers' outlines. We have derived statistics to enable us to find whether the computer-generated boundaries agree with the observers' hand-outlined boundaries as much as the different observers agree with each other. We illustrate the use of this methodology by evaluating image segmentation algorithms on two different applications in ultrasound imaging. In the first application, we attempt to find the epicardial and endocardial boundaries from cardiac ultrasound images, and in the second application, our goal is to find the fetal skull and abdomen boundaries from prenatal ultrasound images.
---
paper_title: Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation

paper_content:

Characterizing the performance of image segmentation approaches has been a persistent challenge. Performance analysis is important since segmentation algorithms often have limited accuracy and precision. Interactive drawing of the desired segmentation by human raters has often been the only acceptable approach, and yet suffers from intra-rater and inter-rater variability. Automated algorithms have been sought in order to remove the variability introduced by raters, but such algorithms must be assessed to ensure they are suitable for the task. The performance of raters (human or algorithmic) generating segmentations of medical images has been difficult to quantify because of the difficulty of obtaining or estimating a known true segmentation for clinical data. Although physical and digital phantoms can be constructed for which ground truth is known or readily estimated, such phantoms do not fully reflect clinical images due to the difficulty of constructing phantoms which reproduce the full range of imaging characteristics and normal and pathological anatomical variability observed in clinical data. Comparison to a collection of segmentations by raters is an attractive alternative since it can be carried out directly on the relevant clinical imaging data. However, the most appropriate measure or set of measures with which to compare such segmentations has not been clarified and several measures are used in practice. We present here an expectation-maximization algorithm for simultaneous truth and performance level estimation (STAPLE). The algorithm considers a collection of segmentations and computes a probabilistic estimate of the true segmentation and a measure of the performance level represented by each segmentation. The source of each segmentation in the collection may be an appropriately trained human rater or raters, or may be an automated segmentation algorithm. The probabilistic estimate of the true segmentation is formed by estimating an optimal combination of the segmentations, weighting each segmentation depending upon the estimated performance level, and incorporating a prior model for the spatial distribution of structures being segmented as well as spatial homogeneity constraints. STAPLE is straightforward to apply to clinical imaging data, it readily enables assessment of the performance of an automated image segmentation algorithm, and enables direct comparison of human rater and algorithm performance.
---
paper_title: Speckle Classification for Sensorless Freehand 3D Ultrasound

paper_content:

Despite being a valuable tool for volume measurement and the analysis of complex geometry, the need for an external position sensor is holding up the clinical exploitation of freehand 3-D ultrasound. Some sensorless systems have been developed, using speckle decorrelation for out-of-plane distance estimation, but their accuracy is still not as good as that of sensor-based systems. Here, we examine the widely held belief that accuracy can be improved by limiting the distance measurements to patches of ultrasound data containing fully developed speckle. Without speckle detection, we observe that scan separation is systematically underestimated by 33.1% in biological tissue. We describe a number of speckle detectors and show that they reduce the underestimate to about 25%. We conclude that speckle classification can improve the quality of distance estimation, but not sufficiently to achieve accurate, metric reconstruction of the insonified volume.
---
paper_title: Segmentation of fetal ultrasound images.

paper_content:

This paper describes a new method for segmentation of fetal anatomic structures from echographic images. More specifically, we estimate and measure the contours of the femur and of cranial cross-sections of fetal bodies, which can thus be automatically measured. Contour estimation is formulated as a statistical estimation problem, where both the contour and the observation model parameters are unknown. The observation model (or likelihood function) relates, in probabilistic terms, the observed image with the underlying contour. This likelihood function is derived from a region-based statistical image model. The contour and the observation model parameters are estimated according to the maximum likelihood (ML) criterion, via deterministic iterative algorithms. Experiments reported in the paper, using synthetic and real images, testify for the adequacy and good performance of the proposed approach.
---
paper_title: Comments on: A methodology for evaluation of boundary detection algorithms on medical images

paper_content:

In this paper we analyze a result previously published about a comparison between two statistical tests used for evaluation of boundary detection algorithms on medical images. We conclude that the statement made by Chalana and Kim (1997) about the performance of the percentage test has a weak theoretical foundation, and according to our results, is not correct. In addition, we propose a one-sided hypothesis test for which the acceptance region can be determined in advance, as opposed to the two-sided confidence intervals proposed in the original paper, which change according to the estimated quantity.
---
paper_title: A multiparametric and multiresolution segmentation algorithm of 3D ultrasonic data

paper_content:

An algorithm devoted to the segmentation of 3-D ultrasonic data is proposed. The algorithm involves 3-D adaptive clustering based on multiparametric information: the gray-scale intensity of the echographic data, 3-D texture features calculated from the envelope data, and 3-D tissue characterization information calculated from the local frequency spectra of the radio-frequency signals. The segmentation problem is formulated as a Maximum A posterior (MAP) estimation problem. A multi-resolution implementation of the algorithm is proposed. The approach is tested on simulated data and on in vivo echocardiographic 3-D data. The results presented in the paper illustrate the robustness and the accuracy of the proposed approach for the segmentation of ultrasonic data.
---
paper_title: Spatio-temporal nonrigid registration for ultrasound cardiac motion estimation

paper_content:

We propose a new spatio-temporal elastic registration algorithm for motion reconstruction from a series of images. The specific application is to estimate displacement fields from two-dimensional ultrasound sequences of the heart. The basic idea is to find a spatio-temporal deformation field that effectively compensates for the motion by minimizing a difference with respect to a reference frame. The key feature of our method is the use of a semi-local spatio-temporal parametric model for the deformation using splines, and the reformulation of the registration task as a global optimization problem. The scale of the spline model controls the smoothness of the displacement field. Our algorithm uses a multiresolution optimization strategy to obtain a higher speed and robustness. We evaluated the accuracy of our algorithm using a synthetic sequence generated with an ultrasound simulation package, together with a realistic cardiac motion model. We compared our new global multiframe approach with a previous method based on pairwise registration of consecutive frames to demonstrate the benefits of introducing temporal consistency. Finally, we applied the algorithm to the regional analysis of the left ventricle. Displacement and strain parameters were evaluated showing significant differences between the normal and pathological segments, thereby illustrating the clinical applicability of our method.
---
paper_title: Novel Bayesian multiscale method for speckle removal in medical ultrasound images

paper_content:

A novel speckle suppression method for medical ultrasound images is presented. First, the logarithmic transform of the original image is analyzed into the multiscale wavelet domain. We show that the subband decompositions of ultrasound images have significantly non-Gaussian statistics that are best described by families of heavy-tailed distributions such as the alpha-stable. Then, we design a Bayesian estimator that exploits these statistics. We use the alpha-stable model to develop a blind noise-removal processor that performs a nonlinear operation on the data. Finally, we compare our technique with current state-of-the-art soft and hard thresholding methods applied on actual ultrasound medical images and we quantify the achieved performance improvement.
---
paper_title: Detection of lines and boundaries in speckle images-application to medical ultrasound

paper_content:

This paper describes an approach to boundary detection in ultrasound speckle based on an image enhancement technique. The enhancement algorithm works by filtering the image with "sticks," short line segments which are varied in orientation to achieve the maximum projected value at each point. The statistical properties of this approach have been described in an earlier paper; in this work we present three significant extensions to improve the performance of the basic method. First, we investigate the effect of varying the size and shape of the sticks. We show that these variations affect the performance of the algorithm in very fundamental ways, for example by making it more or less sensitive to thinner or more tightly curving boundaries. Second, we present a means of improving the performance of this technique by estimating the distribution function of the orientation of the line passing through each point. Finally, we show that images can be "stained" for easier visual interpretation by applying to each pixel a false color whose hue is related to the orientation of the most prominent line segment at that point. Examples are given to illustrate the performance of the different settings on a single image.
---
paper_title: Morphological image sequence processing

paper_content:

We present a morphological multi-scale method for image sequence processing, which results in a truly coupled spatio-temporal anisotropic diffusion. The aim of the method is not to smooth the level-sets of single frames but to denoise the whole sequence while retaining geometric features such as spatial edges and highly accelerated motions. This is obtained by an anisotropic spatio-temporal level-set evolution, where the additional artificial time variable serves as the multi-scale parameter. The diffusion tensor of the evolution depends on the morphology of the sequence, given by spatial curvatures of the level-sets and the curvature of trajectories (=acceleration) in sequence-time. We discuss different regularization techniques and describe an operator splitting technique for solving the problem. Finally we compare the new method with existing multi-scale image sequence processing methodologies.
---
paper_title: Speckle in ultrasound B-mode scans

paper_content:

Ultrasound images obtained with a simple linear or sector scan show a granular appearance, called "speckle." This speckle is analyzed. The reduction in speckle that can be obtained with a compound scan with maximum amplitude writing is computed. The reduction in speckle is almost as large as can be obtained with averaging. It depends on the number of independent amplitude values that are measured. The condition for the independence of two amplitude values is derived, and thus a limit is given for the possible reduction in speckle.
---
paper_title: Use of non-Rayleigh statistics for the identification of tumors in ultrasonic B-scans of the breast

paper_content:

A model for the scattering of ultrasound from breast tissue is proposed. The model is based on the use of non-Rayleigh statistics, specifically the K distribution to describe the backscattered echo from the tissue. A multiparameter test based on this model has been designed to characterize the tissue. The data from the B-scan images of the breasts of 6 different patients were analyzed using this model. The results indicate that the non-Rayleigh statistics seem to be useful in characterizing and identifying malignant, benign, and normal tissue regions. >
---
paper_title: Real-time speckle reduction and coherence enhancement in ultrasound imaging via nonlinear anisotropic diffusion

paper_content:

This paper presents a novel approach for speckle reduction and coherence enhancement of ultrasound images based on nonlinear coherent diffusion (NCD) model. The proposed NCD model combines three different models. According to speckle extent and image anisotropy, the NCD model changes progressively from isotropic diffusion through anisotropic coherent diffusion to, finally, mean curvature motion. This structure maximally low-pass filters those parts of the image that correspond to fully developed speckle, while substantially preserving information associated with resolved-object structures. The proposed implementation algorithm utilizes an efficient discretization scheme that allows for real-time implementation on commercial systems. The theory and implementation of the new technique are presented and verified using phantom and clinical ultrasound images. In addition, the results from previous techniques are compared with the new method to demonstrate its performance.
---
paper_title: Statistics of Speckle in Ultrasound B-Scans

paper_content:

the of the magnitude, i.e., intensity, of the field.) It is shown that Rayleigh statistics govern the fist-order behavior of the magnitude; and the autocorrelation of the resulting image speckle is obtained by the methodof Middleton. The corresponding power spectrum follows immediately by Fourier transformation. Theoretical and experimentally determined autocorrelation functions and power spectra derived from B-scans of a scattering phantom containing many scatterers per resolution cell are presented. These functions lead naturally to the definition of the average speckle spot or cell sue, and this inturn is comparable to the resolution cell. Each independent speckle servesas a degreeof freedom that determines the number of samples of tissue available over a target.As the speckle cell size decreases this number increases in a manner predictable from the physical parameters of the cell size. However, it is found that the speckle cellis broadened, the degrees of freedom diminished, when the object structureis correlated. This yields the possibilityof deducing information about the object structure from the second-order statistics of the speckle texture, in addition to that obtainable from the fiistorder statistics.
---
paper_title: Use of the K-distribution for classification of breast masses.

paper_content:

The K-distribution had been introduced as a valid model to represent the statistics of the envelope of the backscattered echo from phantom and tissue. This paper investigates the efficacy of the parameters of this statistical model; namely, the effective number and the effective cross-section, to characterize breast lesions as benign or malignant. Based on the normalized values of the effective number and the effective scattering cross-section, images containing benign and malignant masses were classified for a data set from 52 patients having breast masses/lesions. The receiver operating characteristic (ROC) curves were then obtained to test the classification based on these two parameters. The results indicate that the parameters of the K-distribution may be useful in classification of the breast lesions as benign and malignant.
---
paper_title: Classification of breast masses in ultrasonic B scans using Nakagami and K distributions

paper_content:

Classification of breast masses in greyscale ultrasound images is undertaken using a multiparameter approach. Five parameters reflecting the non-Rayleigh nature of the backscattered echo were used. These parameters, based mostly on the Nakagami and K distributions, were extracted from the envelope of the echoes at the site, boundary, spiculated region and shadow of the mass. They were combined to create a linear discriminant. The performance of this discriminant for the classification of breast masses was studied using a data set consisting of 70 benign and 29 malignant cases. The Az value for the discriminant was 0.96 ± 0.02, showing great promise in the classification of masses into benign and malignant ones. The discriminant was combined with the level of suspicion values of the radiologist leading to an Az value of 0.97 ± 0.014. The parameters used here can be calculated with minimal clinical intervention, so the method proposed here may therefore be easily implemented in an automated fashion. These results also support the recent reports suggesting that ultrasound may help as an adjunct to mammography in breast cancer diagnostics to enhance the classification of breast masses.
---
paper_title: Biased motion-adaptive temporal filtering for speckle reduction in echocardiography.

paper_content:

Describes a new fully motion-adaptive spatio-temporal filtering technique to reduce the speckle in ultrasound images. The advantages of this approach are demonstrated in echocardiographic boundary detection and in comparison with other techniques. The first stage of many automated echocardiographic image interpretation schemes is filtering to reduce the amount of speckle noise. The authors show how the two-dimensional least mean squares (TDLMS) filter can be configured as a motion-compensated filter for a time sequence of ultrasound images that eliminates the blurring associated with direct averaging. For an image corrupted by multiplicative speckle noise, the mode of the intensity distribution approximates the maximum likelihood estimator. In consequence, the temporal filter's output is biased towards the mode from the mean, using information contained within the speckle itself. A new adaptive algorithm for controlling the filter's convergence is also included. To evaluate performance, application to simulated, phantom, and an in vivo test sequence of the carotid artery are considered in comparison with other techniques. The effect of filtering on edges is of great importance, as these are used by subsequent image interpretation schemes. Quantitative measurements demonstrate the effectiveness of the Biased TDLMS filter, for both noise reduction and edge preservation. Echocardiographic images have a high noise content and suffer from poor contrast. Despite this challenging environment, the Biased TDLMS filter is shown to produce images that are better inputs for subsequent feature extraction. The benefits for echocardiographic images are highlighted by considering the problems of mitral valve analysis and extraction of the left atrium boundary.
---
paper_title: Classification of ultrasonic B-mode images of breast masses using Nakagami distribution

paper_content:

The Nakagami distribution was proposed recently for modeling the echo from tissue. In vivo breast data collected from patients with lesions were studied using this Nakagami model. Chi-square tests showed that the Nakagami distribution is a better fit to the envelope than the Rayleigh distribution. Two parameters, m (effective number) and alpha (effective cross section), associated with the Nakagami distribution were used for the classification of breast masses. Data from 52 patients with breast masses/lesions were used in the studies. Receiver operating characteristics (ROC) were calculated for the classification methods based on these two parameters. The results indicate that these parameters of the Nakagami distribution may be useful in classification of the breast abnormalities. The Nakagami distribution may be a reasonable means to characterize the backscattered echo from breast tissues toward a goal of an automated scheme for separating benign and malignant breast masses.
---
paper_title: Effective Density Estimators Based on the K Distribution: Interest of Low and Fractional Order Moments

paper_content:

The K distribution is an efficient model to the nonRayleigh statistics of the envelope of backscattered signals in random media. This modeling leads to estimate a parameter of effective density by means of the calculation of statistical moments of the envelope signal. In this study, we propose a mathematical analysis of an effective density estimator previously used and based on superior order moments. In order to improve the effective density estimate, we propose several estimators based on low and fractional order moments. The performances of these estimators are evaluated both with simulated signals and in an experimental context with synthetic foams. Estimators based on low and fractional moments appear to be more robust than superior moment-based estimator and an improvement of the spatial resolution of the estimate can be obtained. Results also confirm the capability of the effective density parameter to characterize the spatial distribution of scattering structures.
---
paper_title: Speckle reduction and contrast enhancement of echocardiograms via multiscale nonlinear processing

paper_content:

This paper presents an algorithm for speckle reduction and contrast enhancement of echocardiographic images. Within a framework of multiscale wavelet analysis, the authors apply wavelet shrinkage techniques to eliminate noise while preserving the sharpness of salient features. In addition, nonlinear processing of feature energy is carried out to enhance contrast within local structures and along object boundaries. The authors show that the algorithm is capable of not only reducing speckle, but also enhancing features of diagnostic importance, such as myocardial walls in two-dimensional echocardiograms obtained from the parasternal short-axis view. Shrinkage of wavelet coefficients via soft thresholding within finer levels of scale is carried out on coefficients of logarithmically transformed echocardiograms. Enhancement of echocardiographic features is accomplished via nonlinear stretching followed by hard thresholding of wavelet coefficients within selected (midrange) spatial-frequency levels of analysis. The authors formulate the denoising and enhancement problem, introduce a class of dyadic wavelets, and describe their implementation of a dyadic wavelet transform. Their approach for speckle reduction and contrast enhancement was shown to be less affected by pseudo-Gibbs phenomena. The authors show experimentally that this technique produced superior results both qualitatively and quantitatively when compared to results obtained from existing denoising methods alone. A study using a database of clinical echocardiographic images suggests that such denoising and enhancement may improve the overall consistency of expert observers to manually defined borders.
---
paper_title: On low order moments of the homodyned-K distribution

paper_content:

Fractional low order moments have been reported as beneficial for sampling computations using the K distribution. However, it has been recently pointed out that this it not the case for the homodyned-K distribution for a tissue discrimination problem. In this paper we show that such an statement is not fully justified. To that end, we follow a standard pattern recognition procedure both to determine class separability measures and to classify data with several classifiers. We conclude that the optimum order of the moments is intimately linked to the specific statistical properties of the tissues to be discriminated. Some ideas on how to choose the optimum order are discussed.
---
paper_title: The distribution of the local entropy in ultrasound images.

paper_content:

In this article, a model for the amplitude statistics of the backscattered ultrasonic signal is presented. We propose to view a tissue as being composed of a large number of small units, each having slightly different characteristics. This variability within the tissue is expressed by fluctuations in the parameters of the local probability distribution function (PDF). Based on analogous expressions derived for radio propagation and optical scintillations, the local PDF is modulated by a lognormal distribution of the local standard deviation. Integrating the local contributions yields the amplitude PDF for the entire tissue. We show that the local entropy is a normal variable, since for four different local PDFs it is linearly related to the logarithm of the local standard deviation. When the local entropy histogram exhibits distinct and multiple peaks, the local entropy distribution can be used for region segmentation. This fact is demonstrated for ultrasonic images of ovarian cysts.
---
paper_title: K-distributed noise

paper_content:

A brief review of the history, properties and applications of K-distributed noise is presented. Statistical relationships and generalizations of the model are summarized, and processing techniques developed to extract signals embedded in this kind of noise are briefly discussed.
---
paper_title: Denoising of ultrasound sector scans by nonlinear filtering of a morphological and linear ratio pyramid

paper_content:

The quality of ultrasound images is limited due to granular speckle noise. The presented despeckle algorithm compensates the depth-dependent shape of granular speckles in sector scans by an initial coordinate transform. This yields a horizontally oriented speckle pattern of constant resolution and hence allows the use of constant filter templates. The signal-dependent nature of multiplicative speckle noise is considered by a ratio pyramid containing noise-normalized, subsampled scales corrupted by signal- independent noise. Since speckles can be identified as positive and negative impulses on the subsampled scales, they are removed by selfdual nonlinear multistage filters (NMF). The templates are adapted to the granular appearance of the speckles and the degree of filtering is individually controlled by the local noise power in each scale. We propose a new selfdual morphological pyramid with the common erosion/dilation as analysis operators and the reconstructive dilation/erosion as synthesis operators. The resulting closing-by-reconstruction and opening-by- reconstruction branches consider local intensity amplifications and attenuations, respectively. They are generated separately and combined only for scale-selective restoration by NMFs. Besides morphological decomposition, a ratio Laplacian pyramid is evaluated and its performance is compared with the proposed morphological decomposition, a ratio Laplacian pyramid is evaluated and its performance is compared with the proposed morphological decomposition. Both methods lead to significant noise reduction, where the morphological method introduces less signal degenerations.
---
paper_title: Non-rayleigh first-order statistics of ultrasonic backscatter from normal myocardium

paper_content:

Abstract Historically, it has been assumed that the first-order envelope statistics of ultrasonic backscatter from myocardium are best described by the Rayleigh probability distribution function (PDF); however, few studies have tested this assumption. This study compares the ability of five PDFs, including the Rayleigh, to describe high-frequency (5–15 MHz) ultrasonic backscatter from in vivo canine myocardium and in vitro human myocardium. The PDFs used have all been previously proposed as descriptions of backscatter from parenchymal tissue or other random media. In this study goodness-of-fit testing of backscatter recorded at several frequencies and insonification angles shows that only in a minority of cases is the envelope Rayleigh-distributed. In most cases, the K distribution provides the best fit. In addition, computer simulation shows that sparse Poisson scattering can produce K -distributed backscatter. Scattering of this type may contribute to the observed non-Rayleigh character of myocardial backscatter. We conclude that the Rayleigh distribution is not an adequate description of backscatter from myocardium. Non-Rayleigh distributions may offer an additional approach to myocardial tissue characterization.
---
paper_title: A diffusion stick method for speckle suppression in ultrasonic images

paper_content:

This paper presents a diffusion stick method for speckle suppression in ultrasonic images. An asymmetric stick filter kernel is firstly defined by decomposing the rectangle neighborhood into line segments of variable orientations. Then, the weighted sum of averages along each stick is used to produce the filtered images. Implemented in an iteration scheme, our method works as a pseudo-diffusion process, where the diffusivity is controlled by a normalized variance function. Experiments of synthetic and real images show that the diffusion stick technique performs effectively in suppressing speckle noise, preserving resolvable structures and enhancing linear features.
---
paper_title: Analysis Of Ultrasound Image Texture Via Generalized Rician Statistics

paper_content:

Tissue signatures are obtained from the first and second order statistics of ultrasonic B-scan texture. Laboratory measurements and early clinical results show that the image may be segmented to discriminate between different normal tissues and to detect abnormal conditions based on a three-dimensional feature space. These features describe the intrinsic backscatter properties of the tissues imaged and may be used as the basis of an automatic tissue characterization algorithm.
---
paper_title: Speckle Analysis Using Signal to Noise Ratios Based on Fractional Order Moments

paper_content:

The SNR (signal-to-noise ratio) of the echo envelope image is a monotonically-increasing function of scatterer number density. Various SNRs, like amplitude SNR and intensity SNR, can be used to quantify the scatterer density. The problem of using a SNR based on higher order moments like the intensity SNR is that they require large sample sizes to obtain estimates with high confidence (the variance of the estimate becomes large for higher moments). In this paper, we consider SNRs based on fractional order moments (moments of order less than 1), and obtain mathematical analyses of their properties using the K distribution, which has been shown to be a good model for the density function of backscatter echo envelope signal. Statistics of SNRs based on fractional moment are derived and appear to be more robust and useful than the amplitude and intensity SNRs previously studied. The SNRs based on fractional order moments have greater dynamic range and the sample size requirements are smaller than those for integral order moment SNRs, like amplitude SNR or intensity SNR. Thus, SNRs based on fractional order moments could be used to better quantify the variations in scatterer density which can be used for tissue classification problems.
---
paper_title: A robust speckle reducing anisotropic diffusion

paper_content:

This paper deals with anisotropic diffusion in images affected by speckle. Two existing methods are reviewed. The first is a robust diffusion technique, non adapted to speckle, based on the Tukey function. The second applies an isotropic diffusion to speckle but lacks robustness. The contribution of this paper is to create a robust anisotropic diffusion filter adapted to speckle. The proposed approach is based on the two reviewed methods and introduces an original diffusion tensor Experimentation results are presented and the performance of the three methods compared. The proposed algorithm shows significant enhancement.
---
paper_title: Ultrasonic speckle formation, analysis and processing applied to tissue characterization

paper_content:

This paper describes the image formation in medical ultrasound for the case of scattering media. The texture statistics are dominated by speckle formation. The effects of spatial, fixed and adaptive, filtering, as well as, of grey scale encoding on the detection of lesions are analytically described and illustrated with representative images.
---
paper_title: An adaptive speckle suppression filter for medical ultrasonic imaging

paper_content:

An adaptive smoothing technique for speckle suppression in medical B-scan ultrasonic imaging is presented. The technique is based on filtering with appropriately shaped and sized local kernels. For each image pixel, a filtering kernel, which fits to the local homogeneous region containing the processed pixel, is obtained through a local statistics based region growing technique. The performance of the proposed filter has been tested on the phantom and tissue images. The results show that the filter effectively reduces the speckle while preserving the resolvable details. The simulation results are presented in a comparative way with two existing speckle suppression methods. >
---
paper_title: Estimation of K distribution parameters using neural networks

paper_content:

The K distribution is an accurate model for ultrasonic backscatter. A neural approach is developed to estimate K distribution parameters. Accuracy and consistency of the estimates from simulated K and envelope data compare favorably with other techniques. Neural networks can potentially be used as a complementary technique for tissue characterization.
---
paper_title: Statistics of the log-compressed echo envelope.

paper_content:

Log compression of A lines to produce B-scan images in clinical ultrasound imaging systems is a standard procedure to control the dynamic range of the images. The statistics of such compressed images in terms of underlying scatterer statistics have not been derived. The statistics are analyzed for partially formed speckle using a general K distribution model of envelope statistics to derive the density function for the log-compressed envelope. This density function is used to elucidate the relation between the moments of the compressed envelope, the compression parameters, and the statistics of the scatterers. The analysis shows that the mean of the log-compressed envelope is an increasing function of both the backscattered energy and the effective scatterer density. The variance of the log-compressed envelope is a decreasing function of the effective scatterer density and is independent of the backscattered energy.
---
paper_title: Ultrasonic tissue characterization using a generalized Nakagami model

paper_content:

The statistics of the backscattered ultrasonic echo from tissue have been described using Rayleigh, K, and Nakagami distributions. The Nakagami and K distributions, each with two parameters, can model the envelope reasonably well. However, a three-parameter distribution is likely to match the envelope of the backscattered echo much better than these two-parameter distributions. Starting with the Nakagami distribution and including an additional parameter to account for the tails of the density function, a generalized Nakagami distribution has been derived. Computer simulation of A-scans and analysis of data collected from tissue-mimicking phantoms show that the generalized Nakagami distribution fits the statistics of the echo of the envelope better than the Nakagami distribution. The parameters of the generalized Nakagami distribution appear to be far more sensitive to the scattering conditions than the parameters of the Nakagami distribution.
---
paper_title: Morphological operations by locally variable structuring elements and their applications to region extraction in ultrasound images

paper_content:

In this paper, we define a new adaptive morphological operation, in which the value of a structuring element varies adaptively depending on the local intensity information of the processing image of interest. We prove that the proposed adaptive morphological operation has almost the same mathematical structure and properties as the conventional ones have. There are many useful functions in the method. Among them are the opening and closing, which implement both smoothing of the image and emphasizing of the edges at a time. Conventional opening operation has a smoothing function but not both. Applying our method to relatively unclear images such as ultrasound ones with speckle noise, its usefulness can be found in extracting regions. We also discuss parameter setting, and its enhancement effect together with experimental results is demonstrated. © 2003 Wiley Periodicals, Inc. Syst Comp Jpn, 34(3): 33–43, 2003; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/scj.10196
---
paper_title: Wavelet-based statistical approach for speckle reduction in medical ultrasound images

paper_content:

A novel speckle-reduction method is introduced, based on soft thresholding of the wavelet coefficients of a logarithmically transformed medical ultrasound image. The method is based on the generalised Gaussian distributed(GGD) modelling of sub-band coefficients. The method used was a variant of the recently published BayesShrink method by Chang and Vetterli, derived in the Bayesian framework for denoising natural images. It was scale adaptive, because the parameters required for estimating the threshold depend on scale and sub-band data. The threshold was computed by Kσ 2 /σ x , where σ and σ x were the standard deviation of the noise and the sub-band data of the noise-free image, respectively, and K was a scale parameter. Experimental results showed that the proposed method outperformed the median filter and the homomorphic Wiener filter by 29% in terms of the coefficient of correlation and 4% in terms of the edge preservation parameter. The numerical values of these quantitative parameters indicated the good feature preservation performance of the algorithm, as desired for better diagnosis in medical image processing.
---
paper_title: Ultrasound Echo Envelope Analysis Using a Homodyned K Distribution Signal Model

paper_content:

The statistics of ultrasound echo envelope signals can be used to characterize scattering media. The Rayleigh distribution and its generalized forms, the K and Rice distributions, have been previously used to model the echo signal. A more generalized statistical model, the homodyned K distribution, combines the K and Rice distribution features to better account for the statistics of the echo signal. We show that this model can give two parameters that are useful for media characterization: k, the ratio of coherent to diffuse signals, and, β, which characterizes the clustering of scatterers in the medium.
---
paper_title: Adaptive speckle reduction filter for log-compressed B-scan images

paper_content:

A good statistical model of speckle formation is useful for designing a good adaptive filter for speckle reduction In ultrasound B-scan images. Previously, statistical models have been used, but they failed to account for the log compression of the echo envelope employed by clinical ultrasound systems. Log-compression helps in reducing the dynamic range of the B-scan Images for display on a monitor as well as enhancing weak backscatters. In this article, statistics of log-compressed echo images, using the K-distribution statistical model for the echo envelope, are used to derive a parameter that can be used to quantify the extent of speckle formation. This speckle quantification can be used with an unsharp masking filter to adaptively reduce speckle. The effectiveness of the filter is demonstrated on images of contrast detail phantoms and on in-vivo abdominal images obtained by a clinical ultrasound system with log-compression.
---
paper_title: Three-dimensional segmentation of luminal and adventitial borders in serial intravascular ultrasound images

paper_content:

Abstract Intravascular ultrasound (IVUS) provides exact anatomy of arteries, allowing accurate quantitative analysis. Automated segmentation of IVUS images is a prerequisite for routine quantitative analyses. We present a new three-dimensional (3D) segmentation technique, called active surface segmentation, which detects luminal and adventitial borders in IVUS pullback examinations of coronary arteries. The technique was validated against expert tracings by computing correlation coefficients (range 0.83–0.97) and William's index values (range 0.37–0.66). The technique was statistically accurate, robust to image artifacts, and capable of segmenting a large number of images rapidly. Active surface segmentation enabled geometrically accurate 3D reconstruction and visualization of coronary arteries and volumetric measurements.
---
paper_title: Morphological image sequence processing

paper_content:

We present a morphological multi-scale method for image sequence processing, which results in a truly coupled spatio-temporal anisotropic diffusion. The aim of the method is not to smooth the level-sets of single frames but to denoise the whole sequence while retaining geometric features such as spatial edges and highly accelerated motions. This is obtained by an anisotropic spatio-temporal level-set evolution, where the additional artificial time variable serves as the multi-scale parameter. The diffusion tensor of the evolution depends on the morphology of the sequence, given by spatial curvatures of the level-sets and the curvature of trajectories (=acceleration) in sequence-time. We discuss different regularization techniques and describe an operator splitting technique for solving the problem. Finally we compare the new method with existing multi-scale image sequence processing methodologies.
---
paper_title: Multiresolution texture segmentation with application to diagnostic ultrasound images

paper_content:

A multiresolution texture segmentation (MTS) approach to image segmentation that addresses the issues of texture characterization, image resolution, and time to complete the segmentation is presented. The approach generalizes the conventional simulated annealing method to a multiresolution framework and minimizes an energy function that is dependent on the resolution of the size of the texture blocks in an image. A rigorous experimental procedure is also proposed to demonstrate the advantages of the proposed MTS approach on the accuracy of the segmentation, the efficiency of the algorithm, and the use of varying features at different resolution. Semireal images, created by sampling a series of diagnostic ultrasound images of an ovary in vitro, were tested to produce statistical measures on the performance of the approach. The ultrasound images themselves were then segmented to determine if the approach can achieve accurate results for the intended ultrasound application. Experimental results suggest that the MTS approach converges faster and produces better segmentation results than the single-level approach. >
---
paper_title: Edge detection in ultrasound imagery using the instantaneous coefficient of variation

paper_content:

The instantaneous coefficient of variation (ICOV) edge detector, based on normalized gradient and Laplacian operators, has been proposed for edge detection in ultrasound images. In this paper, the edge detection and localization performance of the ICOV-squared (ICOVS) detector are examined. First, a simplified version of the ICOVS detector, the normalized gradient magnitude squared, is scrutinized in order to reveal the statistical performance of edge detection and localization in speckled ultrasound imagery. Both the probability of detection and the probability of false alarm are evaluated for the detector. Edge localization is characterized by the position of the peak and the 3-dB width of the detector response. Then, the speckle-edge response of the ICOVS as applied to a realistic edge model is studied. Through theoretical analysis, we reveal the compensatory effects of the normalized Laplacian operator in the ICOV edge detector for edge-localization error. An ICOV-based edge-detection algorithm is implemented in which the ICOV detector is embedded in a diffusion coefficient in an anisotropic diffusion process. Experiments with real ultrasound images have shown that the proposed algorithm is effective in extracting edges in the presence of speckle. Quantitatively, the ICOVS provides a lower localization error, and qualitatively, a dramatic improvement in edge-detection performance over an existing edge-detection method for speckled imagery.
---
paper_title: Automatic segmentation of echocardiographic sequences by active appearance motion models

paper_content:

A novel extension of active appearance models (AAMs) for automated border detection in echocardiographic image sequences is reported. The active appearance motion model (AAMM) technique allows fully automated robust and time-continuous delineation of left ventricular (LV) endocardial contours over the full heart cycle with good results. Nonlinear intensity normalization was developed and employed to accommodate ultrasound-specific intensity distributions. The method was trained and tested on 16-frame phase-normalized transthoracic four-chamber sequences of 129 unselected infarct patients, split randomly into a training set (n = 65) and a test set (n = 64). Borders were compared to expert drawn endocardial contours. On the test set, fully automated AAMM performed well in 97% of the cases (average distance between manual and automatic landmark points was 3.3 mm, comparable to human interobserver variabilities). The ultrasound-specific intensity normalization proved to be of great value for good results in echocardiograms. The AAMM was significantly more accurate than an equivalent set of two-dimensional AAMs.
---
paper_title: Application of artificial neural networks for the classification of liver lesions by image texture parameters.

paper_content:

Ultrasound imaging is a powerful tool for characterizing the state of soft tissues; however, in some cases, where only subtle differences in images are seen as in certain liver lesions such as hemangioma and malignancy, existing B-scan methods are inadequate. More detailed analyses of image texture parameters along with artificial neural networks can be utilized to enhance differentiation. From B-scan ultrasound images, 11 texture parameters comprising of first, second and run length statistics have been obtained for normal, hemangioma and malignant livers. Tissue characterization was then performed using a multilayered backpropagation neural network. The results for 113 cases have been compared with a classification based on discriminant analysis. For linear discriminant analysis, classification accuracy is 79.6% and with neural networks the accuracy is 100%. The present results show that neural networks classify better than discriminant analysis, demonstrating a much potential for clinical application.
---
paper_title: Tissue characterization from ultrasound B-scan data.

paper_content:

An approach to ultrasonic tissue characterization, using textural features of the B-scan image, is described. Portions of a B-scan image, 64 X 64 pixels spatially by 8 bits deep, are acquired from regions of interest and subjected to computer analysis. A systematic approach to defining a set of 93 textural features of a B-scan is described and methods and criteria for selecting optimum combinations of these are discussed. As a test of its power, the approach has been applied to the discrimination between the B-scan textures corresponding to livers and spleens of normal humans and various measures of "success" have been quantified both on a "training set only" and on a "training set plus test set" basis. The overall test probability of success of 82% on a single image and 94% on a subject yielding multiple images indicates the potential of the techniques for conditions where a subtle but uniform change in parenchymal texture may be present.
---
paper_title: LV volume quantification via spatiotemporal analysis of real-time 3-D echocardiography

paper_content:

This paper presents a method of four-dimensional (4-D) (3-D+Time) space-frequency analysis for directional denoising and enhancement of real-time three-dimensional (RT3D) ultrasound and quantitative measures in diagnostic cardiac ultrasound. Expansion of echocardiographic volumes is performed with complex exponential wavelet-like basis functions called brushlets. These functions offer good localization in time and frequency and decompose a signal into distinct patterns of oriented harmonics, which are invariant to intensity and contrast range. Deformable-model segmentation is carried out on denoised data after thresholding of transform coefficients. This process attenuates speckle noise while preserving cardiac structure location. The superiority of 4-D over 3-D analysis for decorrelating additive white noise and multiplicative speckle noise on a 4-D phantom volume expanding in time is demonstrated. Quantitative validation, computed for contours and volumes, is performed on in vitro balloon phantoms. Clinical applications of this spatiotemporal analysis tool are reported for six patient cases providing measures of left ventricular volumes and ejection fraction.
---
paper_title: A practical clinical method for contour determination in ultrasonographic prostate images.

paper_content:

This paper describes a practical method for automated determination of the contour of the prostate in ultrasonographic images. In this method, we use specific edge detection techniques, based on nonlinear Laplace filtering. Possible edges are located at zero-crossings of the second derivative of the image. The strength of the edge is reflected by the value of the gradient of the image at that location. Combining the information about location and strength, an edge intensity image is constructed from the initial ultrasonographic image. In our method, edge enhancement techniques are performed on the edge intensity image. Edges that actually represent a boundary are selected and linked: interpolation techniques are used to fill the gaps between detected boundary edges. The method for contour determination in ultrasonographic images is used for accurate volume measurements in an everyday clinical environment. Its computer implementation is fast, accurate (mean difference within 6% of exact volume) and easy to use.
---
paper_title: Use of the bootstrap technique with small training sets for computer-aided diagnosis in breast ultrasound.

paper_content:

The purpose of this study was to test the efficacy of using small training sets in computer-aided diagnostic systems (CAD) and to increase the capabilities of ultrasound (US) technology in the differential diagnosis of solid breast tumors. A total of 263 sonographic images of solid breast nodules, including 129 malignancies and 134 benign nodules, were evaluated by using a bootstrap technique with 10 original training samples. Texture parameters of a region-of-interest (ROI) were resampled with a bootstrap technique and a decision-tree model was used to classify the tumor as benign or malignant. The accuracy was 87.07% (229 of 263 tumors), the sensitivity was 95.35% (123 of 129), the specificity was 79.10% (106 of 134), the positive predictive value was 81.46% (123 of 151), and the negative predictive value was 94.64% (106 of 112). This analysis method provides a second opinion for physicians with high accuracy. The new method shows a potential to be useful in future application of CAD, especially when a large database cannot be obtained for training or a newly developed ultrasonic system has smaller sets of samples.
---
paper_title: A GA based approach for boundary detection of left ventricle with echocardiographic image sequences

paper_content:

Abstract In this paper automatic detection of the boundary of left ventricle (LV) in a sequence of cardiac images has been proposed. The contour detection algorithm is formulated as a constrained optimization problem based on active contour model. The optimization problem has been solved using Genetic Algorithm (GA). The result obtained by the proposed GA based approach is compared with conventional nonlinear programming methods. Validation of the computer-generated boundaries is done after comparing them with manually outlined contours by expert observers. The performance of the algorithm is comparable to inter-observer anomalies.
---
paper_title: Edge-guided boundary delineation in prostate ultrasound images

paper_content:

Accurate detection of prostate boundaries is required in many diagnostic and treatment procedures for prostate disease. In this paper, a new paradigm for guided edge delineation is described, which involves presenting automatically detected prostate edges as a visual guide to the observer, followed by manual editing. This approach enables robust delineation of the prostate boundaries, making it suitable for routine clinical use. The edge-detection algorithm is comprised of three stages. An algorithm called sticks is used to enhance contrast and at the same time reduce speckle in the transrectal ultrasound prostate image. The resulting image is further smoothed using an anisotropic diffusion filter. In the third stage, some basic prior knowledge of the prostate, such as shape and echo pattern, is used to detect the most probable edges describing the prostate. Finally, patient-specific anatomic information is integrated during manual linking of the detected edges. The algorithm was tested on 125 images from 16 patients. The performance of the algorithm was statistically evaluated by employing five expert observers. Based on this study, we found that consistency in prostate delineation increases when automatically detected edges are used as visual guide during outlining, while the accuracy of the detected edges was found to be at least as good as those of the human observers. The use of edge guidance for boundary delineation can also be extended to other applications in medical imaging where poor contrast in the images and the complexity in the anatomy limit the clinical usability of fully automatic edge-detection techniques.
---
paper_title: Adaptive Segmentation of Ultrasound Images.

paper_content:

Abstract This article describes a novel approach to the semi-automatic segmentation of ultrasound images. Assisted segmentation is particularly attractive when processing many slices through a 3D data set, and even though fully automatic segmentation would be ideal, this is currently not feasible given the quality of ultrasound images. The algorithm developed in this article is based on the active contour paradigm, with several important modifications. The contour is attracted to boundaries described locally by statistical models: this allows for the fact that the definition of what constitutes a boundary may vary around the boundary’s length. The statistical models are trained on-the-fly by observing boundaries accepted by the operator. In this way, operator intervention in a particular slice is sensibly exploited to reduce the need for intervention in subsequent slices. The resulting algorithm provides fast, reliable and verifiable segmentation of in vivo ultrasound images.
---
paper_title: Segmentation of breast tumor in three-dimensional ultrasound images using three-dimensional discrete active contour model.

paper_content:

In this paper, we apply the three-dimensional (3-D) active contour model to a 3-D ultrasonic data file for segmenting of the breast tumor. The 3-D ultrasonic file is composed of a series of two-dimensional (2-D) images. Most of traditional techniques of 2-D image segmentation will not use the information between adjacent images. To suit the property of the 3-D data, we introduce the concept of the 3-D stick, the 3-D morphologic process and the 3-D active contour model. The 3-D stick can get over the problem that the ultrasonic image is full of speckle noise and highlight the edge information in images. The 3-D morphologic process helps to determine the contour of the tumor and the resulting contour can be regarded as the initial contour of the active contour model. Finally, the 3-D active contour model will make the initial contour approach to the real contour of the tumor. However, there is emphasis on these 3-D techniques that they do not consist of a series of 2-D techniques. When they work, they will consider the horizontal, vertical and depth directions at the same time. The use of these 3-D techniques not only segments the 3-D shape but also obtains the volume of the tumor. The volume of the tumor calculated by the proposed method will be compared with the volume calculated by the VOCAL software with the physician's manually drawn shape and it shows that the performance of our method is satisfactory.
---
paper_title: Wavelet-packet-based texture analysis for differentiation between benign and malignant liver tumours in ultrasound images.

paper_content:

The purpose of this study was to apply a novel method of multiscale echo texture analysis for distinguishing benign (hemangiomas) from malignant (hepatocellular carcinomas (HCCs) and metastases) focal liver lesions in B-mode ultrasound images. In this method, regions of interest (ROIs) extracted from within the lesions were decomposed into subimages by wavelet packets. Multiscale texture features that quantify homogeneity of the echogenicity were calculated from these subimages and were combined by an artificial neural network (ANN). A subset of the multiscale features was selected that yielded the highest performance in the classification of lesions measured by the area under the receiver operating characteristic curve (Az). In an analysis of 193 ROIs consisting of 50 hemangiomas, 87 hepatocellular carcinomas and 56 metastases, the multiscale features yielded a high A: value of 0.92 in distinguishing benign from malignant lesions, 0.93 in distinguishing hemangiomas from HCCs and 0.94 in distinguishing hemangiomas from metastases. Our new multiscale texture analysis method can effectively differentiate malignant from benign lesions, and thus has the potential to increase the accuracy of diagnosis of focal liver lesions in ultrasound images.
---
paper_title: Computerized detection and classification of cancer on breast ultrasound.

paper_content:

RATIONALE AND OBJECTIVES ::: To develop and evaluate a two-stage computerized method that first detects suspicious regions on ultrasound images, and subsequently distinguishes among different lesion types. ::: ::: ::: MATERIALS AND METHODS ::: The first stage of detecting potential lesions was based on expected lesion shape and margin characteristics. After the detection stage, all candidate lesions were classified by a Bayesian neural net based on computer-extracted lesion features. Two separate tasks were performed and evaluated at the classification stage: the first classification task was the distinction between all actual lesions and false-positive detections; the second classification task was the distinction between actual cancer and all other detected lesion candidates (including false-positive detections). The neural nets were trained on a database of 400 cases (757 images), consisting of complex cysts and benign and malignant lesions, and tested on an independent database of 458 cases (1,740 images including 578 normal images). ::: ::: ::: RESULTS ::: In the distinction between all actual lesions and false-positive detections, Az values of 0.94 and 0.91 were obtained with the training and testing data sets, respectively. Sensitivity by patient of 90% at 0.45 false-positive detections per image was achieved for this detection-plus-classification scheme for the testing data set. Distinguishing cancer from all other detections (false-positives plus all benign lesions) proved to be more challenging, and Az values of 0.87 and 0.81 were obtained during training and testing, respectively. Sensitivity by patient of 100% at 0.43 false-positive malignancies per image was achieved in the detection and classification of cancerous lesions for the testing dataset. ::: ::: ::: CONCLUSION ::: The results show promising performance of the computerized lesion detection and classification method, and indicate the potential of such a system for clinical breast ultrasound.
---
paper_title: Classification of breast masses in ultrasonic B scans using Nakagami and K distributions

paper_content:

Classification of breast masses in greyscale ultrasound images is undertaken using a multiparameter approach. Five parameters reflecting the non-Rayleigh nature of the backscattered echo were used. These parameters, based mostly on the Nakagami and K distributions, were extracted from the envelope of the echoes at the site, boundary, spiculated region and shadow of the mass. They were combined to create a linear discriminant. The performance of this discriminant for the classification of breast masses was studied using a data set consisting of 70 benign and 29 malignant cases. The Az value for the discriminant was 0.96 ± 0.02, showing great promise in the classification of masses into benign and malignant ones. The discriminant was combined with the level of suspicion values of the radiologist leading to an Az value of 0.97 ± 0.014. The parameters used here can be calculated with minimal clinical intervention, so the method proposed here may therefore be easily implemented in an automated fashion. These results also support the recent reports suggesting that ultrasound may help as an adjunct to mammography in breast cancer diagnostics to enhance the classification of breast masses.
---
paper_title: Unsupervised segmentation of ultrasonic liver images by multiresolution fractal feature vector

paper_content:

The feasibility of selecting fractal feature vector based on multiresolution analysis to segment suspicious abnormal regions of ultrasonic liver images is described in this paper. The proposed feature extraction algorithm is based on the spatial-frequency decomposition and fractal geometry. Segmentation of various liver diseases reveals that the fractal feature vector based on multiresolution analysis is trustworthy. A quantitative characterization based on the proposed unsupervised segmentation algorithm can be utilized to establish an automatic computer-aided diagnostic system. As well, to increase the visual interpretation capability of ultrasonic liver image for junior physicians, off-line learning software is developed to investigate the visual criteria.
---
paper_title: Image Texture Analysis of Sonograms in Chronic Inflammations of Thyroid Gland

paper_content:

The current practice in assessing sonographic findings of chronic inflamed thyroid tissue is mainly qualitative, based just on a physician's experience. This study shows that inflamed and healthy tissues can be differentiated by automatic texture analysis of B-mode sonographic images. Feature selection is the most important part of this procedure. We employed two selection schemes for finding recognition-optimal features: one based on compactness and separability and the other based on classification error. The full feature set included Muzzolini's spatial features and Haralick's co-occurrence features. These features were selected on a set of 2430 sonograms of 81 subjects, and the classifier performance was evaluated on a test set of 540 sonograms of 18 independent subjects. A classification success rate of 100% was achieved with as few as one optimal feature among the 129 texture characteristics tested. Both selection schemes agreed on the best features. The results were confirmed on the independent test set. The stability of the results with respect to sonograph setting, thyroid gland segmentation and scanning direction was tested.
---
paper_title: Automatic ventricular cavity boundary detection from sequential ultrasound images using simulated annealing.

paper_content:

An automatic algorithm has been developed for high-speed detection of cavity boundaries in sequential 2-D echocardiograms using an optimization algorithm called simulated annealing (SA). The algorithm has three stages. (1) A predetermined window of size nxm is decimated to size n'xm' after low-pass filtering. (2) An iterative radial gradient algorithm is employed to determine the center of gravity (CG) of the cavity. (3) 64 radii which originate from the CG defined in stage 2 are bounded by the high-probability region. Each bounded radius is defined as a link in a 1-D, 64-member cyclic Markov random field. This algorithm is unique in that it compounds spatial and temporal information along with a physical model in its decision rule, whereas most other algorithms base their decisions on spatial data alone. This is the first implementation of a relaxation algorithm for edge detection in echocardiograms. Results attained using this algorithm on real data have been highly encouraging.
---
paper_title: Feasibility study of ultrasonic fatty liver biopsy: texture vs. attenuation and backscatter.

paper_content:

The objective of this study was to compare textural to attenuation/backscatter indices of fatty liver correlated to histology to suggest the better approach for an objective noninvasive ultrasonic "biopsy". Forty-four patients with severe steatosis by histopathology were selected for this study. Ten patients had "pure" fatty liver and 34 had in addition fibrosis and/or inflammation. Ultrasonic images were acquired before needle insertion. The ROI used for biopsy was marked on the ultrasonic image and characterized by three attenuation/backscatter and 18 textural related indices. Statistical analysis was performed using logistic regression. Twenty-one healthy subjects served as control. The attenuation/backscatter indices were superior to textural indices in differentiating between the categories studied. Pure fatty livers could be reliably identified (AUC = 1, SE = 0). Among the 18 textural indices, "co-occurrences sum entropy" and "co-occurrences entropy" presented the best results. Attenuation/backscatter based indices appear to have better potential than the textural based indices.
---
paper_title: A multiscale optimization approach for the dynamic contour-based boundary detection issue

paper_content:

We present a new multiscale approach for deformable contour optimization. The method relies on a multigrid minimization method and a coarse-to-fine relaxation algorithm. This approach consists in minimizing a cascade of optimization problems of reduced and increasing complexity instead of considering the minimization problem on the full and original configuration space. Contrary to classical multiresolution algorithms, no reduction of image is applied. The family of defined energy functions are derived from the original (full resolution) objective function, ensuring that the same function is handled at each scale and that the energy decreases at each step of the deformable contour minimization process. The efficiency and the speed of this multiscale optimization strategy is demonstrated in the difficult context of the minimization of a region-based contour energy function ensuring the boundary detection of anatomical structures in ultrasound medical imagery. In this context, the proposed multiscale segmentation method is compared to other classical region-based segmentation approaches such as Maximum Likelihood or Markov Random Field-based segmentation techniques. We also extend this multiscale segmentation strategy to active contour models using a classical edge-based likelihood approach. Finally, time and performance analysis of this approach, compared to the (commonly used) dynamic programming-based optimization procedure, is given and allows to attest the accuracy and the speed of the proposed method.
---
paper_title: Bayesian contour detection in a time series of ultrasound images through dynamic deformable template models.

paper_content:

Deformable template models and Markov chain Monte Carlo methods are used for analysing a space-time process of intracoronary ultrasound images in order to detect the artery contour and various other characteristics as a function of time.
---
paper_title: Computerized lesion detection on breast ultrasound

paper_content:

We investigated the use of a radial gradient index (RGI) filtering technique to automatically detect lesions on breast ultrasound. After initial RGI filtering, a sensitivity of 87% at 0.76 false-positive detections per image was obtained on a database of 400 patients (757 images). Next, lesion candidates were segmented from the background by maximizing an average radial gradient (ARD) index for regions grown from the detected points. At an overlap of 0.4 with a radiologist lesion outline, 75% of the lesions were correctly detected. Subsequently, round robin analysis was used to assess the quality of the classification of lesion candidates into actual lesions and false-positives by a Bayesian neural network. The round robin analysis yielded an Az value of 0.84, and an overall performance by case of 94% sensitivity at 0.48 false-positives per image. Use of computerized analysis of breast sonograms may ultimately facilitate the use of sonography in breast cancer screening programs.
---
paper_title: Discriminant snakes for 3D reconstruction of anatomical organs

paper_content:

In this work a new statistic deformable model for 3D segmentation of anatomical organs in medical images is proposed. A statistic discriminant snake performs a supervised learning of the object boundary in an image slice to segment the next slice of the image sequence. Each part of the object boundary is projected in a feature space generated by a bank of Gaussian filters. Then, clusters corresponding to different boundary pieces are constructed by means of linear discriminant analysis. Finally, a parametric classifier is generated from each contour in the image slice and embodied into the snake energy-minimization process to guide the snake deformation in the next image slice. The discriminant snake selects and classifies image features by the parametric classifier and deforms to minimize the dissimilarity between the learned and found image features. The new approach is of particular interest for segmenting 3D images with anisotropic spatial resolution, and for tracking temporal image sequences. In particular, several anatomical organs from different imaging modalities are segmented and the results compared to expert tracings.
---
paper_title: Applying improved fast marching method to endocardial boundary detection in echocardiographic images

paper_content:

An improved fast marching approach for endocardial boundary detection and tracking in echocardiographic images is presented. Firstly, the traditional fast marching algorithm is applied to the echocardiographic images. And the existing problems are discussed. Then, the algorithm is improved by introducing the average energy of the whole advancing front into the speed term instead of determining the speed term only with the local image features. The experimental results show that the improved algorithm is very effective and stable.
---
paper_title: Recovery of the 3-D shape of the left ventricle from echocardiographic images

paper_content:

A computational method is reported which allows the fully automated recovery of the three-dimensional shape of the cardiac left ventricle from a reduced set of apical echo views. Two typically ill-posed problems have been faced: 1) the detection of the left ventricle contours in each view, and 2) the integration of the detected contour points (which form a sparse and partially inconsistent data set) into a single surface representation. The authors' solution to these problems is based on a careful integration of standard computer vision algorithms with neural networks. Boundary detection comprises three steps: edge detection, edge grouping, and edge classification. The first and second steps (which are typical early-vision tasks not involving specific domain-knowledge) have been performed through fast, well-established algorithms of computer vision. The higher level task of left ventricle-edge discrimination, which involves the exploitation of specific knowledge about the left ventricle silhouette, has been performed by feedforward neural networks. Following the most recent results in the field of computer vision, the first step in solving the problem of recovering the ventricle surface has been the adoption of a physically inspired model of it. Basically, the authors have modeled the left ventricle surface as a closed, thin, elastic surface and the data as a set of radial springs acting on it. The recovery process is equivalent to the settling of the surface-plus-springs system into a stable configuration of minimum potential energy. The finite element discretization of this model leads directly to an analog neural-network implementation. The efficiency of such an implementation has been remarkably enhanced through a learning algorithm which embeds specific knowledge about the shape of the left ventricle in the network. Experiments using clinical echographic sequences are described. Four apical views (each with a different rotation of the probe) have been acquired during a heartbeat from a set of seven normal subjects. These images have been utilized to set the various processing modules and test their capabilities. >
---
paper_title: Maximum likelihood segmentation of ultrasound images with Rayleigh distribution

paper_content:

This study presents a geometric model and a computational algorithm for segmentation of ultrasound images. A partial differential equation (PDE)-based flow is designed in order to achieve a maximum likelihood segmentation of the target in the scene. The flow is derived as the steepest descent of an energy functional taking into account the density probability distribution of the gray levels of the image as well as smoothness constraints. To model gray level behavior of ultrasound images, the classic Rayleigh probability distribution is considered. The steady state of the flow presents a maximum likelihood segmentation of the target. A finite difference approximation of the flow is derived, and numerical experiments are provided. Results are presented on ultrasound medical images as fetal echography and echocardiography.
---
paper_title: Classification algorithms for quantitative tissue characterization of diffuse liver disease from ultrasound images

paper_content:

Visual criteria for diagnosing diffused liver diseases from ultrasound images can be assisted by computerized tissue classification. Feature extraction algorithms are proposed in this paper to extract the tissue characterization parameters from liver images. The resulting parameter set is further processed to obtain the minimum number of parameters which represent the most discriminating pattern space for classification. This preprocessing step has been applied to over 120 distinct pathology-investigated cases to obtain the learning data for classification. The extracted features are divided into independent training and test sets, and are used to develop and compare both statistical and neural classifiers. The optimal criteria for these classifiers are set to have minimum classification error, ease of implementation and learning, and the flexibility for future modifications. Various algorithms of classification based on statistical and neural network methods are presented and tested. The authors show that very good diagnostic rates can be obtained using unconventional classifiers trained on actual patient data.
---
paper_title: Diagnosis of breast tumors with sonographic texture analysis using wavelet transform and neural networks.

paper_content:

To increase the ability of ultrasonographic technology for the differential diagnosis of solid breast tumors, we describe a novel computer-aided diagnosis (CADx) system using neural networks for classification of breast tumors. Tumor regions and surrounding tissues are segmented from the physician-located region-of-interest (ROI) images by applying our proposed segmentation algorithm. Cooperating with the segmentation algorithm, three feasible features, including variance contrast, autocorrelation contrast and distribution distortion of wavelet coefficients, were extracted from the ROI images for further classification. A multilayered perceptron (MLP) neural network trained using error back-propagation algorithm with momentum was then used for the differential diagnosis of breast tumors on sonograms. In the experiment, 242 cases (including benign breast tumors from 161 patients and carcinomas from 82 patients) were sampled with k-fold cross-validation (k = 10) to evaluate the performance. The receiver operating characteristic (ROC) area index for the proposed CADx system is 0.9396 +/- 0.0183, the sensitivity is 98.77%, the specificity is 81.37%, the positive predictive value is 72.73% and the negative predictive value is 99.24%. Experimental results showed that our diagnosis model performed very well for breast tumor diagnosis.
---
paper_title: Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions

paper_content:

Breast cancer is the most frequently diagnosed malignancy and the second leading cause of mortality in women . In the last decade, ultrasound along with digital mammography has come to be regarded as the gold standard for breast cancer diagnosis. Automatically detecting tumors and extracting lesion boundaries in ultrasound images is difficult due to their specular nature and the variance in shape and appearance of sonographic lesions. Past work on automated ultrasonic breast lesion segmentation has not addressed important issues such as shadowing artifacts or dealing with similar tumor like structures in the sonogram. Algorithms that claim to automatically classify ultrasonic breast lesions, rely on manual delineation of the tumor boundaries. In this paper, we present a novel technique to automatically find lesion margins in ultrasound images, by combining intensity and texture with empirical domain specific knowledge along with directional gradient and a deformable shape-based model. The images are first filtered to remove speckle noise and then contrast enhanced to emphasize the tumor regions. For the first time, a mathematical formulation of the empirical rules used by radiologists in detecting ultrasonic breast lesions, popularly known as the "Stavros Criteria" is presented in this paper. We have applied this formulation to automatically determine a seed point within the image. Probabilistic classification of image pixels based on intensity and texture is followed by region growing using the automatically determined seed point to obtain an initial segmentation of the lesion. Boundary points are found on the directional gradient of the image. Outliers are removed by a process of recursive refinement. These boundary points are then supplied as an initial estimate to a deformable model. Incorporating empirical domain specific knowledge along with low and high-level knowledge makes it possible to avoid shadowing artifacts and lowers the chance of confusing similar tumor like structures for the lesion. The system was validated on a database of breast sonograms for 42 patients. The average mean boundary error between manual and automated segmentation was 6.6 pixels and the normalized true positive area overlap was 75.1%. The algorithm was found to be robust to 1) variations in system parameters, 2) number of training samples used, and 3) the position of the seed point within the tumor. Running time for segmenting a single sonogram was 18 s on a 1.8-GHz Pentium machine.
---
paper_title: Echocardiographic texture analysis using the wavelet transform: differentiation of early heart muscle disease.

paper_content:

Echocardiographic quantitation of myocardial texture for diagnosis of early cardiomyopathy (CMP) remains problematic. Conventional statistical methods are limited, contributed by a small image region-of-interest (ROI) and difficulty in discrimination from noise. This study was performed to evaluate the 2-D Haar wavelet decomposition method as a tool to identify textural changes in a rat model of early CMP, focusing on changes that occur before development of M-mode structural abnormalities. Early diabetic CMP, ethanol CMP and diabetic-ethanol CMP rat models were evaluated. Echocardiography was performed on two groups of rats. Group I (5 week cohort, n = 4 per subgroup) included controls, rats on 12% ethanol, a diabetic subgroup, and diabetic rats on 4% ethanol. Group II (10 week cohort, n = 5 per subgroup) included the same categories as group I with an additional subgroup taking 4% ethanol was also studied. M-mode left ventricular measurements were comparable in all subgroups of group I. However, diabetic rats in group II had an increased left ventricular dimension (LVD) compared to all others and an increased septal dimension (IVSD) and posterior wall dimension (PWD) were noted in the 4% and 12% ethanol groups. End-diastolic digital images of all rats in the parasternal short axis view, at the papillary muscle level, were downloaded to a computer. A 16 x 16 (ROI) was selected from the anterior interventricular septum. Although standard statistical methods could not differentiate any of the groups, calculation of textural energy and normalized textural energy with the 2-D Haar wavelet decomposition method found at 5 weeks increased normalized texture energy in diabetics compared to all others. At 10 weeks increased texture energy was noted in diabetics. Diabetic-ethanol rats at both 5 and 10 weeks revealed a blunted textural energy compared to diabetic rats. In a rat model of diabetic cardiomyopathy, the 2-D wavelet decomposition method identified textural energy changes before development of echocardiographic structural changes. Ethanol-associated blunting of textural changes in diabetic rats was also noted. This method for quantitation of ventricular texture may be relevant for diagnosis of early cardiomyopathy.
---
paper_title: Ultrasonic multifeature tissue characterization for prostate diagnostics.

paper_content:

A new system for prostate diagnostics based on multifeature tissue characterization is proposed. Radiofrequency (RF) ultrasonic echo data are acquired during the standard transrectal ultrasound (US) imaging examination. Nine spectral, texture, first order and morphologic parameters are calculated and fed into two adaptive neuro-fuzzy inference systems (FIS) working in parallel. The outputs of the FISs are fed into a postprocessing procedure evaluating contextual information before being combined to form a malignancy map in which areas of high cancer probability are marked in red. The malignancy map is presented to the physician during the examination to improve the early detection of prostate cancer. The system has been evaluated on 100 patients undergoing radical prostatectomy. The ROC curve area using leave-one-out cross-validation over patients is A(Z) = 0.86 when distinguishing between hyperechoic and hypoechoic tumors and normal tissue and A(Z) = 0.84 when distinguishing between isoechoic tumors and healthy tissue, respectively. Tumors that are not visible in the conventional B-mode image can be located. Diagnosis of the prostate carcinoma using multifeature tissue characterization in combination with US imaging allows the detection of tumors at an early stage. Also, biopsy guidance and therapy planning can be improved.
---
paper_title: Segmentation of ultrasound images by using a hybrid neural network

paper_content:

A hybrid neural network is presented for the segmentation of ultrasound images.Feature vectors are formed by the discrete cosine transform of pixel intensities in region of interest (ROI). The elements and the dimension of the feature vectors are determined by considering only two parameters: The amount of ignored coefficients, and the dimension of the ROI.First-layer-nodes of the proposed hybrid network represent hyperspheres (HSs) in the feature space. Feature space is partitioned by intersecting these HSs to represent the distribution of classes. The locations and radii of the HSs are found by the genetic algorithms.Restricted Coulomb energy (RCE) network, modified RCE network, multi-layer perceptron and the proposed hybrid neural network are examined comparatively for the segmentation of ultrasound images.
---
paper_title: Combinative Multi-scale Level Set Framework for Echocardiographic Image Segmentation

paper_content:

In the automatic segmentation of echocardiographic images, a priori shape knowledge is used to compensate poor features in ultrasound images. The shape knowledge is often learned via off-line training process, which requires tedious human effort and is unavoidably expertise-dependent. More importantly, a learned shape template can only be used to segment a specific class of images with similar boundary shapes.In this paper, we present a multi-scale level set framework for echo image segmentation. We extract echo image boundaries automatically at a very coarse scale. These boundaries are then not only used as boundary initials at finer scales, but also as an external constraint to guide contour evolutions. This constraint functions similar to a traditional shape prior. Experimental results validate this combinative framework.
---
paper_title: An adaptive template-matching method and its application to the boundary detection of brachial artery ultrasound scans.

paper_content:

We developed an adaptive template-matching method for vessel wall boundary detection in brachial artery ultrasound (US) scans. The computer-aided identification of lumen-intima and media-adventitia boundaries of the brachial artery US scan is a critical step for flow-mediated vasodilator response measurement, which has become an increasingly important tool in both clinical and research applications. The adaptive template we propose in this paper is a combination of two parameterized Gaussian envelopes that approximates the US pulse envelope. The algorithm for template matching is cast as a constrained nonlinear least squares problem. A best match between the template and the observed US scan line signal results in a set of optimum parameters of the adaptive template, and the location of the boundaries is directly computed from these parameters. We present the results of applying our method to synthetic and clinical data, showing that the adaptive template-matching method provides superior accuracy in detecting the media-adventitia boundaries of both the near wall and the far wall of the vessel to that of conventional edge-detection methods.
---
paper_title: Multiple Resolution Bayesian Segmentation of Ultrasound Images

paper_content:

We propose a novel method for obtaining the maximum a posteriori (MAP) probabilistic segmentation of speckle-laden ultrasound images. Our technique is multiple-resolution based, and relies on the conversion of speckle images with Rayleigh statistics to subsampled images with Gaussian statistics. This conversion reduces computation time, as well as allowing accurate parameter estimation for a probabilistic segmentation algorithm. Results appear to provide improvements over previous techniques in terms of low-contrast detail and accuracy.
---
paper_title: Prostate segmentation algorithm using dyadic wavelet transform and discrete dynamic contour

paper_content:

Knowing the location and the volume of the prostate is important for ultrasound-guided prostate brachytherapy, a commonly used prostate cancer treatment method. The prostate boundary must be segmented before a dose plan can be obtained. However, manual segmentation is arduous and time consuming. This paper introduces a semi-automatic segmentation algorithm based on the dyadic wavelet transform (DWT) and the discrete dynamic contour (DDC). A spline interpolation method is used to determine the initial contour based on four user-defined initial points. The DDC model then refines the initial contour based on the approximate coefficients and the wavelet coefficients generated using the DWT. The DDC model is executed under two settings. The coefficients used in these two settings are derived using smoothing functions with different sizes. A selection rule is used to choose the best contour based on the contours produced in these two settings. The accuracy of the final contour produced by the proposed algorithm is evaluated by comparing it with the manual contour outlined by an expert observer. A total of 114 2D TRUS images taken for six different patients scheduled for brachytherapy were segmented using the proposed algorithm. The average difference between the contour segmented using the proposed algorithm and the manually outlined contour is less than 3 pixels.
---
paper_title: A dual-snake model of high penetrability for ultrasound image boundary extraction.

paper_content:

Abstract Most deformable models require the initial contour to be placed close to the boundary of the object of interest for boundary extraction of ultrasound (US) images, which is impractical in many clinical applications. To allow a distant initial contour, a new dual-snake model promising high penetrability through the interference of the noises is proposed in this paper. The proposed dual-snake model features a new far-reaching external force, called the discrete gradient flow, a connected component-weighted image force, and an effective stability evaluation of two underlying snakes. The experimental results show that, with a distant initial contour, the mean distance from the derived boundary to the desired boundary is less than 1.4 pixels, and most snake elements are within 2.7 pixels of the desired boundaries for the synthetic images with CNR ≥ 1. For the clinical US images, the mean distance is less than 1.9 pixels, and most snake elements are within 3 pixels of the desired boundaries. (E-mail: chung@lotus.mc.ntu.edu.tw)
---
paper_title: Automatic segmentation of breast lesions on ultrasound

paper_content:

In this paper we present a computationally efficient segmentation algorithm for breast masses on sonography that is based on maximizing a utility function over partition margins defined through gray-value thresholding of a preprocessed image. The performance of the segmentation algorithm is evaluated on a database of 400 cases in two ways. Of the 400 cases, 124 were complex cysts, 182 were benign solid lesions, and 94 were malignant lesions. In the first evaluation, the computer-delineated margins were compared to manually delineated margins. At an overlap threshold of 0.40, the segmentation algorithm correctly delineated 94% of the lesions. In the second evaluation, the performance of our computer-aided diagnosis method on the computer-delineated margins was compared to the performance of our method on the manually delineated margins. Round robin evaluation yielded Az values of 0.90 and 0.87 on the manually delineated margins and the computer-delineated margins, respectively, in the task of distinguishing between malignant and nonmalignant lesions.
---
paper_title: SEGMENTATION OF 3D INTRAVASCULAR ULTRASONIC IMAGES BASED ON A RANDOM FIELD MODEL

paper_content:

Abstract Segmentation of intravascular ultrasound images provides important information about the degree of vessel obstruction as well as about the shape and size of plaques. To address the problems of inter- and intra-observer variances associated with conventional manual tracing, a fully automated segmentation was developed. The algorithm is based on the optimisation of a maximum a posteriori estimator, implementing the Rayleigh distribution of speckle and a priori information about the contours. Within 3D image sets, additional information by the blood flow resulting in a decorrelation of the pixels within the luminal boundary is used to initialise the segmentation. To accelerate the estimation, dynamic programming was used. The segmentation algorithm was realised as a Windows® 95 application on a Pentium® II/233 MHz and delivered reliable and reproducible results independent of the catheter position and the total image brightness (except overflow). In contrast, contours drawn by two physicians for an evaluation of 29 clinical cases showed large intra- and inter-observer variances. In vivo images were acquired with a 20 MHz transducer array (EndoSonics InVision TM ). Comparison with the contours drawn by the physicians and histology demonstrates the potential of the segmentation algorithm.
---
paper_title: Watershed segmentation for breast tumor in 2-D sonography.

paper_content:

Automatic contouring for breast tumors using medical ultrasound (US) imaging may assist physicians without relevant experience, in making correct diagnoses. This study integrates the advantages of neural network (NN) classification and morphological watershed segmentation to extract precise contours of breast tumors from US images. Textural analysis is employed to yield inputs to the NN to classify ultrasonic images. Autocovariance coefficients specify texture features to classify breasts imaged by US using a self-organizing map (SOM). After the texture features in sonography have been classified, an adaptive preprocessing procedure is selected by SOM output. Finally, watershed transformation automatically determines the contours of the tumor. In this study, the proposed method was trained and tested using images from 60 patients. The results of computer simulations reveal that the proposed method always identified similar contours and regions-of-interest (ROIs) to those obtained by manual contouring (by an experienced physician) of the breast tumor in ultrasonic images. As US imaging becomes more widespread, a functional automatic contouring method is essential and its clinical application is becoming urgent. Such a method provides robust and fast automatic contouring of US images. This study is not to emphasize that the automatic contouring technique is superior to the one undertaken manually. Both automatic and manual contours did not, after all, necessarily result in the same factual pathologic border. In computer-aided diagnosis (CAD) applications, automatic segmentation can save much of the time required to sketch a precise contour, with very high stability.
---
paper_title: Using Prior Shapes in Geometric Active Contours in a Variational Framework

paper_content:

In this paper, we report an active contour algorithm that is capable of using prior shapes. The energy functional of the contour is modified so that the energy depends on the image gradient as well as the prior shape. The model provides the segmentation and the transformation that maps the segmented contour to the prior shape. The active contour is able to find boundaries that are similar in shape to the prior, even when the entire boundary is not visible in the image (i.e., when the boundary has gaps). A level set formulation of the active contour is presented. The existence of the solution to the energy minimization is also established. ::: ::: We also report experimental results of the use of this contour on 2d synthetic images, ultrasound images and fMRI images. Classical active contours cannot be used in many of these images.
---
paper_title: 3-D active appearance models: segmentation of cardiac MR and ultrasound images

paper_content:

A model-based method for three-dimensional image segmentation was developed and its performance assessed in segmentation of volumetric cardiac magnetic resonance (MR) images and echocardiographic temporal image sequences. Comprehensive design of a three-dimensional (3-D) active appearance model (AAM) is reported for the first time as an involved extension of the AAM framework introduced by Cootes et al. The model's behavior is learned from manually traced segmentation examples during an automated training stage. Information about shape and image appearance of the cardiac structures is contained in a single model. This ensures a spatially and/or temporally consistent segmentation of three-dimensional cardiac images. The clinical potential of the 3-D AAM is demonstrated in short-axis cardiac MR images and four-chamber echocardiographic sequences. The method's performance was assessed by comparison with manually identified independent standards in 56 clinical MR and 64 clinical echo image sequences. The AAM method showed good agreement with the independent standard using quantitative indexes of border positioning errors, endo- and epicardial volumes, and left ventricular mass. In MR, the endocardial volumes, epicardial volumes, and left ventricular wall mass correlation coefficients between manual and AAM were R/sup 2/=0.94,0.97,0.82, respectively. For echocardiographic analysis, the area correlation was R/sup 2/=0.79. The AAM method shows high promise for successful application to MR and echocardiographic image analysis in a clinical setting.
---
paper_title: A multiple active contour model for cardiac boundary detection on echocardiographic sequences

paper_content:

Tracing of left-ventricular epicardial and endocardial borders on echocardiographic sequences is essential for quantification of cardiac function. The authors designed a method based on an extension of active contour models to detect both epicardial and endocardial borders on short-axis cardiac sequences spanning the entire cardiac cycle. They validated the results by comparing the computer-generated boundaries to the boundaries manually outlined by four expert observers on 44 clinical data sets. The mean boundary distance between the computer-generated boundaries and the manually outlined boundaries was 2.80 mm (/spl sigma/=1.28 mm) for the epicardium and 3.61 (/spl sigma/=1.68 mm) for the endocardium. These distances were comparable to interobserver distances, which had a mean of 3.79 mm (/spl sigma/=1.53 mm) for epicardial borders and 2.67 mm (/spl sigma/=0.88 mm) for endocardial borders. The correlation coefficient between the areas enclosed by the computer-generated boundaries and the average manually outlined boundaries was 0.95 for epicardium and 0.91 for endocardium. The algorithm is fairly insensitive to the choice of the initial curve. Thus, the authors have developed an effective and robust algorithm to extract left-ventricular boundaries from echocardiographic sequences.
---
paper_title: A textural approach based on Gabor functions for texture edge detection in ultrasound images.

paper_content:

Edge detection is an important, but difficult, step in quantitative ultrasound (US) image analysis. In this paper, we present a new textural approach for detecting a class of edges in US images; namely, the texture edges with a weak regional mean gray-level difference (RMGD) between adjacent regions. The proposed approach comprises a vision model-based texture edge detector using Gabor functions and a new texture-enhancement scheme. The experimental results on the synthetic edge images have shown that the performances of the four tested textural and nontextural edge detectors are about 20%-95% worse than that of the proposed approach. Moreover, the texture enhancement may improve the performance of the proposed texture edge detector by as much as 40%. The experiments on 20 clinical US images have shown that the proposed approach can find reasonable edges for real objects of interest with the performance of 0.4 +/- 0.08 in terms of the Pratt's figure.
---
paper_title: Unsupervised Contour Representation and Estimation Using B-Splines and a Minimum Description Length Criterion

paper_content:

This paper describes a new approach to adaptive estimation of parametric deformable contours based on B-spline representations. The problem is formulated in a statistical framework with the likelihood function being derived from a region-based image model. The parameters of the image model, the contour parameters, and the B-spline parameterization order (i.e., the number of control points) are all considered unknown. The parameterization order is estimated via a minimum description length (MDL) type criterion. A deterministic iterative algorithm is developed to implement the derived contour estimation criterion, the result is an unsupervised parametric deformable contour: it adapts its degree of smoothness/complexity (number of control points) and it also estimates the observation (image) model parameters. The experiments reported in the paper, performed on synthetic and real (medical) images, confirm the adequate and good performance of the approach.
---
paper_title: Computerized diagnosis of breast lesions on ultrasound

paper_content:

We present a computer-aided diagnosis(CAD) method for breast lesions on ultrasound that is based on the automatic segmentation of lesions and the automatic extraction of four features related to the lesion shape, margin, texture, and posterior acoustic behavior. Using a database of 400 cases (94 malignant lesions, 124 complex cysts, and 182 benign solid lesions), we investigate the marginal benefit of each feature in our CAD method and the performance of our CAD method in distinguishing malignant lesions from various classes of benign lesions. Finally, independent validation is performed on our CAD method. Eleven independent trials yielded an average A z value of 0.87 in the task of distinguishing malignant from benign lesions.
---
paper_title: Comparison of texture analysis methods for the characterization of coronary plaques in intravascular ultrasound images

paper_content:

Intravascular Ultrasound (IVUS) is a diagnostic imaging technique that provides tomographic visualization of coronary arteries. The aim of this study was to evaluate five texture analysis techniques and determine their ability to distinguish between plaque lesions of different composition. Using histological correlation, regions of calcified, fibrous, and necrotic core plaque were chosen from 27 coronary plaques. First-order statistics, Haralick's method, Laws' texture energy method, the neighborhood gray-tone difference matrix method, and texture spectrum features were examined using discriminant analysis. Self-validation indicated that Haralick's method yielded the most accurate results, with resubstitution and cross-validation error rates of 0.00 and 14.76%, respectively. Further optimization gave error rates of 6.67%, using only two discriminating features, IDM and entropy.
---
paper_title: Computer Assisted Human Follicle Analysis for Fertility Prospects with 3D Ultrasound

paper_content:

Knowledge about the status of the female reproductive system is important for fertility problems and age-related family planning. The volume of these fertility requests in our emancipated society is steadily increasing. Intravaginal 3D ultrasound imaging of the follicles in the ovary gives important information about the ovarian aging, i.e. number of follicles, size, position and response to hormonal stimulation. Manual analysis of the many follicles is laborious and error-prone. We present a multiscale analysis to automatically detect and quantify the number and shape of the patient's follicles. Robust estimation of the centres of the follicles in the speckled echographic images is done by calculating so-called winding number of the intensity singularity, i.e. the path integral of the angular increment of the direction of the gradient vector over a closed neighbourhood around the point. The principal edges on 200-500 intensity traces radiating from the detected singularity points are calculated by a multiscale edge focussing technique on 1D winding numbers. They are fitted with 3D spherical harmonic functions, from which the volume and shape parameters are derived.
---
paper_title: Parametric shape modeling using deformable superellipses for prostate segmentation

paper_content:

Automatic prostate segmentation in ultrasound images is a challenging task due to speckle noise, missing boundary segments, and complex prostate anatomy. One popular approach has been the use of deformable models. For such techniques, prior knowledge of the prostate shape plays an important role in automating model initialization and constraining model evolution. In this paper, we have modeled the prostate shape using deformable superellipses. This model was fitted to 594 manual prostate contours outlined by five experts. We found that the superellipse with simple parametric deformations can efficiently model the prostate shape with the Hausdorff distance error (model versus manual outline) of 1.32/spl plusmn/0.62 mm and mean absolute distance error of 0.54/spl plusmn/0.20 mm. The variability between the manual outlinings and their corresponding fitted deformable superellipses was significantly less than the variability between human experts with p-value being less than 0.0001. Based on this deformable superellipse model, we have developed an efficient and robust Bayesian segmentation algorithm. This algorithm was applied to 125 prostate ultrasound images collected from 16 patients. The mean error between the computer-generated boundaries and the manual outlinings was 1.36/spl plusmn/0.58 mm, which is significantly less than the manual interobserver distances. The algorithm was also shown to be fairly insensitive to the choice of the initial curve.
---
paper_title: Using prior shape and intensity profile in medical image segmentation

paper_content:

In this note we present a coupled optimization model for boundary determination. One part of the model incorporates a prior shape into a geometric active contour model with a fixed parameter. The second part determines the 'best' parameter used in the first part by maximizing the mutual information of the image geometry between the prior and an aligned novel image over all the alignments that are the solutions of the first part corresponding to different parameters. We also present an alternative method, which generates an intensity model formed as the average of a set of aligned training images. Experimental results on cardiac ultrasound images are presented. These results indicate that the proposed model provides close agreement with expert traced borders, and the parameter determined in this model for one image can be used for images with similar properties. The existence of a solution to the proposed minimization problem is also discussed.
---
paper_title: 2D+T acoustic boundary detection in echocardiography

paper_content:

Abstract In this paper we address the problem of spatio-temporal acoustic boundary detection in echocardiography. We propose a phase-based feature detection method to be used as the front end to higher-level 2D+T/3D+T reconstruction algorithms. We develop a 2D+T version of this algorithm and illustrate its performance on some typical echocardiogram sequences. We show how our temporal-based algorithm helps to reduce the number of spurious feature responses due to speckle and provides feature velocity estimates. Further, our approach is intensity-amplitude invariant. This makes it particularly attractive for echocardiographic segmentation, where choosing a single global intensity-based edge threshold is problematic.
---
paper_title: Multiresolution texture based adaptive clustering algorithm for breast lesion segmentation.

paper_content:

OBJECTIVE ::: A specific algorithm is presented for the automatic extraction of breast tumors in ultrasonic imaging. ::: ::: ::: METHOD ::: The algorithm involves two-dimensional adaptive K-means clustering of the gray scale and textural feature images. The segmentation problem is formulated as a maximum a posteriori (MAP) estimation problem. The MAP estimation is achieved using Besag's iterated conditional modes algorithm for the minimization of an energy function. This function has three components: the first constrains the region to be close to the data; the second imposes spatial continuity; and the third takes into consideration the texture of the various regions. A multiresolution implementation of the algorithm is performed using a waveless basis. ::: ::: ::: RESULTS ::: Experiments were carried out on synthetic images and on in vivo breast ultrasound images. Various parameters involved in the algorithm are discussed to evaluate the robustness and accuracy of the segmentation method. ::: ::: ::: CONCLUSION ::: Including textural features in the segmentation of ultrasonic data improves the robustness of the algorithm and makes the segmentation result less parameter dependent.
---
paper_title: Tunnelling Descent: A New Algorithm for Active Contour Segmentation of Ultrasound Images

paper_content:

The presence of speckle in ultrasound images makes it hard to segment them using active contours. Speckle causes the energy function of the active contours to have many local minima, and the gradient descent procedure used for evolving the contour gets trapped in these minima.
---
paper_title: Left ventricular volume estimation for real-time three-dimensional echocardiography

paper_content:

The application of level set techniques to echocardiographic data is presented. This method allows semiautomatic segmentation of heart chambers, which regularizes the shapes and improves edge fidelity, especially in the presence of gaps, as is common in ultrasound data. The task of the study was to reconstruct left ventricular shape and to evaluate left ventricular volume. Data were acquired with a real-time three-dimensional (3-D) echocardiographic system. The method was applied directly in the three-dimensional domain and was based on a geometric-driven scheme. The numerical scheme for solving the proposed partial differential equation is borrowed from numerical methods for conservation law. Results refer to in vitro and human in vivo acquired 3-D+time echocardiographic data. Quantitative validation was performed on in vitro balloon phantoms. Clinical application of this segmentation technique is reported for 20 patient cases providing measures of left ventricular volumes and ejection fraction.
---
paper_title: An automatic approach for morphological analysis and malignancy evaluation of ovarian masses using B-scans.

paper_content:

Ovarian masses are a common phenomenon among women of all ages. The importance of prompt diagnosis of ovarian malignancies is obvious, due to the high mortality rate and the difficulty to detect a tumor in its early stages. In this work, an automatic technique for quantitative analysis and malignancy detection of ovarian masses using B-scan ultrasound (US) images is presented. The core of the technique is morphologic analysis of the ovarian mass. The method employed for this task is divided into two major stages: initial classification of the mass (into one of the three major tumor types: cyst, semisolid, solid), and detailed analysis of the mass. Malignancy evaluation is performed based on the collected data and the criteria provided by commonly used scoring systems. The results reflect adequate performance of the automatic method developed (referring to clinical requirements).
---
paper_title: Automatic cardiac LV boundary detection and tracking using hybrid fuzzy temporal and fuzzy multiscale edge detection

paper_content:

This paper describes a new fully automatic fuzzy multiresolution-based algorithm for cardiac left ventricular (LV) epicardial and endocardial boundary detection and tracking on a sequence of short axis (SA) echocardiographic images of a complete cardiac cycle. This is a necessary step for automatic quantification of cardiac function using echo images, The proposed method is a "center-based" approach in which epicardial and endocardial boundary edge points are searched for on radial lines emanating from the LV center point. The central point of the LV cavity is estimated using a fuzzy-based technique in which the "uncertain" spatial, morphological, and intensity information of the image are represented as fuzzy sets and then combined by fuzzy operators. Edge-detection stage uses multiscale spatial and temporal information in a fuzzy multiresolution framework to identify a single moving edge point for each one of the epicardial and endocardial boundaries over the M radii in the N frames of a complete cardiac cycle. The raw extracted edge points are then processed in the wavelet domain to reduce the effects of noise from the boundaries and papillary muscles from the endocardial boundary extraction process. Finally, a uniform cubic B-spline approximation method is used to define the closed LV boundaries. Experiments with simulated and real echocardiographic images are presented.
---
paper_title: Automatic 3d Prostate Surface Detection From Trus With Level Sets

paper_content:

Prostate boundary detection from ultrasound images plays an important role in prostate disease diagnoses and treatments. However, due to the low contrast, speckle noise and shadowing in ultrasound images, this still remains a difficult task. Currently, prostate boundary detection is performed manually, which is arduous and heavily user dependent. A possible solution is to improve the efficiency by automating the boundary detection process with minimal manual involvement. This paper presents a new approach based on the level set method to automatically detect the prostate surface from 3D transrectal ultrasound images. The user interaction in the initialization procedure is relieved by automatically putting the centroid of the initial zero level sets close to the image center. Region information, instead of the image gradient, is integrated into the level set method to remedy the "boundary leaking" problem caused by gaps or weak boundaries. Moreover, to increase the accuracy and robustness, knowledge-based features, such as expected shape (kidney-like) and ultrasound appearance of the prostate (looking from within the gland, the intensities are transitions from dark to light), are also incorporated into the model. The proposed method is applied to eight 3D TRUS images and the results have shown its effectiveness.
---
paper_title: Improving the distinction between benign and malignant breast lesions: the value of sonographic texture analysis.

paper_content:

To improve the ability of ultrasound to distinguish benign from malignant breast lesions, we used quantitative analysis of ultrasound image texture. Eight cancers, 22 cysts, 28 fibroadenomata, and 22 fibrocystic nodules were studied. The true nature of each lesion was determined by aspiration (for some cysts) or by open biopsy. Analysis of image texture was performed on digitized video output from the ultrasound scanner using fractal analysis and statistical texture analysis methods. The most useful features were those derived from co-occurrence matrices of the images. Using two features together (contrast of a co-occurrence matrix taken in an oblique direction, and correlation of a co-occurrence matrix taken in the horizontal direction), it was possible to exclude 78% of fibroadenomata, 73% of cysts, and 91% of fibrocystic nodules while maintaining 100% sensitivity for cancer. These findings suggest that ultrasonic image texture analysis is a simple way to markedly reduce the number of benign lesion biopsies without missing additional cancers.
---
paper_title: Automated texture-based segmentation of ultrasound images of the prostate

paper_content:

Segmenting two-dimensional images of the prostate into prostate and nonprostate regions is required when forming a three-dimensional image of the prostate from a set of parallel two-dimensional images. The texture-based segmentation method presented here is a pixel classifier based on four texture energy measures associated with each pixel in the image. An automated clustering procedure is used to label each pixel in the image with the label of its most probable class. The segmented images produced as the result of applying the algorithm to an example image are presented and discussed. The automated segmentation algorithm has been found to hold promise as an automated segmentation method.
---
paper_title: Semiautomated segmentation of ovarian follicular ultrasound images using a knowledge-based algorithm.

paper_content:

The application of a knowledge-based segmentation method to the problem of automatically detecting the outer follicle wall boundary in ultrasonographic images of ovaries is presented. A combination of computer detection and interactive adjustment was used to define an approximate inner follicle-wall boundary, which was then used by the computer algorithm as a priori knowledge to automatically find the outer follicle-wall border. The segmentation algorithm was tested on ultrasonographic images of women's ovaries that were imaged in vivo. The semiautomatic segmentations were compared to segmentations by an expert human observer in terms of border placement differences and in terms of quantitative parameters relevant to the physiologic status of the follicles. These physiological parameters include total and specific signal intensity from the follicle and from the follicle wall. The computer-detected outer follicle wall boundaries correlated well with the human observer-defined wall boundaries, in terms of enclosed follicle area, specific and total follicle signal, enclosed wall area, and specific and total wall signal. The actual border placement differences were also small, with a maximum placement difference of 1.47 +/- 0.83 mm and a root mean square (r.m.s.) placement difference of 0.59 +/- 0.28 mm.
---
paper_title: Automated 3-D echocardiography analysis compared with manual delineations and SPECT MUGA

paper_content:

A major barrier for using 3-D echocardiography for quantitative analysis of heart function in routine clinical practice is the absence of accurate and robust segmentation and tracking methods necessary to make the analysis automatic. In this paper, we present an automated three-dimensional (3-D) echocardiographic acquisition and image-processing methodology for assessment of left ventricular (LV) function. We combine global image information provided by a novel multiscale fuzzy-clustering segmentation algorithm, with local boundaries obtained with phase-based acoustic feature detection. We then use the segmentation results to fit and track the LV endocardial surface using a 3-D continuous transformation. To our knowledge, this is the first report of a completely automated method. The protocol is evaluated in a small clinical case study (nine patients). We compare ejection fractions (EFs) computed with the new approach to those obtained using the standard clinical technique, single-photon emission computed tomography multigated acquisition. Errors on six datasets were found to be within six percentage points. A further two, with poor image quality, improved upon EFs from manually delineated contours, and the last failed due to artifacts in the data. Volume-time curves were derived and the results compared to those from manual segmentation. Improvement over an earlier published version of the method is noted.
---
paper_title: Implicit Active Shape Models for 3D Segmentation in MR Imaging

paper_content:

Extraction of structures of interest in medical images is often an arduous task because of noisy or incomplete data. However, hand-segmented data are often available and most of the structures to be extracted have a similar shape from one subject to an other. Then, the possibility of modeling a family of shapes and restricting the new structure to be extracted within this class is of particular interest. This approach is commonly implemented using active shape models [2] and the definition of the image term is the most challenging component of such an approach. In parallel, level set methods [8] define a powerful optimization framework, that can be used to recover objects of interest by the propagation of curves or surfaces. They can support complex topologies, considered in higher dimensions, are implicit, intrinsic and parameter free. In this paper we re-visit active shape models and introduce a level set variant of them. Such an approach can account for prior shape knowledge quite efficiently as well as use data/image terms of various form and complexity. Promising results on the extraction of brain ventricles in MR images demonstrate the potential of our approach.
---
paper_title: Liver fibrosis grade classification with B-mode ultrasound.

paper_content:

B-mode images of 20 fresh postsurgical human liver samples were obtained to evaluate ultrasound ability in determining the grade of liver fibrosis. Image features derived from gray level concurrence and nonseparable wavelet transform were extracted to classify fibrosis with a classifier known as the support vector machine. Each liver sample subsequently underwent histologic examination and liver fibrosis was graded from 0 to 5 (i.e., six grades total). The six grades were then combined into two, three, four and six classes. Classifications with the extracted image features by the support vector machine were tested and correlated with histology. The results revealed that the best classification accuracy of two, three, four and six classes were 91%, 85%, 81% and 72%, respectively. Thus, liver fibrosis can be noninvasively characterized with B-mode ultrasound, even though the performance declines as the number of classes increases. The elastic constants of 16 samples out of a total of 20 were also correlated with the image features. The Pearson correlation coefficients indicated that the image features are more strongly correlated with the fibrosis grade than with the elastic constant.
---
paper_title: Tissue characterization in intravascular ultrasound images

paper_content:

Intravascular ultrasound (IVUS) imaging permits direct visualization of vascular pathology. It has been used to evaluate lumen and plaque in coronary arteries and its clinical significance for guidance of coronary interventions is increasingly recognized. Conventional manual evaluation is tedious and time consuming. This paper describes a highly automated approach to segmentation of coronary wall and plaque, and determination of plaque composition in individual IVUS images and pullback image sequences. The determined regions of plaque were classified in one of three classes: soft plaque, hard plaque, or hard plaque shadow. The method's performance was assessed in vitro and in vivo in comparison with observer-defined independent standards. In the analyzed images and image sequences, the mean border positioning error of the wall and plaque borders ranged from 0.13-0.17 mm. Plaque classification correctness was 90%,.
---
paper_title: Performance of computer-aided diagnosis in the interpretation of lesions on breast sonography

paper_content:

Abstract Rationale and objectives To investigate the potential usefulness of computer-aided diagnosis as a tool for radiologists in the characterization and classification of mass lesions on ultrasound. Materials and methods Previously, a computerized method for the automatic classification of breast lesions on ultrasound was developed. The computerized method includes automatic segmentation of the lesion from the ultrasound image background and automatic extraction of four features related to lesion shape, margin, texture, and posterior acoustic behavior. In this study, the effectiveness of the computer output as an aid to radiologists in their ability to distinguish between malignant and benign lesions, and in their patient management decisions in terms of biopsy recommendation are evaluated. Six expert mammographers and six radiologists in private practice at an institution accredited by the American Ultrasound Institute of Medicine participated in the study. Each observer first interpreted 25 training cases with feedback of biopsy results, and then interpreted 110 additional ultrasound cases without feedback. Simulating an actual clinical setting, the 110 cases were unknown to both the observers and the computer. During interpretation, observers gave their confidence that the lesion was malignant and also their patient management recommendation (biopsy or follow-up). The computer output was then displayed, and observers again gave their confidence that the lesion was malignant and their patient management recommendation. Statistical analyses included receiver operator characteristic analysis and Student t -test. Results For the expert mammographers and for the community radiologists, the A z (area under the receiver operator characteristic curve) increased from 0.83 to 0.87 ( P = .02) and from 0.80 to 0.84 ( P = .04), respectively, when the computer aid was used in the interpretation of the ultrasound images. Also, the A z values for the community radiologists with aid and for the expert mammographers without aid are similar to the A z value for the computer alone (A z = 0.83). Conclusion Computer analysis of ultrasound images of breast lesions has been shown to improve the diagnostic accuracy of radiologists in the task of distinguishing between malignant and benign breast lesions and in recommending cases for biopsy.
---
paper_title: Ovarian ultrasound image analysis: follicle segmentation

paper_content:

Ovarian ultrasound is an effective tool in infertility treatment. Repeated measurements of the size and shape of follicles over several days are the primary means of evaluation by physicians. Currently, follicle wall segmentation is achieved by manual tracing which is time consuming and susceptible to inter-operator variation. An automated method for follicle wall segmentation is reported that uses a four-step process based on watershed segmentation and knowledge-based graph search algorithm which utilizes priori information about follicle structure for inner and outer wall detection. The automated technique was tested on 36 ultrasonographic images of women's ovaries. Validation against manually traced borders has shown good correlation of manually defined and computer-determined area measurements (R2 = 0.85 - 0.96). The border positioning errors were small: 0.63+/-0.36 mm for inner border and 0.67+/-0.41 mm for outer border detection. The use of watershed segmentation and graph search methods facilitates fast, accurate inner and outer border detection with minimal user-interaction.
---
paper_title: Texture analysis of ultrasonic images of the prostate by means of co-occurrence matrices.

paper_content:

As speckle on ultrasonic B-scan may reveal information relative to tissue structure, the present work attempts to discriminate the various prostatic tissues (normal tissue, benign prostatic hypertrophy and cancer) by means of texture analysis. We select regions of interest by their homogeneous appearance. A pre-processing stage is required to obtain stationary samples. The method used measures the second-order statistics, namely co-occurrence matrices. Fairly good tissue signatures have been obtained with parameters derived from these matrices. Of 37 images processed, 78 percent of the samples were classified with success, which is a high score considering that the images cannot be discriminated visually. However, while such results are obtained when wide regions of interest are investigated (64 x 64 pixels), they are not as good with smaller sample sizes, i.e., when the pathological area is very small.
---
paper_title: Automatic segmentation of intravascular ultrasound images: A texture-based approach

paper_content:

Extraction of blood vessel boundaries from intravascular ultrasound images is essential in the quantitative analysis of cardiovascular functions. In this study, we are presenting a completely automated procedure for determining blood vessel borders. This approach uses textural operators to separate different tissue regions and morphological processing to refine extracted contours. The method was tested in a set of 29 intravascular ultrasound images obtainedin vivo. To assess the performance of the method, we have compared the automatically processed images with the manual tracings, using three different criteria: correlation coefficient, match ratio, and relative error of computed shape parameters. In both contour detection and shape parameters estimation, the proposed method yielded consistently good results. Due to its robustness and accuracy, this approach is appropriate for clinical use, whereas computational efficiency of the method facilitates low-cost implementation.
---
paper_title: Random field models in the textural analysis of ultrasonic images of the liver.

paper_content:

Conventional two-dimensional (2-D) texture parameters serve as the "gold standard" of texture analysis. The authors compared a new stochastic model, based on autoregressive periodic random field models (APRFM) with conventional texture analysts (CTA) parameter, which were defined as measures of the co-occurrence matrix, i.e., entropy, contrast, correlation, uniformity, and maximum frequency. By fitting the model to a given texture pattern, the estimated model parameters are suitable texture features. In 81 patients, divided into patients without (N=19) and with (N=62) microfocal lesions of the liver, a set of 24 CTA and 16 APRFM parameters were calculated from ultrasonic liver images. To ensure simple computation the APRFM parameters were based on the unilateral type of pixel neighborhood. Regenerated texture by APRFM was visually comparable with the original texture. Reclassification analysis using the classification and regression tree (CART) discriminant analysis system and the area under the receiver operating characteristic (ROC) curve was used to assess the texture classification potency of APRFM- and CTA-parameters. Discriminating between liver with and without microfocal lesions, the best results were seen for the APRFM parameter.
---
paper_title: Segmentation and tracking in echocardiographic sequences: active contours guided by optical flow estimates

paper_content:

This paper presents a method for segmentation and tracking of cardiac structures in ultrasound image sequences. The developed algorithm is based on the active contour framework. This approach requires initial placement of the contour close to the desired position in the image, usually an object outline. Best contour shape and position are then calculated, assuming that at this configuration a global energy function, associated with a contour, attains its minimum. Active contours can be used for tracking by selecting a solution from a previous frame as an initial position in a present frame. Such an approach, however, fails for large displacements of the object of interest. This paper presents a technique that incorporates the information on pixel velocities (optical flow) into the estimate of initial contour to enable tracking of fast-moving objects. The algorithm was tested on several ultrasound image sequences, each covering one complete cardiac cycle. The contour successfully tracked boundaries of mitral valve leaflets, aortic root and endocardial borders of the left ventricle. The algorithm-generated outlines were compared against manual tracings by expert physicians. The automated method resulted in contours that were within the boundaries of intraobserver variability.
---
paper_title: Automated lumen definition from 30 MHz intravascular ultrasound images

paper_content:

Abstract One prerequisite for standard clinical use of intravascular ultrasound imaging is rapid evaluation of the data. The main quantities to be extracted from the data are the size and the shape of the lumen. Until now, no accurate, robust and reproducible method to obtain the lumen boundaries from intravascular ultrasound images has been described. In this study, 21 different (semi-)automated binary-segmentation methods for determining the lumen are compared with manual segmentation to find an alternative for the laborious and subjective procedure of manual editing. After a preprocessing step in which the catheter area is filled with lumen-like grey values, all approaches consist of two steps: (i) smoothing the images with different filtering methods and (ii) extracting the lumen by an object definition method. The combination of different filtering methods and object definition methods results in a total of 21 methods and 80 experiments. The results are compared with a reference image, obtained from manual editing, by use of four different quality parameters—two based on squared distances and two based on Mahalanobis distances. The evaluation has been carried out on 15 images, of which seven are obtained before balloon dilation and eight after balloon dilation. While for the post-dilation images no definite conclusions can be drawn, an automated contour model applied to images smoothed with a large kernel appears to be a good alternative to manual contouring. For pre-dilation images a fully automated active contour model, initialized by thresholding, preceded by filtering with a small-scale median filter is the best alternative for manual delineation. The results of this method are even better than manual segmentation, i.e. they are consistently closer to the reference image than the average distance of all individual manual segmentations.
---
paper_title: Segmentation of intravascular ultrasound images: a knowledge-based approach.

paper_content:

Intravascular ultrasound imaging of coronary arteries provides important information about coronary lumen, wall, and plaque characteristics. Quantitative studies of coronary atherosclerosis using intravascular ultrasound and manual identification of wall and plaque borders are limited by the need for observers with substantial experience and the tedious nature of manual border detection. We have developed a method for segmentation of intravascular ultrasound images that identifies the internal and external elastic laminae and the plaque-lumen interface. The border detection algorithm was evaluated in a set of 38 intravascular ultrasound images acquired from fresh cadaveric hearts using a 30 MHz imaging catheter. To assess the performance of our border detection method we compared five quantitative measures of arterial anatomy derived from computer-detected borders with measures derived from borders manually defined by expert observers. Computer-detected and observer-defined lumen areas correlated very well (r=0.96, y=1.02x+0.52), as did plaque areas (r=0.95, y=1.07x-0.48), and percent area stenosis (r=0.93, y=0.99x-1.34.) Computer-derived segmental plaque thickness measurements were highly accurate. Our knowledge-based intravascular ultrasound segmentation method shows substantial promise for the quantitative analysis of in vivo intravascular ultrasound image data.
---
paper_title: Segmentation of prostate contours from ultrasound images

paper_content:

The paper presents a novel segmentation technique to extract prostate contours from transrectal ultrasound (TRUS) images. A sticks filter is first used to reduce the speckle and enhance the image contrast. The problem is then discretized by projecting equispaced radii from an arbitrary seed point inside the prostate cavity towards its boundary. The distance of the prostate boundary from the seed point is modeled by the trajectory of a moving object. The motion of this moving object is assumed to be governed by a finite set of dynamical models subject to uncertainty. Candidate edge points obtained along each radius include the measurement of the object position and some false returns. This modeling approach enables us to employ the interacting multiple model (IMM) estimator along with a probabilistic data association filter (PDAF) for prostate contour extraction. Since the method does not employ any numerical optimization, convergence is very fast. The robustness and accuracy of the method is demonstrated by segmenting contours from a series of prostate ultrasound images.
---
paper_title: A Coupled Minimization Problem for Medical Image Segmentation with Priors

paper_content:

We present a coupled minimization problem for image segmentation using prior shape and intensity profile. One part of the model minimizes a shape related energy and the energy of geometric active contour with a parameter that balances the influence from these two. The minimizer corresponding to a fixed parameter in this minimization gives a segmentation and an alignment between the segmentation and prior shape. The second part of this model optimizes the selection of the parameter by maximizing the mutual information of image geometry between the prior and the aligned novel image over all the alignments corresponding to different parameters in the first part. By this coupling the segmentation arrives at higher image gradient, forms a shape similar to the prior, and captures the prior intensity profile. We also propose using mutual information of image geometry to generate intensity model from a set of training images. Experimental results on cardiac ultrasound images are presented. These results indicate that the proposed model provides close agreement with expert traced borders, and the parameter determined in this model for one image can be used for images with similar properties.
---
paper_title: Texture Analysis of Ultrasound B-Mode Images by Segmentation

paper_content:

B-mode texture characterization by supervised methods of pattern recognition is subject to the following drawbacks: precise localization of the lesion to characterize is often difficult and, even when the lesion is well isolated, its texture can be corrupted by the presence of tumor non specific structures. These structures are not easily discernable and introduce a bias in the statistical measures. The results presented in this paper show that these problems can be circumvented by the use of an unsupervised method of image segmentation. The method enhances the B-mode image and partitions the non specific structures and the lesion texture in different regions which can be characterized independently by statistical methods. The unsupervised approach also facilitates the clinical diagnosis done by visual inspection, by revealing subtle characteristics of the B-mode textures.
---
paper_title: Deformable spatio-temporal shape models: extending active shape models to 2D þ time

paper_content:

Abstract This paper extends 2D active shape models to 2D+time by presenting a method for modeling and segmenting spatio-temporal shapes (ST-shapes). The modeling part consists of constructing a statistical model of ST-shape parameters. This model describes the principal modes of variation of the ST-shape in addition to constraints on the allowed variations. An active approach is used in segmentation where an initial ST-shape is deformed to better fit the data and the optimal proposed deformation is calculated using dynamic programming. Segmentation results on both synthetic and real data are presented.
---
paper_title: A shape-space-based approach to tracking myocardial borders and quantifying regional left-ventricular function applied in echocardiography

paper_content:

This paper presents a new semi-automatic method for quantifying regional heart function from two-dimensional echocardiography. In the approach, we first track the endocardial and epicardial boundaries using a new variant of the dynamic snake approach. The tracked borders are then decomposed into clinically meaningful regional parameters, using a novel interpretational shape-space motivated by the 16-segment model used in clinical practice for qualitative assessment of heart function. We show how a quantitative and automatic scoring scheme for the endocardial excursion and myocardial thickening can be derived from this. Results illustrating our approach on apical long-axis two-chamber-view data from a patient with a myocardial infarct in the apical anterior/inferior region of the heart are presented. In a case study (five patients, nine data sets) the performance of the tracking and interpretation techniques are compared with manual delineations of borders using a number of quantitative measures of regional comparison.
---
paper_title: An interacting multiple model probabilistic data association filter for cavity boundary extraction from ultrasound images

paper_content:

This paper presents a novel segmentation technique for extracting cavity contours from ultrasound images. The problem is first discretized by projecting equispaced radii from an arbitrary seed point inside the cavity toward its boundary. The distance of the cavity boundary from the seed point is modeled by the trajectory of a moving object. The motion of this moving object is assumed to be governed by a finite set of dynamical models subject to uncertainty. Candidate edge points obtained along each radius include the measurement of the object position and some false returns. The modeling approach enables us to use the interacting multiple model estimator along with a probabilistic data association filter, for contour extraction. The convergence rate of the method is very fast because it does not employ any numerical optimization. The robustness and accuracy of the method are demonstrated by segmenting contours from a series of ultrasound images. The results are validated through comparison with manual segmentations performed by an expert. An application of the method in segmenting bone contours from computed tomography images is also presented.
---
paper_title: Endocardial Boundary E timation and Tracking in Echocardiographic Images using Deformable Template and Markov Random Fields

paper_content:

We present a new approach to shape-based segmentation and tracking of deformable anatomical structures in medical images, and validate this approach by detecting and tracking the endocardial contour in an echocardiographic image sequence. To this end, some global prior shape knowledge of the endocardial boundary is captured by a prototype template with a set of predefined global and local deformations to take into account its inherent natural variability over time. In this deformable model-based Bayesian segmentation, the data likelihood model relies on an accurate statistical modelling of the grey level distribution of each class present in the ultrasound image. The parameters of this distribution mixture are given by a preliminary iterative estimation step. This estimation scheme relies on a Markov Random Field prior model, and takes into account the imaging process as well as the distribution shape of each class present in the image. Then the detection and the tracking problem is stated in a Bayesian framework, where it ends up as a cost function minimisation problem for each image of the sequence. In our application, this energy optimisation problem is efficiently solved by a genetic algorithm combined with a steepest ascent procedure. This technique has been successfully applied on synthetic images, and on a real echocardiographic image sequence.
---
paper_title: Texture features for classification of ultrasonic liver images

paper_content:

The classification of ultrasonic liver images is studied, making use of the spatial gray-level dependence matrices, the Fourier power spectrum, the gray-level difference statistics, and the Laws texture energy measures. Features of these types are used to classify three sets of ultrasonic liver images-normal liver, hepatoma, and cirrhosis (30 samples each). The Bayes classifier and the Hotelling trace criterion are employed to evaluate the performance of these features. From the viewpoint of speed and accuracy of classification, it is found that these features do not perform well enough. Hence, a new texture feature set (multiresolution fractal features) based on multiple resolution imagery and the fractional Brownian motion model is proposed to detect diffuse liver diseases quickly and accurately. Fractal dimensions estimated at various resolutions of the image are gathered to form the feature vector. Texture information contained in the proposed feature vector is discussed. A real-time implementation of the algorithm produces about 90% correct classification for the three sets of ultrasonic liver images. >
---
paper_title: Segmentation of kidney from ultrasound images based on texture and shape priors

paper_content:

This work presents a novel texture and shape priors based method for kidney segmentation in ultrasound (US) images. Texture features are extracted by applying a bank of Gabor filters on test images through a two-sided convolution strategy. The texture model is constructed via estimating the parameters of a set of mixtures of half-planed Gaussians using the expectation-maximization method. Through this texture model, the texture similarities of areas around the segmenting curve are measured in the inside and outside regions, respectively. We also present an iterative segmentation framework to combine the texture measures into the parametric shape model proposed by Leventon and Faugeras. Segmentation is implemented by calculating the parameters of the shape model to minimize a novel energy function. The goal of this energy function is to partition the test image into two regions, the inside one with high texture similarity and low texture variance, and the outside one with high texture variance. The effectiveness of this method is demonstrated through experimental results on both natural images and US data compared with other image segmentation methods and manual segmentation.
---
paper_title: Cell-based dual snake model: a new approach to extracting highly winding boundaries in the ultrasound images.

paper_content:

Two common deficiencies of most conventional deformable models are the need to place the initial contour very close to the desired boundary and the incapability of capturing a highly winding boundary for sonographic boundary extraction. To remedy these two deficiencies, a new deformable model (namely, the cell-based dual snake model) is proposed in this paper. The basic idea is to apply the dual snake model in the cell-based deformation manner. While the dual snake model provides an effective mechanism allowing a distant initial contour, the cell-based deformation makes it possible to catch the winding characteristics of the desired boundary. The performance of the proposed cell-based dual snake model has been evaluated on synthetic images with simulated speckles and on the clinical ultrasound (US) images. The experimental results show that the mean distances from the derived to the desired boundary points are 0.9 +/- 0.42 pixels and 1.29 +/- 0.39 pixels for the synthetic and the clinical US images, respectively.
---
paper_title: Validation of ultrasonic image boundary recognition in abdominal aortic aneurysm

paper_content:

An aneurysm of the abdominal aorta (AAA) is characterized by modified wall properties, and a balloon-like area usually filled by a thrombus. A rupture of an aortic aneurysm can be fatal, yet there is no way to accurately predict such an occurrence. The study of the wall and thrombus cross-sectional distension, due to a pressure wave, is important as a way of assessing the degradation of the mechanical properties of the vessel wall and the risk of a rupture. Echo ultrasound transverse cross-sectional imaging is used here to study the thrombus and the aortic wall distension, requiring their segmentation within the image. Polar coordinates are defined, and a search is performed for minimizing a cost function, which includes a description of the boundary (based on a limited series of sine and cosine functions) and information from the image intensity gradients along the radii. The method is based on filtering by a modified Canny-Deriche edge detector and then on minimization of an energy function based on five parts. Since echoes from blood in the lumen and the thrombus produce similar patterns and speckle noise, a modified version for identifying the lumen-thrombus border was developed. The method has been validated by various ways, including parameter sensitivity testing and comparison to the performance of an expert. It is robust enough to track the lumen and total arterial cross-sectional area changes during the cardiac cycle. In 34 patients where sequences of images were acquired, the border between the thrombus and the arterial wall was detected with errors less than 2%, while the lumen-thrombus border was detected with a mean error of 4%. Thus, a noninvasive measurement of the AAA cross-sectional area is presented, which has been validated and found to be accurate.
---
paper_title: A Mixture Model for Representing Shape Variation

paper_content:

The shape variation displayed by a class of objects can be represented as probability density function, allowing us to determine plausible and implausible examples of the class. Given a training set of example shapes we can align them into a common co-ordinate frame and use kernel-based density estimation techniques to represent this distribution. Such an estimate is complex and expensive, so we generate a simpler approximation using a mixture of gaussians. We show how to calculate the distribution, and how it can be used in image search to locate examples of the modelled object in new images.
---
paper_title: New maximum likelihood motion estimation schemes for noisy ultrasound images

paper_content:

When performing block-matching based motion estimation with the ML estimator, one would try to match blocks from the two images, within a predefined search area. The estimated motion vector is that which maximizes a likelihood function, formulated according to the image formation model. Two new maximum likelihood motion estimation schemes for ultrasound images are presented. The new likelihood functions are based on the assumption that both images are contaminated by a Rayleigh distributed multiplicative noise. The new approach enables motion estimation in cases where a noiseless reference image is not available. Experimental results show a motion estimation improvement with regards to other known ML estimation methods.
---
paper_title: Segmentation of the prostate from suprapubic ultrasound images

paper_content:

We present a technique for semiautomated segmentation of human prostates using suprapubic ultrasound (US) images. In this approach, a speckle reducing anisotropic diffusion (SRAD) is applied to enhance the images and the instantaneous coefficient of variation (ICOV) is utilized for edge detection. Segmentation is accomplished via a parametric active contour model in a polar coordinate system that is tailored to the application. The algorithm initially approximates the prostate boundary in two stages. First a primary contour is detected using an elliptical model, followed by a primary contour optimization using an area-weighted mean-difference binary flow geometric snake model. The algorithm was assessed by comparing the computer-derived contours with contours produced manually by three sonographers. The proposed method has application in radiation therapy planning and delivery, as well as in automated volume measurements for ultrasonic diagnosis. The average root mean square discrepancy between computed and manual outlines is less than the inter-observer variability. Furthermore, 76% of the computer-outlined contour is less than 1 sigma manual outline variance away from "true" boundary of prostate. We conclude that the methods developed herein possess acceptable agreement with manually contoured prostate boundaries and that they are potentially valuable tools for radiotherapy treatment planning and verification.
---
paper_title: Segmentation of fetal ultrasound images.

paper_content:

This paper describes a new method for segmentation of fetal anatomic structures from echographic images. More specifically, we estimate and measure the contours of the femur and of cranial cross-sections of fetal bodies, which can thus be automatically measured. Contour estimation is formulated as a statistical estimation problem, where both the contour and the observation model parameters are unknown. The observation model (or likelihood function) relates, in probabilistic terms, the observed image with the underlying contour. This likelihood function is derived from a region-based statistical image model. The contour and the observation model parameters are estimated according to the maximum likelihood (ML) criterion, via deterministic iterative algorithms. Experiments reported in the paper, using synthetic and real images, testify for the adequacy and good performance of the proposed approach.
---
paper_title: Nonlinear Multiscale Analysis of 3D Echocardiographic Sequences

paper_content:

Introduces a new model for multiscale analysis of space-time echocardiographic sequences. The proposed nonlinear partial differential equation, representing the multiscale analysis, filters the sequence while keeping the space-time coherent structures. It combines the ideas of regularized Perona-Malik anisotropic diffusion and the Galilean invariant movie multiscale analysis of Alvarez et al. (Arch. Rat. Mech. Anal., vol. 123, p. 200-57, 1993). A numerical method for solving the proposed partial differential equation is suggested and its stability is shown. Computational results on synthesized and real sequences are provided. A qualitative and quantitative evaluation of the accuracy of the method is presented.
---
paper_title: Characterization of echographic image texture by cooccurrence matrix parameters

paper_content:

Abstract The goal of this study was to investigate the potentials of cooccurrence matrix analysis for the characterization of echographic image texture. Echographic data were obtained by one-dimensional simulations. Various data sets were generated with different number densities of the randomly distributed scatterers and with different levels of structural scattering strength. Cooccurrence matrix parameters estimated for analysis were: angular second moment, contrast, correlation, entropy and kappa. The cooccurrence matrix analysis was tuned by varying its parameters: spatial displacement of the pixel pairs, number of gray levels and size of the window. The parameters reached a saturation level at a number density of 3–5 scatterers per resolution cell (−6 dB width). Similarly, when increasing the displacement, a limit value was reached at 4–20 samples, depending on the size of the resolution cell. Using the Mahalanobis distance as a measure of differentiating between two textures, a systematic inverse relation was observed between the size of the window and the number of gray levels used in the estimation of the cooccurrence matrix. The optimal parameters to differentiate textures without structure appeared to be entropy and angular second moment. A window size of 90 speckle cells and 64 gray levels is needed for this purpose. The effective speckle size was estimated from the mean number of maxima of the demodulated echo signals. Resolved structure results in a periodicity of parameter values with displacement. The periodicity can be calculated by changing the displacement d . Optimal parameters for detecting periodicity are contrast and correlation. Analysis of the correlation between parameters showed that entropy vs. angular second moment and contrast vs. correlation are highly correlated.
---
paper_title: Data mining with decision trees for diagnosis of breast tumor in medical ultrasonic images

paper_content:

To increase the ability of ultrasonographic (US) technology for the differential diagnosis of solid breast tumors, we describe a novel computer-aided diagnosis (CADx) system using data mining with decision tree for classification of breast tumor to increase the levels of diagnostic confidence and to provide the immediate second opinion for physicians. Cooperating with the texture information extracted from the region of interest (ROI) image, a decision tree model generated from the training data in a top-down, general-to-specific direction with 24 co-variance texture features is used to classify the tumors as benign or malignant. In the experiments, accuracy rates for a experienced physician and the proposed CADx are 86.67% (78/90) and 95.50% (86/90), respectively.
---
paper_title: Active Shape Models-Their Training and Application

paper_content:

!, Model-based vision is firmly established as a robust approach to recognizing and locating known rigid objects in the presence of noise, clutter, and occlusion. It is more problematic to apply modelbased methods to images of objects whose appearance can vary, though a number of approaches based on the use of flexible templates have been proposed. The problem with existing methods is that they sacrifice model specificity in order to accommodate variability, thereby compromising robustness during image interpretation. We argue that a model should only be able to deform in ways characteristic of the class of objects it represents. We describe a method for building models by learning patterns of variability from a training set of correctly annotated images. These models can be used for image search in an iterative refinement algorithm analogous to that employed by Active Contour Models (Snakes). The key difference is that our Active Shape Models can only deform to fit the data in ways consistent with the training set. We show several practical examples where we have built such models and used them to locate partially occluded objects in noisy, cluttered images. Q 199s A&& prrss, IN.
---
paper_title: Characterization of visually similar diffuse diseases from B-scan liver images using nonseparable wavelet transform

paper_content:

This paper describes a new approach for texture characterization, based on nonseparable wavelet decomposition, and its application for the discrimination of visually similar diffuse diseases of liver. The proposed feature-extraction algorithm applies nonseparable quincunx wavelet transform and uses energies of the transformed regions to characterize textures. Classification experiments on a set of three different tissue types show that the scale/frequency approach, particularly one based on the nonseparable wavelet transform, could be a reliable method for a texture characterization and analysis of B-scan liver images. Comparison between the quincunx and the traditional wavelet decomposition suggests that the quincunx transform is more appropriate for characterization of noisy data, and practical applications, requiring description with lower rotational sensitivity.
---
paper_title: Fully automatic luminal contour segmentation in intracoronary ultrasound imaging-a statistical approach

paper_content:

In this paper, a fully automatic method for luminal contour segmentation in intracoronary ultrasound imaging is introduced. Its principle is based on a contour with a priori properties that evolves according to the statistics of the ultrasound texture brightness, which is generally Rayleigh distributed. The main interest of the technique is its fully automatic character. This is insured by an initial contour that is not set by the user, like in classical snake-based algorithms, but estimated and, thus, adapted to each image. Its estimation combines two pieces of information extracted from the a posteriori probability function of the contour position: the function maximum location (or maximum a posteriori estimator) and the first zero-crossing of its derivative. Then, starting from the initial contour, a region of interest is automatically selected and the process iterated until the contour evolution can be ignored. In vivo coronary images from 15 patients, acquired with the 20-MHz central frequency Jomed Invision ultrasound scanner, were segmented with the developed method. Automatic contours were compared to those manually drawn by two physicians in terms of mean absolute difference. The results demonstrate that the error between automatic contours and the average of manual ones is of small amplitude, and only very slightly higher (0.099 +/- 0.032 mm) than the interexpert error (0.097 +/- 0.027 mm).
---
paper_title: An approach for contour detection of human kidneys from ultrasound images using Markov random fields and active contours

paper_content:

In this paper, a novel method for the boundary detection of human kidneys from three dimensional (3D) ultrasound (US) is proposed. The inherent difficulty of interpretation of such images, even by a trained expert, makes the problem unsuitable for classical methods. The method here proposed finds the kidney contours in each slice. It is a probabilistic Bayesian method. The prior defines a Markov field of deformations and imposes the restriction of contour smoothness. The likelihood function imposes a probabilistic behavior to the data, conditioned to the contour position. This second function, which is also Markov, uses an empirical model of distribution of the echographical data and a function of the gradient of the data. The model finally includes, as a volumetric extension of the prior, a term that forces smoothness along the depth coordinate. The experiments that have been carried out on echographies from real patients validate the model here proposed. A sensitivity analysis of the model parameters has also been carried out.
---
paper_title: Tracking the left ventricle in echocardiographic images by learning heart dynamics

paper_content:

In this paper a temporal learning-filtering procedure is applied to refine the left ventricle (LV) boundary detected by an active-contour model. Instead of making prior assumptions about the LV shape or its motion, this information is incrementally gathered directly from the images and is exploited to achieve more coherent segmentation. A Hough transform technique is used to find an initial approximation of the object boundary at the first frame of the sequence. Then, an active-contour model is used in a coarse-to-fine framework, for the estimation of a noisy LV boundary. The PCA transform is applied to form a reduced ordered orthonormal basis of the LV deformations based on a sequence of noisy boundary observations. Then this basis Is used to constrain the motion of the active contour in subsequent frames, and thus provide more coherent identification. Results of epicardial boundary identification in B-mode images are presented.
---
paper_title: A multiparametric and multiresolution segmentation algorithm of 3D ultrasonic data

paper_content:

An algorithm devoted to the segmentation of 3-D ultrasonic data is proposed. The algorithm involves 3-D adaptive clustering based on multiparametric information: the gray-scale intensity of the echographic data, 3-D texture features calculated from the envelope data, and 3-D tissue characterization information calculated from the local frequency spectra of the radio-frequency signals. The segmentation problem is formulated as a Maximum A posterior (MAP) estimation problem. A multi-resolution implementation of the algorithm is proposed. The approach is tested on simulated data and on in vivo echocardiographic 3-D data. The results presented in the paper illustrate the robustness and the accuracy of the proposed approach for the segmentation of ultrasonic data.
---
paper_title: Subjective surfaces: A method for completing missing boundaries

paper_content:

We present a model and algorithm for segmentation of images with missing boundaries. In many situations, the human visual system fills in missing gaps in edges and boundaries, building and completing information that is not present. This presents a considerable challenge in computer vision, since most algorithms attempt to exploit existing data. Completion models, which postulate how to construct missing data, are popular but are often trained and specific to particular images. In this paper, we take the following perspective: We consider a reference point within an image as given and then develop an algorithm that tries to build missing information on the basis of the given point of view and the available information as boundary data to the algorithm. We test the algorithm on some standard images, including the classical triangle of Kanizsa and low signal/noise ratio medical images.
---
paper_title: Statistical shape influence in geodesic active contours

paper_content:

A novel method of incorporating shape information into the image segmentation process is presented. We introduce a representation for deformable shapes and define a probability distribution over the variances of a set of training shapes. The segmentation process embeds an initial curve as the zero level set of a higher dimensional surface, and evolves the surface such that the zero level set converges on the boundary of the object to be segmented. At each step of the surface evolution, we estimate the maximum a posteriori (MAP) position and shape of the object in the image, based on the prior shape information and the image information. We then evolve the surface globally, towards the MAP estimate, and locally, based on image gradients and curvature. Results are demonstrated on synthetic data and medical imagery, in 2D and 3D.
---
paper_title: Texture-based classification of atherosclerotic carotid plaques

paper_content:

There are indications that the morphology of atherosclerotic carotid plaques, obtained by high-resolution ultrasound imaging, has prognostic implications. The objective of this study was to develop a computer-aided system that will facilitate the characterization of carotid plaques for the identification of individuals with asymptomatic carotid stenosis at risk of stroke. A total of 230 plaque images were collected which were classified into two types: symptomatic because of ipsilateral hemispheric symptoms, or asymptomatic because they were not connected with ipsilateral hemispheric events. Ten different texture feature sets were extracted from the manually segmented plaque images using the following algorithms: first-order statistics, spatial gray level dependence matrices, gray level difference statistics, neighborhood gray tone difference matrix, statistical feature matrix, Laws texture energy measures, fractal dimension texture analysis, Fourier power spectrum and shape parameters. For the classification task a modular neural network composed of self-organizing map (SOM) classifiers, and combining techniques based on a confidence measure were used. Combining the classification results of the ten SOM classifiers inputted with the ten feature sets improved the classification rate of the individual classifiers, reaching an average diagnostic yield (DY) of 73.1%. The same modular system was implemented using the statistical k-nearest neighbor (KNN) classifier. The combined DY for the KNN system was 68.8%. The results of this paper show that it is possible to identify a group of patients at risk of stroke based on texture features extracted from ultrasound images of carotid plaques. This group of patients may benefit from a carotid endarterectomy whereas other patients may be spared from an unnecessary operation.
---
paper_title: Active Appearance Models

paper_content:

We demonstrate a novel method of interpreting images using an Active Appearance Model (AAM). An AAM contains a statistical model of the shape and grey-level appearance of the object of interest which can generalise to almost any valid example. During a training phase we learn the relationship between model parameter displacements and the residual errors induced between a training image and a synthesised model example. To match to an image we measure the current residuals and use the model to predict changes to the current parameters, leading to a better fit. A good overall match is obtained in a few iterations, even from poor starting estimates. We describe the technique in detail and give results of quantitative performance tests. We anticipate that the AAM algorithm will be an important method for locating deformable objects in many applications.
---
paper_title: Ultrasonic liver tissues classification by fractal feature vector based on M-band wavelet transform

paper_content:

This paper proposes a new fractal feature vector based on M-band wavelet transform for classification of ultrasonic liver images-normal liver, cirrhosis, and hepatoma. Classifications for liver images have revealed that the fractal feature vector is trustworthy. A hierarchical classifier produces 97.27% correct classification for the distinction of normal and abnormal liver image and 93.6% correct classification for the distinction of cirrhosis and hepatoma liver image.
---
paper_title: Optimized prostate biopsy via a statistical atlas of cancer spatial distribution

paper_content:

A methodology is presented for constructing a statistical atlas of spatial distribution of prostate cancer from a large patient cohort, and it is used for optimizing needle biopsy. An adaptive-focus deformable model is used for the spatial normalization and registration of 100 prostate histological samples, which were provided by the Center for Prostate Disease Research of the US Department of Defense, resulting in a statistical atlas of spatial distribution of prostate cancer. Based on this atlas, a statistical predictive model was developed to optimize the needle biopsy sites, by maximizing the probability of detecting cancer. Experimental results using cross-validation show that the proposed method can detect cancer with a 99% success rate using seven needles, in these samples.
---
paper_title: Wavelet image extension for analysis and classification of infarcted myocardial tissue

paper_content:

Some computer applications for tissue characterization in medicine and biology, such as analysis of the myocardium or cancer recognition, operate with tissue samples taken from very small areas of interest. In order to perform texture characterization in such an application, only a few texture operators can be employed: the operators should be insensitive to noise and image distortion and yet be reliable in order to estimate texture quality from the small number of image points available. In order to describe the quality of infarcted myocardial tissue, the authors propose a new wavelet-based approach for analysis and classification of texture samples with small dimensions. The main idea of this method is to decompose the given image with a filter bank derived from an orthonormal wavelet basis and to form an image approximation with higher resolution. Texture energy measures calculated at each output of the filter bank as well as energies of synthesized images are used as texture features in a classification procedure. The authors propose an unsupervised classification technique based on a modified statistical t-test. The method is tested with clinical data, and the classification results obtained are very promising. The performance of the new method is compared with the performance of several other transform-based methods. The new algorithm has advantages in classification of small and noisy input samples, and it represents a step toward structural analysis of weak textures.
---
paper_title: Correlations between acoustic and texture parameters from RF and B-mode liver echograms

paper_content:

Radio frequency (RF) echograms were acquired from human subjects without liver pathology (n = 126), who were in the range of 20 to 84 years of age. After appropriate correction for the equipment settings and performance characteristics, acoustospectrographic parameters were estimated. The data were corrected for the frequency-dependent attenuation and then software demodulated. Image texture parameters were calculated based on the assumption of a particular tissue model, and purely statistical parameters were also estimated. The data thus obtained from each subject were corrected for the age trend that was assessed in an earlier publication by the authors. A total of 18 parameters was considered and the correlations were analyzed. It is concluded that nine parameters could be identified which did not strongly correlate with each other. This conclusion is supported by analysis of correlation data from patients. In a companion paper, a discriminant analysis is reported, based on the selected parameters (nine) and applied to the differentiation between normals and various classes of diffuse liver disease.
---
paper_title: Quantitative regional analysis of myocardial wall motion.

paper_content:

Abstract This paper presents a new technique for semiautomatic quantification of regional heart function from 2-D echocardiography. It uses a novel left ventricular border tracking algorithm based on shape-space ideas that we have recently described. In this paper, we show how to decompose the tracked output into clinically meaningful segmental parameters (wall excursion and thickening), using what we call a computational interpretational space (CIS). This leads to a quantitative and automatic scoring scheme for endocardial excursion and myocardial thickening. The method is illustrated on data from a patient with a myocardial infarct in the apical anterior/inferior region of the heart and is also assessed in a small retrospective dobutamine stress echocardiography clinical case study. (E-mail: noble@robots.ox.ac.uk)
---
paper_title: Evaluation of three-dimensional segmentation algorithms for the identification of luminal and medial-adventitial borders in intravascular ultrasound images

paper_content:

Intravascular ultrasound (IVUS) provides direct depiction of coronary artery anatomy, including plaque and vessel area, which is important in quantitative studies on the progression or regression of coronary artery disease. Traditionally, these studies have relied on manual evaluation, which is laborious, time consuming, and subject to large interobserver and intraobserver variability. A new technique, called active surface segmentation, alleviates these limitations and makes strides toward routine analyses. However, for three-dimensional (3-D) plaque assessment or 3-D reconstruction to become a clinical reality, methods must be developed which can analyze many images quickly. Presented is a comparison between two active surface techniques for three-dimensional segmentation of luminal and medial-adventitial borders. The force-acceleration technique and the neighborhood-search technique accurately detected both borders in vivo (r2 = 0.95 and 0.99, Williams' index = 0.67 and 0.65, and r2 = 0.95 and 0.99, WI = 0.67 and 0.70, respectively). However, the neighborhood-search technique was significantly faster and required less computation. Volume calculations for both techniques (r2 = 0.99 and r2 = 0.99) also agreed with a known-volume phantom. Active surface segmentation allows 3-D assessment of coronary morphology and further developments with this technology will provide clinical analysis tools.
---
paper_title: Artificial neural networks and spatial temporal contour linking for automated endocardial contour detection on echocardiograms: a novel approach to determine left ventricular contractile function.

paper_content:

This study investigated the use of artificial neural networks (ANN) for image segmentation and spatial temporal contour linking for the detection of endocardial contours on echocardiographic images. Using a backpropagation network, the system was trained with 279 sample regions obtained from eight training images to segment images into either tissue or blood pool region. The ANN system was then applied to parasternal short axis images of 38 patients. Spatial temporal contour linking was performed on the segmented images to extract endocardial boarders. Left ventricular areas (end-systolic and end-diastolic) determined with the automated system were calculated and compared to results obtained by manual contour tracing performed by two independent investigators. In addition, ejection fractions (EF) were derived using the area-length method and compared with radionuclide ventriculography. Image quality was classified as good in 12 (32%), moderate in 13 (34%) and poor in 13 (34%) patients. The ANN system provided estimates of end-diastolic and end-systolic areas in 36 (89%) of echocardiograms, which correlated well with those obtained by manual tracing (R = 0.99, SEE = 1.44). A good agreement was also found for the comparison of EF between the ANN system and Tc-radionuclide ventriculography (RNV, R = 0.93, SEE = 6.36). The ANN system also performed well in the subset of patients with poor image quality. Endocardial contour detection using artificial neural networks and spatial temporal contour linking allows accurate calculations of ventricular areas from transthoracic echocardiograms and performs well even in images with poor quality. This system could greatly enhance the feasibility, accuracy and reproducibility of calculating cardiac areas to derive left ventricular volumes and ejection fractions.
---
paper_title: AUTOMATED CONTOUR DETECTION FOR HIGH-FREQUENCY INTRAVASCULAR ULTRASOUND IMAGING: A TECHNIQUE WITH BLOOD NOISE REDUCTION FOR EDGE ENHANCEMENT

paper_content:

Automated edge detection may standardize measurements among observers, providing for rapid assessment of intravascular ultrasound (IVUS) images. However, with high frequency images, enhanced blood signals make it difficult to define and trace the lumen borders. Accordingly, we evaluated a fully automated contour analysis facilitated with a blood noise reduction algorithm (BNR) for 40-MHz IVUS images in human coronary arteries of 27 patients. This algorithm is based on the principle that blood echo speckles have higher temporal and spatial variations than the arterial wall. A total of 193 paired lumen areas and 78 external elastic membrane (EEM) areas were measured and compared. Automated measurements showed good agreement with manual tracings for lumen and EEM area, with high correlation coefficients (0.945 and 0.950, respectively) and small variability (0.4 ± 14.4% and 0.6 ± 9.7%, respectively). This preliminary finding suggests that automated contour detection facilitated with BNR appeared to be a feasible and reliable technique for area measurements in 40-MHz IVUS imaging.
---
paper_title: Validation of an automated system for luminal and medial-adventitial border detection in three-dimensional intravascular ultrasound

paper_content:

The precise tomographic assessment of coronary artery disease by intravascular ultrasound (IVUS) is useful in quantitative studies. Such studies require identification of luminal and medial-adventitial (MA) borders in a sequence of IVUS images. We have developed a three-dimensional (3D) active-surface system for border detection that facilitates the analysis of many images with minimal user interaction. To assess the validity of the technique, luminal and MA borders in 529 end-diastolic images from nine coronary arterial segments (58.8 ± 14.2 images per patient) were traced manually by four experienced observers. The computer-detected borders were compared with borders determined by the four observers using a modified Williams' index (WI), the ratio of inter-observer variability to computer-observer variability. While manual tracing required 49.2 ± 12.1 min for analysis, the analysis system identified luminal (R2 = 0.92) and MA borders (R2 = 0.97) in 13.8 ± 4.0 min, a decrease of 35.4 min (p < 0.000001). The computer minus observer differences in lumen area and MA area were −0.88 ± 0.90 and −0.07 ± 0.63 mm2. Therefore, the computer system underestimated both lumen and MA area, but this effect was very small in MA area. The WI values and 95% confidence intervals were 0.98 (0.89,1.06) for luminal border detection and 0.99 (0.95,1.04) for MA border detection. Plaque volume measurements, a common endpoint of clinical trials, also verified the accuracy of the technique (R2 = 0.98). The proposed 3D active-surface border detection system provides a faster and less-tedious alternative to manual tracing for assessment of coronary artery anatomy in vivo.
---
paper_title: Spatio-temporal nonrigid registration for ultrasound cardiac motion estimation

paper_content:

We propose a new spatio-temporal elastic registration algorithm for motion reconstruction from a series of images. The specific application is to estimate displacement fields from two-dimensional ultrasound sequences of the heart. The basic idea is to find a spatio-temporal deformation field that effectively compensates for the motion by minimizing a difference with respect to a reference frame. The key feature of our method is the use of a semi-local spatio-temporal parametric model for the deformation using splines, and the reformulation of the registration task as a global optimization problem. The scale of the spline model controls the smoothness of the displacement field. Our algorithm uses a multiresolution optimization strategy to obtain a higher speed and robustness. We evaluated the accuracy of our algorithm using a synthetic sequence generated with an ultrasound simulation package, together with a realistic cardiac motion model. We compared our new global multiframe approach with a previous method based on pairwise registration of consecutive frames to demonstrate the benefits of introducing temporal consistency. Finally, we applied the algorithm to the regional analysis of the left ventricle. Displacement and strain parameters were evaluated showing significant differences between the normal and pathological segments, thereby illustrating the clinical applicability of our method.
---
paper_title: Computerized characterization of breast masses on three-dimensional ultrasound volumes

paper_content:

We are developing computer vision techniques for the characterization of breast masses as malignant or benign on radiologic examinations. In this study, we investigated the computerized characterization of breast masses on three-dimensional (3-D) ultrasound(US) volumetric images. We developed 2-D and 3-D active contour models for automated segmentation of the mass volumes. The effect of the initialization method of the active contour on the robustness of the iterative segmentation method was studied by varying the contour used for its initialization. For a given segmentation, texture and morphological features were automatically extracted from the segmented masses and their margins. Stepwise discriminant analysis with the leave-one-out method was used to select effective features for the classification task and to combine these features into a malignancy score. The classification accuracy was evaluated using the area A z under the receiver operating characteristic (ROC) curve, as well as the partial area index A z (0.9) , defined as the relative area under the ROC curve above a sensitivity threshold of 0.9. For the purpose of comparison with the computer classifier, four experienced breast radiologists provided malignancy ratings for the 3-D US masses. Our dataset consisted of 3-D US volumes of 102 biopsied masses (46 benign, 56 malignant). The classifiers based on 2-D and 3-D segmentation methods achieved test A z values of 0.87±0.03 and 0.92±0.03, respectively. The difference in the A z values of the two computer classifiers did not achieve statistical significance. The A z values of the four radiologists ranged between 0.84 and 0.92. The difference between the computer’s A z value and that of any of the four radiologists did not achieve statistical significance either. However, the computer’s A z (0.9) value was significantly higher than that of three of the four radiologists. Our results indicate that an automated and effective computer classifier can be designed for differentiating malignant and benign breast masses on 3-D US volumes. The accuracy of the classifier designed in this study was similar to that of experienced breast radiologists.
---
paper_title: 3-D freehand echocardiography for automatic left ventricle reconstruction and analysis based on multiple acoustic windows

paper_content:

A new method is proposed to reconstruct and analyze the left ventricle (LV) from multiple acoustic window three-dimensional (3-D) ultrasound acquired using a transthoracic 3-D rotational probe. Prior research in this area has been based on one acoustic window acquisition. However, the data suffers from several limitations that degrade the reconstruction and reduce the clinical value of interpretation, such as the presence of shadow due to bone (ribs) and air (in the lungs) and motion of the probe during the acquisition. In this paper, we show how to overcome these limitations by automatically fusing information from multiple acoustic window sparse-view acquisitions and using a position sensor to track the probe in real time. Geometric constraints of the object shape, and spatiotemporal information relating to the image acquisition process, are used in new algorithms for 1) grouping endocardial edge cues from an initial image segmentation and 2) defining a novel reconstruction method that utilizes information from multiple acoustic windows. The new method has been validated on a phantom and three real heart data sets. In the phantom study, one finger of a latex glove was scanned from two acoustic windows and reconstructed using the new method. The volume error was measured to be less than 4%. In the clinical case study, 3-D ultrasound and magnetic resonance imaging (MRI) scanning were performed on the same healthy volunteers. Quantitative ejection fractions (EFs) and volume-time curves over a cardiac cycle were estimated using the new method and compared to cardiac MRI measurements. This showed that the new method agrees better with MRI measurements than the previous approach we have developed based on a single acoustic window. The EF errors of the new method with respect to MRI measurements were less than 6%. A more extensive clinical validation is required to establish whether these promising first results translate to a method suitable for routine clinical use.
---
paper_title: Active Shape Models & Segmentation of the Left Ventricle in Echocardiography

paper_content:

Segmentation of the left ventricle in echocardiographic images is a task with important diagnostic power. We propose a model-based approach that aims at extracting the left ventricle for each frame of the cardiac cycle. Our approach exhibits several novel elements. Modelling consists of two separate components, one for the systolic and one for the diastolic moment. Segmentation is considered in two steps. During the first step a linear combination of the systolic and the diastolic model is to be recovered – that dictates the new model – along with a similarity transformation that projects this model to the desired image features. During the second step, a linear combination of the modes of variation for the systolic and diastolic models is recovered for precise extraction of the endocardium boundaries. The process is considered in the temporal domain where constraints are introduced to couple information across frames and to lead to a smooth solution. Promising results demonstrate the potentials of the presented framework.
---
paper_title: Quantitative analysis of ultrasound B-mode images of carotid atherosclerotic plaque: correlation with visual classification and histological examination

paper_content:

This paper presents a quantitative comparison of three types of information available for 52 patients scheduled for carotid endarterectomy: subjective classification of the ultrasound images obtained during scanning before operation, first-and second-order statistical features extracted from regions of the plaque in still ultrasound images from three orthogonal scan planes and finally a histological analysis of the surgically removed plaque. The quantitative comparison was made with the linear model and with separation of the available data into training and test sets. The comparison of subjective classification with features from still ultrasound images revealed an overall agreement of 60% for classification of echogenicity and 70% for classification of structure. Comparison of the histologically determined relative volume of soft materials with features from the still images revealed a correlation coefficient of r = -0.42(p = 0.002). for mean echogenicity of the plaque region. The best performing feature was of second order and denoted Contrast (r = -0.5). Though significant, the latter correlation is probably not strong enough to be useful for clinical prediction of relative volume of soft materials for individual patients. Reasons for this is discussed in the paper, together with suggestions for improvements.
---
paper_title: Segmentation of prostate boundaries from ultrasound images using statistical shape model

paper_content:

Presents a statistical shape model for the automatic prostate segmentation in transrectal ultrasound images. A Gabor filter bank is first used to characterize the prostate boundaries in ultrasound images in both multiple scales and multiple orientations. The Gabor features are further reconstructed to be invariant to the rotation of the ultrasound probe and incorporated in the prostate model as image attributes for guiding the deformable segmentation. A hierarchical deformation strategy is then employed, in which the model adaptively focuses on the similarity of different Gabor features at different deformation stages using a multiresolution technique, i.e., coarse features first and fine features later. A number of successful experiments validate the algorithm.
---
paper_title: Automated analysis of a sequence of ovarian ultrasound images. Part I: segmentation of single 2D images

paper_content:

Abstract An improved algorithm is presented for ovarian follicle detection in ultrasound images. This fully automated recognition algorithm is composed of three successive steps. First, initial homogeneous regions are determined. Then, these initial regions are grown. The growing is controlled by average grey-level and by a newly introduced weighted image gradient. In the last stage, those regions are extracted that probably correspond to the follicles. The algorithm has been tested on 50 ovarian ultrasound images. The recognition rate of follicles using this procedure was around 78%. A possible extension of the algorithm deals with the entire information in the ultrasound image sequence, which is covered in Part II of this paper.
---
paper_title: Robust 3D Segmentation of Anatomical Structures with Level Sets

paper_content:

This paper is concerned with the use of the level set formalism to segment anatomical structures in 3D medical images (ultrasound or magnetic resonance images). A closed 3D surface propagates towards the desired boundaries through the iterative evolution of a 4D implicit function. The major contribution of this work is the design of a robust evolution model based on adaptive parameters depending on the data. First the iteration step and the external propagation force, both usually constant, are automatically computed at each iteration. Additionally, region-based information rather than the gradient is used, via an estimation of intensity probability density functions over the image. As a result, the method can be applied to various kinds of data. Quantitative and qualitative results on brain MR images and 3D echographies of carotid arteries are discussed.
---
paper_title: Image staining and differential diagnosis of ultrasound scans based on the Mahalanobis distance.

paper_content:

The covariance matrices associated with each state of health or disease from a previous study are used as the basis of an image staining display technique for aid in quantitative differential diagnosis. A state of health or disease is chosen by the clinician: this selects the covariance matrix from the data base. A region of interest (ROI) is then scrolled through an abdominal B-scan. For each position of the ROI a point in the four-dimensional feature space is calculated. A natural measure of the distance of this point from the center of mass (multivariate mean) of the disease class is calculated in terms of the covariance matrix of this class; this measure is the Mahalanobis distance. The confidence level for acceptance or rejection of the hypothesized disease class is obtained from the probability distribution of this distance, the T(2) probability law. This confidence level is color coded and used as a color stain that overlays the original scan at that position. The variability of the calculated features is studied as a function of ROI size, or the spatial resolution of the color coded image, and it is found that for an ROI in the neighborhood of 4 cm(2) most of the variability due to the finite number of independent samples (speckles) is averaged out, leaving the "noise floor" associated with inter- and intra-patient variability. ROIs on the order of 1 cm(2) may result with technical advances in B-scan resolution. A small number of points on organ boundaries are entered by the user, to fit with arcs of ellipses to be used to switch between organ (liver and kidney) data bases as the ROI encounters the boundary. By selecting in turn various state-of-health or state-of-disease databases, such images of confidence levels may be used for quantitative differential diagnosis. The method is not limited to ultrasound, being applicable in principle to features obtained from any modality or multimodality combination.
---
paper_title: Automatic segmentation of echocardiographic sequences by active appearance motion models

paper_content:

A novel extension of active appearance models (AAMs) for automated border detection in echocardiographic image sequences is reported. The active appearance motion model (AAMM) technique allows fully automated robust and time-continuous delineation of left ventricular (LV) endocardial contours over the full heart cycle with good results. Nonlinear intensity normalization was developed and employed to accommodate ultrasound-specific intensity distributions. The method was trained and tested on 16-frame phase-normalized transthoracic four-chamber sequences of 129 unselected infarct patients, split randomly into a training set (n = 65) and a test set (n = 64). Borders were compared to expert drawn endocardial contours. On the test set, fully automated AAMM performed well in 97% of the cases (average distance between manual and automatic landmark points was 3.3 mm, comparable to human interobserver variabilities). The ultrasound-specific intensity normalization proved to be of great value for good results in echocardiograms. The AAMM was significantly more accurate than an equivalent set of two-dimensional AAMs.
---
paper_title: Automatic ventricular cavity boundary detection from sequential ultrasound images using simulated annealing.

paper_content:

An automatic algorithm has been developed for high-speed detection of cavity boundaries in sequential 2-D echocardiograms using an optimization algorithm called simulated annealing (SA). The algorithm has three stages. (1) A predetermined window of size nxm is decimated to size n'xm' after low-pass filtering. (2) An iterative radial gradient algorithm is employed to determine the center of gravity (CG) of the cavity. (3) 64 radii which originate from the CG defined in stage 2 are bounded by the high-probability region. Each bounded radius is defined as a link in a 1-D, 64-member cyclic Markov random field. This algorithm is unique in that it compounds spatial and temporal information along with a physical model in its decision rule, whereas most other algorithms base their decisions on spatial data alone. This is the first implementation of a relaxation algorithm for edge detection in echocardiograms. Results attained using this algorithm on real data have been highly encouraging.
---
paper_title: A methodology for evaluation of boundary detection algorithms on medical images

paper_content:

Image segmentation is the partition of an image into a set of nonoverlapping regions whose union is the entire image. The image is decomposed into meaningful parts which are uniform with respect to certain characteristics, such as gray level or texture. In this paper, we propose a methodology for evaluating medical image segmentation algorithms wherein the only information available is boundaries outlined by multiple expert observers. In this case, the results of the segmentation algorithm can be evaluated against the multiple observers' outlines. We have derived statistics to enable us to find whether the computer-generated boundaries agree with the observers' hand-outlined boundaries as much as the different observers agree with each other. We illustrate the use of this methodology by evaluating image segmentation algorithms on two different applications in ultrasound imaging. In the first application, we attempt to find the epicardial and endocardial boundaries from cardiac ultrasound images, and in the second application, our goal is to find the fetal skull and abdomen boundaries from prenatal ultrasound images.
---
paper_title: 3-D active appearance models: segmentation of cardiac MR and ultrasound images

paper_content:

A model-based method for three-dimensional image segmentation was developed and its performance assessed in segmentation of volumetric cardiac magnetic resonance (MR) images and echocardiographic temporal image sequences. Comprehensive design of a three-dimensional (3-D) active appearance model (AAM) is reported for the first time as an involved extension of the AAM framework introduced by Cootes et al. The model's behavior is learned from manually traced segmentation examples during an automated training stage. Information about shape and image appearance of the cardiac structures is contained in a single model. This ensures a spatially and/or temporally consistent segmentation of three-dimensional cardiac images. The clinical potential of the 3-D AAM is demonstrated in short-axis cardiac MR images and four-chamber echocardiographic sequences. The method's performance was assessed by comparison with manually identified independent standards in 56 clinical MR and 64 clinical echo image sequences. The AAM method showed good agreement with the independent standard using quantitative indexes of border positioning errors, endo- and epicardial volumes, and left ventricular mass. In MR, the endocardial volumes, epicardial volumes, and left ventricular wall mass correlation coefficients between manual and AAM were R/sup 2/=0.94,0.97,0.82, respectively. For echocardiographic analysis, the area correlation was R/sup 2/=0.79. The AAM method shows high promise for successful application to MR and echocardiographic image analysis in a clinical setting.
---
paper_title: Computer Assisted Human Follicle Analysis for Fertility Prospects with 3D Ultrasound

paper_content:

Knowledge about the status of the female reproductive system is important for fertility problems and age-related family planning. The volume of these fertility requests in our emancipated society is steadily increasing. Intravaginal 3D ultrasound imaging of the follicles in the ovary gives important information about the ovarian aging, i.e. number of follicles, size, position and response to hormonal stimulation. Manual analysis of the many follicles is laborious and error-prone. We present a multiscale analysis to automatically detect and quantify the number and shape of the patient's follicles. Robust estimation of the centres of the follicles in the speckled echographic images is done by calculating so-called winding number of the intensity singularity, i.e. the path integral of the angular increment of the direction of the gradient vector over a closed neighbourhood around the point. The principal edges on 200-500 intensity traces radiating from the detected singularity points are calculated by a multiscale edge focussing technique on 1D winding numbers. They are fitted with 3D spherical harmonic functions, from which the volume and shape parameters are derived.
---
paper_title: 2D+T acoustic boundary detection in echocardiography

paper_content:

Abstract In this paper we address the problem of spatio-temporal acoustic boundary detection in echocardiography. We propose a phase-based feature detection method to be used as the front end to higher-level 2D+T/3D+T reconstruction algorithms. We develop a 2D+T version of this algorithm and illustrate its performance on some typical echocardiogram sequences. We show how our temporal-based algorithm helps to reduce the number of spurious feature responses due to speckle and provides feature velocity estimates. Further, our approach is intensity-amplitude invariant. This makes it particularly attractive for echocardiographic segmentation, where choosing a single global intensity-based edge threshold is problematic.
---
paper_title: An interacting multiple model probabilistic data association filter for cavity boundary extraction from ultrasound images

paper_content:

This paper presents a novel segmentation technique for extracting cavity contours from ultrasound images. The problem is first discretized by projecting equispaced radii from an arbitrary seed point inside the cavity toward its boundary. The distance of the cavity boundary from the seed point is modeled by the trajectory of a moving object. The motion of this moving object is assumed to be governed by a finite set of dynamical models subject to uncertainty. Candidate edge points obtained along each radius include the measurement of the object position and some false returns. The modeling approach enables us to use the interacting multiple model estimator along with a probabilistic data association filter, for contour extraction. The convergence rate of the method is very fast because it does not employ any numerical optimization. The robustness and accuracy of the method are demonstrated by segmenting contours from a series of ultrasound images. The results are validated through comparison with manual segmentations performed by an expert. An application of the method in segmenting bone contours from computed tomography images is also presented.
---
paper_title: Endocardial Boundary E timation and Tracking in Echocardiographic Images using Deformable Template and Markov Random Fields

paper_content:

We present a new approach to shape-based segmentation and tracking of deformable anatomical structures in medical images, and validate this approach by detecting and tracking the endocardial contour in an echocardiographic image sequence. To this end, some global prior shape knowledge of the endocardial boundary is captured by a prototype template with a set of predefined global and local deformations to take into account its inherent natural variability over time. In this deformable model-based Bayesian segmentation, the data likelihood model relies on an accurate statistical modelling of the grey level distribution of each class present in the ultrasound image. The parameters of this distribution mixture are given by a preliminary iterative estimation step. This estimation scheme relies on a Markov Random Field prior model, and takes into account the imaging process as well as the distribution shape of each class present in the image. Then the detection and the tracking problem is stated in a Bayesian framework, where it ends up as a cost function minimisation problem for each image of the sequence. In our application, this energy optimisation problem is efficiently solved by a genetic algorithm combined with a steepest ascent procedure. This technique has been successfully applied on synthetic images, and on a real echocardiographic image sequence.
---
paper_title: Segmentation of kidney from ultrasound images based on texture and shape priors

paper_content:

This work presents a novel texture and shape priors based method for kidney segmentation in ultrasound (US) images. Texture features are extracted by applying a bank of Gabor filters on test images through a two-sided convolution strategy. The texture model is constructed via estimating the parameters of a set of mixtures of half-planed Gaussians using the expectation-maximization method. Through this texture model, the texture similarities of areas around the segmenting curve are measured in the inside and outside regions, respectively. We also present an iterative segmentation framework to combine the texture measures into the parametric shape model proposed by Leventon and Faugeras. Segmentation is implemented by calculating the parameters of the shape model to minimize a novel energy function. The goal of this energy function is to partition the test image into two regions, the inside one with high texture similarity and low texture variance, and the outside one with high texture variance. The effectiveness of this method is demonstrated through experimental results on both natural images and US data compared with other image segmentation methods and manual segmentation.
---
paper_title: Statistics of the log-compressed echo envelope.

paper_content:

Log compression of A lines to produce B-scan images in clinical ultrasound imaging systems is a standard procedure to control the dynamic range of the images. The statistics of such compressed images in terms of underlying scatterer statistics have not been derived. The statistics are analyzed for partially formed speckle using a general K distribution model of envelope statistics to derive the density function for the log-compressed envelope. This density function is used to elucidate the relation between the moments of the compressed envelope, the compression parameters, and the statistics of the scatterers. The analysis shows that the mean of the log-compressed envelope is an increasing function of both the backscattered energy and the effective scatterer density. The variance of the log-compressed envelope is a decreasing function of the effective scatterer density and is independent of the backscattered energy.
---
paper_title: Artificial neural networks and spatial temporal contour linking for automated endocardial contour detection on echocardiograms: a novel approach to determine left ventricular contractile function.

paper_content:

This study investigated the use of artificial neural networks (ANN) for image segmentation and spatial temporal contour linking for the detection of endocardial contours on echocardiographic images. Using a backpropagation network, the system was trained with 279 sample regions obtained from eight training images to segment images into either tissue or blood pool region. The ANN system was then applied to parasternal short axis images of 38 patients. Spatial temporal contour linking was performed on the segmented images to extract endocardial boarders. Left ventricular areas (end-systolic and end-diastolic) determined with the automated system were calculated and compared to results obtained by manual contour tracing performed by two independent investigators. In addition, ejection fractions (EF) were derived using the area-length method and compared with radionuclide ventriculography. Image quality was classified as good in 12 (32%), moderate in 13 (34%) and poor in 13 (34%) patients. The ANN system provided estimates of end-diastolic and end-systolic areas in 36 (89%) of echocardiograms, which correlated well with those obtained by manual tracing (R = 0.99, SEE = 1.44). A good agreement was also found for the comparison of EF between the ANN system and Tc-radionuclide ventriculography (RNV, R = 0.93, SEE = 6.36). The ANN system also performed well in the subset of patients with poor image quality. Endocardial contour detection using artificial neural networks and spatial temporal contour linking allows accurate calculations of ventricular areas from transthoracic echocardiograms and performs well even in images with poor quality. This system could greatly enhance the feasibility, accuracy and reproducibility of calculating cardiac areas to derive left ventricular volumes and ejection fractions.
---

Title: Ultrasound Image Segmentation: A Survey

Section 1: Classification by Clinical Application
Description 1: Discusses the various papers classified by their clinical application. Highlights significant areas like cardiology, breast cancer, prostate, IVUS (vascular disease), and obstetrics and gynecology.

Section 2: Validation/Quantitative Performance Assessment
Description 2: Summarizes the methods used for validating and assessing the quantitative performance of ultrasound image segmentation techniques. Considers simulation, phantom studies, and clinical data.

Section 3: What Makes a Good Ultrasound Segmentation Method?
Description 3: Examines the characteristics of effective ultrasound segmentation methods, emphasizing the importance of task-specific constraints or priors.

Section 4: Priors
Description 4: Details the use of different types of priors such as speckle as a feature, gray level distribution, intensity gradient, phase, similarity measures, and texture measures in segmentation methods.

Section 5: Time
Description 5: Discusses the use of temporal priors in segmentation, particularly in applications like cardiac segmentation where motion must be accounted for.

Section 6: Conclusion
Description 6: A summarizing section that lists ten influential papers in the field to highlight the various methods and their contributions to ultrasound image segmentation. Provides final comments on open issues and future directions.