This paper aims to enhance the image quality in ultrasound images. The significant difficulties in the ultrasound image are the presence of speckle noise. Speckle is the granular noise, and this kind of noise produces a lot of challenges during medical diagnosis. Also, these kinds of problems degrade image quality. The proposed work overcomes this kind of issue with nonsubsampled contourlet domain-based cross-guided bilateral filtering. Initially, additive speckle noise is introduced with the log-transformed Rayleigh distribution. This additive speckle noise component is to be decomposed through the non-subsampled contourlet domain transform. Then the decomposed image is despeckled by the cross-guided bilateral filter, and the cost function of this filter is minimized through adaptive galactic swarm optimization. The proposed filtering technique despeckles the additive noise in the noisy image. Finally, the decomposed image is reconstructed using the inverse transform of the nonsubsampled decomposition. The implementation of the proposed methodology is carried out in MATLAB simulation platform. Also, the performance of the proposed work is measured by few metrics such as structural similarity index matrix, mean structural similarity index matrix, mean square error, peak signal to noise ratio, Bhattacharyya coefficient, and speckle index. The result of cost function optimization provides less distortion when compared to other techniques. © 2020 Wiley Periodicals LLC