A Deep CNN-Based Approach For Joint Image Compression And Segmentation

Authors

  • Dr.Tamilarasi M Associate Professor, Department of Electronics and Communication Engineering, PGP College of Engineering and Technology,Namakkal, Tamilnadu, India.Orcid Number : 0000-0002-3951-6157
  • Dr. Akbar khan Professor & principal,ECE dept, Nimra College of Engineering and Technology Vijayawada,Andhra Pradesh
  • Jiashu Hu Research Scholar,Department of Engineering,Johns Hopkins University, Baltimore, Maryland, United States.ORCID iD: 0009-0004-3095-0426
  • Dr.C. Balaji SRM Institute of Science and Technology Tiruchirappalli,Tamilnadu,India.Orchid Id : 0009-0002-5892-5498
  • Divya Dwivedi Gaur Research Scholar,Lingyaas University( Department of commerce and Management and school of commerce and Management), Lingyaas University Faridabad, Haryana, India.
  • Dr. Prabal Chakraborty Professor, Lingaya's Vidyapeeth, Faridabad Haryana, India
  • Sanatan Ratna Assistant Professor,Department of Mechanical Engineering, ASET , Amity University Noida, Uttar Pradesh,India.ORCID iD: https://orcid.org/0000-0001-8732-5606

DOI:

https://doi.org/10.29284/v7jxxg75

Keywords:

Deep Convolutional Neural Network, Joint Learning, Image Compression, Semantic Segmentation, Multi-Task Optimization

Abstract

The rapid proliferation of high-resolution imaging devices across medical diagnostics, remote sensing, autonomous systems, and multimedia platforms has intensified the demand for efficient storage and intelligent interpretation of visual data. Conventional image compression and segmentation techniques are typically addressed as independent tasks: compression focuses on reducing redundancy for storage and transmission efficiency, while segmentation aims to extract semantically meaningful regions for analysis. However, separating these processes often results in redundant computations, suboptimal feature utilization, and potential degradation of structural information critical for downstream vision tasks. This study proposes a unified deep convolutional neural network (CNN)-based framework designed to perform joint image compression and segmentation within a single end-to-end architecture. The proposed approach integrates an encoder–decoder compression backbone with a parallel segmentation head that shares intermediate feature representations. The encoder learns compact latent embeddings that preserve both perceptual fidelity and semantic relevance, while the decoder reconstructs compressed images with minimal distortion. Simultaneously, the segmentation branch leverages multi-scale feature maps extracted during encoding to generate accurate pixel-wise classification maps. A hybrid loss function is formulated to balance rate–distortion optimization with segmentation accuracy, ensuring that compression efficiency does not compromise structural boundary preservation. To enhance robustness, attention modules and residual connections are incorporated to retain fine-grained spatial details, particularly in high-frequency regions that are typically vulnerable to compression artifacts. Extensive experimentation is conducted on benchmark datasets representing natural and domain-specific images to evaluate reconstruction quality, compression ratio, and segmentation performance. The results demonstrate that the joint framework achieves competitive compression rates while maintaining superior segmentation accuracy compared to traditional sequential pipelines. Quantitative metrics such as peak signal-to-noise ratio, structural similarity index, and mean intersection-over-union confirm that shared feature learning improves both tasks simultaneously. Furthermore, the integrated architecture reduces computational redundancy and inference time, making it suitable for real-time and resource-constrained environments such as edge devices and embedded systems. The findings highlight the potential of multi-task deep learning models to bridge the gap between data efficiency and semantic understanding. By embedding segmentation awareness into the compression process, the proposed CNN-based approach not only preserves visually significant content but also enhances task-oriented image representation. This research contributes to the advancement of intelligent visual processing systems, offering a scalable and adaptive solution for applications requiring simultaneous compression and analytical interpretation.

References

1. Agustsson, Eirikur, et al. “High-Fidelity Generative Image Compression.” Advances in Neural Information Processing Systems, vol. 33, 2020, pp. 2935–2946.

2. Ballé, Johannes, David Minnen, Saurabh Singh, Sung Jin Hwang, and Nick Johnston. “Variational Image Compression with a Scale Hyperprior.” International Conference on Learning Representations, 2018.

3. Badrinarayanan, Vijay, Alex Kendall, and Roberto Cipolla. “SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 12, 2017, pp. 2481–2495.

4. Cheng, Zhengxue, Heming Sun, Masaru Takeuchi, and Jiro Katto. “Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modules.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 7939–7948.

5. He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. “Deep Residual Learning for Image Recognition.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 770–778.

6. Huang, Gao, Zhuang Liu, Laurens van der Maaten, and Kilian Q. Weinberger. “Densely Connected Convolutional Networks.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 4700–4708.

7. Isola, Phillip, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. “Image-to-Image Translation with Conditional Adversarial Networks.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 1125–1134.

8. Kendall, Alex, Vijay Badrinarayanan, and Roberto Cipolla. “Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding.” BMVC, 2017.

9. Kingma, Diederik P., and Jimmy Ba. “Adam: A Method for Stochastic Optimization.” International Conference on Learning Representations, 2015.

10. Liu, Zihao, Xiaowei Xu, Tao Liu, and Shuaicheng Liu. “Machine Vision Guided 3D Medical Image Compression for Efficient Transmission and Accurate Segmentation in the Clouds.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019, pp. 1–9.

11. Long, Jonathan, Evan Shelhamer, and Trevor Darrell. “Fully Convolutional Networks for Semantic Segmentation.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 3431–3440.

12. Mentzer, Fabian, George Toderici, Michael Tschannen, and Eirikur Agustsson. “High-Fidelity Learned Image Compression.” Advances in Neural Information Processing Systems, vol. 33, 2020, pp. 11913–11924.

13. Minnen, David, Johannes Ballé, and George D. Toderici. “Joint Autoregressive and Hierarchical Priors for Learned Image Compression.” Advances in Neural Information Processing Systems, vol. 31, 2018, pp. 10771–10780.

14. Oktay, Ozan, et al. “Attention U-Net: Learning Where to Look for the Pancreas.” Medical Imaging with Deep Learning, 2018, pp. 1–10.

15. Paszke, Adam, et al. “PyTorch: An Imperative Style, High-Performance Deep Learning Library.” Advances in Neural Information Processing Systems, vol. 32, 2019, pp. 8026–8037.

16. Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” Medical Image Computing and Computer-Assisted Intervention, 2015, pp. 234–241.

17. Rippel, Oren, and Lubomir Bourdev. “Real-Time Adaptive Image Compression.” International Conference on Machine Learning, 2017, pp. 2922–2930.

18. Sandler, Mark, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. “MobileNetV2: Inverted Residuals and Linear Bottlenecks.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 4510–4520.

19. Simonyan, Karen, and Andrew Zisserman. “Very Deep Convolutional Networks for Large-Scale Image Recognition.” International Conference on Learning Representations, 2015.

20. Szegedy, Christian, et al. “Going Deeper with Convolutions.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 1–9.

21. Toderici, George, et al. “Full Resolution Image Compression with Recurrent Neural Networks.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 5306–5314.

22. Wang, Zhou, Alan C. Bovik, Hamid R. Sheikh, and Eero P. Simoncelli. “Image Quality Assessment: From Error Visibility to Structural Similarity.” IEEE Transactions on Image Processing, vol. 13, no. 4, 2004, pp. 600–612.

23. Woo, Sanghyun, Jongchan Park, Joon-Young Lee, and In So Kweon. “CBAM: Convolutional Block Attention Module.” Proceedings of the European Conference on Computer Vision, 2018, pp. 3–19.

24. Xie, Saining, Ross Girshick, Piotr Dollár, Zhuowen Tu, and Kaiming He. “Aggregated Residual Transformations for Deep Neural Networks.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 1492–1500.

25. Yu, Fisher, and Vladlen Koltun. “Multi-Scale Context Aggregation by Dilated Convolutions.” International Conference on Learning Representations, 2016.

26. Zhao, Hengshuang, et al. “Pyramid Scene Parsing Network.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 2881–2890.

27. Zoph, Barret, and Quoc V. Le. “Neural Architecture Search with Reinforcement Learning.” International Conference on Learning Representations, 2017.

28. Johnston, Nick, et al. “Improved Lossy Image Compression with Priming and Spatially Adaptive Bit Rates for Recurrent Networks.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 4385–4393.

29. Chen, Liang-Chieh, et al. “Rethinking Atrous Convolution for Semantic Image Segmentation.” arXiv preprint, 2017.

30. Dosovitskiy, Alexey, et al. “An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale.” International Conference on Learning Representations, 2021.

Downloads

Published

2026-03-09

Issue

Section

Articles

How to Cite

[1]
D. M, “A Deep CNN-Based Approach For Joint Image Compression And Segmentation”, IJASIS, pp. 343–355, Mar. 2026, doi: 10.29284/v7jxxg75.

Share