Logo image
Chaos to Clarity with Semantic Inferencing for Python Source Code Snippets
Conference proceeding

Chaos to Clarity with Semantic Inferencing for Python Source Code Snippets

Aviel Stein and Spiros Mancoridis
2023 IEEE 17th International Conference on Semantic Computing (ICSC), pp 161-166
Feb 2023

Abstract

Analytical models Codes Computational modeling deep learning Filtering Measurement natural language semantic inference source code analysis Source coding structured data Semantics
Our work investigates using semantic indicators in source code to generate descriptions of its functionality. We applied natural language processing (NLP) techniques to improve the performance of a neural machine translation (NMT) model on source code. We trained the model on 20,000 code-comment pairs from the Source Code Analysis Dataset (SCAD) using a custom Python source code tokenizer and a learning model with attention, RNNs, LSTMs, and auto-encoders. We evaluated the model's performance on a hold-out dataset using several established translation metrics, and found that our methods outperform prior work with a mean Bilingual Evaluation Understudy (BLEU) score of 0.47.

Metrics

Details

Logo image