Handwritten Bangla Name Recognition & XAI
An interpretable transfer learning pipeline on custom self-curated handwritten Bangla script, featuring ResNet50 (83.89% test accuracy), Grad-CAM heatmaps, and local LIME explanations.
Project Overview
Bangla handwriting exhibits rich cursive geometry, intricate vowel-sign attachments (kar/fola), and high intra-writer variation, making automated transcription a non-trivial optical character and word recognition challenge.
This research engineered an end-to-end recognition architecture utilizing transfer learning across deep convolutional representations. In addition to achieving competitive test accuracy (83.89%), the project places explainability at the center: utilizing Grad-CAM to visualize neural attention maps and LIME to generate interpretable visual attributions that reveal which structural strokes governed the classifier's decisions.
Key Features
ResNet50 Deep Backbone
Leverages deep residual bottlenecks with specialized fine-tuning layers and adaptive learning rate schedulers to capture multi-scale stroke patterns.
Grad-CAM Spatial Heatmaps
Extracts gradients entering the final convolutional layer to project dense heatmaps over cursive characters, verifying focal attention on phonemic roots.
Local LIME Explanations
Partitions handwritten samples into superpixels to inspect which positive and negative segments drove category logit probabilities.
Curated Dataset & Augmentation
Constructed with an extensive custom dataset featuring multi-writer samples subjected to affine shear, morphological dilation, and elastic deformations.