Heterogeneous remote sensing change detection (HRSCD) is pivotal for disaster emergency monitoring and national geographic surveying. However, the inherent discrepancies in imaging mechanisms between optical and synthetic aperture radar (SAR) sensors often lead to pseudo-changes and blurred semantic boundaries in existing methods. To address these issues, this paper presents an Adaptive Dual-stream Enhanced Network (ADEN). First, a weight-sharing feature extraction module is employed to extract hierarchical multi-scale features from bi-temporal heterogeneous images. Subsequently, to bridge the modality gap, a Hierarchical Alignment Module (HAM) is designed to progressively fuse multi-dimensional information, achieving layer-wise alignment from shallow feature space to semantic space. Finally, a Multi-scale Feature Decoder (MFD) performs multi-level feature decoding to precisely identify change regions. Experiments conducted on five benchmark heterogeneous datasets demonstrate that ADEN effectively suppresses pseudo-changes and yields sharper boundary identification. The proposed method achieves a mean Intersection over Union (mIoU) of 83.32%, which is 3.5% higher than the second-best approach. This study provides a solution for HRSCD. The source code and datasets are available at https://github.com/1234qiancheng1234/ADEN.