prannesshkva

Ael-504M: A Sub-Billion Parameter Hybrid Mamba-2 and Delta-Attention Any-to-Any Multimodal Architecture

Ael-504M is a sub-billion parameter (504M) multimodal foundation model designed for on-device reasoning and cross-sensory synthesis. The architecture features a 24-layer hybrid backbone integrating Mamba-2 State Space Duality (SSD) with Rotary Delta-Attention (RDA), backed by 8-E...

Ael-504M: A Sub-Billion Parameter Hybrid Mamba-2 and Delta-Attention Any-to-Any Multimodal Architecture

Ael-504M is an original sub-billion parameter multimodal foundation model engineered for high-throughput on-device reasoning and cross-sensory synthesis. Key Architectural Innovations: Dual-Brain Sequence Modeling: Interleaves Mamba-2 State Space Duality (SSD) for continuous O(L)...