TII’s Falcon H1R 7B can out-reason models up to 7x its size — and it’s (mostly) open

According to TII’s technical report, the hybrid approach allows Falcon H1R 7B to maintain high throughput even as response ...
SiliconANGLE

IBM releases Granite 4 series of Mamba-Transformer language models

IBM Corp. on Thursday open-sourced Granite 4, a language model series that combines elements of two different neural network architectures. The algorithm family includes four models on launch. They ...
SiliconANGLE

AI21 Labs’ Jamba infuses Mamba to bring more context to transformer-based LLMs

Generative artificial intelligence startup AI21 Labs Ltd., a rival to OpenAI, has unveiled what it says is a groundbreaking new AI model called Jamba that goes beyond the traditional transformer-based ...
EurekAlert!

KAIST develops an AI semiconductor brain combining transformer's intelligence and mamba's efficiency

As recent Artificial Intelligence (AI) models’ capacity to understand and process long, complex sentences grows, the necessity for new semiconductor technologies that can simultaneously boost ...