Tencent’s HY4 is an open-weight AI model that combines efficiency with advanced computational design, as highlighted by World of AI. It features 770 billion parameters, with only 49 billion active at any time, thanks to its Mixture of Experts (MoE) architecture. This approach ensures optimized resource use while maintaining high performance. Additionally, its 1 million […]
The post Tencent HY4 Brings 1 Million Token Context to Apache 2.0 appeared first on Geeky Gadgets.