Tencent's Hy Pushes AI Beyond Language With Advanced Speech Recognition and Fully Editable 3D Worlds

The rapid evolution of AI continues to reshape how systems interpret human input and construct useful outputs across different modalities. 

Advances that once focused primarily on isolated language processing are now extending into more integrated capabilities that handle spoken language with greater accuracy and generate complex spatial environments that users can explore and modify. 

Recent releases from Tencent's Hy team illustrate this progression through complementary tools that share underlying strengths in reasoning and agentic processes while addressing distinct practical needs.

At the center of these efforts stands 'Hy3,' the latest foundation language model in the series. 

Built as a mixture of experts system with 295 billion total parameters and only 21 billion activated during inference, it supports a context window of up to 256 thousand tokens. 

The design incorporates hybrid fast and slow thinking modes that allow it to adapt the depth of computation according to the demands of a given task. 

Official evaluations and internal testing highlight gains in complex reasoning, instruction following, coding, and long context handling, with performance that approaches results from models several times larger in parameter count. 

The model has been integrated into Tencent products such as WorkBuddy and CodeBuddy for productivity workflows, where it supports multi step agent tasks including document generation, data analysis, and tool orchestration. 

Global availability through APIs on Tencent Cloud TokenHub and third party platforms, released under an Apache 2.0 license, emphasizes cost efficiency alongside reliability, with reported reductions in hallucination rates and improved multi turn consistency compared to earlier versions.

This language capability directly informs the design of 'Hy ASR 3.0,' the speech recognition system released as a preview in early August. 

Explicitly powered by the semantic understanding of Hy3, the model combines precise acoustic recognition with deeper contextual interpretation. Benchmark results on open and internal test sets show multilingual word error rates near three percent overall, including 3.34% for Mandarin Chinese, 2.62% for English, and 3.12% for Cantonese. 

Strengths appear in general recognition accuracy, awareness of surrounding conversational context, robustness across noisy or varied acoustic environments, and coverage of dialects. 

Rather than producing isolated word sequences, the system aims to generate coherent transcripts that better reflect intended meaning, even when audio contains background interference or informal speech patterns. 

Early deployment through cloud services and consumer applications such as Yuanbao allows users to experience improved voice input for everyday interactions, customer service scenarios, and content transcription.

Extending agentic methods into three dimensional space, 'Hy3D WorldClaw' represents a further application of structured planning and refinement. 

Introduced as a fully agentic coarse to fine framework, it converts open ended text prompts into large scale, freely explorable open worlds constructed entirely from editable game ready assets that feature high quality geometry and textures. 

The process begins with planning agents that analyze the prompt and produce a structured specification covering regions, terrain constraints, object placements, materials, and spatial relationships. 

A globally coherent terrain foundation is then assembled using semantic layout maps, reusable asset prototypes, generative or procedural materials, and a region aware height field shaped by geomorphic operators. 

For regions requiring finer detail the system generates terrain conditioned compositions, reconstructs editable textured meshes, recovers precise placement and orientation on the terrain surface, and applies iterative refinement through render based agents that inspect and adjust appearance, contacts, scale, and alignment. 

The resulting scenes maintain consistent global structure while delivering rich local content that supports free viewpoint navigation, instance level editing, and direct integration into standard pipelines for rendering, animation, or game engines. 

Unlike approaches that rely on video synthesis or Gaussian splatting, the outputs consist of explicit meshes and materials that remain fully modifiable after generation.

Viewed together these systems demonstrate a consistent emphasis on practical utility. 

Hy3 supplies the core reasoning and agent capabilities that enable more reliable planning and interpretation. Hy ASR 3.0 applies that foundation to the challenges of real world audio, turning spoken language into usable text with greater fidelity to intent. WorldClaw shows how the same agentic principles can scale into the construction of coherent interactive environments that go beyond static generation. 

The combination points toward tools that increasingly support multimodal workflows spanning conversation, transcription, and spatial creation, with each component designed for integration into existing creative and productive processes.

Published