As global AI development escalates with trillion-parameter models, Chinese start-ups emphasize smaller, localized models designed for on-device use, promising faster processing, enhanced privacy, and lower costs.
- Chinese start-ups develop smaller AI models running entirely on devices.
- ModelBest’s valuation hits 20 billion yuan after major funding.
- Apple collaborates with Chinese firms to enhance on-device AI capabilities.
What happened
Amid a global focus on massive AI models that require extensive cloud infrastructure, Chinese technology companies are exploring a parallel path centered on lightweight AI models that can operate entirely on consumer devices like smartphones and laptops. This approach minimizes reliance on cloud data centers, enabling localized AI processing with reduced latency and improved data privacy. Start-ups such as ModelBest and StepFun are at the forefront, developing models and devices that showcase these capabilities.
ModelBest recently secured over 5 billion yuan ($738 million) in funding this year, pushing its valuation to 20 billion yuan. Meanwhile, StepFun unveiled the StepX Neo, billed as the world’s first 'agentic smartphone,' equipped with autonomous AI agents to perform complex user tasks independently. StepFun also launched Step Edge, a suite of on-device AI models offering ultra-low latency and reliable performance even with limited connectivity.
Why it matters
The rise of small, device-optimized AI models reflects a strategic shift influenced by China’s ambition for technological self-sufficiency, especially amidst challenges faced by domestic AI hardware in training extremely large models. Lightweight models are more compatible with existing Chinese AI chips, fueling innovation in locally processed artificial intelligence and reducing dependence on foreign cloud services.
This localized AI evolution aligns with global privacy and efficiency trends, permitting faster decision-making directly on user devices and enhancing protection of sensitive data. The strong financial backing for companies like ModelBest indicates growing investor confidence in edge AI's potential to reshape how AI is deployed and consumed, with significant implications for consumer tech and enterprise applications.
What to watch next
Industry observers should monitor the upcoming product launches and market entries of on-device AI technologies, particularly from StepFun and ModelBest, as well as how Apple integrates Chinese AI models like Alibaba's Qwen series into its local services. Apple’s recent license to operate its Apple Intelligence service in China and collaboration with domestic AI providers mark a critical juncture in device-based AI adoption.
Additionally, attention should focus on the advancements in hardware such as Huawei's Ascend chips which support training and deploying on-device models. The interaction between large-scale cloud AI development and the push for efficient, privacy-preserving edge AI in China will likely influence global AI strategies and competitive dynamics going forward.