当前位置: 首页 / 文章 / 正文

赛轮思AI与联发科合作推出基于英伟达技术的端侧多模态语言模型

代理稿件

车讯网 报道】  在端侧配备智能护栏功能的多模态模型可实现更无缝、更安全的车内交互,解锁强大功能,远超单纯的信息娱乐体验

  上海及马萨诸塞州伯灵顿,2025年4月23日——Cerence Inc.(NASDAQ: CRNC)(“赛轮思AI”),全球对话式AI用户体验创新的领导者,今日宣布与联发科(MediaTek)达成全新战略合作关系,并扩大与英伟达(NVIDIA)的现有合作,共同推出下一代CaLLM™ Edge,一款专为汽车用户交互体验设计的嵌入式小语言模型(Small Language Model,SLM)。凭借由NVIDIA AI Enterprise软件驱动的全新多模态功能,CaLLM Edge将使车内交互比以往任何时候都更智能、更具感知能力、更人性化、更安全。这款多模态端侧小语言模型(SLM)已无缝集成到Cerence xUI™——全新一代端云混合、智能体化的AI平台,并将于2025上海车展上首次亮相。

赛轮思AI与联发科合作推出基于英伟达技术的端侧多模态语言模型

  此次发布的信息源于联发科与英伟达的持续合作,联发科的汽车级天玑汽车座舱芯片组集成了英伟达的GPU、人工智能和图形技术。如今,这两家公司已与赛轮思AI携手推出多模态端侧解决方案,为汽车制造商提供卓越性能并具有成本效益,同时为驾驶者和乘客解锁强大的新功能。利用联发科的汽车座舱解决方案,并率先在NVIDIA DRIVE AGX上进行优化,CaLLM Edge的先进多模态功能通过双处理平台,针对车内部署进行高效率微调,实现了车内车外的全新情境感知。

赛轮思AI与联发科合作推出基于英伟达技术的端侧多模态语言模型

  联发科展台上展示由赛轮思AI 提供技术的车载AI语音助理

赛轮思AI与联发科合作推出基于英伟达技术的端侧多模态语言模型

  赛轮思AI产品与技术执行副总裁Nils Schanz(左四)和联发科企业副总裁兼汽车业务总经理Mike Chang(左五)在上海车展现场

  上海车展标志着Cerence xUI首次在NVIDIA DRIVE AGX上运行,并集成到模拟量产的汽车设计中,该设计复制了实车的多座环境,为驾驶者和乘客带来无缝、个性化的交互体验。关键创新包括:

  车内智能提升——想象一下,您的汽车能感知到您何时在与它交谈,何时没有。您可以要求推荐意大利餐厅,然后问乘客:“第二家怎么样?”车载助理会知道要等待,再继续对话。此外,它还能同时处理驾驶者和乘客的指令,例如,“打开我的车窗”,随后说“我也要”。或者,想象一下,您的汽车可以在您短途旅行时照看您的宠物,或者在您驾驶时回答有关后座小孩的情况。

  车外情境感知增强——想象一下,一个助理不仅能提供车内信息,还能提供车外世界的信息。例如,它能解释或翻译路标,识别路边建筑,甚至提供有关广告牌上有趣事物的详细信息。Cerence xUI可以结合汽车传感器数据以及内部和外部摄像头视频流,利用CaLLM Edge多模态SLM,在端侧实现实时输入处理——所有这些应用场景都将首次在上海车展上展示。

  端侧智能护栏——赛轮思AI已针对NVIDIA DRIVE AGX平台开发了优化的汽车智能护栏技术,该技术整合了NVIDIA NeMo Guardrails功能,确保其驱动的系统在连接条件受限时,仍能安全可靠地提供品牌专属的车内交互体验。这些智能防护机制有助于最大程度减少分心、防止误用,并确保语音交互始终保持情境感知且符合安全规范。

  除了这些为驾驶者带来的新功能外,CaLLM Edge还为汽车制造商提供了关键优势。多模态处理的主要工作在端侧完成,这意味着所需的云端带宽更少,汽车制造商成本更低。此外,使驾驶者能够访问车外信息,并提供先进的生成式人工智能功能,为车企解锁了新的订阅服务和收入来源。

  赛轮思AI产品与技术执行副总裁 Nils Schanz 表示:“随着我们不断突破CaLLM系列云端和嵌入式语言模型的极限,我们继续提升满足各种汽车制造商及其特定信息娱乐平台需求的能力。通过与联发科和英伟达合作,我们为CaLLM Edge注入了实时感知和情境感知能力,重新定义了车内体验。”

  联发科企业副总裁兼汽车业务总经理Mike Chang表示:“赛轮思AI的CaLLM Edge与联发科天玑汽车平台的结合,为车辆中强大的多模态、生成式人工智能驱动体验奠定了坚实基础。联发科天玑汽车平台在端侧支持Cerence LLM和SLM,而我们新推出的配备双AI引擎的C-X1非常适合可靠地同时运行多个AI任务。这一合作是我们汽车生态系统的重要补充,将使全球汽车品牌能够自信地加速下一代设计。”

  英伟达汽车业务副总裁Rishi Dhall表示: “赛轮思AI与联发科的合作基于公司部署NVIDIA人工智能和加速计算以提升整体车内体验。双方合作使汽车制造商能够更好地控制语音体验的定制,而端侧NVIDIA NeMo护栏的集成在安全、可扩展的车内人工智能可成为新的行业标杆。”

  赛轮思AI于4月23日至5月2日在上海车展上与联发科和英伟达共同展示其产品。感兴趣的参观者可以在8.2号馆8BD002号展台体验Cerence xUI 实车演示。该解决方案将在联发科展台——8.2号馆8BE006号展台上展示。

  如需了解更多关于赛轮思AI的信息,请访问www.cerence.ai 或www.cerence.cn 。

  关于Cerence Inc.

  赛轮思(Cerence Inc,NASDAQ: CRNC)是全球汽车行业及移动出行领域在创造直观、无缝且基于人工智能的用户体验方面的领导者。凭借超过二十五年在语音、生成式AI与大语言模型领域的创新成果和技术优势,赛轮思为驾驶者与乘客精心打造了集成的车载体验,使每一次出行都更加安全、互联和愉悦。至今,已有逾 5亿辆汽车采用了赛轮思技术。赛轮思与全球顶尖的汽车制造商、移动出行OEM及科技领军企业紧密合作,共同推动下一代用户体验的发展。赛轮思中国总部设于上海,公司业务遍布全球,其全球团队致力于持续突破人工智能的创新边界。如欲了解更多信息,请访问www.cerence.ai或www.cerence.cn。

  此新闻稿为翻译本,所有内容以Cerence英文版新闻稿为准。

媒体查询,请联系:

Kate Hickman | 电话: 339-215-4583 | 电邮: kate.hickman@cerence.com

席莹| 电话: 131 2183 1378 | 电邮: sally@gedyinc.com

 

  Cerence AI and MediaTek Partner to Introduce Multi-Modal Language Models Running on the Edge, Built on NVIDIA

  Multi-modal models with smart guardrailing at the edge enable more seamless and safer in-car interactions, unlocking powerful capabilities that go far beyond pure infotainment

  SHANGHAI andBURLINGTON, Mass.,April23, 2025– Just ahead of Auto Shanghai 2025, Cerence Inc. (NASDAQ: CRNC) (“Cerence AI”), a global leader pioneering conversational AI-powered user experiences, today announced a new partnership with MediaTek and expanded collaboration with NVIDIA to deliver the next generation of CaLLM™ Edge, its embedded small language model (SLM) purpose-built for automotive user experiences. With new multi-modal capabilities powered by NVIDIA AI Enterprise software, CaLLM Edge will now make in-car interactions smarter, more perceptive, more human, far safer and more secure than ever. This multi-modal edge SLM is seamlessly integrated into Cerence xUI™, the company’s hybrid cloud/embedded agentic AI platform, and will be showcased for the first time at Auto Shanghai 2025.

  Today’s announcement stems from an ongoing collaboration between MediaTek and NVIDIA, with MediaTek’s automotive-grade Dimensity Auto Cockpit chipsets integrating NVIDIA’s GPU, AI, and graphics technologies. Now, the companies have teamed with Cerence AI on a multi-modal edge solution that delivers top performance and cost efficiency for automakers and unlocks powerful new features for drivers and passengers. Leveraging MediaTek’s automotive cockpit solution and optimized first on NVIDIA DRIVE AGX, CaLLM Edge’s advanced multi-modal capabilities are fine-tuned for in-vehicle deployment and high efficiency via a dual processing platform, delivering a new level of contextual awareness – both inside and outside the vehicle.

  Auto Shanghai marks the first public demonstration of Cerence xUI running on NVIDIA DRIVE AGX, integrated into a production-ready automotive reference design that replicates a real car’s multi-seat environment, enabling seamless, personalized interaction for drivers and passengers alike. Key innovations include:

  Increased intelligence inside the car–Imagine your car knows when you’re talking to it – and when you’re not. You could ask for recommendations for Italian restaurants, then ask your passenger: “What about the second one?” – and the assistant knows to wait to jump back into the conversation. Plus, the assistant can take direction from driver and passengers at the same time – for example, “Open my window,” followed by “Same for me.” Or, imagine your car can keep an eye on your pet while you run a short errand, or, while you’re driving, answer questions about how your toddler is doing in the back seat.

  Additional context from outside the car– Imagine an assistant that provides information about not only what is inside the vehicle, but also in the world outside. For example, it can explain or translate road signs, identify roadside buildings, and even offer details about something interesting spotted on a billboard. Cerence xUI can leverage car sensor data and both interior and exterior camera feeds in combination with the CaLLM Edge multi-modal SLM, enabling streaming input on the edge – all of which will be shown for the first time at Auto Shanghai.

  Smartguardrailingon the edge– Cerence AI has developed automotive guardrails optimized for NVIDIA DRIVE AGX, helping ensure Cerence-powered systems can safely and reliably handle the nuances of brand-specific in-car interaction, even in conditions with limited connectivity. As part of its comprehensive hybrid architecture, Cerence AI will be delivering this embedded guardrail with NVIDIA NeMo Guardrails, both to complement its cloud variant as well as help minimize distractions, prevent misuse, and ensure voice interactions stay context-aware and compliant with safety norms.

  Beyond these new capabilities for drivers, CaLLM Edge also offers key benefits for automakers. The heavy lifting of the multi-modal processing happens at the edge, meaning less cloud bandwidth required and reduced costs for OEMs. In addition, enabling drivers to access information outside the car and delivering advanced, generative AI-powered features unlocks new subscription-based services and revenue streams for OEMs.

  “As we continue to push the limits of our CaLLM family of cloud and embedded language models, we continue to improve our ability to meet the needs of a wide variety of automakers and their specific infotainment platforms,” said Nils Schanz, EVP, Product & Technology, Cerence AI. “By teaming with MediaTek and NVIDIA, we’ve supercharged CaLLM Edge with real-time perception and contextual awareness that redefines the in-vehicle experience.”

  “The combination of Cerence’s CaLLM Edge with MediaTek Dimensity Auto platforms creates an incredible foundation for powerful multi-modal, generative AI-driven experiences in vehicles,” said Mike Chang, Corporate Vice President and General Manager of Automotive Business of MediaTek. “MediaTek Dimensity Auto supports both Cerence’s LLM and SLM on the edge, and our new C-X1 featuring dual AI engines is ideal for the task of reliably running multiple AI tasks simultaneously. This partnership is a key addition to our automotive ecosystem and will enable global automotive brands to accelerate their next-generation designs in confidence.”

  “Cerence’s collaboration with MediaTek builds on the company’s work to deploy NVIDIA AI and accelerated compute to improve the overall in-vehicle experience,” said Rishi Dhall, Vice President of Automotive at NVIDIA. “The work now gives automakers greater control to customize voice experiences, and our work to integrate NVIDIA NeMo Guardrails at the edge has the power to set a new industry benchmark in the evolution of safe, scalable in-car AI.”

  Cerence AI will demonstrate its offering with MediaTek and NVIDIA at Auto Shanghai, taking place April 23-May 2. Interested attendees can experience Cerence xUI in action in Hall 8.2, booth number 8BD002. The solution will also be shown at MediaTek’s booth, also in Hall 8.2, at booth number 8BE006.

  To learn more about Cerence AI, visit www.cerence.ai, and follow the company on LinkedIn.

  About CerenceInc.

  Cerence Inc. (NASDAQ: CRNC) is a global industry leader in creating intuitive, seamless, AI-powered experiences across automotive and transportation. Leveraging decades of innovation and expertise in voice, generative AI, and large language models, Cerence powers integrated experiences that create safer, more connected, and more enjoyable journeys for drivers and passengers alike. With more than 500 million cars shipped with Cerence technology, the company partners with leading automakers, transportation OEMs, and technology companies to advance the next generation of user experiences. Cerence is headquartered in Burlington, Massachusetts, with operations globally and a worldwide team dedicated to pushing the boundaries of AI innovation. For more information, visit www.cerence.ai.

责任编辑:王晶莹

分享到

评论
评论
0 / 500 字
猜你喜欢
热门PGC 查看更多
  • 全部拆解

    启辰 大V DDi

    看报告
    评分86
    全部拆解

    大众 朗逸

    看报告
    评分67
    部分拆解

    吉利 银河L7

    看报告
    评分85
    部分拆解

    欧拉 欧拉闪电猫

    看报告
    评分85
  • 全部拆解

    大众 途昂

    看报告
    评分77
    全部拆解

    大众 途岳

    看报告
    评分74
    部分拆解

    哈弗 枭龙MAX

    看报告
    评分79
    部分拆解

    星途 瑶光

    看报告
    评分85
  • 全部拆解

    捷途 捷途大圣

    看报告
    评分85
    部分拆解

    吉利 帝豪

    看报告
    评分75
    全部拆解

    大众 凌渡L

    看报告
    评分80
    全部拆解

    奥迪 奥迪Q2L

    看报告
    评分68
播放按钮