Leaked video: Sony is working on a prototype AI-powered version of a PlayStation game character that can interact with players through voice prompts

sony收購yStation game characters. An anonymous tipster has shared an internal video from
sony收購sony’s PlayStation group with The Verge that demonstrates an AI-powered version of Aloy from Horizon Forbidden West. After we published this story, the video was pulled from YouTube due to a copyright claim from Muso, a copyrights enforcement company which advertises
sony收購sony Interactive Entertainment (aka PlayStation) as a client.The video is narrated by Sharwin Raghoebardajal, a director of software engineering at
sony收購sony Interactive Entertainment who works on video game technology, AI, computer vision, and face technology for
sony收購sony’s PlayStation Studios Advanced Technology Group. We watched Raghoebardajal demonstrate an AI-powered version of Aloy that can hold a conversation with a player through voice prompts during gameplay.Aloy could be seen responding to queries with an AI-powered synthesized voice and facial movements, both in a demo setting and within the full Horizon Forbidden West game. Raghoebardajal makes it clear this is just a prototype that has been developed alongside Guerrilla Games to demonstrate the technology internally at
sony收購sony.The AI-powered version of Aloy. Image:
sony收購sonyThe technology demo uses OpenAI’s whisper for speech-to-text, and both GPT-4 and Llama 3 for conversations and decision making.
sony收購sony’s has its own internal Emotional Voice Synthesis (EVS) system that it uses for speech generation, according to Raghoebardajal, and audio to face animation is powered by
sony收購sony’s own Mockingbird technology.While the demo is seen running on PC,
sony收購sony has also experimented with running parts of this technology directly on PS5 consoles with “little overhead,” according to Raghoebardajal.
sony收購sony first demonstrated this internally a year ago, before showing a more advanced version behind closed doors at its
sony收購sony Technology Exchange Fair (STEF) in Tokyo in November.“This is just a glimpse of what is possible,” says Raghoebardajal. This tech demo doesn’t answer the more obvious questions over whether it even makes sense to talk to Aloy when you’re supposed to be playing as her in Horizon Forbidden West, or the impact such a technology could have on voice actors and game developers.The video above was pulled after The Verge published our story; you can see an animation above.Nvidia has been working on its own similar technology for AI-powered NPCs in games, where you speak freely to video game characters. Ace, as Nvidia calls it, has been demonstrated several times throughout 2024, and the GPU maker has even worked with Inworld AI to create Covert Protocol, a playable tech demo of Nvidia’s AI game technology.Microsoft has also been partnering closely with Inworld AI to eventually bring AI characters to Xbox, allowing game developers to use generative AI characters, storylines, and more. Microsoft has also created its own Muse AI model that generates gameplay, designed initially for game developers to create a game environment for prototyping and ideating.There is already a lot of fear among game developers and studios about how AI could impact the creative process of making video games, particularly when so many layoffs are impacting the gaming industry. Almost half (49 percent) of 3,000 respondents to a Game Developers Conference (GDC) 2024 survey said that generative AI tools are currently being used in their workplace, with 31 percent saying they personally use them.
sony收購sony’s experiments with AI-powered PlayStation characters are bound to generate more conversation around the role of AI in video game creation, just ahead of GDC next week in San Francisco. We reached out multiple times to
sony收購sony for a comment on this leaked internal video, but the company didn’t respond. We’ve asked again to confirm whether
sony收購sony pulled the video, and if it has further comment.Update, March 10th: Added that the video has been pulled by a copyright agent which counts PlayStation as a client.See More: AIEntertainmentGamingNewsOpenAIPlayStation
sony收購sonyTechMost PopularMost PopularFCC approves Verizon’s $20 billion merger after it commits to ‘ending’ DEIJeff Bezos makes his most ghoulish deal yetI let lasers power my smart home — and I don’t want to go backREI’s anniversary sale is dropping prices on Garmins and other great outdoor gearSpotify is sorry that it revealed how many people listen to your podcastInstallerA weekly newsletter by David Pierce designed to tell you everything you need to download, watch, read, listen to, and explore that fits in The Verge’s universe.Email (required)Sign UpBy submitting your email, you agree to our Terms and Privacy Notice. This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.Advertiser Content FromThis is the title for the native adMore in NewsMeta faces Democratic probe into plans to power a giant data center with gasGameStop will have more Sw


sony收購(圖/記者黃肇祥攝,以下皆同)

sony收購sony 最新一代旗艦 Xperia 1 VII 正式登場!《自由 3C 頻道》在第一時間獲得實機進行測試,究竟這次加入的 AI 功能表現如何?是否值得升級?以下就透過實拍照片帶你看。


sony收購

▲Xperia 1 VII 盒裝依舊精簡,採用
sony收購sony 集團以環保為訴求、以甘蔗纖維與竹子製成的可回收紙盒。配件也依舊簡單,盒裝內只有一台手機,完全看不到充電頭、USB-C 連接線乃至說明書的蹤影。

Xperia 1 VII 手機外型依舊沒有太大變化,正面螢幕是 6.5 吋 FHD+ 解析度,支援 1~120Hz 更新率,比例也維持在 19.5:9。體驗上比較大的差異在於「自動亮度」功能的升級,由於
sony收購sony 在背部增添了光源感應器,並與 BRAVIA 電視部門有深入合作,前後代對比下能明顯發現,當碰到光源變化時,Xperia 1 VII 能比 Xperia 1 VI 更快速且靈敏地改變亮度,在戶外使用時格外明顯,可說是相當貼心的升級。


sony收購

▲側邊 Xperia 1 VII 保留了實體快門鍵,以及結合指紋辨識的電源鍵。


sony收購

▲左為 Xperia 1 VI,右為 Xperia 1 VII,或許是因為升級超廣角鏡頭,可以發現 Xperia 1 VII 模組更大,此外在第二顆鏡頭下方也多了一組光源感測器。


sony收購


sony收購

▲「超廣角」是 Xperia 1 VII 這次的升級重點,更大的感光元件使整體畫質明顯提升,且邊緣變形校正也更為積極,用戶可以輕鬆拍出廣闊的視角。這次還增加了最近 5 公分的微距攝影,可以將相機靠物體非常近進行拍攝,並支援自動對焦。


sony收購

▲▼Xperia 1 VII 的超廣角微距並沒有專屬模式,只要開啟 0.7 倍即可自行控制距離啟用。實際拍攝效果如上;但若想深入捕捉肉眼難以觀察的細節,仍建議如下圖使用內建的長焦微距模式,距離最遠可達 360mm,能拍攝極為細微的物件,只不過無法自動對焦,需手動使用峰值對焦來捕捉畫面。


sony收購

原則上,想要把相機當放大鏡使用,會建議使用超廣角進行微距拍攝,有自動對焦且畫質更佳,長焦則捕捉肉眼難以查看的細節,但在拍攝的時候得耗費較長時間進行峰值對焦的調整。

▼Xperia 1 VII 這次也修改了背景虛化(人像模式)的演算法,虛化效果更銳利、積極,尤其在逆光下的 HDR 表現有顯著提升。


sony收購

▼Xperia 1 VII 依舊提供全手動的「專業」相機模式,如果喜歡捕捉光影,特別推薦使用此模式進行拍攝,可減少演算法的干擾,體驗上更接近單眼相機。


sony收購


sony收購

▼對焦依舊是 Xperia 1 VII 的強項,尤其是家裡有貓貓狗狗或是小孩,Xperia 1 VII 具有的連拍速度結合眼部對焦,在拍攝成功率上極高。


sony收購


sony收購

▼全新的「AI 錄影」功能加入了「拍攝主體位置固定」,只要在畫面上先鎖定拍攝主角,手機便會持續進行對焦追蹤,並透過裁切讓人物保持在畫面中央,錄影時也會有圖示引導用戶移動手機位置。

實測發現,該功能適合邊走邊拍的情境,例如小孩騎腳踏車、狗狗在公園奔跑時,就能透過 AI 錄影來確保主角持續鎖定在中央位置(也能手動調整位置)。不過由於需啟動裁切,畫面視角相對較窄,畫質會被限制在 FHD 解析度與 30fps 是需要取捨的地方。

▼「自動取景」錄影在拍攝前可先設定取景框,鎖定想捕捉的特寫區域與大小。接著按下錄影鍵後,手機會同時錄製兩段影片,一為(下方影片一)螢幕中可見的寬廣全景畫面,另一則(下方影片二)為用戶預先鎖定的特寫畫面。在拍攝人物時,就無需使用穩定性較差的長焦來特寫錄影,透過廣角或超廣角構圖更加容易,且特寫片段可直接上傳至 Instagram 分享。

 

sony收購
sony收購

發佈留言

發佈留言必須填寫的電子郵件地址不會公開。 必填欄位標示為 *