Software Defined Media
Object-based digital media
Media data is decoupled from audio-visual data and 3D meta-data, which represents multiple objects that exist in 3D space, and transmitted to remote locations for the reproduction of 3D space.
Software defined media space
The software manages the audio-visual objects in the virtual 3D space and renders images and sounds suitable for the rendering environments.
Internet by design
Targeting new research areas and markets involving Internet-by-design audio-visual environments.
Notices
News
Press Releases
We released super-realistic SDM recording data set and Web3D viewer.
We hold a press conference about LiVRation (remote VR live streaming service).
We published a press release about Ultra-realistic SDM orchestral recordings
Awards
Our paper published in Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2020) won the best presentation award.
Our paper published in Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2019) won the Young researcher award.
Dr. Tsukada (Chair) was awarded Yamashita SIG Research Award.
Our paper published in Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2018) won the best paper award.
Our paper published in Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2017) won the best paper award.
We got the second prize in LIVE MUSIC HACKASONG hold in Billboard Tokyo.
Keiko Ogawa (KMD:Graduate School of Media Design, Keio）was awarded a honor of "Dean's List" upon completion of Master's Degree.
Media
| Date | Title | Type |
|---|---|---|
| 2018-05-15 | NHK、 「VRで音楽ライブ 誰でもどこでも」、ニュースチェック11 | TV |
| 2018-05-15 | 時事通信社 | Newspaper |
| 2018-05-15 | 日経産業新聞 | Newspaper |
| 2018-05-15 | 日刊工業新聞 | Newspaper |
| 2018-05-15 | 産経新聞 | Newspaper |
| 2018-05-14 | ビルボード×Cipのハッカソンで誕生した"LiVRation"が実用化に向け記者発表を実施 | Daily News | Billboard JAPAN | Web Article |
| 2018-05-14 | ライブをVRで鑑賞、視点や音響もカスタマイズできる「LiVRation」 - AV Watch | Web Article |
| 2018-05-14 | 臨場感高くライブを再現するシステム「ライブレーション」：時事ドットコム | Web Article |
| 2018-05-14 | 映像や音、臨場感高く＝遠隔地でライブ再現－東大など：時事ドットコム | Web Article |
| 2018-05-14 | 音楽ライブに360度映像で参加 東大がＶＲ技術（動画あり） | 科学技術・大学 ニュース | 日刊工業新聞 電子版 | Web Article |
| 2018-05-14 | ライブを超えた体験を可能にする遠隔ライブVR配信プラットフォーム「LiVRation」を開発 - 産経ニュース | Web Article |
| 2018-05-14 | 音楽ライブの臨場感をＶＲで体験 東京・渋谷 | NHKニュース | Web Article |
| 2018-02-05 | テクノロジーはエンタテインメント体験をどう拡張する？ 『LIVE HACKASONG』レポート - Real Sound｜リアルサウンド | Web Article |
| 2018-02-02 | "エンタテインメント体験の拡張"をテーマにしたロングラン・ハッカソン「Live HACKASONG」最終審査結果発表 | Musicman-NET | Web Article |
| 2018-02-01 | 最新技術を使った新たなライブの楽しみ方とは？ 【LIVE HACKASONG】最終審査＆表彰式レポート | Daily News | Billboard JAPAN | Web Article |
| 2017-02-02 | "ライブ"と"テクノロジー"のコラボハッカソン開催〜Billboard LIVE MUSIC HACKASONGに垣間見る未来 - WirelessWire News（ワイヤレスワイヤーニュース） | Web Article |
| 2017-01-30 | "ライブ体験の拡張"を目指すハッカソン、ビルボードライブ東京にて最終審査が開催 | Daily News | Billboard JAPAN | Web Article |
| 2017-01-28 | "ライブ体験の拡張"をテーマにしたハッカソン「Live Music HACKASONG」最終審査・表彰式を開催 | Musicman-NET | Web Article |
| 2016-09-07 | 【CEDEC2016】ゲーム技術を業界外へ持ち出そう！サウンド技術から切り開く新ビジネスへの挑戦事例 | GameBusiness.jp | Web Article |
| 2016-07-22 | ASCII.jp：合計82チャンネル、360度4Kカメラでオーケストラを収録 | Web Article |
Events
We demonstrated our works about Software Defined Media in Interop 2019@Makuhari Messe.
We presented our prototype systems in the forum of Graduate School of Media Design, Keio University.
We presented our prototype systems in the forum of Graduate School of Media Design, Keio University.
We got the second prize in LIVE MUSIC HACKASONG hold in Billboard Tokyo.
We recorded the concert of Department of Musicology, Keio University for the future experiments data.
We provided 3D audio management system using SDM in the Smartlife hackathon.
We displayed the SDM demonstration of the interactive object-based audio-visual service in IETF 94 @Yokohama Bits-N-Bites.
Smartlife hackathon for organizers and developers was held in the University of Tokyo. We developed the demonstration that combines the indoor localization technique and the object-oriented audio-visual service.
We provided 3D audio management system using SDM in the Smartlife hackathon.
We displayed the SDM demonstration of the interactive object-based audio-visual service at Interop 2015 Tokyo in Makuhari Messe.
We displayed the SDM demonstration of the interactive object-based audio-visual service in the WIDE camp at Hamanako Royal Hote in Shizuoka.
Publications
English Publications
Semantic Digital Twin for interoperability and comprehensive management of data assets
Kazuma Inokuchi, Jin Nakazato, Manabu Tsukada, Hiroshi Esaki
IEEE International Conference on Metaverse Computing, Networking and Applications (IEEE MetaCom 2023), Jun. 2023
ZIGEN: A Windowing System Enabling Multitasking Among 3D and 2D Applications in Immersive Environments.
Akihiro Kiuchi, Taishi Eguchi, Jun Rekimoto, Manabu Tsukada, Hiroshi Esaki
Vancouver, Canada: ACM SIGGRAPH 2022 Posters, 2022
The Software Defined Media Ontology for Music Events
Ray Atarashi, Takuro Sone, Yu Komohara, Manabu Tsukada, Takashi Kasuya, Hiraku Okumura, Masahiro Ikeda, Hiroshi Esaki
Workshop on Semantic Applications for Audio and Music (SAAM) held in conjunction with ISWC 2018, Oct. 2018, pp. 15–23
Japanese Publications
IFCモデルサーバを用いたBIM向けWebビューワの実装
古田悟, 中里仁, 塚田学, 江崎浩
マルチメディア，分散，協調とモバイル(DICOMO2023)シンポジウム, Jul. 2023 (Japanese)
5G を用いた遠隔コラボレーションの QoE 評価に関する研究
伊藤広記, 中川紘輔, 中里仁, Romain Fontugne, 塚田学, 江崎浩
マルチメディア，分散，協調とモバイル(DICOMO2023)シンポジウム, Jul. 2023 (Japanese)
An interactive remote VR delivery platform for live music event
Takashi Kasuya, Manabu Tsukada, Ryosuke Ando, Yasutomo Shirahama, Takuro Shoji, Takuro Sone, Hiroshi Esaki
Information Processing Society of Japan Transaction of Digital Contents Creation (DCON), vol. 7, no. 2, pp. 1–14, Aug. 2019 (Japanese)
SDM360²:An interactive 3D audio-visual service with a free-view-listen point
Manabu Tsukada, Yu Komohara, Takashi Kasuya, Hideaki Nii, Shigeki Takasaka, Keiko Ogawa, Hiroshi Esaki
Information Processing Society of Japan Transaction of Digital Contents Creation (DCON), vol. 6, no. 2, pp. 10–23, Aug. 2018 (Japanese)
LiVRation: An interactive audio-visual service by using Virtual Reality
Takashi Kasuya, Manabu Tsukada, Yu Komohara, Shigeki Takasaka, Takuhiro Mizuno, Yoshitaka Nomura, Uta Ueda, Hiroshi Esaki
Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2018), Jun. 2018 (Japanese)
Best Paper Award
Software Defined Media: Flexible Services Platform for Audio-Visual Applications
Manabu Tsukada, Keiko Ogawa, Masahiro Ikeda, Takuro Sone, Kenta Niwa, Shoichiro Saito, Takashi Kasuya, Hideki Sunahara, Hiroshi Esaki
Special issue on Network Technology, Japan Society For Software Science And Technology (JSSST), vol. 34, no. 3, pp. 37–58, Sep. 2017 (Japanese)
SDM360²: An interactive audio-visual service for music event
Manabu Tsukada, Yu Komohara, Hideaki Nii, Takashi Kasuya, Shigeki Takasaka, Keiko Ogawa, Hiroshi Esaki
Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2017), Jun. 2017 (Japanese)
Best Paper Award,Yamashita SIG Research Award
SDM Ontology: Ontology for managing metadata of Software Defined Media
Yu Komohara, Manabu Tsukada, Hiroshi Esaki, Takuro Sone, Masahiro Ikeda, Shigeki, Takasaka, Rei Atarashi, Yoshifumi Atarashi
Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2017), Jun. 2017 (Japanese)
Projects
Contact
Address
I-REF building, Graduate School of Information Science and Technology, The University of Tokyo, 1-1-1, Yayoi, Bunkyo-ku, Tokyo, 113-8657 Japan ( Map )
Contacts
Email: sdm-wg-request@wide.ad.jp