Software Defined Media


Object-based digital media

Media data is decoupled from audio-visual data and 3D meta-data, which represents multiple objects that exist in 3D space, and transmitted to remote locations for the reproduction of 3D space.

Software defined media space

The software manages the audio-visual objects in the virtual 3D space and renders images and sounds suitable for the rendering environments.

Internet by design

Targeting new research areas and markets involving Internet-by-design audio-visual environments

News


Next Events

2018/08/28 WG meeting will be held in the University of Tokyo.
2018/07/17 WG meeting will be held in the University of Tokyo.

News

2018/06/13-15 We demonstrated our works in Interop 2018@Makuhari Messe. Also, we had the SDM session from 14:30 to 15:50 in 15th June at the place.
2018/05/14 We hold a press conference about LiVRation (remote VR live streaming service). Press release (in Japanese) Video Photos
(The news appeard in the follwong media: )
2018/01/30 We won the first prize in LIVE HACKASONG hold in Billboard Tokyo.
(The news appeard in the follwong media:
2017/11/22 We presented our prototype systems in the VR/AR meetup.
2017/11/3-4 We presented our prototype systems in the forum of Graduate School of Media Design, Keio University.
2017/08/22 Our paper published in Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2017) won the best paper award.
2017/07/20 SDM symposium was held in the University of Tokyo.
2017/05/23 We reported our activities in IEEE International Conference on Communications (ICC2017) in Paris, France.
2017/01/26 We got the second prize in LIVE MUSIC HACKASONG hold in Billboard Tokyo.
(The news appeard in the follwong media: )
2016/09/20 We reported our activities in 141st Audio Engineering Society in Los Angeles.
2016/08/26 Minamo Takahashi (BANDAI NAMCO Studios Inc.) presented 3D audio in the WG at CEDEC 2016
(The news appeard in the follwong media:
2016/07/29-30 SDM workshop and ideathon were held in the University of Tokyo.
2016/07/21 We announce about flexible audio-visual database for recorded concert data, which will be published as Audio Engineering Society Convention Paper in September (in Japanese). News
(The news appeard in the follwong media: )
2016/03/31 Keiko Ogawa (KMD:Graduate School of Media Design, Keio)was awarded a honor of "Dean's List" upon completion of Master's Degree. Thesis Link
2016/01/10 We recorded the concert of Department of Musicology, Keio University.
2015/12/12-13 We provided 3D audio management system using SDM in the Smartlife hackathon.
2015/11/05 We displayed the SDM demonstration in IETF 94 @Yokohama Bits-N-Bites.
2015/10/17-18 Smartlife hackathon for organizers and developers was held in the University of Tokyo.
2015/08/26 Takashi Kasuya (Takenaka corp.) presented the activities in Smartlife hackathon at CEDEC 2015
2015/07/18-19 We provided 3D audio management system using SDM in the Smartlife hackathon.
2015/06/10-12 We displayed the SDM demonstration in Interop Tokyo 2015.
2015/05/14 Prof. Esaki introduced the SDM activities in the 23th Broadband Symposium.
2015/03/13 We displayed the SDM demonstration at Shinshu-Matsushiro Royal Hotel in Nagano.
2015/01/14 Dr. Tsukada introduced the SDM activities in the IIJ seminar.
2014/01/22 Kick-off meeting was held in the University of Tokyo and SDM WG was launched in the WIDE project.

People


Hiroshi Esaki (Chair)

The University of Tokyo

Manabu Tsukada (Chair)

The University of Tokyo

Publications


English Papers

  1. Software Defined Media: Virtualization of Audio-Visual Services
    Manabu Tsukada (The University of Tokyo), Keiko Ogawa (Keio University), Masahiro Ikeda (Yamaha), Takuro Sone (Yamaha), Kenta Niwa (NTT), Shoichiro Saito (NTT), Takashi Kasuya (Takenaka Cooporation), Hideki Sunahara (Keio University), Hiroshi Esaki (The University of Tokyo)
    IEEE International Conference on Communications (ICC2017), Paris, France, 21-25 May 2017
  2. Investigating integration between auditory and visual location information presented in an augmented-reality device
    Hiraku Okumura, Khiwadkar Sushrut, Sungyoung Kim
    The Journal of the Acoustical Society of America 140(4):3277-3277, October 2016.
  3. New Recording Application for Software Defined Media
    Masahiro Ikeda (Yamaha), Takuro Sone (Yamaha), Kenta Niwa (NTT), Shoichiro Saito (NTT), Manabu Tsukada (The University of Tokyo) and Hiroshi Esaki (The University of Tokyo)
    Audio Engineering Society Convention Paper, 141st AES Convention, Los Angeles, USA, September 2016.
  4. Smartphone-Based 360° Video Streaming/Viewing System including Acoustic Immersion
    Kenta Niwa, Daisuke Ochi , Akio Kameda; Yutaka Kamamoto; Takehiro Moriya
    Audio Engineering Society Convention Paper, 141st AES Convention, Los Angeles, USA, September 2016.
  5. Tangible sound : a tangible interface for object-based sound system
    Keiko Ogawa (Keio University)
    Master’s thesis, KMD:Graduate School of Media Design, Keio University, March 2016.

Japanese Papers

  1. SDM3602:An interactive 3D audio-visual service with a free-view-listen point
    Manabu Tsukada, Yu Komohara, Takashi Kasuya, Hideaki Nii, Shigeki Takasaka, Keiko Ogawa, and Hiroshi Esaki
    Information Processing Society of Japan Transaction of Digital Contents Creation (DCON),Vol.6, No.2, August, 2018. (Japanese)
  2. LiVRation: An interactive audio-visual service by using Virtual Reality
    Takashi Kasuya, Manabu Tsukada, Yu Komohara, Shigeki Takasaka, Takuhiro Mizuno, Yoshitaka Nomura, Uta Ueda, Hiroshi Esaki
    Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2018), June 2018, (Japanese)
  3. Software Defined Media Ontology: A framework for reproduction of audio-visual contents by distributed recording environment
    Yu Komohara (The University of Tokyo)
    Master’s thesis, Graduate School of Information Science and Technology, The University of Tokyo March, 2018 (Japanese)
  4. Software Defined Media activity report 2017
    SDM consortium member
    WIDE Report, March 2018. (Japanese)
  5. Software Defined Media: Flexible Services Platform for Audio-Visual Applications
    Manabu Tsukada, Keiko Ogawa, Masahiro Ikeda, Takuro Sone, Kenta Niwa, Shoichiro Saito, Takashi Kasuya, Hideki Sunahara, and Hiroshi Esaki
    Special issue on Network Technology, Japan Society For Software Science And Technology (JSSST), September, 2017. (Japanese)
  6. SDM Ontology: Ontology for managing metadata of Software Defined Media
    Yu Komohara, Manabu Tsukada, Hiroshi Esaki, Takuro Sone, Masahiro Ikeda, Shigeki, Takasaka, Rei Atarashi, and Yoshifumi Atarashi
    Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2017), June 2017, (Japanese)
  7. SDM3602: An interactive audio-visual service for music event
    Manabu Tsukada, Yu Komohara, Hideaki Nii, Takashi Kasuya, Shigeki Takasaka, Keiko Ogawa, and Hiroshi Esaki
    Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2017), June 2017, (Japanese)
  8. Software Defined Media activity report 2016
    SDM consortium member
    WIDE Report, March 2017. (Japanese)
  9. Tangible Sound Object: A Tangible Interface for Object-based Sound Systems
    Keiko Ogawa, Manabu Tsukada, Hiroshi Esaki, Hideki Sunahara
    Symposium on Multimedia, Distributed, Cooperative and Mobile Systems (DICOMO2016), July 2016, (Japanese)
  10. Software Defined Media activity report 2015
    SDM consortium member
    WIDE Report, March 2016. (Japanese)
  11. Software Defined Media activity report 2014
    SDM consortium member
    WIDE Report, March 2015. (Japanese)