Digital Multimedia

Principles and practical use for the Web

Javier Espinosa, PhD
Postdoctoral Research Fellow, LAFMIA lab
http://espinosa-oviedo.com

Genoveva Vargas-Solar, PhD
Research Scientist, CNRS, France
http://vargas-solar.com

Gil Mathieu, PhD
Multimedia developer and designer, AMULI
http://amuli.fr

Description

The consistent integration of multimedia (text, image, vector forms, animation, audio, video, 3D models) assembled in interactive and navigational spaces within applications becomes a recurrent requirement for building digital documents (Web pages, e-books, blogs, among others). The evolution of technology and the emergence of a plethora of tools aiming at processing multimedia and building documents makes it difficult to provide simple and efficient documents that provide clear messages and information. It is thus important to understand the digitalisation and processing challenges introduced by multimedia and their integration within digital documents. These challenges call for expertise both in technological, communication and cognitive knowledge. This course, addresses the first expertise component: technology.

Objectives

  • Define the vocabulary necessary to interact with the computer and people. Mastering a technique requires mastering its associated vocabulary. The challenge with multimedia is that it is multi-technique and multi-expertise. The vocabulary serves as communication tool that leads to harmonic interaction among people participating in the design of digital documents. The programmer needs to be aware of the vocabulary of the graphic designer, the author and vice-versa.

  • Learn the principles of the theoretic background that is behind technology in order to provide a general knowledge on multimedia and associated processing and exploitation techniques.

  • Learn how to deal with different technology to produce and process multimedia in order to build simple and efficient digital documents.

Content

  1. Representation of media ( slides1, slides2 and article)
    • Text/digital document
    • Image
    • Audio
    • Video
  2. Production and processing of media ( material)
    • Analysis
    • Synthesis
    • Processing
  3. “Document”/Multimedia presentation ( slides and article)
    • Presentation models
    • Creating multimedia documents
  4. Mashups ( slides)
    • Definition and models
    • Design and creation tools
    • Maintenance: data freshness
  5. Storing and presenting multimedia presentations ( slides1 and slides2)
    • Introduction to NoSQL
    • Map-Reduce Model

Hands On

  1. Image formats ( pdf)
  2. Pixel manipulation ( pdf)
  3. Video processing ( pdf)
  4. Multimedia presentations ( pdf)
  5. A first touch on NoSQL Servers: CouchDB ( slides)
  6. Storing and visualizing media collections as presentations ( pdf pdf-erratacode)