Nettmusikk

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== NPAPWS 2018 ======
  * Place: Miami, New World Symphony
  * Date: 2018-04-24 to 2018-04-26
  * Programme: https://npapws.org/npapw18-programme/

The following sections are based on Otto J Wittner's notes from the workshop.
===== Panel discussion on itc's impact on music eduation ++ =====
  * Many opportunities... (bla bla)
  * Network performaings arts at the stage now as motion pictures were in the beginning
    * I.e. currently mostly recreating live conserts/performances like cinema just filmed theater performances
    * New unique productions will probably emerge over time
  * Should we and can we compete with the real thing, i.e. live performances ?
    * No, but online / virtual version should inspire the audience to visit live venues
  * (Panel focus in general towards classical music.)
    * (They seem to forget/ignore all other genre of music...)
    * Question from audience raised this issue. Plan member admit all music should be listened to

===== Panel on international collaborations =====
  * ( EaPConnect summary )
  * Music collaboration tools rigged in "public" space at Tempere univ. linked to UK
    * Applied Nimbra hw boxes (120 KNOK for a pair !)
    * A lot of activities emerged over the link
    * Ref 196? experiment named "whole in space" (online link across US)
    * Students are uncomfortable the first two-three sessions, but then start chatting over the link
  * ( Claudio reports how music collab. tech. seem to disappear when it works properly )
    * Misc success stories where scepticle musicians (incl. professional conductor) are convinced when after trying music coll. tech.

===== Recording Audio Across distance =====
  * Slide (ref picture taken on phone) showing latencies across orchestra and across US Internet topology
  * Live clapping experiment showing have musicians deaccelerate when delaly is introduced and no visual reference is available.
  * Popular music
    * Microtiming is important, groove, fast percussion
    * In studio: Click tracks, visual cues (no conductor)
    * Latency issue are very different from classical (orchestra) music
  * Collaboration between Berkely (and all its international campuses) and Napier in Edinburgh
  * Example with el-guitar teaching session with 810ms rt delay
  * Example of work composed assuming 3sec latency
  * Example showing successful cross atlantic studio session with ~90ms return delay
  * Delay test performed with studio musicians
    * Ref Chris Chafe's clapping experiments from 2004'ish
    * Three musicians were given gradually increasing delay toward the other two musicians
    * Deaccelleration begins at 35ms. A disaster av 60ms.
    * Fast paced melody, some acceleration when delay is ̃~0ms, deacceleration starts around 35ms
    * Drummer admit to "give up and just go with it" at 35ms
  * Lola-cue-track and recordings at each end
    * MUST run ProTools (or just the same DAW?) on both ends to enable "reproduction" off-line later

===== LOLA, Ultragrid and MVTP updates =====
  * LOLA
    * Utilizes multiple cores in the hw
    * Possible to downscale sessions to 20Mbps
    * Attention needed to not configure sessions to require more resources than hw and network can provide
    * Long list of requested features 
    * Analogue SD cameras will not be supported in coming versions
    * Web site https://lola.conts.it
    * Multiple camera support coming  (in version 2.0 ?)
    * Ambisonic experiments ongoing
    * Replay on-the-fly in 2.0
    * Smaller units
      * Startech USB3 eth dongle
      * External USB audio interface (e.g. fireface) with 64 sample option
      * Gaming laptop, e.g. Dell, with Nvidia graphics card (with cuda support)
    * Launch event in september 2018, hence ready during summer

  * Ultragrid
    * Now up to 8k video
    * Frame based video capture. Support for misc capture cards.
    * Next release
      * 120 fps support. Bitflow capture card support
      * Intel GPU video acceleration support
      * Full Spout support
      * New GUI (at last.)
    * End-to-end minimum delay ~30ms
      * 120 fps uncompressed, bitflow capture card, JAI Spark camera, 120hz display
      * Difficult with respect to light conditions
    * Normal conditions give end-to-end ~40ms
      * uncompressed 60hz 4k video
    * All-equipment-in-one-box option developed, base don laptop and external capture cards
    * GUI
      * Minimum setup: Camera selection, display selection (and/or preview), Video and audio compression, destination
    * Community update
      * UG applied for voice master classes
      * UG and LOLA has been applied together in event (Near in the distance 3)
      * UG applied for live concert distribution i US from theater to schools and libraries
        * Limited link capacity
        * Old hw

  * MVTP video transmission units
    * Smaller unit: 2x full HD (1080p60), Larger supportes 4xHD
    * 2 ch audio per video stream, 24 bit 48khz (?)
    * Add < 1ms latency due to compression and transmission
      * Compression ratio 5:1 or 10:1 with film industry quality
    * Dream Chip Technology cameras: HD and 4k 6hz versions
      * Only 0.1ms delay from sensor to sdi output !
      * ... not including shutter time, i.e. 1/fps
    * SDI cameras are superior to USB cameras w.r.t. image quality
      * Low delay SDI cameras exist !!


===== On the Fringe =====
  * Common difficulties for "normal" internet users: Capacity limitation, NAT/firewalls, ...
  * Tools that work
    * JamKazam
      * From 2014, standard audio intercase
      * Without latency (?), no feedback issues (?)
      * Sw with network monitoring, audio monitoring, ++
      * Multi web cam support
      * Chat and backtalk channel
      * Fees for lessons and JamTracks, otherwise free to use
      * Demo: 130k incoming audio (!) A lot of packet-loss
      * Legal issues? On session initiation you choose which copyright license should apply
      * In general well developed piece of sw, especially to be freely downloadable
      * Codec ? Now codec, raw audio (Really? At 130kbps ?)
      * 
    * Artsmesh
      * Build on Jack API and ffmpeg
      * Need to be bought via the crypto currency Ethereum
      * $100 dollar for purchase

===== What about wireless? =====
  * 5G networks will make architecture merge with the Internet
    * Due to screen + camera technology and high bandwidth
    * ... or via virtual reality head-sets 
  * More sensors will be applied, e.g.
     * Sensor in bow for violins
     * Haptic gloves
     * 3D audio
  * "Connected cultures" project
    * Vision: Include artists from where they are => wireless technology essential
  * 5G are suppose to provide ultra-low latency... (probably only close to what wired nets provide)
    * Illustration showing 5G cell example with also indoor cells
    * Experiments with 4G shows 200ms end-to-end latency (Pipeline: web-cam ... 4G... some display)
    * 4G is suppose to introduce around 40ms delay. 5G are to improve upon this.
  * 3D sound
    * Use surround speaker system rather than some headset
    * (A lot of details about 5 channel 3d audio experiments)
    * Capturing and representing audio reflections of higher degree is important
  * Q&A
    * How will 5G handle interference and other radio wave challenges? Similar to 4G, but also apply beam forming to focus radio coverage to smaller areas

===== Producing and staging network performances =====
  * Ian Biscoe, Renate Kreil, Maria Isabel Gandia
  * Project including Cuba and Havanna in a networked perfomance
    * Hardly no Internet networks available
    * A lot of enthusiasm required
    * Language challenges
    * Good partners / helpers important
      * E.g. an american with Cuban friends in the sw business
    * Local solutions: E.g. green screen based on curtains fixed with tape to wall
    * Elector acoustics based on vintage computer hw (e.g. commodore 64)
  * Project shown at NPAPWS 2017 in Copenhagen 

  * Net arts coordination center - https://www.netart.cc
    * Recommend to set up a web site as the first step in a networked performance projects
      * For advertising first, and for documentation later
    * So far always aim for new challenges, e.g. new scales (no of sites / participants) og tool combinations
    * Time frame for larger project is around two years
    * Recording of show shown combining LOLA and Ultragrid
      * 3 remote participants (projected in background), dancer on stage
    * 20 technicians at one end of production (Wienna side)
    * 80 people in total all places together
 
  * Univ Catalonia
    * Check your Internet connection before planning performance
    * In person meetings are valuable
    * Interaction and cooperation with people from other cultures (with other languages) is necessary
      * Be open and patient 
    * Funding: E.g. EaPConnect, city council
    * Artists: Students enjoy participating
    * Network "hacks" may be required
    * When applying green screens ALL colors need to be transmitted, i.e. both R, G and B connectors must be in place

  * Ian brings
    * either his own bus with all that he needs or...
    * A suitcase with converters and connectors as well as capture cards and graphics cards (?)
    * Borrow computers, projectors and camera
  * Ian integrates available systems by writing minor patches 
  * What about reliability? Do you have backup plans?
    * Too expensive unfortunately
    * Tape down connectors