User Tools

Site Tools


nettmus:2018-04-24_npapws_2018
no way to compare when less than two revisions

Differences

This shows you the differences between two versions of the page.


nettmus:2018-04-24_npapws_2018 [2018/04/30 09:34] (current) – created - external edit 127.0.0.1
Line 1: Line 1:
 +====== NPAPWS 2018 ======
 +  * Place: Miami, New World Symphony
 +  * Date: 2018-04-24 to 2018-04-26
 +  * Programme: https://npapws.org/npapw18-programme/
  
 +The following sections are based on Otto J Wittner's notes from the workshop.
 +===== Panel discussion on itc's impact on music eduation ++ =====
 +  * Many opportunities... (bla bla)
 +  * Network performaings arts at the stage now as motion pictures were in the beginning
 +    * I.e. currently mostly recreating live conserts/performances like cinema just filmed theater performances
 +    * New unique productions will probably emerge over time
 +  * Should we and can we compete with the real thing, i.e. live performances ?
 +    * No, but online / virtual version should inspire the audience to visit live venues
 +  * (Panel focus in general towards classical music.)
 +    * (They seem to forget/ignore all other genre of music...)
 +    * Question from audience raised this issue. Plan member admit all music should be listened to
 +
 +===== Panel on international collaborations =====
 +  * ( EaPConnect summary )
 +  * Music collaboration tools rigged in "public" space at Tempere univ. linked to UK
 +    * Applied Nimbra hw boxes (120 KNOK for a pair !)
 +    * A lot of activities emerged over the link
 +    * Ref 196? experiment named "whole in space" (online link across US)
 +    * Students are uncomfortable the first two-three sessions, but then start chatting over the link
 +  * ( Claudio reports how music collab. tech. seem to disappear when it works properly )
 +    * Misc success stories where scepticle musicians (incl. professional conductor) are convinced when after trying music coll. tech.
 +
 +===== Recording Audio Across distance =====
 +  * Slide (ref picture taken on phone) showing latencies across orchestra and across US Internet topology
 +  * Live clapping experiment showing have musicians deaccelerate when delaly is introduced and no visual reference is available.
 +  * Popular music
 +    * Microtiming is important, groove, fast percussion
 +    * In studio: Click tracks, visual cues (no conductor)
 +    * Latency issue are very different from classical (orchestra) music
 +  * Collaboration between Berkely (and all its international campuses) and Napier in Edinburgh
 +  * Example with el-guitar teaching session with 810ms rt delay
 +  * Example of work composed assuming 3sec latency
 +  * Example showing successful cross atlantic studio session with ~90ms return delay
 +  * Delay test performed with studio musicians
 +    * Ref Chris Chafe's clapping experiments from 2004'ish
 +    * Three musicians were given gradually increasing delay toward the other two musicians
 +    * Deaccelleration begins at 35ms. A disaster av 60ms.
 +    * Fast paced melody, some acceleration when delay is ̃~0ms, deacceleration starts around 35ms
 +    * Drummer admit to "give up and just go with it" at 35ms
 +  * Lola-cue-track and recordings at each end
 +    * MUST run ProTools (or just the same DAW?) on both ends to enable "reproduction" off-line later
 +
 +===== LOLA, Ultragrid and MVTP updates =====
 +  * LOLA
 +    * Utilizes multiple cores in the hw
 +    * Possible to downscale sessions to 20Mbps
 +    * Attention needed to not configure sessions to require more resources than hw and network can provide
 +    * Long list of requested features 
 +    * Analogue SD cameras will not be supported in coming versions
 +    * Web site https://lola.conts.it
 +    * Multiple camera support coming  (in version 2.0 ?)
 +    * Ambisonic experiments ongoing
 +    * Replay on-the-fly in 2.0
 +    * Smaller units
 +      * Startech USB3 eth dongle
 +      * External USB audio interface (e.g. fireface) with 64 sample option
 +      * Gaming laptop, e.g. Dell, with Nvidia graphics card (with cuda support)
 +    * Launch event in september 2018, hence ready during summer
 +
 +  * Ultragrid
 +    * Now up to 8k video
 +    * Frame based video capture. Support for misc capture cards.
 +    * Next release
 +      * 120 fps support. Bitflow capture card support
 +      * Intel GPU video acceleration support
 +      * Full Spout support
 +      * New GUI (at last.)
 +    * End-to-end minimum delay ~30ms
 +      * 120 fps uncompressed, bitflow capture card, JAI Spark camera, 120hz display
 +      * Difficult with respect to light conditions
 +    * Normal conditions give end-to-end ~40ms
 +      * uncompressed 60hz 4k video
 +    * All-equipment-in-one-box option developed, base don laptop and external capture cards
 +    * GUI
 +      * Minimum setup: Camera selection, display selection (and/or preview), Video and audio compression, destination
 +    * Community update
 +      * UG applied for voice master classes
 +      * UG and LOLA has been applied together in event (Near in the distance 3)
 +      * UG applied for live concert distribution i US from theater to schools and libraries
 +        * Limited link capacity
 +        * Old hw
 +
 +  * MVTP video transmission units
 +    * Smaller unit: 2x full HD (1080p60), Larger supportes 4xHD
 +    * 2 ch audio per video stream, 24 bit 48khz (?)
 +    * Add < 1ms latency due to compression and transmission
 +      * Compression ratio 5:1 or 10:1 with film industry quality
 +    * Dream Chip Technology cameras: HD and 4k 6hz versions
 +      * Only 0.1ms delay from sensor to sdi output !
 +      * ... not including shutter time, i.e. 1/fps
 +    * SDI cameras are superior to USB cameras w.r.t. image quality
 +      * Low delay SDI cameras exist !!
 +
 +
 +===== On the Fringe =====
 +  * Common difficulties for "normal" internet users: Capacity limitation, NAT/firewalls, ...
 +  * Tools that work
 +    * JamKazam
 +      * From 2014, standard audio intercase
 +      * Without latency (?), no feedback issues (?)
 +      * Sw with network monitoring, audio monitoring, ++
 +      * Multi web cam support
 +      * Chat and backtalk channel
 +      * Fees for lessons and JamTracks, otherwise free to use
 +      * Demo: 130k incoming audio (!) A lot of packet-loss
 +      * Legal issues? On session initiation you choose which copyright license should apply
 +      * In general well developed piece of sw, especially to be freely downloadable
 +      * Codec ? Now codec, raw audio (Really? At 130kbps ?)
 +      * 
 +    * Artsmesh
 +      * Build on Jack API and ffmpeg
 +      * Need to be bought via the crypto currency Ethereum
 +      * $100 dollar for purchase
 +
 +===== What about wireless? =====
 +  * 5G networks will make architecture merge with the Internet
 +    * Due to screen + camera technology and high bandwidth
 +    * ... or via virtual reality head-sets 
 +  * More sensors will be applied, e.g.
 +     * Sensor in bow for violins
 +     * Haptic gloves
 +     * 3D audio
 +  * "Connected cultures" project
 +    * Vision: Include artists from where they are => wireless technology essential
 +  * 5G are suppose to provide ultra-low latency... (probably only close to what wired nets provide)
 +    * Illustration showing 5G cell example with also indoor cells
 +    * Experiments with 4G shows 200ms end-to-end latency (Pipeline: web-cam ... 4G... some display)
 +    * 4G is suppose to introduce around 40ms delay. 5G are to improve upon this.
 +  * 3D sound
 +    * Use surround speaker system rather than some headset
 +    * (A lot of details about 5 channel 3d audio experiments)
 +    * Capturing and representing audio reflections of higher degree is important
 +  * Q&A
 +    * How will 5G handle interference and other radio wave challenges? Similar to 4G, but also apply beam forming to focus radio coverage to smaller areas
 +
 +===== Producing and staging network performances =====
 +  * Ian Biscoe, Renate Kreil, Maria Isabel Gandia
 +  * Project including Cuba and Havanna in a networked perfomance
 +    * Hardly no Internet networks available
 +    * A lot of enthusiasm required
 +    * Language challenges
 +    * Good partners / helpers important
 +      * E.g. an american with Cuban friends in the sw business
 +    * Local solutions: E.g. green screen based on curtains fixed with tape to wall
 +    * Elector acoustics based on vintage computer hw (e.g. commodore 64)
 +  * Project shown at NPAPWS 2017 in Copenhagen 
 +
 +  * Net arts coordination center - https://www.netart.cc
 +    * Recommend to set up a web site as the first step in a networked performance projects
 +      * For advertising first, and for documentation later
 +    * So far always aim for new challenges, e.g. new scales (no of sites / participants) og tool combinations
 +    * Time frame for larger project is around two years
 +    * Recording of show shown combining LOLA and Ultragrid
 +      * 3 remote participants (projected in background), dancer on stage
 +    * 20 technicians at one end of production (Wienna side)
 +    * 80 people in total all places together
 + 
 +  * Univ Catalonia
 +    * Check your Internet connection before planning performance
 +    * In person meetings are valuable
 +    * Interaction and cooperation with people from other cultures (with other languages) is necessary
 +      * Be open and patient 
 +    * Funding: E.g. EaPConnect, city council
 +    * Artists: Students enjoy participating
 +    * Network "hacks" may be required
 +    * When applying green screens ALL colors need to be transmitted, i.e. both R, G and B connectors must be in place
 +
 +  * Ian brings
 +    * either his own bus with all that he needs or...
 +    * A suitcase with converters and connectors as well as capture cards and graphics cards (?)
 +    * Borrow computers, projectors and camera
 +  * Ian integrates available systems by writing minor patches 
 +  * What about reliability? Do you have backup plans?
 +    * Too expensive unfortunately
 +    * Tape down connectors 
nettmus/2018-04-24_npapws_2018.txt · Last modified: 2018/04/30 09:34 by 127.0.0.1