.. _audio_hardware: Audio Hardware ===================== Each interaction island has one or more cardioid microphones and each of the five major apartment areas (living room, kitchen, hallway/entrance, bathroom and sports room) has one central omnidirectional microphone. These areas also have ceiling-mounted speakers in their corners, basically forming individual 4.0 setups for each of the areas, except for the hallway where only two speakers are installed. In total, there is the following number of audio input and output hardware currently installed: ======================================= ======= ========================== Type Number Note ======================================= ======= ========================== Genelec 8020C speakers 14 Genelec 8010A speakers 4 Smaller, for the bathroom Rode NT3 cardoid 12 condenser microphones Rode NT55 omnidirectional 5 condenser microphones Genelec 7050B subwoofer 1 ======================================= ======= ========================== See below for polar patterns and frequency responses of the microphones used. .. todo:: add specs and plots of speakers Additionally, AKG C411 pickup microphones will be installed to capture structure-borne sounds in various surfaces, namely the countertop and cupboards in the kitchen, the dining table, the shower and the sinks. The analog audio is fed through multi-core cables to and from the control room, where 4 Motu 8M audio interfaces and microphone pre-amps are used to connect all these input and output channels to ``AUD``, an Intel Xeon E5 3.7 GHz quad-core machine running Mac OS, that does audio processing and synthesis and works as a network interface (:ref:`hookah`). The Motu audio devices use AVB (**TODO: put reference to InstituteofElectricalandElectronicsEngineers2011 back in**) to communicate with each other. The speakers will automatically switch off after a certain amount of time of silence (Genelec does not seem to reveal the exact amount of time this takes, possibly because it's not well defined in the first place). They automatically switch back on again when they receive a line signal but this takes a noticable amount of time. The :ref:`batcry` component is there to switch them back on again when their imminent use can be anticipated. .. todo:: add specs, references (for hardware and AVB) and say some word on the decision process for these hardware and distribution choices .. todo:: add descriptions and guidelines for the Motus, screenshots, a link to the REST API, and caveats like the relation between sampling rate and number of available mixers Cabling ------- Multicores ^^^^^^^^^^ +----------+---------+------+--------+----------+-----------------+-----------+ |Location |Pickup |Omni |Cardio |Speakers |Multicore |Multicore | | |In |In |In | |In/Out |Code | +==========+=========+======+========+==========+=================+===========+ |Bathroom |1 |1 |2 |4 |8/4 |MC4 | +----------+---------+------+--------+----------+-----------------+-----------+ |Gym |0 |1 |1 |3 |4/4 |MC3 | | | | | | | | | +----------+---------+------+--------+----------+-----------------+-----------+ |Door |1 |0 |0 |0 |— |— | |Control | | | | | | | |Room | | | | | | | +----------+---------+------+--------+----------+-----------------+-----------+ |Floor |0 |0 |0 |4 |— |— | |Control | | | | | | | |Room | | | | | | | +----------+---------+------+--------+----------+-----------------+-----------+ |Ceiling |0 |3 |9 |9 |14/14 |MC2 | |Main Room | | | | | | | +----------+---------+------+--------+----------+-----------------+-----------+ |Floor |5 |0 |1 |2+1 [#f1]_|8/4 |MC0 | |Kitchen | | | | | | | +----------+---------+------+--------+----------+-----------------+-----------+ |Floor Main|6 |0 |0 |0 |reverse(4/8)->8/4|MC1 | |Room | | | | | | | +----------+---------+------+--------+----------+-----------------+-----------+ |Shower |1 |0 |0 |0 |— |— | +----------+---------+------+--------+----------+-----------------+-----------+ Spare: 4/4 .. rubric:: Footnotes .. [#f1] Temporary speaker for Flobi sim. MC0 – Kitchen Floor ^^^^^^^^^^^^^^^^^^^ +-------+------+-------------+-----+ |Channel|Name |Destination |Motu | | | | |Port | +=======+======+=============+=====+ |Speaker|Red |AD7 |#3 | |1 |Out 1 | |Out 1| +-------+------+-------------+-----+ |Speaker|Red |AD10 |#3 | |2 |Out 2 | |Out 4| +-------+------+-------------+-----+ |Speaker|Red | | | |3 |Out 3 | | | +-------+------+-------------+-----+ |Speaker|Red |Floor Cabinet|#4 | |4 |Out 4 |Speaker |Out 8| +-------+------+-------------+-----+ |Mic 1 |Brown |ASC6 |#1 In| | |In 1 | |6 | +-------+------+-------------+-----+ |Mic 2 |Brown |ASP5 |#3 In| | |In 2 | |5 | +-------+------+-------------+-----+ |Mic 3 |Brown |ASP6 |#3 In| | |In 3 | |6 | +-------+------+-------------+-----+ |Mic 4 |Brown |ASP7 |#3 In| | |In 4 | |7 | +-------+------+-------------+-----+ |Mic 5 |Orange| | | | |In 5 | | | +-------+------+-------------+-----+ |Mic 6 |Orange| | | | |In 6 | | | +-------+------+-------------+-----+ |Mic 7 |Orange| | | | |In 7 | | | +-------+------+-------------+-----+ |Mic 8 |Orange| | | | |In 8 | | | +-------+------+-------------+-----+ MC1 – Main Room Floor ^^^^^^^^^^^^^^^^^^^^^^^^^ +-------+-----+-----------+-----+ |Channel|Name |Destination|Motu | | | | |Port | +=======+=====+===========+=====+ |Mic 1 |Aux1 |Bodentank |#2 In| | | |Left |1 | +-------+-----+-----------+-----+ |Mic 2 |Aux2 |Bodentank |#2 In| | | |Right |2 | +-------+-----+-----------+-----+ |Mic 3 |Aux3 | | | +-------+-----+-----------+-----+ |Mic 4 |Aux4 | | | +-------+-----+-----------+-----+ |Mic 5 |Aux5 | | | +-------+-----+-----------+-----+ |Mic 6 |Aux6 | | | +-------+-----+-----------+-----+ |Mic 7 |Aux7 | | | +-------+-----+-----------+-----+ |Mic 8 |Aux8 | | | +-------+-----+-----------+-----+ |Speaker|01 |Bodentank |#2 | |1 | |Left |Out 2| +-------+-----+-----------+-----+ |Speaker|02 |Bodentank |#2 | |2 | |Right |Out 3| +-------+-----+-----------+-----+ |Speaker|03 | | | |3 | | | | +-------+-----+-----------+-----+ |Speaker|04 |Subwoofer |#2 | |4 | | |Out 1| +-------+-----+-----------+-----+ MC2 – Main Room Ceiling ^^^^^^^^^^^^^^^^^^^^^^^^^^^ +-------+-----+-----------+-----------+-----+ |Channel|Name |Destination|Destination|Motu | | | | |Label |Port | +=======+=====+===========+===========+=====+ |Speaker|Aux1 |Main Room |AD1 |#1 | |1 | |North | |Out 5| | | |Corner | | | +-------+-----+-----------+-----------+-----+ |Speaker|Aux2 |Main Room |AD2 |#1 | |2 | |East Corner| |Out 6| +-------+-----+-----------+-----------+-----+ |Speaker|Aux3 |Main Room |AD3 |#1 | |3 | |South | |Out 7| | | |Corner | | | +-------+-----+-----------+-----------+-----+ |Speaker|Aux4 |Main Room |AD4 |#1 | |4 | |West Corner| |Out 8| +-------+-----+-----------+-----------+-----+ |Speaker|Aux5 |Kitchen |AD5 |#2 | |5 | |North | |Out 5| | | |Corner | | | +-------+-----+-----------+-----------+-----+ |Speaker|Aux6 |Kitchen |AD6 |#2 | |6 | |East Corner| |Out 6| +-------+-----+-----------+-----------+-----+ |Speaker|Aux7 |Sports |AD14 | | |7 | |West Corner| | | +-------+-----+-----------+-----------+-----+ |Speaker|Aux8 | | | | |8 | | | | | +-------+-----+-----------+-----------+-----+ |Speaker|Aux9 | | | | |9 | | | | | +-------+-----+-----------+-----------+-----+ |Speaker|Aux10| | | | |10 | | | | | +-------+-----+-----------+-----------+-----+ |Speaker|Aux11| | | | |11 | | | | | +-------+-----+-----------+-----------+-----+ |Speaker|Aux12|Camera |(temp) |#2 | |12 | |Feedback 1 | |Out 8| +-------+-----+-----------+-----------+-----+ |Speaker|Aux13|Camera |(unpatched)|#2 | |13 | |Feedback 2 | |Out 7| +-------+-----+-----------+-----------+-----+ |Speaker|Aux14|Kitchen |(temp) |#3 | |14 | |over right | |Out 8| | | |Handle | | | +-------+-----+-----------+-----------+-----+ |Mic 1 |01 | |ASC1 |#1 In| | | | | |1 | +-------+-----+-----------+-----------+-----+ |Mic 2 |02 | |ASC2 |#1 In| | | | | |2 | +-------+-----+-----------+-----------+-----+ |Mic 3 |03 | |ASC3 |#1 In| | | | | |3 | +-------+-----+-----------+-----------+-----+ |Mic 4 |04 | |ASC4 |#1 In| | | | | |4 | +-------+-----+-----------+-----------+-----+ |Mic 5 |05 | |ASC5 |#1 In| | | | | |5 | +-------+-----+-----------+-----------+-----+ |Mic 6 |06 | | | | | | | | | | +-------+-----+-----------+-----------+-----+ |Mic 7 |07 | |ASC7 |#1 In| | | | | |7 | +-------+-----+-----------+-----------+-----+ |Mic 8 |08 | |ASC8 |#1 In| | | | | |8 | +-------+-----+-----------+-----------+-----+ |Mic 9 |09 | |ASC9 |#2 In| | | | | |3 | +-------+-----+-----------+-----------+-----+ |Mic 10 |10 | |ASO1 |#2 In| | | | | |4 | +-------+-----+-----------+-----------+-----+ |Mic 11 |11 |Test Mic |ASO3 |#2 In| | | |Kitchen | |6 | | | |Omni | | | +-------+-----+-----------+-----------+-----+ |Mic 12 |12 | | | | | | | | | | +-------+-----+-----------+-----------+-----+ |Mic 13 |13 |Test Mic |ASC10 |#2 In| | | |Hallway | |7 | | | |Cardio | | | +-------+-----+-----------+-----------+-----+ |Mic 14 |14 |Test Mic |ASO2 |#2 In| | | |Hallway | |5 | | | |Omni | | | +-------+-----+-----------+-----------+-----+ MC3 – Gym ^^^^^^^^^^^^^^^^^^^^^ +-------+-----+-----------+-----+ |Channel|Name |Destination|Motu | | | | |Port | +=======+=====+===========+=====+ |Speaker|Aux1 |AD11 | | |1 | | | | +-------+-----+-----------+-----+ |Speaker|Aux2 |AD12 | | |2 | | | | +-------+-----+-----------+-----+ |Speaker|Aux3 |AD13 | | |3 | | | | +-------+-----+-----------+-----+ |Speaker|Aux4 | | | |4 | | | | +-------+-----+-----------+-----+ |Mic 1 |01 |ASO4 | | +-------+-----+-----------+-----+ |Mic 2 |02 |ASC11 | | +-------+-----+-----------+-----+ |Mic 3 |03 | | | +-------+-----+-----------+-----+ |Mic 4 |04 | | | +-------+-----+-----------+-----+ MC4 – Bathroom ^^^^^^^^^^^^^^ +-------+------+-----------+-----+ |Channel|Name |Destination|Motu | | | | |Port | +=======+======+===========+=====+ |Speaker|Red |AD15? |#4 | |1 |Out 1 | |Out 1| +-------+------+-----------+-----+ |Speaker|Red |AD16? |#4 | |2 |Out 2 | |Out 2| +-------+------+-----------+-----+ |Speaker|Red |AD17? |#4 | |3 |Out 3 | |Out 3| +-------+------+-----------+-----+ |Speaker|Red |AD18? |#4 | |4 |Out 4 | |Out 4| +-------+------+-----------+-----+ |Mic 1 |Brown |ASO5 |#2 In| | |In 1 | |8 | +-------+------+-----------+-----+ |Mic 2 |Brown |ASC12 | | | |In 2 | | | +-------+------+-----------+-----+ |Mic 3 |Brown | | | | |In 3 | | | +-------+------+-----------+-----+ |Mic 4 |Brown | | | | |In 4 | | | +-------+------+-----------+-----+ |Mic 5 |Orange| | | | |In 5 | | | +-------+------+-----------+-----+ |Mic 6 |Orange| | | | |In 6 | | | +-------+------+-----------+-----+ |Mic 7 |Orange| | | | |In 7 | | | +-------+------+-----------+-----+ |Mic 8 |Orange| | | | |In 8 | | | +-------+------+-----------+-----+ Single Cables ^^^^^^^^^^^^^ +-----------+-----+ |Destination|Motu | | |Port | +===========+=====+ |Control |#1 | |Room |Out4 | |Speaker | | |South | | +-----------+-----+ |Control |#1 | |Room |Out2 | |Speaker | | |East | | |(Window | | |Right) | | +-----------+-----+ |Control |#1 | |Room |Out1 | |Speaker | | |North | | |(Window | | |Left) | | +-----------+-----+ |Control |#1 | |Room |Out3 | |Speaker | | |West | | +-----------+-----+ |Control |#4 | |Room Mic 1 |In 8 | +-----------+-----+ |Subwoofer |#2 | |Control R. |Out 7| +-----------+-----+ Plots -------- .. figure:: /images/audiomap.png :scale: 50 % :alt: audio hardware in apartment Overview of the microphones and speakers in the apartment and their labels. .. figure:: /images/nt3_freq.png :scale: 50 % :alt: NT3 frequency plot Plot of the Rode NT3 frequency response. Copyright RØDE Microphones. .. figure:: /images/nt3_polar.png :scale: 50 % :alt: NT3 polar plot Polar pattern of the Rode NT3 microphone. Copyright RØDE Microphones. .. figure:: /images/nt55_omni_freq.png :scale: 50 % :alt: NT55 frequency plot Plot of the Rode NT55 frequency response. Copyright RØDE Microphones. .. figure:: /images/nt55_omni_polar.png :scale: 50 % :alt: NT55 polar plot Polar pattern of the NT55 microphone. Copyright RØDE Microphones.