...
Multiple-zone audio management - System Level Audio
Next Meeting - Thursday
...
18 March 2021 - 11:30am CET (AUDIO_HAL CW2110)
Click to Join Webex meeting
...
- Access code: 297 637 101
- Meeting password: 92839687
Agenda
- Progress on external-system design, WebRTC based demo, ...
- Check what can be prepared and demonstrated for the next Virtual All Members meeting
Anchor | ||||
---|---|---|---|---|
|
Participants
Chris Simmonds (part) Gunnar Andersson Philippe Robin Piotr Krawczyk Stephen Lawrence Unknown User (wassim.filali)
Apologies
Minutes
CI/Testing
Gunnar: Shortly about Go issues sorted out. Both Lava and Go.CD updated to latest versions. Go now behind NGINX proxy (it used to handle its own SSL/TLS but this is more standard). Some breakage to sort out -- large artifact transfers were being truncated, etc. NGINX settings sort this out.
StephenL: We have set up full CTS & VTS in Lava. Seems very large and running many tests. How could we reduce the tests to the most relevant. But in some cases the tests still seem not that comprehensive.
Does Chris have experience?
Chris: There ought to be a test for every API. Admit that some seem trivial however. Just call the function and see if there is a reply, basically.
StephenL: So for audio tests, it won't really test behavior
Chris: Yes, the tests cannot monitor the output, so some might pass even if no sound actually comes out, etc.
Effects / DSPs / binary blobs
Wassim: I looked at offloading to DSP in Android 11. I can find the effects headers. Where is the implemntation -- DSP binaries?
Chris: AOSP should ships some basic effects, with source code. (algorithms on general CPU only, since DSPs are very specific). DSP code is likely to be binaries without source code, and therefore can't ship with AOSP.
SL: Agree, silicon vendors ship binaries and often a DSP development kit to write code, and so on. But it's likely even 3rd parties are involved and selling implementations of special effects/processing.
In summary: Binary implementations come from elsewhere, either as part of BSP delivery from Silicon Vendor, or even third party.
Design and demo of external audio system
Wassim: We haven't discussed using WebRTC before, let's We'd like to create an isolated/simulated environment (e.g. dockerized). Demonstrate how to play/control non-local audio.
Proposed Idea: Use a browser as the receiving audio device. (And UI)
Web audio API - volumes, effects, filters, extract channels... even different zones set up?
You could forward to WebRTC inside Android. Android WebRTC -- see link TODO It seems easy to stream to WebRTC. (but that's not quite the same, see below)
Wassim shows example WebRTC user interface with volume controls etc.
Piotr: What is volume control controlling here?
Wassim: It happens on the local machine.
(discussion: it should affect the Android based source instead?)
Implementation alternatives
1. Reuse Android WebRTC implementation
2. Don't use WebRTC implementation from Android, extract audio as before (via plain socket) to some external server. This external server may also act as a WebRTC server and could be implemented using any non-Android implementation (i.e. likely Linux, and likely packaged in Docker of course). The WebRTC server sends audio over WebRTC but also hosts the web page of course, that is the client user interface, shown in "user's" browser)
Wassim and Gunnar prefer alt. 2). This simply extracts audio from Android and the fact that WebRTC is used is a non-Android related detail in this demo setup.
Piotr/Wassim:
Discussion on full round-trip, e.g. user changes volume or other setting on user interface - this might affect audio server, but in some cases need to be fed back also into the Android system.
Gunnar/Wassim:
Web page as user interface would be like a remote-control case. Agreed. Wassim notes in that case Android could run "headless" for the purposes of the demo.
Gunnar: A more car-like setup is that the user interface is still provided by Android, only the audio processing and playback may be on an external system.
Who is skilled at web development? Wassim is. Piotr would need to spend some time learning more.
Wassim: Can we try running the emulator headless (in a container)?
Piotr: I would expect it will fail when not having the graphics access.
Wassim: I'd prefer a simple remote-server setup, ideally a collection of docker containers.
... (discussion) running full emulator UI from docker might have issues (theoretically possible, but why?)
... might be OK to just run emulator on host without container - but it should be just a simple launch
... note that the emulator is in fact a virtual machine.
Alternative - Android in container has been shown before. Is it possible to build on it? Probably not based on automotive build out of the box There Android executes directly on kernel (container) and not a VM. Links?
Demonstration scenarios
- User interaction is desired on Windows (typical corporate environment)
- User interaction could be with the Android UI --> requires the emulator to be running on the Windows client machine. The audio/WebRTC server has been assumed to be on same machine also, but since the audio is over TCP/IP it could theoretically be elsewhere.
- User interaction could be via Browser only --> no requirement on where the Android system + WebRTC server actually runs. Deployment on some Linux server might be nice if it can be done headless.
Anchor | ||||
---|---|---|---|---|
|
Participants
Gunnar Andersson Philippe Robin Piotr Krawczyk Stephen Lawrence Unknown User (wassim.filali) Unknown User (niskandar)
Minutes
Introduction from Philippe
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Minutes
Thursday 18 February 2021 - 11:30am CET
Participants
Unknown User (wassim.filali) Stephen Lawrence Philippe Robin
apologies: Gunnar Andersson, Nadim Iskandar, Suhasini Raghuram, Piotr Krawczyk
Minutes
Discussion on AVB/TSN and hypervisors and virtio between Wassim and Stephen; will continue next week
Anchor | ||||
---|---|---|---|---|
|
Participants
Unknown User (wassim.filali) Gunnar Andersson Unknown User (niskandar) Stephen Lawrence Philippe Robin Suhasini Raghuram Piotr Krawczyk
Minutes
Update regarding the platform
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Unknown User (wassim.filali) Gunnar Andersson Unknown User (niskandar) Stephen Lawrence Philippe Robin @Chris Simmons(2net)
Minutes
Discussion about
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Suhasini Raghuram Unknown User (wassim.filali) Gunnar Andersson Unknown User (niskandar) Stephen Lawrence Philippe Robin
Minutes
Discussion about the AVB and next steps or topics to do (but we cannot reach the conclusion without Piotr)
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Suhasini Raghuram Unknown User (wassim.filali) Stephen Lawrence Piotr Krawczyk Gunnar Andersson
Apologies
Minutes
Review of the backlog for audio HAL
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Suhasini Raghuram Unknown User (wassim.filali) Stephen Lawrence Piotr Krawczyk Gunnar Andersson Unknown User (niskandar)
Minutes
Philippe: talking about the FOSDEM presentation, if some time is left we could mention the backlog tasks.
...
Thursday 17 December 2020 - 11:30am CET (AUDIO_HAL CW50)
Participants
Gunnar Andersson Philippe Robin Suhasini Raghuram Stephen Lawrence Piotr Krawczyk
apologies: Wassim Filali, Unknown User (niskandar)
Minutes
How to get help on the Kingfisher board
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Gunnar Andersson Philippe Robin Unknown User (wassim.filali) Suhasini Raghuram Stephen Lawrence Unknown User (niskandar)
Minutes
Virtual open source conference. GENIVI was recommended to give a talk (Fosdem: biggest open source conference). If we submit anything to the Embedded Mobile and Automotive dev room, we need to have strong code examples.
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Gunnar Andersson Philippe Robin Piotr Krawczyk Unknown User (wassim.filali) Suhasini Raghuram Stephen Lawrence Mohan Karthik Unknown User (niskandar)
Minutes
Continuing the session about Network Audio Synchronization and answering questions
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Gunnar Andersson Philippe Robin Piotr Krawczyk Unknown User (wassim.filali) Johan Suhasini Raghuram Stephen Lawrence Mohan Karthik Chris Simmonds Unknown User (niskandar)
Minutes
Wassim giving a session about Network Audio Synchronization (many additional information came from Mohan Karthik)
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Gunnar Andersson Philippe Robin Piotr Krawczyk Unknown User (wassim.filali) Unknown User (niskandar)
Minutes
Going through the list of prioritized topics:
...
Thursday - 5 November - 11:30am CET
Participants
Gunnar Andersson Philippe Robin Stephen Lawrence Suhasini Raghuram, Unknown User (wassim.filali), Chris Simmonds
Minutes
Review of the list of prioritarized topics
...
Thursday - 1 October - 11:30am CEST
Participants
Gunnar Andersson Philippe Robin Stephen Lawrence Suhasini Raghuram Henric Carlsson
apologies: Unknown User (wassim.filali) Unknown User (niskandar)
Minutes
Review the work breakdown structure and update it to get a shared knowledge of the project status before preparing the agenda of the AHAL working session at the tech summit
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Gunnar Andersson Philippe Robin Stephen Lawrence Unknown User (wassim.filali) Suhasini Raghuram Henric Carlsson Unknown User (niskandar)
Minutes
Updates from last meeting:
...
Thursday 17 September - 11:30am CEST
Participants
Gunnar Andersson Stephen Lawrence Henric Carlsson Piotr Krawczyk Unknown User (wassim.filali)
Minutes
Discussion on demo implementation status
Thursday 10 September - 11:30am CEST
Participants
Gunnar Andersson Stephen Lawrence Henric Carlsson Piotr Krawczyk Unknown User (wassim.filali) Philippe Robin
Minutes
Discussion on configuration & demo building & integration of the emulator project, followed by Jira review
Anchor | ||||
---|---|---|---|---|
|
Participants
Gunnar Andersson Stephen Lawrence Henric Carlsson Piotr Krawczyk
Minutes
Discussion on feature content for MS3 demo (MS3 = virtual tech summit scheduled on October 26-30) Gunnar Andersson can you add the notes you took during the call ? thanks
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Gunnar Andersson Stephen Lawrence Henric Carlsson Piotr Krawczyk Unknown User (niskandar)
Minutes
Going through the previous minutes of the meeting.
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Suhasini Raghuram Gunnar Andersson Stephen Lawrence Unknown User (niskandar)
Minutes
Going through the previous minutes of the meeting.
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Philippe Robin Suhasini Raghuram Unknown User (wassim.filali) Unknown User (niskandar) Stephen Lawrence Piotr Krawczyk
Minutes
Going through the previous todo list:
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Philippe Robin Gunnar Andersson Unknown User (bartoszbialek) Suhasini Raghuram Unknown User (wassim.filali) Unknown User (niskandar) Stephen Lawrence
Minutes
Alternative board for Suhasini, any upadte on that matter?
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Philippe Robin Gunnar Andersson Piotr Krawczyk Unknown User (bartoszbialek) Henric Carlsson Suhasini Raghuram Unknown User (wassim.filali) Unknown User (niskandar)
Minutes
Should the minutes be more like a transcript?
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Unknown User (niskandar) Gunnar Andersson Unknown User (zafirulhassan) Piotr Krawczyk Unknown User (bartoszbialek) Unknown User (zafirulhassan)
Minutes
Looking at the history, the best course of action here is to go through the Jira tickets and assign them to start working on them.
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Unknown User (wassim.filali) Philippe Robin Gunnar Andersson Piotr Krawczyk Unknown User (bartoszbialek) Henric Carlsson Stephen Lawrence Suhasini Raghuram Unknown User (niskandar)
Minutes
Let's start by going through the points that we have gathered last time in PoC Milestones and Work Breakdown.
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Unknown User (wassim.filali) Unknown User (niskandar) Philippe Robin Gunnar Andersson Piotr Krawczyk Unknown User (bartoszbialek) @Henric Unknown User (zafirulhassan)
Minutes
Introduction to members and new member Zafirul
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Suhasini Raghuram Unknown User (wassim.filali) Unknown User (niskandar) Philippe Robin Gunnar Andersson Piotr Krawczyk Unknown User (bartoszbialek) @Henric
Minutes
Debriefing of the virtual summit
...
Anchor | ||||
---|---|---|---|---|
|
Participants
Suhasini Raghuram Unknown User (wassim.filali) Unknown User (niskandar) Philippe Robin Andrii Chepurnyi Harald Bartholomae Ruslan Shymkevych Gunnar Andersson Piotr Krawczyk @Henric
Minutes
Going through the presentation of Wassim
...
AnchorAUDIO_HAL_CW18 AUDIO_HAL_CW18
Thursday 30 April - 11:30am CET (AUDIO_HAL_CW18)
AUDIO_HAL_CW18 | |
AUDIO_HAL_CW18 |
Participants
Philippe RobinSuhasini Raghuram Unknown User (wassim.filali) @Henric Ruslan Shymkevych
apologies: Piotr Krawczyk Unknown User (bartoszbialek)
Minutes
Review of Ruslan's email of 23 April - archive
...
AnchorAUDIO_HAL_CW17 AUDIO_HAL_CW17
Thursday 23 April - 11:30am CET (AUDIO_HAL_CW17)
AUDIO_HAL_CW17 | |
AUDIO_HAL_CW17 |
Participants
Philippe Robin Piotr Krawczyk Unknown User (bartoszbialek) Suhasini Raghuram Unknown User (niskandar) Unknown User (wassim.filali) @Henric
Minutes
Updates of the tasks done from last week: Wassim, Piotr, Nadim
...
AnchorAUDIO_HAL_CW16 AUDIO_HAL_CW16
Thursday 16 April - 11:30am CET (AUDIO_HAL_CW16)
AUDIO_HAL_CW16 | |
AUDIO_HAL_CW16 |
Participants
Philippe Robin Gunnar Andersson Piotr Krawczyk Unknown User (bartoszbialek) Suhasini Raghuram Ruslan Murtazin Unknown User (niskandar) Unknown User (wassim.filali) Andrii Chepurnyi @Henric
...
- Discuss the gathered topics, who can work on which topics and which strategy
- Status update on the "access raw streams"
Minutes
Changes done in this page Android and System Level Audio:
...
AnchorAUDIO_HAL_CW15 AUDIO_HAL_CW15
Thursday 09 April - 11:30am CET (AUDIO_HAL_CW15)
AUDIO_HAL_CW15 | |
AUDIO_HAL_CW15 |
Participants
Philippe Robin Gunnar Andersson Piotr Krawczyk Unknown User (bartoszbialek)Andrii Chepurnyi@Henric Suhasini Raghuram Stephen Lawrence
...
- from last week's minutes
- Discuss the gathered topics, who can work on which topics and which strategy
- Status update on the "access raw streams"
- AOB
- abstract of the GENIVI virtual tech summit AASIG Audio HAL workshop
Minutes
list of gathered topics on multi-zone audio management
...
Thursday 02 April - 11:30am CET (AUDIO_HAL_CW14)
Participants
Philippe Robin Gunnar Andersson Piotr Krawczyk Unknown User (bartoszbialek) Unknown User (wassim.filali) Andrii Chepurnyi Unknown User (niskandar) @Henric Suhasini Raghuram
...
- Slides from Wassim about the two models inside and outside of AA
- discussion of the cases/features that we are trying to solve
- checking the Audio Manager to decide whether or not it needs an update
Minutes
- 2 strategies or options:
- android provides sources and sinks
- Android controls the complete systems
- We will not discuss the need to have such options
- Basically some functions cannot be integrated to AA
- Audio sources coming from android or from external (android not aware of them)
- Each strategy has limitations and can be criticized
- Idea is to get each model and apply to it questions/cases
- Questions like safety sources, raw streams, etc.
...