High-Level Audio Processing in Python
This project contains code for live audio recording and processing in python. Besides basic usage of PyAudio for simple recording, you will find asynchronous processing methods and the use of artificial intelligence for high level applications.
This code has been developed by ZKM | Hertz-Lab as part of the project »The Intelligent Museum«.
Copyright (c) 2021 ZKM | Karlsruhe. Copyright (c) 2021 Paul Bethge.
For information on usage and redistribution, and for a DISCLAIMER OF ALL WARRANTIES, see the file, "LICENSE.txt," in this distribution.
BSD Simplified License.
Description
Right now, this project only contains example code for quick and dirty sound processing. We may use class abstraction at some point in time. You will find a lot of borrowed code and trained neural nets from other repository, instead of submodules, as the purpose of this project is to maintain working code rather than bleeding edge technology.
We want to thank the following repositories for providing open-source solutions:
Usage
We will be using PyAudio to access the microphone which depends on PortAudio. Please take a look at the installation guide. For some platforms however you can find prebuilt binaries.
Linux (APT)
sudo apt install libasound-dev portaudio19-devMacOS (Brew)
brew install portaudioPlease find a README in each of the example subfolders for clarification of addtional requirements and usage as each example is very different in that regard.
The Intelligent Museum
An artistic-curatorial field of experimentation for deep learning and visitor participation
The ZKM | Center for Art and Media and the Deutsches Museum Nuremberg cooperate with the goal of implementing an AI-supported exhibition. Together with researchers and international artists, new AI-based works of art will be realized during the next four years (2020-2023). They will be embedded in the AI-supported exhibition in both houses. The Project „The Intelligent Museum” is funded by the Digital Culture Programme of the Kulturstiftung des Bundes (German Federal Cultural Foundation) and funded by the Beauftragte der Bundesregierung für Kultur und Medien (Federal Government Commissioner for Culture and the Media).
As part of the project, digital curating will be critically examined using various approaches of digital art. Experimenting with new digital aesthetics and forms of expression enables new museum experiences and thus new ways of museum communication and visitor participation. The museum is transformed to a place of experience and critical exchange.
