Questions tagged [audio-processing]
For questions about audio processing tasks in the context of artificial intelligence.
29
questions
0
votes
0answers
42 views
+50
Understanding gumbel-softmax backpropagation in Wav2Vec papers
I'm studying the series of Wav2Vec papers, in particular, the vq-wav2vec and wav2vec 2.0, and have a problem understanding some details about the quantization procedure.
The broader context is this: ...
2
votes
2answers
95 views
Is it realistic to train a transformer-based model (e.g. GPT) in a self-supervised way directly on the Mel spectrogram?
In music information retrieval, one usually converts an audio signal into some kind "sequence of frequency-vectors", such as STFT or Mel-spectrogram.
I'm wondering if it is a good idea to ...
0
votes
0answers
13 views
How to Approach a Conversation Detector?
I am currently looking for a way to detect if a conversation is occurring. The meaning of the conversation is not important for this case.
One approach that seems viable is to try to detect a voice ...
1
vote
0answers
14 views
Model for direct audio-to-audio speech re-encoding
There are many resources available for text-to-audio (or vice versa) synthesis, for example Google's 'Wavenet'.
These tools do not allow the finer degree of control that may be required regarding the ...
0
votes
0answers
26 views
Speech diarization for a conversation detector: A good idea or not?
I am trying to write a program in which an ai can detect whether a conversation is occurring or not. The ai does not need to transcribe words or have any meaning about the conversation, simply if one ...
2
votes
1answer
36 views
I want to determine how similar a given song is to Queen's songs. Am I headed in the right direction?
I've asked this question before (@ Reddit) and people suggested CNNs on a mel spectrogram more than anything else. This is great.
But I'm sort of stuck at: label some music data as "queen" ...
2
votes
1answer
100 views
How to get more accuracy of the logistic regression model?
I am working on a Baby Crying Detection model using logistic regression.
Out of $581$ audios, $222$ are of a baby crying. Each audio is of $5$ seconds.
what I have done is convert each audio into ...
1
vote
0answers
38 views
Is it likely that a sentient AI experience synesthesia?
The reason I ask this question is because we humans tend to compartmentalize our sensory inputs, except in some individuals that experience synesthesia. If an Artificial Intelligence Entity (AIE) can ...
1
vote
0answers
19 views
Can Machine Learning be used to synthesize engine sounds?
I'm working on a project to equip model locomotives with sound boards. I'm in the process of designing the board at the moment, and the idea is to allow users to load their own sound files onto an SD ...
1
vote
1answer
450 views
Can we use transformers for audio classification tasks?
Since transformers are good at processing sequential data, can we also use them for audio classification problems (same as RNNs)?
0
votes
1answer
22 views
How to combine specific CNN models that work better at slightly different tasks?
I'm not sure how to describe this in the most accurate way but I'll give it a shot.
I've developed a Inception-Resnet V2 model for detecting audio signals via spectrogram. It does a pretty good job ...
1
vote
0answers
15 views
Is there a problem for "Sound Source Identification in Video Footage"?
I've been considering starting a project for some time on sound source identification.
To be more specific, my goal is to be able to identify the "sources" for sound in videos. Moving parts ...
3
votes
1answer
119 views
How can I find a specific word in an audio file?
I'm trying to train and use a neural network to detect a specific word in an audio file. The input of the neural network is an audio of 2-3 seconds duration, and the neural network must determine ...
1
vote
0answers
45 views
What is the most compressed audio that I can feed an AI?
The problem I currently have is that I want to train an AI to produce music, like music that contains voices etc... However, the problem is that with a WAV file, one second of audio can be up to 48,...
1
vote
0answers
16 views
What are the best datasets available for music information retrieval?
I am interested in doing some work in classification problems in music information retrieval. I know that there are some formats of datasets (such as MIDI, Spectrogram, Piano-roll, MusicXML, etc.) for ...
1
vote
0answers
34 views
Is there an AI that can complete Deezer Spleeter work?
I have used Deezer Spleeter but it produces echoes aside the stems, so I wonder if there is already an AI that remove echoes noises.
1
vote
0answers
60 views
Noise Cancellation on live audio stream
I want to build an application which takes a live audio from source (mic) and filtering the noise (unwanted sounds like chattering, traffic noises) and fetch into an application for further processing....
2
votes
0answers
333 views
How do I train a multiple-speaker model (speech synthesis) based on Tacotron 2 and espnet?
I'm new to Speech Synthesis & Deep Learning. Recently, I got a task as described below:
I have problem in training a multi-speaker model which should be created by Tacotron2. And I was told I can ...
1
vote
0answers
28 views
State of the art in voice recognition
In the media there's lot of talk about face recognition, mainly with respect to identifying faces (= assigning to persons). Less attention is paid to the recognition of facially expressed emotions but ...
2
votes
1answer
347 views
How to use AI for language recognition?
Given an audio track, I'm trying to find a way to recognize the audio language. Only within a small set (e.g. English vs Spanish). Is there a simple solution to detect the language in a speech?
1
vote
1answer
70 views
Deep audio fingerprinting for word search
Simply speaking, I'm trying to somehow search an audio clip for a list of words, and if found, I mark the time stamps. My use-case is profanity check with a list of pre-defined profane words.
Is ...
3
votes
1answer
225 views
Can AI be used to reverse engineer a black box?
A while back I posted on the Reverse Engineering site about an audio DSP system whose designer had passed away and whose manufacturer no longer had source code (but the question was deleted). ...
4
votes
0answers
106 views
AI method for evaluating user performance based on audio pitch re: public speaking
First I will clarify the context, I have to learn new technologies for my bachelor thesis. I am making a mobile application similar to Flappy Bird, except it's voice controlled. The idea is to have ...
1
vote
0answers
37 views
Speech to text models
I'm currently using google speech to text api to transcribe audio in real time (police scanner audio dispatches). The audio quality isn't great and I've been putting in key words to try to help train ...
0
votes
2answers
61 views
What are the current open source text-to-audio libraries?
I am not new to AI and did some work for few months but completely new to text to audio. Yes I used text to audio tools a decade back... but I would like to know where exactly we stand in terms of ...
1
vote
1answer
58 views
Isolate the speech of two people in an audio record with two people only
I would like to find a way to isolate the speech of each of the people in an audio record so I can create a file of that form :
...
1
vote
1answer
181 views
Can I filter barking sounds on the television?
My dog goes bonkers every time the sound of a barking dog is heard on a television program. I never noticed this before but literally every movie or show with an outdoors setting eventually includes ...
2
votes
1answer
3k views
How to combine input from different types of data sources?
I've to train a neural network using microphone data (wav files), accelerometer sensor data and light sensor data.
Right now the approach I thought was to convert all data into images and combine ...
2
votes
1answer
121 views
Difficulty understanding Keras LSTM fitting data
I'm try to train a RNN with a chunk of audio data, where X and Y are two audio channels loaded into numpy arrays. The objective is to experiment with different NN designs to train them to transform ...
