3

I am currently working on a project where I need to create mel-spectrograms to classify WAV audio-files with a neuronal network. In order to have a valid input to train my network, I first have to convert these audio-files into a mel-spectrogram. To do so I am currently using librosa.feature.melspectrogram and this works perfectly fine.

Part of the project is also to classify unknown WAV audio-files in a webrowser. I am using ONNX.js for this task and this works also perfectly fine.

The problem is now that I need to create the exact same mel-spectrogram like the server would do in Python with librosa. Otherwise the input would be different and therefore the output/prediction as well.

So my question is: is there any library in JavaScript that allows one to create a mel-spectrogram that is identical for the same WAV-audio-file both on client-side (JS) and server-side (Python)?

Is there a port of librosa for JS? Any other ideas are also welcomed, e.g. changing the server-library just to use a library that works in both languages (JS and Python) and gave the exact same result for a given WAV.

I already considered TensorFlow.js but there is implemented only a subset of TensorFlow in JavaScript (tfio.experimental.audio.melscale exists only in Python server-side).

Improve this question
9
  • You want to embed some python code into your javascript - stackoverflow.com/questions/13175510/… Commented Apr 10, 2021 at 7:22
  • Embedding python code in JavaScript is not possible (technically). Running server-side code that is requested by client is also not possible, because the audio wav-file must be uploaded to server and this is not allowed for privacy reasons. Commented Apr 10, 2021 at 8:29
  • So, isn't it possible to preprocess your wav files, and store the images (mel-spec) in the cloud ? Commented Apr 10, 2021 at 8:39
  • Sorry, this was my mistake: the wav-file must NOT be uploaded to server due privacy reasons. This is part of the project specification. Commented Apr 10, 2021 at 8:48
  • What about that? github.com/torch-js/torch-js - Torchaudio provides all the required functions for computing MelSpectrogram Commented Apr 10, 2021 at 8:51
Related questions
4
Using Librosa to plot a mel-spectrogram
1
Using tensorflow.contrib.framework.python.ops.audio_ops.audio_spectrogram to generate spectrogram
10
Store the Spectrogram as Image in Python
Load 7 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.