Commit
·
9d931e8
1
Parent(s):
69b60da
Update README.md
Browse files
README.md
CHANGED
@@ -11,11 +11,13 @@ pipeline_tag: audio-classification
|
|
11 |
|
12 |
<!-- Provide a quick summary of what the model is/does. -->
|
13 |
|
14 |
-
We explore benefits of unsupervised pretraining of wav2vec 2.0 (W2V2) using large-scale unlabeled home recordings collected using LittleBeats and LENA (Language Environment Analysis) devices.
|
15 |
-
LittleBeats
|
16 |
We use W2V2 to advance LB audio pipeline such that it automatically provides reliable labels of speaker diarization and vocalization classifications for family members, including infants, parents, and siblings, at home.
|
17 |
We show that W2V2 pretrained on thousands hours of large-scale unlabeled home audio outperforms oracle W2V2 pretrained on 52k-hours released by Facebook/Meta in terms of automatic family audio analysis tasks.
|
18 |
|
|
|
|
|
19 |
## Model Description
|
20 |
|
21 |
<!-- Provide a longer summary of what this model is. -->
|
|
|
11 |
|
12 |
<!-- Provide a quick summary of what the model is/does. -->
|
13 |
|
14 |
+
We explore benefits of unsupervised pretraining of wav2vec 2.0 (W2V2) using large-scale unlabeled home recordings collected using LittleBeats (LB) and LENA (Language Environment Analysis) devices.
|
15 |
+
LittleBeats is a new infant wearable multi-modal device that we developed, which simultaneously records audio, movement of the infant, as well as heart-rate variablity.
|
16 |
We use W2V2 to advance LB audio pipeline such that it automatically provides reliable labels of speaker diarization and vocalization classifications for family members, including infants, parents, and siblings, at home.
|
17 |
We show that W2V2 pretrained on thousands hours of large-scale unlabeled home audio outperforms oracle W2V2 pretrained on 52k-hours released by Facebook/Meta in terms of automatic family audio analysis tasks.
|
18 |
|
19 |
+
For more details about LittleBeats, check out **https://littlebeats.hdfs.illinois.edu/**
|
20 |
+
|
21 |
## Model Description
|
22 |
|
23 |
<!-- Provide a longer summary of what this model is. -->
|