Improving automated segmentation of radio shows with audio embeddings published @ IEEE ICASSP2020

πŸ“… February 12, 2020 β€’ πŸ• 11:54 β€’ 🏷 Papers β€’ πŸ‘ 46

Oberon Berlage’s MSc. thesis: “Improving automated segmentation of radio shows with audio embeddings” which he wrote under my supervision during his internship at FD Mediagroep was awarded a 9/10, under condition that the work was publishable.

Turns out it was, as it was recently accepted at IEEE ICASSP2020 (the 45th International Conference on Acoustics, Speech, and Signal Processing) without any additional work/experiments (just a bit of reduction). But you already knew this… Oberon will be presenting this work in Barcelona, thanks to the generous support of UvA’s Information Studies program.

We now published a preprint, read it below:

  • [PDF] [DOI] O. Berlage, K. Lux, and D. Graus, “Improving automated segmentation of radio shows with audio embeddings,” in Icassp 2020 – 2020 ieee international conference on acoustics, speech and signal processing (icassp), 2020, pp. 751-755.
    [Bibtex]
    @inproceedings{berlage2020improving,
    author={O. {Berlage} and K. {Lux} and D. {Graus}},
    booktitle={ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
    title={Improving Automated Segmentation of Radio Shows with Audio Embeddings},
    year={2020},
    pages={751-755},
    doi={10.1109/ICASSP40776.2020.9054315},
    url={https://doi.org/10.1109/ICASSP40776.2020.9054315}
    }

His work revolved around improving BNR SMART Radio‘s text-based segmentation by incorporating audio signals in the form of audio embeddings. This turns out to improve over our text-based baseline by a whopping +32.3% F1-measure!

Even better: an audio-only approach, trained on a smallish openly available dataset, outperforms our text-only baseline by 9.4%. This means the segmentation method can be employed without need for audio transcription, which could be a money-saver.

“Improving automated segmentation of radio shows with audio embeddings”

πŸ“… July 5, 2019 β€’ πŸ• 15:41 β€’ 🏷 Blog and Research β€’ πŸ‘ 74

Update (28/1/2020): Oberon’s thesis was accepted and will be published at the IEEE 45th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2020), to be held May 4-8 in Barcelona, Spain! The submission is co-authored with Klaus Lux and myself.

Oberon Berlage recently successfully defended his MSc. thesis (title above!) for the Data Science Master at University of Amsterdam, and graduated with a whopping 9!

He’s the first academic offspring of our AI Team @ FD Mediagroep, and worked on BNR SMART Radio‘s segmenter. Oberon improved our text-based segmenter by adding audio embeddings, improving the F1 score with +32%!

His thesis is now online, check it out at: http://scriptiesonline.uba.uva.nl/document/673254

Dutch Interactive Awards (2x) for BNR SMART Radio!

πŸ“… June 28, 2019 β€’ πŸ• 10:17 β€’ 🏷 Blog β€’ πŸ‘ 52

Yesterday BNR SMART Radio won two Dutch Interactive Awards (DIA 2019) Awards! We were nominated together with Elastique, the folks who designed the UX/interface of our BNR SMART Radio app which you can download here (or in your app stores, both Android/iOS)!

πŸ₯‡ Content

We won Gold in the category “Content”. Why, you may ask?

β€œFinally a reason to listen to Radio in general, and BNR in particular. Because advertising is absent and topics are tailored to the personal taste of the listener, who can search in a targeted way and express appreciation for a broadcast through a thumbsup, they reach new target audiences online.”

jury report (source: emerce)

πŸ₯ˆ Disruptor

Next to this, we also won the Silver DIA2019 Award in the category “Disruptor”!

“In a world where radio has never deviated from the linear model, the jury finds this very disruptive. SMART Radio provides a personal radio experience and possibly a new revenue model in the long term. The jury members find the potential of the underlying strategy even more impressive. What if BNR joins forces with FD Mediagroep and combines the work of both parties in this? The jury sees all kinds of opportunities to fit in new forms of advertising (or to omit them). The collaboration between the agency and the media company has resulted in something that has never been seen before.”

jury report (source: emerce)

Current standing

For who has trouble keeping track πŸ˜…, these are the awards we won with SMART Radio:

πŸ† Marconi Online Award
πŸ† AMMA Award (with SMART Journalism)
πŸ† DIA2019 Award, category: Content
πŸ₯ˆ DIA2019 Award, category: Disruptor

Featured on the European Science-Media Hub

πŸ“… June 5, 2019 β€’ πŸ• 08:29 β€’ 🏷 Media β€’ πŸ‘ 6

In the context of the upcoming workshop “AI and Journalism” Bennie Mols interviewed me for the website of the European Science-Media Hub, on how we apply AI in journalism for Het FD and BNR. Read the piece here:

Or read the more in-depth background interview here:

We won the AMMA Media-innovation award for our News Personalization projects at FD Mediagroep!

πŸ“… May 17, 2019 β€’ πŸ• 13:50 β€’ 🏷 Blog β€’ πŸ‘ 44

After winning the Marconi award for radio innovation, yesterday we picked up the AMMA Award for Media Innovation for our news personalization efforts at FD Mediagroep (both SMART Journalism for Het FD and SMART Radio for BNR Nieuwsradio)!

It’s really great to see that our current investment into AI and innovation seems to resonate with the outside world πŸ€–. And I am really happy to be with a company that sees this development as such an important direction that we are able to work with a big and talented team of data scientists, interns, engineers, and product folks πŸ€“

BNR SMART Radio wins the Marconi Online Award!

πŸ“… February 1, 2019 β€’ πŸ• 16:17 β€’ 🏷 Blog β€’ πŸ‘ 90

Really happy and proud of our amazing AI team for winning the (first) Marconi Online Award at the Gouden RadioRing Gala, for BNR SMART Radio!

SMART Radio is the first product that comes out of our FD Mediagroup AI team! SMART Radio is released in beta for iOS (anytime) and Android, give it a try by downloading it here: https://bnr.nl/smartradio.

Image: BNR

Read more about SMART Radio in our demo paper, presented at DIR 2018:


Featured in BNR’s “Artificial Intelligence Podcast” on AI in Media Part I: Tech

πŸ“… November 27, 2018 β€’ πŸ• 10:22 β€’ 🏷 Media β€’ πŸ‘ 19

In the latest AI Podcast, I am featured, talking with Li’ao Wang on our SMART Radio and SMART Journalism projects. Stream the episode below!

“Media is smart, but needs to get smarter. That’s what we’re working on here at the FD Mediagroep. Come and see what we do with AI to make our creators and content better.”

Stream on BNR

Stream on Spotify