{"id":84442,"date":"2022-10-11T11:10:27","date_gmt":"2022-10-11T15:10:27","guid":{"rendered":"https:\/\/newsroom.carleton.ca\/?post_type=cu_story&#038;p=84442"},"modified":"2025-08-19T09:37:08","modified_gmt":"2025-08-19T13:37:08","slug":"big-data-predict-song-popularity","status":"publish","type":"cu_story","link":"https:\/\/carleton.ca\/news\/story\/big-data-predict-song-popularity\/","title":{"rendered":"Can big data really predict what makes a song popular?"},"content":{"rendered":"\n<section class=\"w-screen px-6 cu-section cu-section--white ml-offset-center md:px-8 lg:px-14\">\n    <div class=\"space-y-6 cu-max-w-child-max  md:space-y-10 cu-prose-first-last\">\n\n        \n                    \n                    \n            \n    <div class=\"cu-wideimage relative flex items-center justify-center mx-auto px-8 overflow-hidden md:px-16 rounded-xl not-prose  my-6 md:my-12 first:mt-0 bg-opacity-50 bg-cover bg-cu-black-50 pt-24 pb-32 md:pt-28 md:pb-44 lg:pt-36 lg:pb-60 xl:pt-48 xl:pb-72\" style=\"background-image: url(https:\/\/carleton.ca\/news\/wp-content\/uploads\/sites\/162\/concert-fans-cheering-1200x900-1.jpg); background-position: 50% 50%;\">\n\n                    <div class=\"absolute top-0 w-full h-screen\" style=\"background-color:rgba(0,0,0,0.600);\"><\/div>\n        \n        <div class=\"relative z-[2] max-w-4xl w-full flex flex-col items-center gap-2 cu-wideimage-image cu-zero-first-last\">\n            <header class=\"mx-auto mb-6 text-center text-white cu-pageheader cu-component-updated cu-pageheader--center md:mb-12\">\n\n                                    <h1 class=\"cu-prose-first-last font-semibold mb-2 text-3xl md:text-4xl lg:text-5xl lg:leading-[3.5rem] cu-pageheader--center text-center mx-auto after:left-px\">\n                        Can big data really predict what makes a song popular?\n                    <\/h1>\n                \n                            <\/header>\n        <\/div>\n\n                    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"absolute bottom-0 w-full z-[1]\" fill=\"none\" viewbox=\"0 0 1280 312\">\n                <path fill=\"#fff\" d=\"M26.412 315.608c-.602-.268-6.655-2.412-13.524-4.769a1943.84 1943.84 0 0 1-14.682-5.144l-2.276-.858v-5.358c0-4.876.086-5.358.773-5.09 1.674.643 21.38 5.84 34.646 9.109 14.682 3.59 28.935 6.858 45.936 10.449l9.874 2.089H57.322c-16.4 0-30.31-.16-30.91-.428ZM460.019 315.233c42.974-10.074 75.602-19.88 132.443-39.867 76.16-26.791 152.063-57.709 222.385-90.663 16.7-7.823 21.336-10.074 44.262-21.273 85.004-41.688 134.719-64.193 195.291-88.413 66.55-26.577 145.2-53.584 194.27-66.765C1258.5 5.626 1281.34 0 1282.24 0c.17 0 .34 27.596.34 61.3v61.299l-2.23.375c-84.7 13.718-165.93 35.955-310.736 84.931-46.494 15.753-65.427 22.076-96.166 32.15-9.102 3-24.814 8.198-34.989 11.574-107.543 35.954-153.008 50.422-196.626 62.639l-6.74 1.876-89.126-.054c-78.135-.054-88.782-.161-85.948-.857ZM729.628 312.875c33.229-10.985 69.248-23.523 127.506-44.207 118.705-42.223 164.596-57.709 217.446-73.302 2.62-.75 8.29-2.465 12.67-3.751 56.19-16.772 126.94-33.597 184.17-43.671 5.07-.91 9.66-1.768 10.22-1.875l.94-.161v170.236l-281.28-.054H719.968l9.66-3.215ZM246.864 313.411c-65.041-2.251-143.047-12.11-208.432-26.256-18.375-3.965-41.73-9.538-42.202-10.074-.171-.214-.257-21.38-.214-47.046l.129-46.618 6.654 3.697c57.313 32.043 118.491 56.531 197.699 79.143 40.313 11.521 83.459 18.058 138.669 21.059 15.584.857 65.685.857 81.14 0 33.744-1.876 61.306-4.93 88.396-9.806 6.396-1.126 11.634-1.983 11.722-1.929.255.375-20.48 7.769-30.999 11.038-28.592 8.948-59.288 15.646-91.873 20.147-26.36 3.59-50.015 5.627-78.35 6.698-15.584.59-55.209.59-72.339-.053Z\"><\/path>\n                <path fill=\"#fff\" d=\"M-3.066 295.067 32.06 304.1v9.033H-3.066v-18.066Z\"><\/path>\n            <\/svg>\n            <\/div>\n\n    \n\n    <\/div>\n<\/section>\n\n<p>This article is <a href=\"https:\/\/theconversation.com\/can-big-data-really-predict-what-makes-a-song-popular-189052\" rel=\"noopener noreferrer\" target=\"_blank\">republished<\/a> from The Conversation under a Creative Commons licence. All photos provided by <a href=\"https:\/\/theconversation.com\" rel=\"noopener noreferrer\" target=\"_blank\">The Conversation<\/a> from various sources.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p><\/p>\n\n\n\n<p>Music is part of our lives in different ways. We listen to it on our commutes and it resounds through shopping centres. Some of us seek live music at concerts, festivals and shows or rely on music to set the tone and mood of our days.<\/p>\n\n\n\n<p>While we might understand the genres or songs we appreciate, it&#8217;s not clear precisely why a certain song is more appealing or popular. Perhaps the lyrics speak to an experience? Perhaps the energy makes it appealing? These questions are important to answer for music industry professionals, and <a href=\"https:\/\/theconversation.com\/how-data-is-transforming-the-music-industry-70940\" target=\"_blank\" rel=\"noopener noreferrer\">analyzing data<\/a> is a key part of this.<\/p>\n\n\n\n<p>At Carleton University, a group of data science researchers sought to answer the question: &#8220;What descriptive features of a song make it popular on music\/online platforms?&#8221;<\/p>\n\n\n\n<h2 id=\"revenue-in-the-music-industry\" class=\"wp-block-heading\">Revenue in the music industry<\/h2>\n\n\n\n<p>Revenue in the music industry <a href=\"https:\/\/doi.org\/10.1509\/jm.14.0473\" target=\"_blank\" rel=\"noopener noreferrer\">is derived from two sources that are affected by different factors: live music and recorded music<\/a>. During the pandemic, although live music income dropped due to the cancellation of in-person performances, the <a href=\"https:\/\/doi.org\/10.1371\/journal.pone.0267640\" target=\"_blank\" rel=\"noopener noreferrer\">income from streaming<\/a> rose. <\/p>\n\n\n\n<p>As digital platforms like Spotify and TikTok have grown, <a href=\"https:\/\/doi.org\/10.5753\/sbcm.2019.10436\" target=\"_blank\" rel=\"noopener noreferrer\">the majority of music revenue has come to be contributed by digital media, mostly music streaming<\/a>. How and whether this <a href=\"https:\/\/theconversation.com\/artists-spotify-criticisms-point-to-larger-ways-musicians-lose-with-streaming-heres-3-changes-to-help-in-canada-176526\" target=\"_blank\" rel=\"noopener noreferrer\">revenue reaches singers and songwriters at large<\/a> is another matter. <\/p>\n\n\n\n<h2 id=\"popularity-on-digital-platforms\" class=\"wp-block-heading\">Popularity on digital platforms<\/h2>\n\n\n\n<p>The popularity of a song on digital platforms is considered a measure of the revenue the song may generate.<\/p>\n\n\n\n<p>As such, producers seek to answer questions like &#8220;<a href=\"https:\/\/doi.org\/10.1098\/rsos.171274\" target=\"_blank\" rel=\"noopener noreferrer\">How can we make the song more popular?<\/a>&#8221; and &#8220;<a href=\"https:\/\/doi.org\/10.1109\/ICMLA.2019.00149\" target=\"_blank\" rel=\"noopener noreferrer\">What are the characteristics of songs that make it the top charts?<\/a>&#8221; <\/p>\n\n\n\n<p>With collaborators <a href=\"https:\/\/www.linkedin.com\/in\/laura-colley\/\" target=\"_blank\" rel=\"noopener noreferrer\">Laura Colley<\/a>, <a href=\"https:\/\/www.linkedin.com\/in\/andrew-dybka\/\" target=\"_blank\" rel=\"noopener noreferrer\">Andrew Dybka<\/a>, Adam Gauthier, Jacob Laboissonniere, Alexandre Mougeot and Nayeeb Mowla, we produced a systematic study that collected data from YouTube, Twitter, TikTok, Spotify and Billboard (<a href=\"https:\/\/www.billboard.com\/charts\/hot-100\" target=\"_blank\" rel=\"noopener noreferrer\">Billboard Hot-100<\/a>, sometimes also denoted by data researchers as &#8220;<a href=\"https:\/\/data.world\/bigml\/association-discovery\" target=\"_blank\" rel=\"noopener noreferrer\">Billboard hot top<\/a>&#8221; or in our work and others&#8217; work, &#8220;Billboard Top-100&#8221;).<\/p>\n\n\n\n<p>We linked the datasets from the different platforms with Spotify&#8217;s acoustic descriptive metric or &#8220;descriptive features&#8221; for songs. These features have been derived <a href=\"https:\/\/www.billboard.com\/music\/music-news\/echo-nest-columbia-university-launch-million-song-dataset-1178990\/\" target=\"_blank\" rel=\"noopener noreferrer\">from a dataset which yielded categories for measuring and analyzing qualities of songs<\/a>. Spotify&#8217;s <a href=\"https:\/\/www.theguardian.com\/technology\/2014\/mar\/06\/spotify-echo-nest-streaming-music-deal\" target=\"_blank\" rel=\"noopener noreferrer\">metrics capture<\/a> <a href=\"https:\/\/doi.org\/10.1098\/rsos.171274\" target=\"_blank\" rel=\"noopener noreferrer\">descriptive features such as<\/a> <em>acousticness<\/em>, <em>energy<\/em>, <em>danceability<\/em> and <em>instrumentalness<\/em> (the collection of instruments and voices in a given piece). <\/p>\n\n\n\n<p>We sought to find trends and analyze the relationship between songs&#8217; descriptive features and their popularity.<\/p>\n\n\n\n<p>The rankings on the weekly <a href=\"https:\/\/www.billboard.com\/charts\/hot-100\/\" target=\"_blank\" rel=\"noopener noreferrer\">Billboard Hot-100<\/a> are based on sales, online streams and radio plays in the United States.<\/p>\n\n\n\n<p>The analysis we performed by looking at Spotify and Billboard revealed insights that are useful for the music industry.<\/p>\n\n\n\n<figure class=\"wp-block-image align-center\"><img decoding=\"async\" src=\"https:\/\/images.theconversation.com\/files\/487408\/original\/file-20220929-12-z8jn23.jpg?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;fit=clip\" alt=\"A person seen grooving in their car.\"\/><figcaption class=\"wp-element-caption\">\n              <span class=\"caption\">How well can &#8216;danceability,&#8217; and other factors as rated by Spotify, predict music popularity?<\/span><br>\n              <span class=\"attribution\"><span class=\"source\">(Shutterstock)<\/span><\/span><br>\n            <\/figcaption><\/figure>\n\n\n\n<h2 id=\"what-predicts-a-billboard-hit\" class=\"wp-block-heading\">What predicts a Billboard hit?<\/h2>\n\n\n\n<p>To perform <a href=\"https:\/\/ieeexplore.ieee.org\/document\/9842568\" target=\"_blank\" rel=\"noopener noreferrer\">this study<\/a>, we used two different data sets pertaining to songs that <a href=\"https:\/\/www.npr.org\/sections\/therecord\/2013\/08\/16\/207879695\/how-the-hot-100-became-americas-hit-barometer\" target=\"_blank\" rel=\"noopener noreferrer\">were Billboard hits<\/a> <a href=\"https:\/\/data.world\/kcmillersean\/billboard-hot-100-1958-2017\" target=\"_blank\" rel=\"noopener noreferrer\">from the early 1940s to 2020<\/a> and Spotify data related to over 600,000 tracks and over one million artists.<\/p>\n\n\n\n<p>Interestingly, we found no substantial correlations between the number of weeks a song remained on the charts, as a measure of popularity, and the acoustic features included in the study. <\/p>\n\n\n\n<p>Our analysis determined that newer songs tend to last longer on the charts and that a song&#8217;s popularity affects how long it stays on the charts. <\/p>\n\n\n\n<p>In a related study, researchers collected data for Billboard&#8217;s Hot 100 from 1958 to 2013 and found that <a href=\"https:\/\/doi.org\/10.1007\/978-3-319-13734-6_36\" target=\"_blank\" rel=\"noopener noreferrer\">songs with a higher <em>tempo<\/em> and <em>danceability<\/em> often get a higher peak position on the Billboard charts<\/a>. <\/p>\n\n\n\n<h2 id=\"predicting-spotify-song-popularity\" class=\"wp-block-heading\">Predicting Spotify song popularity<\/h2>\n\n\n\n<p>We also used the songs&#8217; features to generate machine learning models to predict Spotify song popularity. Preliminary results concluded that features are not linearly correlated, with some expected exceptions including songs&#8217; <em>energy<\/em>. <\/p>\n\n\n\n<p>This indicated that the Spotify metrics we studied \u2014 including <em>acousticness<\/em>, <em>danceability<\/em>, <em>duration<\/em>, <em>energy<\/em>, <em>explicitness<\/em>, <em>instrumentalness<\/em>, <em>liveness<\/em>, <em>speechiness<\/em> (a measure of the presence of spoken words in a song), <em>tempo<\/em> and <em>release year<\/em>  \u2014 were not strong predictors of the song&#8217;s popularity.<\/p>\n\n\n\n<p>The majority of songs in the Spotify dataset were not listed as explicit, tended to have low <em>instrumentalness<\/em> and <em>speechiness<\/em>, and were typically recent songs. <\/p>\n\n\n\n<p>Although one may think that some features that are innate to certain songs make them more popular, our study revealed that popularity can not be attributed solely to quantifiable acoustic elements. <\/p>\n\n\n\n<p>This means that song makers and consumers must consider other contextual factors beyond the musical features, as captured by Spotify&#8217;s measurables, that may contribute to the song&#8217;s success. <\/p>\n\n\n\n<h2 id=\"elements-affecting-popularity-shift\" class=\"wp-block-heading\">Elements affecting popularity shift<\/h2>\n\n\n\n<p>Our study reinforces that elements affecting the popularity of songs change over time and should be continuously explored. <\/p>\n\n\n\n<p>For example, <a href=\"https:\/\/doi.org\/10.1098%2Frsos.171274\" target=\"_blank\" rel=\"noopener noreferrer\">in songs produced between 1985 and 2015 in the United Kingdom, songs produced by female artists were more successful<\/a>. <\/p>\n\n\n\n<figure class=\"wp-block-image align-left\"><img decoding=\"async\" src=\"https:\/\/images.theconversation.com\/files\/487411\/original\/file-20220929-25-g603nl.jpg?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=237&amp;fit=clip\" alt=\"Woman holding a microphone seen flexing her bicep.\"\/><figcaption class=\"wp-element-caption\">\n              <span class=\"caption\">Melanie Chisholm (Sporty Spice) of the Spice Girls seen in December 2007.<\/span><br>\n              <span class=\"attribution\"><span class=\"source\">THE CANADIAN PRESS\/Jonathan Hayward<\/span><\/span><br>\n            <\/figcaption><\/figure>\n\n\n\n<p>Other aspects may substantially contribute to the success of a song. Data scientists have proposed <a href=\"https:\/\/doi.org\/10.1371\/journal.pone.0244576\" target=\"_blank\" rel=\"noopener noreferrer\">simplicity of the lyrics<\/a>, the advertising and <a href=\"https:\/\/www.ipr.edu\/blogs\/audio-production\/what-are-the-elements-of-popular-music\/\" target=\"_blank\" rel=\"noopener noreferrer\">distribution plans<\/a> as potential predictors of songs&#8217; popularity. <\/p>\n\n\n\n<h2 id=\"attached-listeners\" class=\"wp-block-heading\">Attached listeners<\/h2>\n\n\n\n<p>Many musicians and producers make use of popular events and marketing strategies to advertise songs. Such events create social engagements and <a href=\"https:\/\/doi.org\/10.3389\/fpsyg.2018.02682\" target=\"_blank\" rel=\"noopener noreferrer\">audience involvement<\/a> which attaches the listener to the song being performed. <\/p>\n\n\n\n<p>For the public, <a href=\"https:\/\/www.osheaga.com\/en\" target=\"_blank\" rel=\"noopener noreferrer\">live music events<\/a>, following long lockdowns, have been opportune for reuniting friends, and <a href=\"https:\/\/ottawabluesfest.ca\" target=\"_blank\" rel=\"noopener noreferrer\">enjoying live artistry and<\/a> entertainment.<\/p>\n\n\n\n<p>While attending a music event or listening to a song, we invite you to reflect on what it is about the song that makes you enjoy it.<\/p>\n\n\n\n<p>&#8212;<br>\n<a href=\"https:\/\/newsroom.carleton.ca\">Carleton Newsroom<\/a><\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/counter.theconversation.com\/content\/189052\/count.gif?distributor=republish-lightbox-basic\" alt=\"The Conversation\"\/><\/figure>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Music is part of our lives in different ways. We listen to it on our commutes and it resounds through shopping centres. Some of us seek live music at concerts, festivals and shows or rely on music to set the tone and mood of our days.<\/p>\n","protected":false},"author":410,"featured_media":84443,"template":"","meta":{"_acf_changed":false,"footnotes":"","_links_to":"","_links_to_target":""},"cu_story_type":[1623],"cu_story_tag":[],"class_list":["post-84442","cu_story","type-cu_story","status-publish","has-post-thumbnail","hentry","cu_story_type-expert-perspectives"],"acf":{"cu_post_thumbnail":false},"_links":{"self":[{"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story\/84442","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story"}],"about":[{"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/types\/cu_story"}],"author":[{"embeddable":true,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/users\/410"}],"version-history":[{"count":3,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story\/84442\/revisions"}],"predecessor-version":[{"id":84559,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story\/84442\/revisions\/84559"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/media\/84443"}],"wp:attachment":[{"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/media?parent=84442"}],"wp:term":[{"taxonomy":"cu_story_type","embeddable":true,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story_type?post=84442"},{"taxonomy":"cu_story_tag","embeddable":true,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story_tag?post=84442"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}