Even though Justin has never confirmed that this track is about Selena, his manager Scooter Braun told Billboard that Justin wrote the song when he "was going through a tough time." "If you listen to the lyrics in these songs, 'Heartbreaker,' 'All That Matters,' he's pouring his heart out," Scooter explained. The song was released around the same time of one of Selena and Justin's breakups.