Oliver has been writing music on the piano since 2006, when he started taking lessons in middle school. In college, he worked with his piano instructor to record some of his early songs.