Mood, music and Yahoo hack U

Emotion and music are very closely related. No matter the mood, we have a song for every occasion. Have you ever wanted a background music to your life? Face the Music was one of the winning entries for 2012 Georgia Tech Yahoo Hack U.  The hack detects a person’s mood (sad, angry, neutral, hopeful, happy) and plays music according to it. The application uses face.com’s API to detect mood from an image and Last.fm’s API to play back music tagged with the detected mood.
The aim is to move a person’s mood towards happy, hence starting from the initial emotion, we gradually move towards happy notes. Thumbnails for the coverflow are not the album art, but images that represent the current mood, to empathize with a person’s feeling. The  hack was built in 22 hours and 30 minutes.

My Contributions
  • Lead user experience design and prototyping.
  • Implemented the mood engine for facial recognition and mood recognition using facial microexpressions.
  • Planned, designed, built and evaluated the system end to end with the team using HCD methods and agile development
  • Created system architecture, workflow  and played a pivotal role during integration.
Tools & Methods

Code

  • HTML5
  • CSS3
  • Javascript
  • Jquery
  • PhP
  • MySQL

Methods

  • Storyboards
  • Personas
  • Brainstorm
  • Mindmaps
  • Prototyping
Team
  • Nachiketas Ramanujam (Concept, UX design, & APIs)
  • Kartik Agarwal (Visual & interaction design)
  • Tarun Chakravorthy (Interaction design and front end)
  • Boris DeSouza (Full stack development)