He moved to San Francisco in 1990 and worked as a studio musician, appearing on a Tracy Chapman album in the mid 1990s. At the end of the decade, he was a member of the group Killer Joey with Drummer Joey Baron, Guitarist Steve Cardenas, and Bassist Tony Scherr. Levy then moved to New York City, where he met Norah Jones and was a member of her band at the beginning of her career through her bestselling albums and world tours. He has also played with Rosanne Cash, Chris Difford, Amos Lee, and Lisa Loeb. He leads a trio called the Mint Imperials.