A walker is the association of a sub-millimetric bouncing drop moving along with a co-evolving Faraday wave. When confined in a harmonic potential, its stable trajectories are periodic and quantised both in extension and mean angular momentum. In this article, we present the rest of the story, specifically the chaotic paths. They are chaotic and show intermittent behaviors between an unstable quantised set of attractors. First, we present the two possible situations we find experimentally. Then, we emphasise theoretically two mechanisms that lead to unstable situations. It corresponds either to noise-driven chaos or low-dimensional deterministic chaos. Finally, we characterise experimentally each of these distinct situations. This article aims at presenting a comprehensive investigation of the unstable paths in order to complete the picture of walkers in a two dimensional harmonic potential.