Battery contact with spring