Give the man a Cupie Doll! He grabbed the brass ring. he knocked over the whole pile of milk bottles (even the one that was nailed down to keep anyone from winning!
You have grasped the concept precisely. You ain't doing your neighbor any favors by loving them like yourself if you hate, loath, despise, and beat yourself up! The only way Jesus admonition makes ANY sense is if we love our ourselves as God loved us in Christ!