GA: Peppers are doing badly

Several of the NW peppers are really yellow and haven't grown at all.  

The rest just haven't done much.  I've harvested a couple of hot/banana peppers but that's it.  Neighbour's are gorgeous and big with peppers.

I always thought my yard's lack of sun was the blame for never having success in the past, but no, must be something else I'm doing wrong with peppers...