Are herbs like rosemary hard to grow? Rosemary is a popular garden perennial useful in herb, fragrance and container gardens.