The Quick Answer You should be concerned about delayed speech if your child is not meeting age-appropriate language milestones, such as not babbling by 12