Zinc is at such a low level in wort that it's practically not there. Malt and water don't contain enough to make much of a difference. Most beers do fine without adding any nutrients, but higher gravity and lagers may need to have a little extra help. Zinc is beneficial to yeast. The ammonia you smell is di-ammonium phosphate or DAP. It's a source of phosphate. Malt already contains it and may not be needed, it needed more in meads and wine. Brewtan B will also reduce any metals because it's a chelation agent, another reason to use a nutrient containing zinc if you add Brewtan to the boil.
I add nutrients to all my beers (Wyeast nutrient and bread yeast), it's not harmful in any way. I suppose I could stop and it may make no difference. But I definitely will add nutrient to high gravity and lager beers. I compete a lot in beer competitions and I use every edge I can to win fairly and honestly. Keeping the yeast as healthy as possible, along with other techniques, have kept me competitive.