From reading the initial post we know-
1. The pond was about 5 weeks old when the first fish were added. The first fish were added 3 weeks ago. One fish was just added.
2. The skittish behavior did not start or, at least, was not noticed until Alpravinosh physically entered the pond.
3. This pond is located either in a sub-tropical/tropical climate or in the Southern Hemisphere.
4. None of the usual signs of Ammonia or Nitrate toxicity have manifest.
I rarely enter my pond but when I do my fish exhibit the same behavior as described. All animals are keenly aware of their environment and are acutely aware of any change in this environment, no matter how small. When a threat is perceived, they will exhibit "flight" reflex. This is exactly what my fish exhibit and what Alpravinosh's fish have exhibited. If someone startles you, you are likely to react in some physical manner. Is that a reason to rush to the emergency room, I think not.
If the new fish has introduced a pathogen into the pond, it will take several days to weeks for the other fish to show signs of infection as Lisak1 intimated, not overnight. Plus there is an equal chance that the new fish could become infected by something that was already present in the pond.
No need to exhibit paranoia just because a few fish had the Bejezzuz scared out of them.