His greatest success was the surprising Olympic victory at the X Winter Games in Grenoble in 1968 in front of the American Tim Wood and the French Patrick Péra . His compatriot Emmerich Danzer , who was actually favored , was only fourth in this competition.
In 2002, Schwarz was sentenced to one and a half years in prison for trafficking in girls in Austria. He received another prison sentence in 2006. He was sentenced in the first instance to eight years in prison for attempting to kidnap the 18-year-old daughter of a millionaire. Since he committed the latter act while he was being suspended (for skin cancer) for his first sentence, he was sentenced to ten years and six months by the appellate court in early March 2007. Schwarz and the public prosecutor had appealed against the judgment of the first court. At the beginning of 2014, Schwarz was finally released from prison after detention was relaxed in previous years.