Prostate cancer and its outcomes are a real threat for health and well-being for men living in the Western world. The number of men with a diagnosis of prostate cancer, before the age of 65 years, has increased in recent decades. The aim of this study was to explore how some of these Swedish men experienced and talked about their sexuality. Four focus group discussions were performed in the context of associations for prostate cancer. Using qualitative content analysis, it was identified how the diagnosis was a threat to their male identity; the men's vulnerability as a group in society was made explicit. Their sexuality was diminished by their illness experiences. These experiences were difficult to share and talk about with others and therefore connected with silence and sorrow. As a result of this, the informants often played a passive role when or if they discussed issues related to sexuality with someone in the health care organizations. The possibility of voluntarily joining a cancer association was probably highly beneficial for these men. During the sessions, several men expressed the opinion that "it is always great to talk.".