If the semiconductor rally loses steam, it’s retail investors who could get hurt the most