No, it depends on the energy level and the wavelength. Yes, the eye is more sensitive to the middle waves lengths but shorter wavelengths are more dangerous to receptors and eye structures. That's why folks need to screen against UV, a major cause of macular degeneration.
When looking at light, you have to take the spectral sensitivity function and the energy level into consideration. The retina has specific mechanisms to shield against the shorter wavelengths.
Any wavelength is dangerous at the right energy levels. Short wavelengths have more risks.