You can lower INT and WIT. U can not affect MEN, only with sets equipped.
And STR is really important for daggers since C5 they can crit their skills.
As a PW us should use only +5 WIT nothing else, because if u lower STR u will be weak as Kalrathian ale, and your skill crit rate will be even worse. If u lower your DEX, u loose too much. If u lower your CON, u will be stunned more easily.
IF u have majestic light, i prefer for u to use +4 STR -4 CON +5 WIT (only if u can't live without dyes)
If u have antharas/ Zaken, then use Nightmare set and +4STR -4CON +5 WIT.(no dyes are even better imo)
That is my opinion.