Better that you can explain what happen on you so that we can give you better advice; but it's up to you.
pratimoksha vows are said possible to be given up. The case happen in monks or nuns, not sure how lay people do it but should be possible.
If it's bodhisattva vows, there is no way to give it up, unless you give up bodhicitta, which is not something you should even consider. However, as long as you keep your bodhicitta and the willing to benefit others, it's more flexible in sense of keep the vows.
For samaya, there is also no method to give up, but if you have any practical problem, you can ask your lama and try to get permission from him, so it's also flexible.
Pratimoksha vows are the base of vajrayana vows and after empowerment they were turned into 'part of' vajrayana vows, so if you have received empowerment, you shouldn't just give up several vows just by yourself, better to consult your lama and see what you can do.
There must be a way to make things easier, just don't give up three jewels and bodhicitta, try to keep in the path still.