The last frost day here used to be May 15th, but now its moved up a week.

Add my vote to the option of planting them out and covering when needed. One caution, plastic tarps can frostburn tender leaves where they touch. Much better to use landscape fabric. That varies in price, but I found a 10 by 30 ft sheet for $17 on Amazon. That's freakin' huge for a very reasonable price. Then just cut into sections that are most useful to you. Temporarily burying in leaf mulch is great, so long as the plants aren't so tiny they get lost, and you uncover them quickly again.

As everyone else has said keep them covered at night. If you lose them seeds are cheap the best I remember. You can always start again.
I always planted early and sometimes had to go back and spot plant or start all over again.

I have used gallon containers that you put over each plant when the temp is forecast below 40 F. If you can get milk jugs, you cut the bottom out and they will act as mini greenhouses. You can tent the rows with visquene, a small roll will cover a very large garden. Tent it up at least 24 inches with weights around the edges and you have the equivalent of a cold frame that they use up north,

If you are near any livestock, you can bring manure over and put it 6" away from plants and the warmth of the deccomposition will keep them alive. Bigger pots outside in a sheltered area is also an option. A sunny south-facing wall would be my preference. Peas will be fine. Summer crops like beans and squash would benefit from a floating row cover at night (with the manure to really keep 'em warm).

Cover them at nght, (landscape fabric, plastic sheets, or just blankets but prop up up the heavier covers with lots of sticks and be sure to to remove them before the sun cooks everything, or just put them in bigger containers for now.

I always do that. Have a grow light hooked up in my garage. It enables me to get my tomatoes in the ground as early as I can. This year, for example, my tomato plants are in the ground, almost 3 feet tall, and full of blossoms. I also plant my potatoes in late January or early February .

Simply wait. They'll be fine inside for awhile.

Put something - plastic sheeting around the plants to protect them .

Make plans to cover them if the temperature drops, sheets might do the trick.

Can't you keep them inside?