But don’t pick them yet! 7. When the leaves have all turned brown on your potato plants. Then gently sump out the burlap sack and dig through the soil with your hands to find all the potatoes! 8.