Yes - those berries will have the seeds inside. They turn red when ripe and fall off the plant. I think asparagus needs male & female plants to make seeds. I know I only get berries on a few plants and the rest are berry-less. I don't know much about growing them from seed but I have had some self sown seedlings sprout.