Were these plants transplanted from the wild, or purchased? Sometimes wild collected things refuse to thrive in captivity.I'm not sure that pots are the way to go, as they heat up and cool down differently than the actual soil. Moisture is also different when growing in containers.
If these were nursery purchased plants, I would ask where I bought them for advice. The brown leaves on the one looks like it is stressed in some way, but not knowing your climate or growing conditions, I hesitate to make suggestions. They certainly do look unhappy though.
Did it live and finally thrive?
Ginseng was such a big deal here in the Cumberlands that some industrous one farmier tried growing it too. Years later his frames with sometype of covering was still there, and he was still trying. His friends reported there there was not much to report on the ginseng, but he was raising a nice crop of copperhead snakes -- Yicks!