No worries. The leaves will eventually die off as the new growth takes over. It is a process and takes time. Do not cut the leaves away. Congratulations on your new paph. Be sure to post a photo of it when it does bloom. We all want to congratulate you! - it is a right of passage for some and most definitely the beginning of an addiction you will grow to cherish.
Cheers,
BD