Welcome to India. I am not aware of a orchid garden in New Delhi. there is a presidential garden called the mogul gardens that grow lot of varieties but have not noticed orchids there. This was few years back i am not sure if they have a green house that grows orchids.
Best places for orchids are northeast of the country or down south.
All the very best and hope you enjoy your stay