I think that is a good idea. Our evaluation boards with ADV7511 use a pull-down resistor on this pin.
If ADV7513 PD pin has a resistor to ground, then when ADV7513 is powered up, it will have device address of 0x72 and PD pin will be active high. So you should make sure the PD is low while you are trying to configure the ADV7513. If either the PD pin goes high or the PD bit (0x41[6]) is set to 1, the device will go into power down state.
-Matt