Only certain (very limited short runs) times are you permitted to use Romex in a conduit but most you must use individual conductors rated THHN/THWN (Note: THWN is rated "weather resistant").
As you state you will be connecting into a panel it seems you will only be able to use individual conductors.
Joe, I am certainly not an electrician, but when the inspector was signing off my work at my house, he mentioned that my city will red tag any Romex loaded into any type of conduit, due to the build up of heat. Obviously this is only a local issue?
It is my understanding that romex is not to be installed in conduit unless it needs protection.
In this case it is only the portion of the run that needs protection and not the entire length of the run.
If the entire length of the run needs protection then you should switch to conduit and THHN.