Yes, But the Nuclear reactor would be Inside, and During Initial stages , It will be tested On the non Nuclear power source as you said rather running the Whole submarine on nuke reactor....
Well, When The Sea trials are completed, there You are sure that, your nuclear reactors in it are safe...